EP1197020A2 - Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments - Google Patents

Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments

Info

Publication number
EP1197020A2
EP1197020A2 EP00920069A EP00920069A EP1197020A2 EP 1197020 A2 EP1197020 A2 EP 1197020A2 EP 00920069 A EP00920069 A EP 00920069A EP 00920069 A EP00920069 A EP 00920069A EP 1197020 A2 EP1197020 A2 EP 1197020A2
Authority
EP
European Patent Office
Prior art keywords
location
segments
client location
remote processing
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP00920069A
Other languages
German (de)
French (fr)
Other versions
EP1197020B2 (en
EP1197020B1 (en
Inventor
James D. Logon
Richard S. Goldhor
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gotuit Media Corp
Original Assignee
Gotuit Media Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=22426512&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP1197020(A2) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Gotuit Media Inc filed Critical Gotuit Media Inc
Priority to DE60037119T priority Critical patent/DE60037119T3/en
Publication of EP1197020A2 publication Critical patent/EP1197020A2/en
Application granted granted Critical
Publication of EP1197020B1 publication Critical patent/EP1197020B1/en
Publication of EP1197020B2 publication Critical patent/EP1197020B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0033Recording/reproducing or transmission of music for electrophonic musical instruments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/27Arrangements for recording or accumulating broadcast information or broadcast-related information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/125Library distribution, i.e. distributing musical pieces from a central or master library
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/131Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/155Library update, i.e. making or modifying a musical database using musical parameters as indices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/09Arrangements for device control with a direct linkage to broadcast information or to broadcast space-time; Arrangements for control of broadcast-related services
    • H04H60/14Arrangements for conditional access to broadcast information or to broadcast-related services
    • H04H60/18Arrangements for conditional access to broadcast information or to broadcast-related services on copying information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54

Definitions

  • This invention relates to systems for storing and reproducing recorded music and programming materials and more particularly to program storage and playback systems in which recorded program content and descriptions are transferred between a client location and a remote processing location.
  • the present invention represents an extension to the systems and methods described in U.S. Patent 5,892,536 issued to James D. Logan, Richard Goldhor and Daniel Goessling on April 6, 1999 and in International Publication WO 98/31 1 13 published on July 16, 1998.
  • the present invention provides methods for moving those recordings to a central server to free space on the local storage unit, and to allow the user to access the stored material from other players.
  • the present invention as shown in Fig. 2 of the drawings further includes a mechanism, seen at 123, for identifying programs as shown in Fig. 1, and further for transmitting programs and programs segments to be added to the library file 125 maintained at the remote server.
  • the identification mechanism is employed to verify that the programs are stored locally, and to communicate that fact to the remote processor, which maintains an accounting file which specifies which users have the right to retrieve and play back which programs from the shared library.
  • Fig. 1 is a block diagram of a prior art client-side program storage and playback device interconnected via a communications pathway to a remote server which recognizes snippets of programs received from the client-side unit and which returns descriptions of matching program segments, such as individual songs, to the play back unit; and
  • Fig. 2 is a block diagram of program storage and playback system including a mechanism for storing program content on behalf of the user on a central remote shared server.
  • Fig. 1 of the drawings allows a listener or viewer to enjoy selected, previously broadcast radio or television programs or program segments at a later when it is more convenient or desirable.
  • previously broadcast musical programming segments here referred to as "songs"
  • Fig. 1 of the drawings The basic mechanism employed is shown in Fig. 1 of the drawings and consists of a client-side recorder/player, shown at the left of the vertical dashed line 101, and a song identification server shown at the right of the line 101.
  • the recorder/player consists of a broadcast receiver 103 coupled to an antenna 105 for receiving, demodulating and digitizing broadcast signals and for recording those signals on a substantially continuous manner in a local storage unit 107.
  • a "snippet extractor” ⁇ 109 sends brief digitized segments, here called “snippets,” to the recognition engine 111 at the server.
  • the recognition engine 111 compares each snippet with a database 113 containing prerecorded programming, such as popular songs. When an incoming snippet from the client recorder/player matches one of the items in the database 113, information describing the matching item is returned to the client side and stored as a record in the stored content guide seem at 115.
  • the transmitted information includes data specifying the time duration between the beginning of the identified snippet and the beginning of the program item (e.g. song) from which the snippet was taken, the time duration between the beginning of the snippet and the end of the program item, as well as descriptive information about the program item (e.g., song title, performer, composer, album name, date performed, etc.).
  • the user of the player recorder can review listings of songs that are available in the local song storage unit 107, and play back any song or other program item listed as indicated at 121.
  • the broadcast receiver 103 may be set by the user to continuously record the broadcast from a preselected a radio station, or may be programmed to switch to different frequencies at different times to record different selected programs from different stations.
  • the incoming signal may be derived from an AM or FM radio broadcast, or from the audio portion of television programming.
  • the principles employed in the arrangement shown in Fig. 1, and in the present invention, are applicable to television programming as well, and may be used to store, catalog and play back television programs and segments of television programs.
  • FIG. 1 A variety of different program extraction and recognition mechanisms may be used to implement the arrangement of Fig. 1 and the invention. See, for example, U.S. Patent 5,577,249 entitled “Method for finding a reference token sequence in an original token string within a database of token strings using appended non-contiguous substrings"; U.S. Patent 4,918,730 entitled “Process and circuit arrangement for the automatic recognition of signal sequences," U.S. Patent 4,739,398 entitled “Method, apparatus and system for recognizing broadcast segments,” and U.S. Patent 4,697,209 entitled “Methods and apparatus for automatically identifying programs viewed or recorded.”
  • the signature database 113 and recognition engine 1 1 1 preferably takes the form of a shared system to which multiple client-side recorder players may be connected via a suitable digital communications pathway such as the Internet or a direct modem connection via the dialup telephone system.
  • the broadcast receiver 103 preferably includes analog-to-digital converter and a digital compression mechanism to conserve space on the local storage unit 107 and to reduce the size of each snippet sent to the server.
  • the selection and playback mechanism 121 preferably includes means for displaying a listing of the available programs and program segments stored in local storage unit 107, means for searching the information in the stored content guide 115, and means for selectively playing and erasing selected items in local storage 107 that are identified in the stored content guide information at 115.
  • All of these functions may be performed, if desired, by a suitably programmed personal computer equipped with a TV-Radio tuner card, such as the Hauppauge WinCast/TV-Radio card, and utilizing the PC's local hard disk to provide both the local song storage and storage for the stored program and content guide.
  • An Internet connection from the client PC to a remote server may be used to upload snippets and download program and program segment specification data either continuously or on a batch basis.
  • the snippet extractor 109 may scan pre-recorded program segments in the store 107 and pass them to the recognition engine 111 for processing at "off hours" when the added computational and communications burden placed on both the client and server side apparatus may be more efficiently handled.
  • snippets which are transmitted to the server but not recognized, and which hence represent programming which cannot be automatically cataloged may be automatically deleted from the storage unit 107 after a predetermined time, whereas recognized program segments may be retained until there disposition is specified by the user.
  • the present invention as shown in Fig. 2 of the drawings further includes a mechanism, seen at 123, for identifying and transmitting programs and programs segments to be added to the library file 125 maintained at the remote server. As indicated at 127 in Fig. 2, the program material in the remote library file 128 may be retrieved for playback and returned local storage when desired.
  • Those elements seen in Fig. 2 which provide the same functions as like units shown in Fig. 1 are identified by the same reference numbers.
  • Multiple users may share the library file 125, with only a single copy of each program segment actually being stored.
  • a client station signals its intent to store a given program or program segment which has been stored in its local storage unit 115, and that program or program segment is already stored in the shared library file 125 as determined by a server-side account manager routine indicated at 128, rather than actually transferring a copy from the client to the server, the copy at the client side is simply erased and an accounting entry is stored in the account file 129 to indicate that a "virtual transfer" of the file has been made. In this way, the copyright on the broadcast program material is protected against making any copy beyond the single copy for listener's personal use. User's who have not actually first created their own copy in local storage on the client recorder/playback unit cannot obtain an accounting "credit" which will entitle them to download the library file copy.
  • the system could "lock" the original copy at the time the transfer or virtual transfer was made, making the original copy inoperable even though it is still resident (not yet erased) on the client player.
  • the lock could be opened later after a secure message was received from the server indicating that the accounting credit was being eliminated in the account file 129. In this way, the owner of a recorded program segment can play that segment on different players at different times, while the system insures that only one operative at any one time.
  • Each song in the library file 128 would thus be available only to authenticated individuals who had earlier uploaded the song to the server.
  • the master copy on the server would remain operable to be downloaded to other individuals A server that would download (or unlock if it was already there) a copy to a user's second PC after verifying that the copy on the first PC was locked thus ensuring one copy per user.
  • a user may purchase the right to play and locally record a program segment downloaded from the server.
  • the system that would register record/CD purchasers and allow them to download temporary copies of their purchased material to a remote site following appropriate identification.
  • the server could manage the sale or auction of previously purchased "virtual copies”.
  • advertisements could be added between programs or program segments (songs).
  • the recorder/playback unit could include means for manually marking the beginning and ending of a desired program segment which the user desires to save in his or her "virtual jukebox.
  • Intelligent fast forward and backward buttons, speech speedup software (with pitch control so one could listen to the music in fast-time) to get to the end quickly, set-time jumps back and forth, etc. could be used to facilitate the markup process.
  • a music/talk recognition mechanism may be used to delimit the song.
  • This approach rely on an algorithm or circuit that distinguish music from the spoken word (in something akin to "audio scene-change" in video technology).
  • the arrangement described in U.S. Patent 4,542,525 entitled “Method and apparatus for classifying audio signals” processes an audio signal and derives either a speech recognition signal, a music recognition signal or an indication of an unidentifiable signal.
  • Another implementation employs algorithms to separate two songs. That is, the system would be able to distinguish the beginning of one song and the end of another — songA/songB recognition. These transition points would then be used to help delimit songs within a stored audio stream. This technique would work in conjunction with a music/talk recognition system that separates the talk from the music would be more important than separating the occasional pair of songs that have no talk between them.
  • Specific word or phrase recognition would also be used to identify segments. For instance, the traffic report each day might start with the same phrase which could be recognized with standard speech recognition technology. The system would place intelligent bookmarks (intelligent in that they related to a known topic) at these identified locations.
  • Entire talk shows or news broadcasts could be translated to text via speech recognition. Listeners could use the voice input devices in their car PCs to request topics to hear about. These topics would be selected based on word matches. Finally, bookmarks could be created that merely related to time. Thus, a listener mignt surf through a time-shifted block of audio and one of the bookmarks might be the audio corresponding the top of the hour or the breaks at every quarter hour.
  • computer readable information might accompany the broadcast of a song.
  • time-shifted radio listening would involve a multi-tuner broadcast receiver 103.
  • This system would continuously try to delimit songs on multiple channels at once using our original song recognition algorithms (on the client or server machines), or the ideas of music/talk recognition or songA/songB recognition. Multiple tuners could even be useful in the case of manual markups as this can probably be done faster than real time.
  • One implementation of this would use high end equipment that could digitize all the channels in specific spectrum range with a single circuit.
  • the Channel Changer implementation is optimized for the latter two options — options which would be most likely in systems with limited memory, or ones with larger memory but little content yet stored. In these cases the listener is more dependent on what is being broadcast at the present than on what is stored on disk from earlier recordings. As a result, a system that finds the greatest number of good songs quickly will have additional utility.
  • There are several aspects of the Channel Changer system which attempt to emulate the methods that people use as they search for good songs by switching from channel to channel in a car.
  • song recognition technology (of any of the types described above) is combined with multiple radio tuners, each with its own buffer, and channel- changing algorithms that would be used to intelligently tune the radio tuners to the optimal set of stations.
  • One of the tuners would be the "playing tuner", while the others would be “searching tuners”.
  • This system will allow a listener to quickly surf multiple radio channels and "pull down” and store the greatest number of desired songs in the shortest time (compared to a single tuner system or a multi-tuner system without channel-changing algorithms).
  • the system would consist of a database of song fingerprints and the requisite recognition software.
  • the song fingerprints would be as close to the front of the song as possible (not too close or the DJ might chop it off) so that song identification could happen as soon as possible once the song started playing.
  • Each searching tuner would have a buffer available to it (which could be as short as the distance from the beginning of a song to the fingerprint plus processing time) to capture the audio before reaching a given song's fingerprint. Once the fingerprint was found and identified, the song would be rated on a "desirability" scale. The audio before the buffer before the fingerprint would be combined with the rest of the song. The next step would be dependent on which playing option was in effect:
  • the song would be saved in the jukebox. If there is not enough unused memory to save the song, the system would compare the new song's rating to that of the song in the jukebox that had the lowest rating. If the new song has a higher rating, it would replace the existing song having the lowest rating. The process would continue over time over multiple tuners, gradually lifting the average rating of songs in memory.
  • the song would be saved in a short term buffer and queued up for playback. Again, if the queue was filed, the new song would have to be better than the worst song in the queue to find a space.
  • the playing tuner would switch over to the new song as soon as it was being broadcast. There would not necessarily be storage of the whole song. The switch to the new song would be made with some consideration being given to how much better the new song is, and how close the old song is to being over.
  • This search algorithm to find better stations to tune to using multiple tuners would have several steps. The first would be to rank stations by the probability of finding a desired song. This list could be fluid and change depending on the number of successful searches completed on each station over a recent period of time.
  • the system would predict the probability of finding a desired song in the immediate future on any one given station.
  • the station ranking and the "song-immediacy probability" would both be assessed to decide which station to send the next available tuner to. There the tuner would wait for the next song to come on and be identified. If would then assess the desirability of the new song and under playing options
  • the recorder/playback unit can be programmed to develop song desirability ratings automatically.
  • the rating system could learn from the listener:
  • the system could also keep track of over how long a time, and how many times, each title had been listened to and deduce a decay rate in the desirability in that song due to the multiple exposures. The system could learn what the listeners typical desired decay rate was.
  • the user could have a simple rating interface whereby he or she could consciously rate songs so the system would know how to rate them later.
  • the rating system could be an ongoing process so that a user could help the system understand over time at what rate the listener might be growing tired of a new system. This could be a simple "thumbs down" button that might depress the songs rating in the personal jukebox so that the song would not be played as often.
  • a self-reflective mechanism could be employed. That is, if the user expressed a preference for the Beatles tune #1, the system then knows which songs are most like that and puts the others in the desirability scale accordingly.
  • buttons on the standard radio could be used for any of the skipping and approval rating functions mentioned above.
  • This information could be uploaded when the system "docks" to receive more song finge ⁇ rints if that system is employed, or a separate communications step may be used to transmit this information.
  • the second step is "documenting" the listener's tastes while listening.
  • the third step is making the song available for replay. This can be done by merely waiting to hear it again on the radio, buying the record, or using the present system to snip it out for future listening. The listener can document his or her preferences and save the song all at the same time.
  • the car is the ideal environment to use this system as the listener is easily able to hit a button or use a verbal command to rate or store a desirable song when it is being played.
  • playlist software may be utilized. This enables automatic play of either randomized or listener-selected songs in much the same way a CD player does.
  • the user When in user-controlled mode, the user would be able to work from an audio menu which would announce the group and/or song before playing. The listener could then surf through the jukebox while driving.
  • the system would adapt and use some of the playlist software used by radio stations to construct the random playlists.
  • This software would continuously scan new songs that had been delimited by the system and offer them as new material to the listener. An audible signal would announce that this was a new song.
  • the user could command the system to discard the song and not play it again or rate the song during the first or a subsequent play which would then allow it a place in the jukebox.
  • the playlist generator would attempt to optimize the presentation of new material to a listener based on past listening habits, surfing actions, and explicit expressions of interest in certain types of music.
  • Another use for song identification with a stored audio system would be to purchase the song being played much in the same way that the listener can now while listening to an Internet broadcast.
  • Other interactive features would be to allow the listener to request information about the band, etc.
  • song recognition technology could be used to help listeners identify a specific song that they can't remember — a computerized version of "name that tune". For instance, a user might be able to sing, or perform with an instrument, a few notes of a song. The system would come back with a match or a list of songs that may match the user's attempt to sing the song. The user could then play some of the songs on the "possible matches” list or may recognize the song by the name. In any case, the user might go on from there to buy the song that matched his or her "performed” rendition or cite it as a song for which it would desirable to capture with the song recognition system when played over the radio again.

Abstract

A system for selecting, erasing or reproducing program recordings using marking and descriptive data which is transmitted to a client location from a remote processing location. A database of identification signals specifying the characteristics of a known programming is maintained at a remote processing location. In a first embodiment, selected identification signals are downloaded from the database to the client location and are used by a processor at the client location to identify desired programming within a locally stored collection of previously received broadcast programming signals. In a second arrangement, locally stored programming signals are processed to extract identification data which is uploaded from the client location to the remote processing location for comparison to the database, and information describing the content of the matching programs is returned to the client location for use as a program guide, facilitating the selection, permanent storage, or playback of desired program records and/or the erasure of undesired programming. To conserve local storage space, identified program records may be uploaded and stored at the remote processing location, or shared program records in a central library may be made available for remote playback after the identity of equivalent locally stored programming is confirmed.

Description

Specification
Title: Electronic music and program storage, recognition, management and playback system
Technical Field
This invention relates to systems for storing and reproducing recorded music and programming materials and more particularly to program storage and playback systems in which recorded program content and descriptions are transferred between a client location and a remote processing location.
Background Art
The present invention represents an extension to the systems and methods described in U.S. Patent 5,892,536 issued to James D. Logan, Richard Goldhor and Daniel Goessling on April 6, 1999 and in International Publication WO 98/31 1 13 published on July 16, 1998.
International Publication WO 98/31113 describes an arrangement of the type illustrated in Fig. 1 of the attached drawings which enables a user at a client location to identify and selectively play back or erase program selections, such as individual songs, using program guide information which is downloaded from a remote processing location.
Summary of the Present Invention
As the listener accumulates a large number of previously recorded programs or program segments (e.g. songs) which he or she desires to retain, the present invention provides methods for moving those recordings to a central server to free space on the local storage unit, and to allow the user to access the stored material from other players. To this end, the present invention as shown in Fig. 2 of the drawings further includes a mechanism, seen at 123, for identifying programs as shown in Fig. 1, and further for transmitting programs and programs segments to be added to the library file 125 maintained at the remote server.
As further contemplated by the present invention, to avoid the need to upload programs from local storage, the identification mechanism is employed to verify that the programs are stored locally, and to communicate that fact to the remote processor, which maintains an accounting file which specifies which users have the right to retrieve and play back which programs from the shared library.
These and other features and advantages of the present invention will be made more apparent by considering the following details description which is presented in connection with the attached drawings.
Brief Description of the Drawings
Fig. 1 is a block diagram of a prior art client-side program storage and playback device interconnected via a communications pathway to a remote server which recognizes snippets of programs received from the client-side unit and which returns descriptions of matching program segments, such as individual songs, to the play back unit; and
Fig. 2 is a block diagram of program storage and playback system including a mechanism for storing program content on behalf of the user on a central remote shared server.
Description of the Best Mode
The prior art arrangement shown in Fig. 1 of the drawings allows a listener or viewer to enjoy selected, previously broadcast radio or television programs or program segments at a later when it is more convenient or desirable. In particular, previously broadcast musical programming segments (here referred to as "songs") can be easily identified and replayed.
The basic mechanism employed is shown in Fig. 1 of the drawings and consists of a client-side recorder/player, shown at the left of the vertical dashed line 101, and a song identification server shown at the right of the line 101.
The recorder/player consists of a broadcast receiver 103 coupled to an antenna 105 for receiving, demodulating and digitizing broadcast signals and for recording those signals on a substantially continuous manner in a local storage unit 107. On the client-side, a "snippet extractor" \109 sends brief digitized segments, here called "snippets," to the recognition engine 111 at the server. The recognition engine 111 compares each snippet with a database 113 containing prerecorded programming, such as popular songs. When an incoming snippet from the client recorder/player matches one of the items in the database 113, information describing the matching item is returned to the client side and stored as a record in the stored content guide seem at 115. The transmitted information includes data specifying the time duration between the beginning of the identified snippet and the beginning of the program item (e.g. song) from which the snippet was taken, the time duration between the beginning of the snippet and the end of the program item, as well as descriptive information about the program item (e.g., song title, performer, composer, album name, date performed, etc.). Using the information thus accumulated, the user of the player recorder can review listings of songs that are available in the local song storage unit 107, and play back any song or other program item listed as indicated at 121.
The broadcast receiver 103 may be set by the user to continuously record the broadcast from a preselected a radio station, or may be programmed to switch to different frequencies at different times to record different selected programs from different stations. The incoming signal may be derived from an AM or FM radio broadcast, or from the audio portion of television programming. The principles employed in the arrangement shown in Fig. 1, and in the present invention, are applicable to television programming as well, and may be used to store, catalog and play back television programs and segments of television programs.
A variety of different program extraction and recognition mechanisms may be used to implement the arrangement of Fig. 1 and the invention. See, for example, U.S. Patent 5,577,249 entitled "Method for finding a reference token sequence in an original token string within a database of token strings using appended non-contiguous substrings"; U.S. Patent 4,918,730 entitled "Process and circuit arrangement for the automatic recognition of signal sequences," U.S. Patent 4,739,398 entitled "Method, apparatus and system for recognizing broadcast segments," and U.S. Patent 4,697,209 entitled "Methods and apparatus for automatically identifying programs viewed or recorded."
The signature database 113 and recognition engine 1 1 1 preferably takes the form of a shared system to which multiple client-side recorder players may be connected via a suitable digital communications pathway such as the Internet or a direct modem connection via the dialup telephone system. The broadcast receiver 103 preferably includes analog-to-digital converter and a digital compression mechanism to conserve space on the local storage unit 107 and to reduce the size of each snippet sent to the server. The selection and playback mechanism 121 preferably includes means for displaying a listing of the available programs and program segments stored in local storage unit 107, means for searching the information in the stored content guide 115, and means for selectively playing and erasing selected items in local storage 107 that are identified in the stored content guide information at 115. All of these functions may be performed, if desired, by a suitably programmed personal computer equipped with a TV-Radio tuner card, such as the Hauppauge WinCast/TV-Radio card, and utilizing the PC's local hard disk to provide both the local song storage and storage for the stored program and content guide. An Internet connection from the client PC to a remote server may be used to upload snippets and download program and program segment specification data either continuously or on a batch basis. In the batch mode, the snippet extractor 109 may scan pre-recorded program segments in the store 107 and pass them to the recognition engine 111 for processing at "off hours" when the added computational and communications burden placed on both the client and server side apparatus may be more efficiently handled.
If desired, snippets which are transmitted to the server but not recognized, and which hence represent programming which cannot be automatically cataloged, may be automatically deleted from the storage unit 107 after a predetermined time, whereas recognized program segments may be retained until there disposition is specified by the user.
As the listener accumulates a large number of previously recorded programs or program segments (e.g. songs) which he or she desires to retain, it would be desirable to move those recordings to a central server to free space on the local storage unit, and to allow the user to access the stored material from other players. To this end, the present invention as shown in Fig. 2 of the drawings further includes a mechanism, seen at 123, for identifying and transmitting programs and programs segments to be added to the library file 125 maintained at the remote server. As indicated at 127 in Fig. 2, the program material in the remote library file 128 may be retrieved for playback and returned local storage when desired. Those elements seen in Fig. 2 which provide the same functions as like units shown in Fig. 1 are identified by the same reference numbers.
Multiple users may share the library file 125, with only a single copy of each program segment actually being stored. When a client station signals its intent to store a given program or program segment which has been stored in its local storage unit 115, and that program or program segment is already stored in the shared library file 125 as determined by a server-side account manager routine indicated at 128, rather than actually transferring a copy from the client to the server, the copy at the client side is simply erased and an accounting entry is stored in the account file 129 to indicate that a "virtual transfer" of the file has been made. In this way, the copyright on the broadcast program material is protected against making any copy beyond the single copy for listener's personal use. User's who have not actually first created their own copy in local storage on the client recorder/playback unit cannot obtain an accounting "credit" which will entitle them to download the library file copy.
To insure that only one copy can be used, the system could "lock" the original copy at the time the transfer or virtual transfer was made, making the original copy inoperable even though it is still resident (not yet erased) on the client player. The lock could be opened later after a secure message was received from the server indicating that the accounting credit was being eliminated in the account file 129. In this way, the owner of a recorded program segment can play that segment on different players at different times, while the system insures that only one operative at any one time.
Each song in the library file 128 would thus be available only to authenticated individuals who had earlier uploaded the song to the server. The master copy on the server would remain operable to be downloaded to other individuals A server that would download (or unlock if it was already there) a copy to a user's second PC after verifying that the copy on the first PC was locked thus ensuring one copy per user.
Note also that a user may purchase the right to play and locally record a program segment downloaded from the server. The system that would register record/CD purchasers and allow them to download temporary copies of their purchased material to a remote site following appropriate identification.
Furthermore, users might be able to exchange or sell their personal copies of songs. To this end, the server could manage the sale or auction of previously purchased "virtual copies".
In order to reduce the cost of the service provided by the server, and to compensate the copyright owners of the program material, advertisements could be added between programs or program segments (songs).
In addition to, or as an alternative to, the automatic snippet recognition mechanism discussed above, There are several less elegant, but nonetheless practical methods to identify and mark the boundaries of desired program segments stored in the local storage unit 107. The recorder/playback unit could include means for manually marking the beginning and ending of a desired program segment which the user desires to save in his or her "virtual jukebox. Intelligent fast forward and backward buttons, speech speedup software (with pitch control so one could listen to the music in fast-time) to get to the end quickly, set-time jumps back and forth, etc. could be used to facilitate the markup process. These techniques might work particularly well in the car given that the listener has the time to do the required "work".
A music/talk recognition mechanism may be used to delimit the song. This approach rely on an algorithm or circuit that distinguish music from the spoken word (in something akin to "audio scene-change" in video technology). For example, the arrangement described in U.S. Patent 4,542,525 entitled "Method and apparatus for classifying audio signals" processes an audio signal and derives either a speech recognition signal, a music recognition signal or an indication of an unidentifiable signal.
Another implementation employs algorithms to separate two songs. That is, the system would be able to distinguish the beginning of one song and the end of another — songA/songB recognition. These transition points would then be used to help delimit songs within a stored audio stream. This technique would work in conjunction with a music/talk recognition system that separates the talk from the music would be more important than separating the occasional pair of songs that have no talk between them.
These delimitation techniques would then be applied to the audio stored in a time- shifted radio system. The talk or ads between songs could be eliminated either automatically or through user actions. With the bookmarks separating songs, the listener would be able to use an input device (such as a push button or voice-recognized spoken commands) to quickly surf from song to song. The user could then key in, or dictate using voice recognition, descriptive information about any desired song to be saved for future playback, the descriptive information being placed in the stored content guide 115.
Another form of automatic bookmarking would involve" talk radio." In this environment the system would offer another form of recognition — speaker identification. For talk radio this would allow listeners to jump from segment to segment as new speakers joined in the conversation. Each time a new voice was identified, a bookmark would be planted.
Specific word or phrase recognition would also be used to identify segments. For instance, the traffic report each day might start with the same phrase which could be recognized with standard speech recognition technology. The system would place intelligent bookmarks (intelligent in that they related to a known topic) at these identified locations.
Entire talk shows or news broadcasts could be translated to text via speech recognition. Listeners could use the voice input devices in their car PCs to request topics to hear about. These topics would be selected based on word matches. Finally, bookmarks could be created that merely related to time. Thus, a listener mignt surf through a time-shifted block of audio and one of the bookmarks might be the audio corresponding the top of the hour or the breaks at every quarter hour.
In another implementation of a delimiting system, computer readable information, possibly in the form of RDS information identifying the song, performers, etc., might accompany the broadcast of a song. In the case of an Internet broadcast, this might include computer readable data such as the name of the song, performer, etc. If these tags were at a known and consistent location vis a vis the start of the song, this would allow for accurate delimiting of the song. If it was inconsistently placed, but generally located near the beginning of a song, then a song could be excised out but it would have some extraneous material associated with it. A system could be devised that excised out a 5 minute block from a buffer surrounding such an identifier. The user could then manually edit the extraneous material.
Another implementation of time-shifted radio listening would involve a multi-tuner broadcast receiver 103. This system would continuously try to delimit songs on multiple channels at once using our original song recognition algorithms (on the client or server machines), or the ideas of music/talk recognition or songA/songB recognition. Multiple tuners could even be useful in the case of manual markups as this can probably be done faster than real time. One implementation of this would use high end equipment that could digitize all the channels in specific spectrum range with a single circuit.
In the operation of a time-shifted radio system, with limited tuners and limited disk storage, the user in general has three playing options:
1. To play a song out of a stored jukebox (presumably stored long ago)
2. To play a recently stored song (involving a short time-shift)
3. To play a song that was being broadcast live at the moment of play.
The Channel Changer implementation is optimized for the latter two options — options which would be most likely in systems with limited memory, or ones with larger memory but little content yet stored. In these cases the listener is more dependent on what is being broadcast at the present than on what is stored on disk from earlier recordings. As a result, a system that finds the greatest number of good songs quickly will have additional utility. There are several aspects of the Channel Changer system which attempt to emulate the methods that people use as they search for good songs by switching from channel to channel in a car.
In this implementation, song recognition technology (of any of the types described above) is combined with multiple radio tuners, each with its own buffer, and channel- changing algorithms that would be used to intelligently tune the radio tuners to the optimal set of stations. (One of the tuners would be the "playing tuner", while the others would be "searching tuners".) This system will allow a listener to quickly surf multiple radio channels and "pull down" and store the greatest number of desired songs in the shortest time (compared to a single tuner system or a multi-tuner system without channel-changing algorithms).
The system would consist of a database of song fingerprints and the requisite recognition software. The song fingerprints would be as close to the front of the song as possible (not too close or the DJ might chop it off) so that song identification could happen as soon as possible once the song started playing.
Each searching tuner would have a buffer available to it (which could be as short as the distance from the beginning of a song to the fingerprint plus processing time) to capture the audio before reaching a given song's fingerprint. Once the fingerprint was found and identified, the song would be rated on a "desirability" scale. The audio before the buffer before the fingerprint would be combined with the rest of the song. The next step would be dependent on which playing option was in effect:
1. Under this option, the song would be saved in the jukebox.. If there is not enough unused memory to save the song, the system would compare the new song's rating to that of the song in the jukebox that had the lowest rating. If the new song has a higher rating, it would replace the existing song having the lowest rating. The process would continue over time over multiple tuners, gradually lifting the average rating of songs in memory.
2. Under this option, the song would be saved in a short term buffer and queued up for playback. Again, if the queue was filed, the new song would have to be better than the worst song in the queue to find a space.
3. Under this option (which uses minimum memory), the playing tuner would switch over to the new song as soon as it was being broadcast. There would not necessarily be storage of the whole song. The switch to the new song would be made with some consideration being given to how much better the new song is, and how close the old song is to being over. This search algorithm to find better stations to tune to using multiple tuners would have several steps. The first would be to rank stations by the probability of finding a desired song. This list could be fluid and change depending on the number of successful searches completed on each station over a recent period of time.
Then, using a predictive algorithm which would keep track of which channels had just played a song and which were in the middle of a song or an ad, the system would predict the probability of finding a desired song in the immediate future on any one given station.
The station ranking and the "song-immediacy probability" would both be assessed to decide which station to send the next available tuner to. There the tuner would wait for the next song to come on and be identified. If would then assess the desirability of the new song and under playing options
1. see if the song warranted space in the jukebox,
2. buffer the song and put it in the playing queue
3. switch the playing tuner over to the newly found song.
(Under scenario 3, the user might want the flexibility to use fingeφrints that are deeper into the song. Deeper fingeφrints would allow the search tuner to identify a song even if it was "found" while in the middle of its playback. This would allow especially desirable songs to be listened to in part. Ideally however, the system would have a separate tuner for each worthwhile station. This would eliminate having to jump from station to station and deal with partial songs.)
The recorder/playback unit can be programmed to develop song desirability ratings automatically. The rating system could learn from the listener:
1. It could watch to see if, and when, a listener skipped out of a song as it was being played under any of the three listening options.
2. It could monitor if, under option #3, the user un-did a swap presented by the system.
3. The system could also keep track of over how long a time, and how many times, each title had been listened to and deduce a decay rate in the desirability in that song due to the multiple exposures. The system could learn what the listeners typical desired decay rate was.
4. Also, the user could have a simple rating interface whereby he or she could consciously rate songs so the system would know how to rate them later. The rating system could be an ongoing process so that a user could help the system understand over time at what rate the listener might be growing tired of a new system. This could be a simple "thumbs down" button that might depress the songs rating in the personal jukebox so that the song would not be played as often.
In addition, a self-reflective mechanism could be employed. That is, if the user expressed a preference for the Beatles tune #1, the system then knows which songs are most like that and puts the others in the desirability scale accordingly.
For a car-PC system, the buttons on the standard radio could be used for any of the skipping and approval rating functions mentioned above.
An interesting and potentially valuable use for this information would be to provide the song ratings back to the broadcasters or record companies. This information could be uploaded when the system "docks" to receive more song fingeφrints if that system is employed, or a separate communications step may be used to transmit this information.
With the vast amount of music in existence and being played over the airwaves, a major problem is figuring out what an individual listener may like — and then using this information to listen to the songs have a higher probability of being desirable. Solving this problem is a three step process. First the listener must get exposed to wide range of new material. Radio broadcast (over the airwaves or Internet) is perfect for this. It pushes at listeners randomized playlists of songs grouped around certain musical interest groups.
The second step is "documenting" the listener's tastes while listening. And the third step is making the song available for replay. This can be done by merely waiting to hear it again on the radio, buying the record, or using the present system to snip it out for future listening. The listener can document his or her preferences and save the song all at the same time.
The car is the ideal environment to use this system as the listener is easily able to hit a button or use a verbal command to rate or store a desirable song when it is being played.
Once a personal jukebox has been developed, playlist software may be utilized. This enables automatic play of either randomized or listener-selected songs in much the same way a CD player does. When in user-controlled mode, the user would be able to work from an audio menu which would announce the group and/or song before playing. The listener could then surf through the jukebox while driving.
In random or playlist mode, the system would adapt and use some of the playlist software used by radio stations to construct the random playlists. This software would continuously scan new songs that had been delimited by the system and offer them as new material to the listener. An audible signal would announce that this was a new song. The user could command the system to discard the song and not play it again or rate the song during the first or a subsequent play which would then allow it a place in the jukebox. The playlist generator would attempt to optimize the presentation of new material to a listener based on past listening habits, surfing actions, and explicit expressions of interest in certain types of music.
Another use for song identification with a stored audio system would be to purchase the song being played much in the same way that the listener can now while listening to an Internet broadcast. Other interactive features would be to allow the listener to request information about the band, etc.
Another use for song recognition technology (whether on the client or server side) would be to help listeners identify a specific song that they can't remember — a computerized version of "name that tune". For instance, a user might be able to sing, or perform with an instrument, a few notes of a song. The system would come back with a match or a list of songs that may match the user's attempt to sing the song. The user could then play some of the songs on the "possible matches" list or may recognize the song by the name. In any case, the user might go on from there to buy the song that matched his or her "performed" rendition or cite it as a song for which it would desirable to capture with the song recognition system when played over the radio again.
It is to be understood that the specific arrangements which have been described are merely illustrative applications of the principles of the invention. Numerous modifications may be made by those skilled in the art without departing from the true spirit of the invention.

Claims

What is claimed is: 1. A method for selectively reproducing locally stored programming signals comprising, in combination, the steps of: storing a first set of separate programming segments at a client location, storing, at a remote processing location, a second set of separate programming segments and content descriptions for each of said programming segments in said second set, at said client location, employing processing means to derive identification data from each of said first set of separate programming segments, transmitting said identification data from said client location to a remote processing location, at said remote processing location, comparing said identification data with said second set of programming segments to identify common program segments found in both said first and said second set of programming segments, transmitting from said remote processing location to said client location selected ones of content descriptions which describe said common program segments, at said client location, presenting said selected content descriptions to a user to facilitate the selection of particular ones of said common program segments, at said remote processing location, accepting a retrieval request from said client location specifying one or more of said particular ones of said common program segments, and responding to said request by transmitting to said client location the content of said one or more particular ones of said common program segments.
2. The method set forth in claim 1 wherein at least some of said programming signals are recorded musical performances.
3. The method set forth in claim 2 wherein at least some of said content descriptions specify one or more attributes of the corresponding recorded musical performance from the group of attributes consisting of the title, performer, composer, and date of the corresponding recorded musical performance.
4. The method set forth in claim 1 wherein said step of storing said first set of programming signals comprises receiving and recording broadcasted programming signals.
5. The method set forth in claim 4 wherein said second set of programming segments is derived from said broadcasted programming signals received at said remote processing location concurrently with the reception and recording of said broadcast programming signals at said client location, and said content descriptions transmitted to said client location from said remote processing location are used at said client location to facilitate the selective time- shifted reproduction of said broadcast programming signals.
6. The method as set forth in 1 wherein said content descriptions transmitted from said remote processing location to said client location include information specifying the beginning and ending time of each of said common program segments.
7. The method as set forth in claim 1 further including the steps of transmitting one or more previously received program segments from said client location to said remote processing location, and storing said previously received program segments at said remote processing location for subsequent retrieval.
8. The method set forth in claim 1 further comprising the steps of uploading a copy of a program segment stored locally at said client location to said remote processing location and storing the uploaded copy ins said stored library for later retrieval from said remote processing location.
9. The method set forth in claim 1 further including the steps of posting an entry in an accounting file upon the transmittal of said identification data to said remote processing location, subsequently transmitting a playback request identifying said client location and identifying a requested program segment, and authorizing the transmittal of said requested program segment if said accounting file contains data indicating that identification data for said requested program segment was previously transmitted from said client location.
10. The method set forth in claim 9 further including the step of disabling the playback of a local copy of an program segment when the remote playback of said program segment is authorized at said remote processing location.
11. The method set forth in claim 9 further including the step of disabling the transmittal of said requested program segment from said remote processing location when the playback of the copy of said requested program segment locally stored at said client location is enabled.
12. A method for selectively reproducing previously broadcast programming segments comprising, in combination, the steps of: employing a first broadcast receiver at a client location for capturing a broadcast signal, recording said broadcast signal in a local storage unit in a substantially continuous manner as said signal is received at said client location; processing said broadcast signal at said client location to extract brief segments from the content of said broadcast signal, utilizing a communications channel to transmit said brief segments from said client location to a remote processing location; comparing said segments received from said client location with a library of previously recorded programs stored at said remote processing location to identify particular programs which contain segments matching the segments received from said client location, and transmitting program guide data describing said particular programs to said client location from said remote programming location.
13. The method as set forth in claim 12 further including the steps of displaying said program guide data for use at said client station to facilitate the selection and reproduction of desired ones of said particular programs.
14. The method as set forth in claim 12 wherein said data identifying said particular programs includes timing information specifying the beginning and ending time of each of said particular programs.
15. The method as set forth in claim 14 wherein the steps of recording and processing said broadcast signal at said client location are performed by a programmed personal computer.
16. The method as set forth in claim 15 wherein said communications channel is the Internet.
17. The method as set forth in claim 12 further including steps, at said client location, of processing said program guide data to display a listing of the available programs in said local storage unit, and selectively processing said available programs in response to commands from a user.
18. The method set forth in claim 18 wherein said step of processing said available programs to selectively reproduce selected ones of said available programs.
19. The method set forth in claim 18 wherein said step of processing said available programs further includes selectively erasing designated ones of said available programs.
EP00920069A 1999-03-29 2000-03-29 Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments Expired - Lifetime EP1197020B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE60037119T DE60037119T3 (en) 1999-03-29 2000-03-29 ELECTRONIC STORAGE OF MUSIC DATA AND PROGRAMS, WITH THE DETECTION OF PROGRAM SEGMENTS, SUCH AS MUSIC LECTURES RECORDED, AND SYSTEM FOR THE MANAGEMENT AND PLAYING OF SUCH PROGRAM SEGMENTS

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12675899P 1999-03-29 1999-03-29
US126758P 1999-03-29
PCT/US2000/008823 WO2000058940A2 (en) 1999-03-29 2000-03-29 Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances a nd system for the management and playback of these programme segments

Publications (3)

Publication Number Publication Date
EP1197020A2 true EP1197020A2 (en) 2002-04-17
EP1197020B1 EP1197020B1 (en) 2007-11-14
EP1197020B2 EP1197020B2 (en) 2011-04-13

Family

ID=22426512

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00920069A Expired - Lifetime EP1197020B2 (en) 1999-03-29 2000-03-29 Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments

Country Status (4)

Country Link
EP (1) EP1197020B2 (en)
AU (1) AU4066300A (en)
DE (1) DE60037119T3 (en)
WO (1) WO2000058940A2 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8108393B2 (en) 2009-01-09 2012-01-31 Hulu Llc Method and apparatus for searching media program databases
US8239889B2 (en) 2008-03-10 2012-08-07 Hulu, LLC Method and apparatus for collecting viewer survey data and for providing compensation for same
US8527537B2 (en) 2009-02-19 2013-09-03 Hulu, LLC Method and apparatus for providing community-based metadata
US8578408B2 (en) 2008-03-10 2013-11-05 Hulu, LLC Method and apparatus for providing directed advertising based on user preferences
US8782709B2 (en) 2009-02-19 2014-07-15 Hulu, LLC Method and apparatus for providing a program guide having search parameter aware thumbnails
US9141860B2 (en) 2008-11-17 2015-09-22 Liveclips Llc Method and system for segmenting and transmitting on-demand live-action video in real-time
US9141859B2 (en) 2008-11-17 2015-09-22 Liveclips Llc Method and system for segmenting and transmitting on-demand live-action video in real-time
US9189547B2 (en) 2009-05-11 2015-11-17 Hulu, LLC Method and apparatus for presenting a search utility in an embedded video
US9202224B2 (en) 2008-03-10 2015-12-01 Hulu, LLC Providing a survey during an advertisement opportunity to improve advertising experience
US9367745B2 (en) 2012-04-24 2016-06-14 Liveclips Llc System for annotating media content for automatic content understanding
US9659597B2 (en) 2012-04-24 2017-05-23 Liveclips Llc Annotating media content for automatic content understanding
US9769546B2 (en) 2013-08-01 2017-09-19 Hulu, LLC Preview image processing using a bundle of preview images

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6505160B1 (en) 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US7308485B2 (en) 1997-04-15 2007-12-11 Gracenote, Inc. Method and system for accessing web pages based on playback of recordings
KR20020043239A (en) 2000-08-23 2002-06-08 요트.게.아. 롤페즈 Method of enhancing rendering of a content item, client system and server system
EP1362485B1 (en) 2001-02-12 2008-08-13 Gracenote, Inc. Generating and matching hashes of multimedia content
EP1410380B1 (en) 2001-07-20 2010-04-28 Gracenote, Inc. Automatic identification of sound recordings
JP4398242B2 (en) 2001-07-31 2010-01-13 グレースノート インコーポレイテッド Multi-stage identification method for recording
US20050010604A1 (en) 2001-12-05 2005-01-13 Digital Networks North America, Inc. Automatic identification of DVD title using internet technologies and fuzzy matching techniques
WO2004023810A1 (en) * 2002-09-05 2004-03-18 Thomson Licensing S.A. System and method for providing programming in a multi-dwelling unit or multi-tenant unit network
GB2401714A (en) * 2003-05-16 2004-11-17 Glencroft Ltd Selecting audio information
US7565213B2 (en) 2004-05-07 2009-07-21 Gracenote, Inc. Device and method for analyzing an information signal
US7908273B2 (en) 2006-03-09 2011-03-15 Gracenote, Inc. Method and system for media navigation
US20080274687A1 (en) 2007-05-02 2008-11-06 Roberts Dale T Dynamic mixed media package
EP2206114A4 (en) 2007-09-28 2012-07-11 Gracenote Inc Synthesizing a presentation of a multimedia event
US8185513B2 (en) 2008-12-31 2012-05-22 Hulu Llc Method and apparatus for generating merged media program metadata
US8805854B2 (en) 2009-06-23 2014-08-12 Gracenote, Inc. Methods and apparatus for determining a mood profile associated with media data
US8071869B2 (en) 2009-05-06 2011-12-06 Gracenote, Inc. Apparatus and method for determining a prominent tempo of an audio work
US8996538B1 (en) 2009-05-06 2015-03-31 Gracenote, Inc. Systems, methods, and apparatus for generating an audio-visual presentation using characteristics of audio, visual and symbolic media objects
US20140041054A1 (en) * 2012-08-01 2014-02-06 Microsoft Corporation Attestation of possession of media content items using fingerprints
FR2996934A1 (en) * 2012-10-17 2014-04-18 France Telecom NAVIGATION METHOD IN AUDIO CONTENT INCLUDING MUSICAL EXTRACTS
EP2928094B1 (en) * 2014-04-03 2018-05-30 Alpine Electronics, Inc. Receiving apparatus and method of providing information associated with received broadcast signals

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0222772A4 (en) 1983-03-21 1987-09-08 Burton L Greenberg Television program transmission verification method and apparatus.
US5661787A (en) 1994-10-27 1997-08-26 Pocock; Michael H. System for on-demand remote access to a self-generating audio recording, storage, indexing and transaction system
GB9504376D0 (en) 1995-03-04 1995-04-26 Televitesse Systems Inc Automatic broadcast monitoring system
US5799141A (en) 1995-06-09 1998-08-25 Qualix Group, Inc. Real-time data protection system and method
US5751672A (en) 1995-07-26 1998-05-12 Sony Corporation Compact disc changer utilizing disc database
GB2304489A (en) * 1995-08-15 1997-03-19 Steve Mccauley Entertainment system
US5778395A (en) 1995-10-23 1998-07-07 Stac, Inc. System for backing up files from disk volumes on multiple nodes of a computer network
US5765173A (en) 1996-01-11 1998-06-09 Connected Corporation High performance backup via selective file saving which can perform incremental backups and exclude files and uses a changed block signature list
US6025837A (en) 1996-03-29 2000-02-15 Micrsoft Corporation Electronic program guide with hyperlinks to target resources
US5732216A (en) * 1996-10-02 1998-03-24 Internet Angles, Inc. Audio message exchange system
US6088455A (en) * 1997-01-07 2000-07-11 Logan; James D. Methods and apparatus for selectively reproducing segments of broadcast programming
US5794254A (en) 1996-12-03 1998-08-11 Fairbanks Systems Group Incremental computer file backup using a two-step comparison of first two characters in the block and a signature with pre-stored character and signature sets
JPH1155201A (en) 1997-07-29 1999-02-26 Sony Corp Device, method and system for information processing and transmitting medium
JPH1166824A (en) * 1997-08-15 1999-03-09 Sony Corp Audio server system
US6032130A (en) 1997-10-22 2000-02-29 Video Road Digital Inc. Multimedia product catalog and electronic purchasing system
EP1062558A2 (en) 1998-03-12 2000-12-27 Fairbanks Systems Group System and method for backing up computer files over a wide area computer network
US6898762B2 (en) 1998-08-21 2005-05-24 United Video Properties, Inc. Client-server electronic program guide

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0058940A3 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9202224B2 (en) 2008-03-10 2015-12-01 Hulu, LLC Providing a survey during an advertisement opportunity to improve advertising experience
US8239889B2 (en) 2008-03-10 2012-08-07 Hulu, LLC Method and apparatus for collecting viewer survey data and for providing compensation for same
US8578408B2 (en) 2008-03-10 2013-11-05 Hulu, LLC Method and apparatus for providing directed advertising based on user preferences
US8707343B2 (en) 2008-03-10 2014-04-22 Hulu, LLC Method and apparatus for collecting viewer survey data and for providing compensation for same
US9426537B2 (en) 2008-03-10 2016-08-23 Hulu, LLC Providing directed advertising based on user preferences
US11625917B2 (en) 2008-11-17 2023-04-11 Liveclips Llc Method and system for segmenting and transmitting on-demand live-action video in real-time
US9141860B2 (en) 2008-11-17 2015-09-22 Liveclips Llc Method and system for segmenting and transmitting on-demand live-action video in real-time
US9141859B2 (en) 2008-11-17 2015-09-22 Liveclips Llc Method and system for segmenting and transmitting on-demand live-action video in real-time
US8364707B2 (en) 2009-01-09 2013-01-29 Hulu, LLC Method and apparatus for searching media program databases
US9477721B2 (en) 2009-01-09 2016-10-25 Hulu, LLC Searching media program databases
US8108393B2 (en) 2009-01-09 2012-01-31 Hulu Llc Method and apparatus for searching media program databases
US8527537B2 (en) 2009-02-19 2013-09-03 Hulu, LLC Method and apparatus for providing community-based metadata
US8805866B2 (en) 2009-02-19 2014-08-12 Hulu, LLC Augmenting metadata using user entered metadata
US8782709B2 (en) 2009-02-19 2014-07-15 Hulu, LLC Method and apparatus for providing a program guide having search parameter aware thumbnails
US9189547B2 (en) 2009-05-11 2015-11-17 Hulu, LLC Method and apparatus for presenting a search utility in an embedded video
US9659597B2 (en) 2012-04-24 2017-05-23 Liveclips Llc Annotating media content for automatic content understanding
US10381045B2 (en) 2012-04-24 2019-08-13 Liveclips Llc Annotating media content for automatic content understanding
US9367745B2 (en) 2012-04-24 2016-06-14 Liveclips Llc System for annotating media content for automatic content understanding
US9769546B2 (en) 2013-08-01 2017-09-19 Hulu, LLC Preview image processing using a bundle of preview images
US10602240B2 (en) 2013-08-01 2020-03-24 Hulu, LLC Decoding method switching for preview image processing using a bundle of preview images

Also Published As

Publication number Publication date
AU4066300A (en) 2000-10-16
WO2000058940A2 (en) 2000-10-05
WO2000058940A3 (en) 2001-03-08
EP1197020B2 (en) 2011-04-13
EP1197020B1 (en) 2007-11-14
DE60037119T3 (en) 2012-10-04
DE60037119D1 (en) 2007-12-27
DE60037119T2 (en) 2008-08-21

Similar Documents

Publication Publication Date Title
EP1197020B1 (en) Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments
US6931451B1 (en) Systems and methods for modifying broadcast programming
US7058376B2 (en) Radio receiving, recording and playback system
US20040143349A1 (en) Personal audio recording system
US7580325B2 (en) Utilizing metadata to improve the access of entertainment content
JP4528763B2 (en) Real-time recording agent for streaming data from the Internet
US6088455A (en) Methods and apparatus for selectively reproducing segments of broadcast programming
JP4317127B2 (en) System and method for indexing and summarizing music videos
US20050044561A1 (en) Methods and apparatus for identifying program segments by detecting duplicate signal patterns
US20040267388A1 (en) Method and system for recording and processing of broadcast signals
US20020120925A1 (en) Audio and video program recording, editing and playback systems using metadata
US20040255334A1 (en) Methods and apparatus for seamlessly changing volumes during playback using a compact disk changer
US20040255330A1 (en) CD and DVD players
US20040255340A1 (en) Methods and apparatus for playing different programs to different listeners using a compact disk player
US20110209062A1 (en) User preference based collecting of music content
JP2001042866A (en) Contents provision method via network and system therefor
CA2650065A1 (en) Real time, on the fly, distribution of pre-selected electronic content
KR20070109950A (en) Information processing system, terminal unit, information processing method and program
JP4035993B2 (en) Data processing apparatus and method
CN100546267C (en) The system, device, method, recording medium and the computer program that are used for process information
US8219634B2 (en) Information distribution system, and information distribution method
TW200307874A (en) Apparatus and method for identifying audio
US20050012563A1 (en) Method and system for the simulataneous recording and identification of audio-visual material
JP4365087B2 (en) Method and apparatus for providing content via network, and method and apparatus for acquiring content
CN100399296C (en) Method and apparatus for search and recording of media signals

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20011120

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

RBV Designated contracting states (corrected)

Designated state(s): DE FR GB

17Q First examination report despatched

Effective date: 20040624

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60037119

Country of ref document: DE

Date of ref document: 20071227

Kind code of ref document: P

ET Fr: translation filed
PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

26 Opposition filed

Opponent name: COZENS, PAUL DENNIS

Effective date: 20080814

PLAF Information modified related to communication of a notice of opposition and request to file observations + time limit

Free format text: ORIGINAL CODE: EPIDOSCOBS2

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

PLBP Opposition withdrawn

Free format text: ORIGINAL CODE: 0009264

RAP2 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: GOTUIT MEDIA CORP.

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20100429 AND 20100505

PUAH Patent maintained in amended form

Free format text: ORIGINAL CODE: 0009272

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: PATENT MAINTAINED AS AMENDED

27A Patent maintained in amended form

Effective date: 20110413

AK Designated contracting states

Kind code of ref document: B2

Designated state(s): DE FR GB

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20110331

Year of fee payment: 12

REG Reference to a national code

Ref country code: DE

Ref legal event code: R102

Ref document number: 60037119

Country of ref document: DE

Effective date: 20110413

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20110329

Year of fee payment: 12

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20120329

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20121130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120402

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60037119

Country of ref document: DE

Effective date: 20121002

REG Reference to a national code

Ref country code: GB

Ref legal event code: S28

Free format text: APPLICATION FILED

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20131031 AND 20131106

REG Reference to a national code

Ref country code: GB

Ref legal event code: S28

Free format text: RESTORATION ALLOWED

Effective date: 20140219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121002

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: THE PATENT HAS BEEN ANNULLED BY A DECISION OF A NATIONAL AUTHORITY

Effective date: 20120329

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20170406 AND 20170412

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20190327

Year of fee payment: 20

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20200328

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20200328

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230519