WO2001031913A1 - Method and system for providing personalized broadcast television highlights service - Google Patents

Method and system for providing personalized broadcast television highlights service Download PDF

Info

Publication number
WO2001031913A1
WO2001031913A1 PCT/US2000/028986 US0028986W WO0131913A1 WO 2001031913 A1 WO2001031913 A1 WO 2001031913A1 US 0028986 W US0028986 W US 0028986W WO 0131913 A1 WO0131913 A1 WO 0131913A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
user
data indicative
visual content
visual
Prior art date
Application number
PCT/US2000/028986
Other languages
French (fr)
Inventor
Heidi Aarlien Peterson
Rafael A. Alonso
John C. Pearson
Jeffrey Esakov
Bruce Anderson
Original Assignee
Sarnoff Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sarnoff Corporation filed Critical Sarnoff Corporation
Priority to AU12181/01A priority Critical patent/AU1218101A/en
Publication of WO2001031913A1 publication Critical patent/WO2001031913A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4147—PVR [Personal Video Recorder]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
    • H04N21/4545—Input to filtering algorithms, e.g. filtering a region of the image
    • H04N21/45457—Input to filtering algorithms, e.g. filtering a region of the image applied to a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47214—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4755—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for defining user preferences, e.g. favourite actors or genre
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests

Definitions

  • the present invention relates generally to audio/visual content presentation, and particularly to methods and systems for presenting high quality audio/visual content and user-interactive information.
  • the rise in popularity of the global interconnection of computing devices and networks commonly referred to as the Internet offers new levels of interactivity for users accessing entertainment and information.
  • Internet communication channels are relatively low in bandwidth as compared to more traditional entertainment transport systems such as broadcast television (TV).
  • TV broadcast television
  • the amount of bandwidth available is typically inconsistent over time.
  • high- quality video such as broadcast TV quality
  • audio/visual content provided to users over the Internet is typically of low-quality, with regard to frame-rate and resolution, or undesirably slow to download or otherwise access.
  • broadcast television in its current form offers better quality audio/visual content, and is likely to improve in the near future with the widespread arrival and acceptance of digital television (DTV) and high-definition television (HDTV).
  • DTV digital television
  • HDTV high-definition television
  • this next generation television still doesn't offer the interactivity and rich variety of user-interactive content that the Internet does.
  • a characteristic that broadcast television and the Internet do have in common is the skyrocketing amount of available content, leading to "information overload" for the user. Smart systems are needed to help a user sort through this vast amount of content.
  • Personalized television services such as TiVo and REPLAYTV provide
  • PRAJA offers sports-program-content-based information over the web, with metadata and hyperlinks.
  • PRAJA does not integrate broadcast TV in any way, and thus can only offer Internet-quality audio/visual content. Also, PRAJA does not offer any personalization of the information presented. Summary of Invention
  • a method for identifying at least a portion of high quality audio/visual content being of potential interest to a user and available via a first communications network and corresponding user-interactive content available via a second communications network including: storing data indicative of at least one user interest; receiving data indicative of scheduling information for the high quality audio/visual content via the first or second communications network; receiving data indicative of the high quality audio/visual data and data indicative of the user-interactive content via the first or second network; and, automatically identifying select portions of the high quality audio/visual content and corresponding user-interactive content dependently upon the stored data indicative of the at least one user interest using the data indicative of scheduling information, data indicative of the high quality audio/visual data and data indicative of the user-interactive content.
  • Figure 1 illustrates a block diagram of a system according to one aspect of the present invention.
  • Figure 2 illustrates a block diagram of a set top box according to another aspect of the present invention and suitable for use with the system of Figure 1. Detailed Description of the Invention
  • PBTV Personalized Broadcast TV Highlights Service
  • PBTV delivers broadcast-quality audio/visual content plus web content and interactivity to provide a personalized and enriched viewing experience.
  • the PBTV system Based on an individual user's preferences, the PBTV system provides efficient storage, indexing, search, and retrieval of broadcast-quality digital audio/visual content, along with related multimedia content, and hyperlinks to related Web Sites.
  • Figure 1 illustrates a block diagram of a system 10 according to one aspect of the present invention.
  • the system 10 includes at least one consumer electronics, set-top box (WEB/DVR/STB) or STB 100, at least one website 200 (PBTV website 200), at least one content provider (NCP) 300 and at least one digital video broadcaster 400.
  • WEB/DVR/STB set-top box
  • NCP content provider
  • the present invention will be discussed in a non-limiting example which includes a single user 100, website 200, NCP 300 and broadcaster 400 for sake of clarity.
  • the Digital Video Broadcaster 400 provides high-quality digital audio/visual (AN) content 410 in the PBTV system 10. This AN content 410 can be provided via a satellite or cable television system for example.
  • AN digital audio/visual
  • Participating ⁇ ewMedia Content Providers ( ⁇ CPs) 300 provide metadata and multimedia information and analysis 310, as well as hyperlinks to web sites related to high quality audio/visual content 410.
  • Metadata as used herein generally refers to data which describes or is associated with programs 410 or portions of programs 410.
  • the Web/Digital-video-recorder/Set-top-box STB 100 is a consumer electronics device.
  • the PBTV Web Site 200 acts as a source or gateway for electronic program guides (EPGs), and as a gateway to NewMedia Content Providers (NCPs) 300 for the STB 100.
  • Program-related metadata and multimedia content e.g., program-related information and analysis, is downloaded 210 via the
  • FIG. 1 therein is illustrated a block diagram of an STB 100 according to another aspect of the present invention and suitable for use with the system of Figure 1.
  • the STB 100 includes a microprocessor 120, decoder
  • the decoder 110 for decoding broadcast content, modem 130 for communicating with the website 200, e.g. communications 180, 210, and accessing the Internet, and storage device 140 such as a hard disk drive, for storing AN data and other information.
  • Communications mediums for the back-channel to the website 200 from the STB 100 include conventional telephone lines, digital subscriber lines (DSLs), cable modem channels and cellular and other wireless networks for example.
  • the decoder 110 also provides audio/visual content to the display device 160, such as a television or other suitable monitor.
  • the device 100 further includes one or more input devices 170 such a keyboard, mouse or remote control, for operation of the STB 100 using a Graphical User Interface (GUI) displayed using the display device 160 via the microprocessor 120 and decoder 110.
  • GUI Graphical User Interface
  • Video programming content 410 is provided by the digital video broadcaster 400 to the STB 100 and ⁇ CP 300, and is the actual broadcast-quality video the PBTV system 10 delivers to the display 160.
  • the Electronic Program Guides (EPGs) are provided by either the broadcaster 400 or via the PBTV Web Site 200, and provide scheduling information for programming content.
  • Metadata is supplied by an NCP 300 via the PBTV Web Site 200, and describes the program content 410, including time-of-occurrence information, such as for a scene beginning at time "X", data describing who, what, where, when, why, or how.
  • User Interest Profiles are personalized by a user via the PBTV Web Site 200 and describe, for each participating NCP 300, the interests of an individual user, expressed in terms of the metadata available from that NCP 300. For example, "I am interested in all scenes where Brad Pitt appeared," or "I am interested in all New York Jets third-down plays where Vinny Testaverde passed the ball" can be used to generate UIPs. UIPs can be stored as database records.
  • Related multimedia content is information and analysis furnished by the NCPs 300 via the PBTV Web Site 200, and includes such things as related news, e.g. an article about Brad Pitt's previous movie or Vinny Testaverde's injury status, evaluation of the program content, e.g.
  • Hyperlinks to related multimedia content are also furnished by an NCP 300 via the PBTV Web Site 200, and provide a user with opportunities for further exploration, e.g. a hyperlink to a Universal Pictures web site or to an NFL web site.
  • a PBTV user begins by personalizing a UEP template for a NewMedia Content Provider (NCP) 300 associated with one of the user's general areas of interest, e.g. sports, movies or news, for example as communication 180.
  • the UIP template for an NCP 300 is preferably designed to facilitate searching and retrieving video and related content using the metadata available from that NCP 300, and the EPG.
  • a personalized UIP for an NCP 300 describes the user's personal interests in terms of the metadata available from that particular NCP 300.
  • the EPG data and metadata can be queried using a
  • UIP to not only identify programs 410 of potential interest to a user, but portions of programs 410 of potential interest to a user as well.
  • the PBTV system 10 Based on the UIP and the EPG, the PBTV system 10 identifies, by using appropriately formed queries based upon the UIP, which broadcast programs 410 are of potential interest to the user, and the times those "interesting" programs 410, or even portions of programs 410 will be broadcast. According to an aspect of the invention, based upon the results, the STB 100 automatically records the compressed bitstreams of those "interesting" programs 410, or portions of programs 410, using the storage device 140. The user can play back the PBTV-recorded broadcast- quality video programming, thus seeing programming content 410 that has been sifted according to the user's UIP.
  • this playback also facilitates user-guided exploring of related multimedia content and hyperlinks provided by an NCP 300 via the PBTV Web Site 200 by means of a GUI.
  • the GUI used to present the PBTV content for a particular NCP 300 is preferably tailored to the needs of the metadata and related content available from that NCP
  • the PBTV system 10 in order to use the EPG and metadata to drive the STB 100 to accurately record and index the desired broadcast video, and then retrieve that stored video, the PBTV system 10 uniquely identifies any arbitrary point in the video broadcast, and links that instant in the broadcast with corresponding points in the metadata and the EPG. According to another aspect of the present invention, the PBTV system 10 achieves this synchronization using the Presentation Time Stamp (PTS) of the programming content 410, which can take the form of an MPEG-2 ATSC compliant video bitstream, for example.
  • PTS Presentation Time Stamp
  • this PTS-based approach to synchronization permits an event in the broadcast programming content 410 to be identified to within 21 frames, or less than 1 second.
  • the recording cues calculated for the Web/DVR/STB 100 recording process based on the EPG and UIP can take this tolerance into account, to insure that all desired audio/visual content is recorded.
  • the PBTV system 10 allows a user to specify not only which programs are of interest, but even which parts of those programs are of interest using UIPs.
  • the STB 100 uses a video "crunching" operation to further compress the recorded bitstream.
  • the STB 100 begins by recording in its entirety, a program 410 which, based on information in the EPG and the UIP, may be of interest to the user.
  • the system 10 queries the now available metadata based upon the UIP, and "crunches" the previously recorded bitstream by removing from the STB 100 storage device 140 any "uninteresting" portions of the bitstream, such as advertisements for example.
  • the exact portions of the previously stored bitstream to be erased are determined by matching the PTS information in the metadata with the PTSs in the encoded video bitstream, as has been discussed.
  • delivery of the programming content 410 to the display device 160 can be buffered or delayed, using the STB for example, for a suitable temporal duration, such as 5 seconds for example, so as to allow an opportunity for the metadata to become available.
  • a suitable temporal duration such as 5 seconds for example
  • another approach to video "crunching" is graduated removal. With this technique, rather than completely removing "uninteresting" portions of the stored, compressed bitstream, these portions are transcoded to a lower bitrate, so that they take up less space in storage device 140. User prioritization on video content, expressed in the UIP, can act as a guide for this graduated removal process. Graduated removal can also be utilized when the available capacity of storage device 140 approaches a given threshold, in order to free-up space so that additional compressed audio/visual content can be recorded for example.
  • the recording followed by "crunching" of a stored video can be performed either serially or in a pipelined fashion, depending on the amount of lag time between program broadcast 410 and metadata availability from the NCP 300.
  • de-fragmentation as is conventionally understood can be is performed on the remaining compressed video bitstreams so as to achieve more efficient packing of the "crunched" programming content.
  • UIPs can reside in either the user's STB 100 or PBTV Web Site 200.
  • the EPG can be obtained as part of the digital video broadcast 410, or from the PBTV Web Site 200, and can be stored at the PBTV Web Site 200, or in the user's STB 100.
  • the computations to control automated recording can be performed at the
  • PBTV Web Site 200 or in the user's STB 100.
  • appropriately sifted metadata can be batch downloaded to the user's STB 100 or reside at the PBTV Web Site 200 and be accessed on an as needed basis by the STB 100.
  • Related multimedia content can also be pre-downloaded to the user's STB 100, or downloaded on-the-fly at time of video playback from the web site 200.

Abstract

A system and method for selectively presenting portions of at least broadcast quality audio/visual content from at least one broadcaster via a broadcast network and portions of user-interactive content accessible via a computer network based upon a user's interests and using a presentation device. The system includes: an input device for providing data indicative of at least one user interest; at least one web site for providing access to data indicative of the audio/visual content; a plurality of memory locations storing computing instructions for identifying the portions of the audio/visual content using the data indicative of the least at least one user interest and data indicative of the audio/visual content; and, a storage device for recording the identified portions of the audio/visual content.

Description

METHOD AND SYSTEM FOR PROVIDING PERSONALIZED BROADCAST TELEVISION HIGHLIGHTS SERVICE
Field of Invention
The present invention relates generally to audio/visual content presentation, and particularly to methods and systems for presenting high quality audio/visual content and user-interactive information.
Background of Invention
The rise in popularity of the global interconnection of computing devices and networks commonly referred to as the Internet offers new levels of interactivity for users accessing entertainment and information. However, Internet communication channels are relatively low in bandwidth as compared to more traditional entertainment transport systems such as broadcast television (TV). Further, the amount of bandwidth available is typically inconsistent over time. Because high- quality video, such as broadcast TV quality, requires a consistently available, relatively high bandwidth, audio/visual content provided to users over the Internet is typically of low-quality, with regard to frame-rate and resolution, or undesirably slow to download or otherwise access.
In contrast, broadcast television in its current form offers better quality audio/visual content, and is likely to improve in the near future with the widespread arrival and acceptance of digital television (DTV) and high-definition television (HDTV). However, this next generation television still doesn't offer the interactivity and rich variety of user-interactive content that the Internet does. A characteristic that broadcast television and the Internet do have in common is the skyrocketing amount of available content, leading to "information overload" for the user. Smart systems are needed to help a user sort through this vast amount of content.
Accordingly, it is an object of the present invention to provide a system and method for providing delivery of high quality video in combination with interactive components designed to help the user sort through, or have automatically sorted through, available content and further retrieve user-interactive content.
Personalized television services such as TiVo and REPLAYTV provide
•personalized, automated digital recording of broadcast video. However, while these services address some of the shortcomings addressed above, such as the problem of finding what you want in the glut of broadcast video content, they are only crudely personalized. Essentially, they are user-friendly, minimally intelligent, digital video recorders. WEBTV offers services that begin to integrate TV and the Internet, however does not offer program-specific metadata.
In the area of sports, PRAJA offers sports-program-content-based information over the web, with metadata and hyperlinks. However PRAJA does not integrate broadcast TV in any way, and thus can only offer Internet-quality audio/visual content. Also, PRAJA does not offer any personalization of the information presented. Summary of Invention
A method for identifying at least a portion of high quality audio/visual content being of potential interest to a user and available via a first communications network and corresponding user-interactive content available via a second communications network, the method including: storing data indicative of at least one user interest; receiving data indicative of scheduling information for the high quality audio/visual content via the first or second communications network; receiving data indicative of the high quality audio/visual data and data indicative of the user-interactive content via the first or second network; and, automatically identifying select portions of the high quality audio/visual content and corresponding user-interactive content dependently upon the stored data indicative of the at least one user interest using the data indicative of scheduling information, data indicative of the high quality audio/visual data and data indicative of the user-interactive content.
Brief Description of the Figures
Figure 1 illustrates a block diagram of a system according to one aspect of the present invention; and,
Figure 2 illustrates a block diagram of a set top box according to another aspect of the present invention and suitable for use with the system of Figure 1. Detailed Description of the Invention
The present invention introduces a hybrid system that merges the advantages of broadcast TV and the Internet, which is hereinafter referred to as a Personalized Broadcast TV Highlights Service (PBTV). According to one aspect of the present invention, PBTV delivers broadcast-quality audio/visual content plus web content and interactivity to provide a personalized and enriched viewing experience. Based on an individual user's preferences, the PBTV system provides efficient storage, indexing, search, and retrieval of broadcast-quality digital audio/visual content, along with related multimedia content, and hyperlinks to related Web Sites.
Referring now to the Figures, like references identify like elements of the
Invention. Figure 1 illustrates a block diagram of a system 10 according to one aspect of the present invention. The system 10 includes at least one consumer electronics, set-top box (WEB/DVR/STB) or STB 100, at least one website 200 (PBTV website 200), at least one content provider (NCP) 300 and at least one digital video broadcaster 400. The present invention will be discussed in a non-limiting example which includes a single user 100, website 200, NCP 300 and broadcaster 400 for sake of clarity. The Digital Video Broadcaster 400 provides high-quality digital audio/visual (AN) content 410 in the PBTV system 10. This AN content 410 can be provided via a satellite or cable television system for example. Participating ΝewMedia Content Providers (ΝCPs) 300 provide metadata and multimedia information and analysis 310, as well as hyperlinks to web sites related to high quality audio/visual content 410. Metadata, as used herein generally refers to data which describes or is associated with programs 410 or portions of programs 410. The Web/Digital-video-recorder/Set-top-box STB 100 is a consumer electronics device. The PBTV Web Site 200 acts as a source or gateway for electronic program guides (EPGs), and as a gateway to NewMedia Content Providers (NCPs) 300 for the STB 100. Program-related metadata and multimedia content, e.g., program-related information and analysis, is downloaded 210 via the
PBTV Web site 200 to the user's STB 100 in response to requests therefore as will be described.
Referring now also to Figure 2, therein is illustrated a block diagram of an STB 100 according to another aspect of the present invention and suitable for use with the system of Figure 1. The STB 100 includes a microprocessor 120, decoder
110 for decoding broadcast content, modem 130 for communicating with the website 200, e.g. communications 180, 210, and accessing the Internet, and storage device 140 such as a hard disk drive, for storing AN data and other information. Communications mediums for the back-channel to the website 200 from the STB 100 include conventional telephone lines, digital subscriber lines (DSLs), cable modem channels and cellular and other wireless networks for example. The decoder 110 also provides audio/visual content to the display device 160, such as a television or other suitable monitor. The device 100 further includes one or more input devices 170 such a keyboard, mouse or remote control, for operation of the STB 100 using a Graphical User Interface (GUI) displayed using the display device 160 via the microprocessor 120 and decoder 110.
Video programming content 410 is provided by the digital video broadcaster 400 to the STB 100 and ΝCP 300, and is the actual broadcast-quality video the PBTV system 10 delivers to the display 160. The Electronic Program Guides (EPGs) are provided by either the broadcaster 400 or via the PBTV Web Site 200, and provide scheduling information for programming content. Metadata is supplied by an NCP 300 via the PBTV Web Site 200, and describes the program content 410, including time-of-occurrence information, such as for a scene beginning at time "X", data describing who, what, where, when, why, or how. User Interest Profiles (UIPs) are personalized by a user via the PBTV Web Site 200 and describe, for each participating NCP 300, the interests of an individual user, expressed in terms of the metadata available from that NCP 300. For example, "I am interested in all scenes where Brad Pitt appeared," or "I am interested in all New York Jets third-down plays where Vinny Testaverde passed the ball" can be used to generate UIPs. UIPs can be stored as database records. Related multimedia content is information and analysis furnished by the NCPs 300 via the PBTV Web Site 200, and includes such things as related news, e.g. an article about Brad Pitt's previous movie or Vinny Testaverde's injury status, evaluation of the program content, e.g. a criticism of Brad Pitt's acting or Vinny Testaverde's game performance, or related statistics, e.g. Brad Pitt's resume or third-down statistics for the Jets for the game and the season. Hyperlinks to related multimedia content, e.g. websites, are also furnished by an NCP 300 via the PBTV Web Site 200, and provide a user with opportunities for further exploration, e.g. a hyperlink to a Universal Pictures web site or to an NFL web site.
Referring still to Figure 2, a PBTV user begins by personalizing a UEP template for a NewMedia Content Provider (NCP) 300 associated with one of the user's general areas of interest, e.g. sports, movies or news, for example as communication 180. The UIP template for an NCP 300 is preferably designed to facilitate searching and retrieving video and related content using the metadata available from that NCP 300, and the EPG. In other words, a personalized UIP for an NCP 300 describes the user's personal interests in terms of the metadata available from that particular NCP 300. The EPG data and metadata can be queried using a
UIP to not only identify programs 410 of potential interest to a user, but portions of programs 410 of potential interest to a user as well.
Based on the UIP and the EPG, the PBTV system 10 identifies, by using appropriately formed queries based upon the UIP, which broadcast programs 410 are of potential interest to the user, and the times those "interesting" programs 410, or even portions of programs 410 will be broadcast. According to an aspect of the invention, based upon the results, the STB 100 automatically records the compressed bitstreams of those "interesting" programs 410, or portions of programs 410, using the storage device 140. The user can play back the PBTV-recorded broadcast- quality video programming, thus seeing programming content 410 that has been sifted according to the user's UIP. According to another aspect of the invention, this playback also facilitates user-guided exploring of related multimedia content and hyperlinks provided by an NCP 300 via the PBTV Web Site 200 by means of a GUI. The GUI used to present the PBTV content for a particular NCP 300 is preferably tailored to the needs of the metadata and related content available from that NCP
300. This can also be accomplished by analogously querying data indicative of websites using a UIP, to identify ones of the websites of potential interest to the user. According to an aspect of the present invention, in order to use the EPG and metadata to drive the STB 100 to accurately record and index the desired broadcast video, and then retrieve that stored video, the PBTV system 10 uniquely identifies any arbitrary point in the video broadcast, and links that instant in the broadcast with corresponding points in the metadata and the EPG. According to another aspect of the present invention, the PBTV system 10 achieves this synchronization using the Presentation Time Stamp (PTS) of the programming content 410, which can take the form of an MPEG-2 ATSC compliant video bitstream, for example. By calculating a difference between the PTS at the beginning of a broadcast program, which corresponds to a time in the EPG associated with this program, and the PTS at a particular point in the broadcast program, that point in the program can be uniquely identified within a resolution of the frequency-of-occurrence of the PTSs. Therefore, by simply receiving the programming content 410, decoding the PTSs, and calculating changes in the PTSs, a metadata author such as NCP 300 can uniquely identify or refer to any event in the broadcast programming content 410. Since a
PTS occurs at least every 700 milliseconds in an ATSC compliant bitstream, this PTS-based approach to synchronization permits an event in the broadcast programming content 410 to be identified to within 21 frames, or less than 1 second. The recording cues calculated for the Web/DVR/STB 100 recording process based on the EPG and UIP can take this tolerance into account, to insure that all desired audio/visual content is recorded.
As set forth, the PBTV system 10 allows a user to specify not only which programs are of interest, but even which parts of those programs are of interest using UIPs. According to yet another aspect of the invention, in cases where only portions of a program 410 are of interest, in order to more efficiently utilize the capacity of the storage device 140, the STB 100 uses a video "crunching" operation to further compress the recorded bitstream. According to yet another aspect of the present invention, where metadata cannot be guaranteed to be available concurrently with programming content 410, in the case of a live sports broadcast for example, the STB 100 begins by recording in its entirety, a program 410 which, based on information in the EPG and the UIP, may be of interest to the user. Once corresponding metadata is available from an NCP 300 via the PBTV Web Site 200 for a program 410 that has been recorded, the system 10 queries the now available metadata based upon the UIP, and "crunches" the previously recorded bitstream by removing from the STB 100 storage device 140 any "uninteresting" portions of the bitstream, such as advertisements for example. The exact portions of the previously stored bitstream to be erased are determined by matching the PTS information in the metadata with the PTSs in the encoded video bitstream, as has been discussed This approach of initially recording an entire program and then later "crunching" that program, permits a time lag between when a program 410 is broadcast, and when the program-related metadata is available. According to yet another aspect of the present invention, where metadata cannot be guaranteed to be available concurrently with programming content 410, delivery of the programming content 410 to the display device 160 can be buffered or delayed, using the STB for example, for a suitable temporal duration, such as 5 seconds for example, so as to allow an opportunity for the metadata to become available. According to another aspect of the present invention, another approach to video "crunching" is graduated removal. With this technique, rather than completely removing "uninteresting" portions of the stored, compressed bitstream, these portions are transcoded to a lower bitrate, so that they take up less space in storage device 140. User prioritization on video content, expressed in the UIP, can act as a guide for this graduated removal process. Graduated removal can also be utilized when the available capacity of storage device 140 approaches a given threshold, in order to free-up space so that additional compressed audio/visual content can be recorded for example.
The recording followed by "crunching" of a stored video can be performed either serially or in a pipelined fashion, depending on the amount of lag time between program broadcast 410 and metadata availability from the NCP 300. Following the video crunching process, in order to more efficiently use available storage space of the device 140, de-fragmentation as is conventionally understood can be is performed on the remaining compressed video bitstreams so as to achieve more efficient packing of the "crunched" programming content.
UIPs can reside in either the user's STB 100 or PBTV Web Site 200. The EPG can be obtained as part of the digital video broadcast 410, or from the PBTV Web Site 200, and can be stored at the PBTV Web Site 200, or in the user's STB 100. The computations to control automated recording can be performed at the
PBTV Web Site 200, or in the user's STB 100. Further, appropriately sifted metadata can be batch downloaded to the user's STB 100 or reside at the PBTV Web Site 200 and be accessed on an as needed basis by the STB 100. Related multimedia content can also be pre-downloaded to the user's STB 100, or downloaded on-the-fly at time of video playback from the web site 200.
Although the invention has been described and pictured in a preferred form with a certain degree of particularity, it is understood that the present disclosure of the preferred form, has been made only by way of example, and that numerous changes in the details of construction and combination and arrangement of parts may be made without departing from the spirit and scope of the invention as hereinafter claimed. It is intended that the patent shall cover by suitable expression in the appended claims, whatever features of patentable novelty exist in the invention disclosed.

Claims

ClaimsWe Claim:
1. A system (10) for selectively presenting portions of at least broadcast quality audio/visual content (410) from at least one broadcaster via a broadcast network and portions of user-interactive content (310) accessible via a computer network based upon a user's interests and using a presentation device (160), said system (10) comprising:
an input device (170) for providing data indicative of at least one user interest;
at least one web site (200) for providing access to data (210) indicative of said audio/visual content;
a plurality of memory locations storing computing instructions for identifying said portions of said audio/visual content using said data indicative of said at least one user interest and data indicative of said audio/visual content; and,
a storage device (140) for recording said identified portions of said audio/visual content.
2. The system of Claim 1, wherein said instructions utilize time stamps (PTS) to identify said portions of said audio/visual content (410).
3. The system of Claim 1, further comprising a set top box (100) which includes said storage device (140) and a processor (120) for executing said instructions, and said plurality of memory locations.
4. The system of Claim 3, wherein said storage device (140) records said at least one other portion than said select portion of said audio/visual content, and said processor (120) and storage device (140) erase said at least one other portion based upon said data indicative of said audio/visual content.
5. A method for identifying at least a portion of high quality audio/visual content being of potential interest to a user and available via a communications network, said method comprising:
storing data indicative of at least one user interest;
receiving data indicative of scheduling information for said audio/visual content;
receiving data indicative of said audio/visual content; and,
automatically identifying select portions of said audio/visual content dependently upon said stored data indicative of said at least one user interest using said data indicative of scheduling information and data indicative of said audio/visual content.
6. The method of Claim 5, further comprising:
receiving data indicative of user-interactive content corresponding to said audio/visual content and being available via a second network; and,
automatically identifying select portions of said user-interactive content using said data indicative of at least one user interest and data indicative of said user- interactive content;
wherein said first network comprises a broadcast network and said second network comprises a computer network.
7. The method of Claim 5, further comprising: storing at least a portion of said audio/visual content so as to be accessible to said user at a rate sufficient to enable real-time presentation of said audio/visual content.
8. The method of Claim 7, further comprising selectively deleting at least a portion of said stored audio/visual content.
9. A device (100) for selectively presenting select portions of audio/visual broadcasts (410) received via a broadcast network (400) and being of potential interest to a user, said device (100) comprising: at least one input (170) for receiving data indicative of at least one user interest;
a decoder (110) for receiving said audio/visual broadcasts (410);
a modem (130) for receiving data associated with said audio/visual broadcasts (410) via a computer network (200);
at least one memory device (140) for storing at least said select portions of said audio/visual broadcasts (410); and,
at least one processor (120) electrically coupled to said decoder (110), modem (130) and memory device (140), and for identifying said select portions of said audio/visual broadcasts (410) using said received data associated with said audio/visual broadcasts (410).
10. The device of Claim 5, further comprising at least one processor memory storing instructions for causing said processor (120) to selectively delete fractions of said stored audio/visual broadcasts (410) from said at least one storage device (140) using said received data indicative of said audio/visual broadcasts (410).
PCT/US2000/028986 1999-10-22 2000-10-20 Method and system for providing personalized broadcast television highlights service WO2001031913A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU12181/01A AU1218101A (en) 1999-10-22 2000-10-20 Method and system for providing personalized broadcast television highlights service

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16121899P 1999-10-22 1999-10-22
US60/161,218 1999-10-22

Publications (1)

Publication Number Publication Date
WO2001031913A1 true WO2001031913A1 (en) 2001-05-03

Family

ID=22580329

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/028986 WO2001031913A1 (en) 1999-10-22 2000-10-20 Method and system for providing personalized broadcast television highlights service

Country Status (2)

Country Link
AU (1) AU1218101A (en)
WO (1) WO2001031913A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004021695A1 (en) * 2002-08-29 2004-03-11 Opentv, Inc. A method and apparatus for selecting compression for an incoming video signal in an interactive television system
EP1415473A1 (en) * 2001-05-30 2004-05-06 Opentv, Inc. On-demand interactive magazine
EP1441526A1 (en) * 2003-01-27 2004-07-28 France Telecom Method for thematic recording of digital content with sceduled broadcasting
CN108156470A (en) * 2017-12-27 2018-06-12 北京潘达互娱科技有限公司 Interactive approach and device based on network direct broadcasting
CN108449636A (en) * 2018-03-19 2018-08-24 北京潘达互娱科技有限公司 The interactive approach and device of network direct broadcasting
USRE47908E1 (en) 1991-12-23 2020-03-17 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE48056E1 (en) 1991-12-23 2020-06-16 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5038211A (en) * 1989-07-05 1991-08-06 The Superguide Corporation Method and apparatus for transmitting and receiving television program information
EP0648054A2 (en) * 1993-08-06 1995-04-12 International Business Machines Corporation Apparatus and method for selectively viewing video information
WO1998003016A1 (en) * 1996-07-12 1998-01-22 Interactive Pictures Corporation Viewer profile of broadcast data and browser
EP0848554A2 (en) * 1996-12-11 1998-06-17 International Business Machines Corporation Accessing television program information
WO1998026584A1 (en) * 1996-12-10 1998-06-18 United Video Properties, Inc. Internet television program guide system
EP0854645A2 (en) * 1997-01-03 1998-07-22 Texas Instruments Incorporated Electronic television program guide system and method
WO1998043183A1 (en) * 1997-03-25 1998-10-01 Sony Electronics, Inc. Integrated search of electronic program guide, internet and other information resources
WO1999038321A1 (en) * 1998-01-23 1999-07-29 Index Systems, Inc. Home entertainment system and method of its operation

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5038211A (en) * 1989-07-05 1991-08-06 The Superguide Corporation Method and apparatus for transmitting and receiving television program information
EP0648054A2 (en) * 1993-08-06 1995-04-12 International Business Machines Corporation Apparatus and method for selectively viewing video information
WO1998003016A1 (en) * 1996-07-12 1998-01-22 Interactive Pictures Corporation Viewer profile of broadcast data and browser
WO1998026584A1 (en) * 1996-12-10 1998-06-18 United Video Properties, Inc. Internet television program guide system
EP0848554A2 (en) * 1996-12-11 1998-06-17 International Business Machines Corporation Accessing television program information
EP0854645A2 (en) * 1997-01-03 1998-07-22 Texas Instruments Incorporated Electronic television program guide system and method
WO1998043183A1 (en) * 1997-03-25 1998-10-01 Sony Electronics, Inc. Integrated search of electronic program guide, internet and other information resources
WO1999038321A1 (en) * 1998-01-23 1999-07-29 Index Systems, Inc. Home entertainment system and method of its operation

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE47908E1 (en) 1991-12-23 2020-03-17 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE48056E1 (en) 1991-12-23 2020-06-16 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE49387E1 (en) 1991-12-23 2023-01-24 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
EP1415473A1 (en) * 2001-05-30 2004-05-06 Opentv, Inc. On-demand interactive magazine
EP1415473A4 (en) * 2001-05-30 2006-07-05 Opentv Inc On-demand interactive magazine
WO2004021695A1 (en) * 2002-08-29 2004-03-11 Opentv, Inc. A method and apparatus for selecting compression for an incoming video signal in an interactive television system
EP1441526A1 (en) * 2003-01-27 2004-07-28 France Telecom Method for thematic recording of digital content with sceduled broadcasting
FR2850509A1 (en) * 2003-01-27 2004-07-30 France Telecom METHOD FOR THEMATIC RECORDING OF PROGRAMMED DIFFUSION DIGITAL CONTENTS
CN108156470A (en) * 2017-12-27 2018-06-12 北京潘达互娱科技有限公司 Interactive approach and device based on network direct broadcasting
CN108449636A (en) * 2018-03-19 2018-08-24 北京潘达互娱科技有限公司 The interactive approach and device of network direct broadcasting

Also Published As

Publication number Publication date
AU1218101A (en) 2001-05-08

Similar Documents

Publication Publication Date Title
US8522268B2 (en) Method and apparatus for creating a targeted integrated image
US9237203B2 (en) Integrated media content server system and method for the customization of metadata that is associated therewith
US9294792B2 (en) Dynamic rebroadcast scheduling of videos
US8813127B2 (en) Media content retrieval system and personal virtual channel
US8392946B2 (en) Method of recommending local and remote content
KR101002070B1 (en) Relation contents receiving apparatus, relation contents providing apparatus and relation contents transmitting system using thereof
US20080112690A1 (en) Personalized local recorded content
US20020170068A1 (en) Virtual and condensed television programs
US20080209474A1 (en) Method And Apparatus For Managing Tv Channel Lists
US20070156589A1 (en) Integrating personalized listings of media content into an electronic program guide
US20070154168A1 (en) Systems and methods for accessing media program options based on program segment interest
US20080086754A1 (en) Peer to peer media distribution system and method
US20070154169A1 (en) Systems and methods for accessing media program options based on program segment interest
US20040073947A1 (en) Meta data enhanced television programming
US11133975B2 (en) Fragmenting media content
KR100711608B1 (en) System for management of real-time filtered broadcasting videos in a home terminal and a method for the same
Zhang et al. A personalized TV guide system compliant with MHP
US8909032B2 (en) Advanced recording options for interactive media guidance application systems
KR101221473B1 (en) Meta data information providing server, client apparatus, method for providing meta data information, and method for providing contents
WO2001031913A1 (en) Method and system for providing personalized broadcast television highlights service
US9462349B2 (en) Method and system for content recording and indexing
Choi et al. Personalized data broadcasting service based on TV-anytime metadata
Yeo et al. Media content management on the DTV platform

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP