WO2001013277A2

WO2001013277A2 - System and method for delivering video images

Info

Publication number: WO2001013277A2
Application number: PCT/US2000/022223
Authority: WO
Inventors: Robert D. Smith; Daniel S. Schiappa; Robert D. Mcdonald
Original assignee: Vingage Corporation
Priority date: 1999-08-13
Filing date: 2000-08-11
Publication date: 2001-02-22
Also published as: WO2001013277A3; AU6639800A

Abstract

A system and method provides a dynamic delivery layer that operates between a client and a server for delivering video images to the client. In particular, the dynamic delivery layer determines an optimal, or otherwise appropriate, delivery format of the video image based on one or more parameters associated with the client. These parameters may include a bandwidth of a communication link between the client and the server, a display capability of the client, a codec associated with the video image, one or more video characteristics associated with the client, etc. Once these parameters are determined, the dynamic delivery layer determines an optimal or appropriate delivery format for the video image to maximize the viewing experience at the client. In other words, the video capabilities of the client are determined and the video image is adjusted accordingly to accommodate those capabilities while maximizing the quality of the video image delivered to the client.

Description

SYSTEM AND METHOD FOR DELIVERING VIDEO IMAGES

Background to the Invention

Field of the Invention

The present invention relates generally to videography, and more particularly, to a network-based system and method for storing, retrieving, delivering, and processing video images across various system platforms.

Discussion of the Related Art

Presently, conventional video cameras capture video images and store them in either an analog or a digital format on a magnetic tape, magnetic or optical disk, or a memory, such as a computer memory, or other similar medium for storing and/or recording video signals, commonly and collectively referred to and used generally herein unless otherwise noted as a "videotape." Once stored on the videotape, video images can be "played back" or reviewed in a corresponding videotape player. In many cases, the conventional video camera performs both capture and playback functions.

From time to time, a user of the video camera may wish to share the stored video images with others. For example, the user may have stored video images of his children and may wish to share those video images with the grandparents of the children. In order to share the video images with the grandparents, the user must either relinquish the original videotape or make a copy of the videotape. Relinquishing control of the videotape is a dubious prospect, particularly for important or sentimental videotapes. Copying the videotape onto another tape is a tedious and time-consuming process that involves the use of at least the videotape player and another videotape recorder. As each set of grandparents will require their own copy of the stored video images, the process must be repeated until the requisite number of copies are made. Furthermore, copies of the original video image lack the same image quality of the original video image.

Often times, the persons receiving copies of the videotape may not have the proper equipment to view the videotape. For example, presently, video images may be stored in multiple formats such as a VHS tape, a beta tape, an 8mm tape, a 3.5" floppy disk, a memory device, etc. In most cases, videotapes having different formats are incompatible with one another. That is, a VHS videotape player may not playback video images from an 8mm tape, or from a 3.5" floppy disk. Thus, if a user stores video images on an 8mm tape using his camera, he must make copies onto another type of videotape (e.g., a VHS tape) if the grandparents do not have an 8mm videotape player. Interfacing videotape players of different types in order to make copies is a challenging task, even if the user has access to the necessary equipment. Seldom is this task successful on the first attempt.

Editing video images from one or more videotapes poses a more difficult and time-consuming task than merely copying videotapes. Very few users have access to video image editing programs because of their expense and system requirements. Thus, most users must use "brute force" techniques employing multiple playback and recording devices to edit their video images and compile them into an entertaining and/or useful production. Because of the difficulties associated with these techniques, many users simply do not edit their video images and require their viewers to endure the often-painful series of repetitive, accidentally recorded, or poorly conceived video images.

Many forms of conventional videotapes degrade over time and use, and thus are not an effective means for long-term storage of video images. Each time some forms of videotape are played, the video signals disposed thereon degrade. Some videotape is prone to tape stretch and wrinkle. Videotape players are known to "eat" tapes or

"crash" disks. Videotape is also susceptible to damage from heat from being left in a passenger compartment of a car or from a house fire.

Some conventional systems have been developed for the storage and retrieval of still images. Some of these systems are described in U.S. Patent Nos. 5,666,215, 5,760,916, and 5,760,917, which are assigned to Eastman Kodak Company. However, none of these systems are directed toward the unique problems associated with video images.

In particular, delivery of video images from a server to a client on a network is a particularly difficult task. Digital video images may exist in several digital formats each having different resolutions, different form factors, different bandwidth requirements, different compression techniques, etc. A particular client may not be able to handle one or more of the digital formats. For example, this may be because of a narrowband delivery channel (e.g., an analog or digital/ISDN modem) between the client and the server, a low resolution viewing monitor at the client, etc. One way to overcome this conventionally has been to convert the video image into a format readable and accessible by all clients. However, for clients with sufficient capability to handle the bandwidth and resolution of particular digital formats, viewing inferior quality video images is not appealing.

Additionally, video images stored on a server for later delivery to a client on a network are stored according to a particular streaming format; e.g., according to a particular video compression (codec) technology. Thus, as new streaming formats emerge, video previously stored on the server will not be of optimum quality, and will instead remain at the quality and size at which it was originally encoded and stored.

Although such previously stored video could conceivably be individually updated (i.e., re-encoded according to the most recent technology and additionally stored), to do so would require extensive time and resources. Additionally, the process would have to be repeated each time a new streaming format was developed. Finally, such updating would have to be done promptly upon the availability of an improved streaming format, or else the best possible video image might not be available when requested by a user.

What is needed is a system and method for delivering video images that are not fraught with the problems associated with conventional videotape systems. Summary of the Invention

The present invention is a system and method for storing, manipulating, and retrieving video images, and fulfilling consumer requests associated therewith. According to the present invention, a video image capture device captures a video image of a scene. The video image is converted, if necessary, into a digital video image and uploaded onto a video server. The video server catalogs, stores, and maintains the digital video image for the user. The user may edit the digital video image, preferably in a non-linear fashion. The user may delete portions of the digital video image, combine the digital video image with other digital video images, and include audio such as background music or narration with the digital video image.

Once edited, the user may send copies of the digital video images (or links or addresses thereto) to other users. The user may also order copies of the digital video image to be stored on a VHS tape, a DVD, or other similar storage medium.

Another embodiment of the present invention provides the user with a video image storage facility that manages and maintains a video collection. The present invention provides a mechanism whereby the user can upload an entire video collection, regardless of format, and have that collection stored. Anytime the user wishes to access the collection, he may do so via a network download device, such as a television with a settop box or a personal computer.

Another embodiment of the present invention provides the user with an editing tool that allows the user to edit and/or organize video images and create home video productions without having to invest in expensive and elaborate imaging and editing equipment and software. One aspect of this feature is that the user may eliminate unwanted portions of a video image without resorting to brute force copying and dubbing techniques. Another aspect of this feature is that the user may combine one or more video images into a video production.

Another embodiment of the present invention provides the user with a still image acquisition tool that allows the user to capture and create still images from video images. This feature allows a particular frame in the video image to be located and a still image to be created therefrom. The still image may then be stored and accessed in a manner similar to the video images or the still may be processed and printed as a photograph.

Another embodiment of the present invention allows the user to distribute a video image (or a link thereto) to other users without having to make videotape copies of the video image. This feature also allows the video image to be viewed by the other users in a format appropriate to the other user.

Another embodiment of the present invention allows the user to make a time capsule, or record an inventory for insurance purposes. The time capsule may be uploaded onto the video server with instructions to send the time capsule back to the user (or someone else) on a particular date. The inventory may be made and stored on the video server so that in the event of a fire, a flood, a theft, or other disaster, the inventory may be safely recovered.

Another embodiment of the present invention provides the user with the ability to have his video production produced onto a storage medium. In this way, the user may order "hard copies" (i.e., VHS tapes, DVDs, CD-ROMS, etc.) of his video images that may be played back on a convention video image player. For example, the user may order that one or more video images be produced onto a digital versatile disc ("DVD"), which may subsequently be delivered to the user according to the present invention. Preferably, this process is accomplished via a network such as the Internet. According to the present invention, the user selects one or more personal video images, edits and/or organizes them into a video production, and requests that the video production be written/recorded onto the storage medium. Once proper payment is arranged, the video production is written/recorded onto the storage medium and delivered to the user.

Another embodiment of the present invention provides the user with a selection of licensed video images that he may combine with his personal video images to create the video production. This selection of licensed video images may include maps, music, video, movie clips, "time bomb content," etc.

Another embodiment of the present invention provides a dynamic delivery layer that operates between a client and a server for delivering video images to the client. In particular, the dynamic delivery layer determines an optimal delivery format of the video image based on one or more parameters associated with the client. These parameters may include a bandwidth of a communication link between the client and the server, a display capability of the client, a codec associated with the video image, one or more video characteristics associated with the client, etc. Once these parameters are determined, the dynamic delivery layer determines an optimal delivery format for the video image to maximize the viewing experience at the client. In other words, the present invention determines the video capabilities of the client and adjusts the video image accordingly to accommodate those capabilities while maximizing the quality of the video image delivered to the client.

For example, the video image may exist in a digital video format requiring a high-speed network to accommodate the streaming video. Attempting to deliver the video image in this format to a client with an analog modem would be useless. Converting the video image to a format appropriate to the analog modem prior to delivery would maximize the quality of the video image delivered to the client. Other parameters of the client may be similarly determined and the format of the video image adjusted accordingly.

Another embodiment of the present invention additionally encodes an original video image, or video asset, using the most optimal streaming format available. At a later time, when a user requests a stream of the video image, the present invention determines whether the video asset is currently encoded according to the most optimal technology available. If so, the video is streamed to the user using the dynamic delivery layer (DDL). However, if not, then the video stream is re-encoded, preferably "on the fly," as it is read from the server, according to the newest technology. The video is subsequently streamed using the DDL. In one embodiment, the present invention repeats this process every time a user requests a video image. Thus, according to this embodiment, there is no need to systematically update the formats of all stored video assets as soon as an improved coding technology emerges. Instead, the video assets are updated on an as-needed basis, so that the resources needed at the server end are minimized, while the quality of the viewing experience on the client end is maximized.

Another embodiment of the present invention provides a video shopping agent. According to the present invention, a consumer subscribes to a shopping service that allows the consumer to select from a menu of products and/or services, or types thereof, that the consumer may be inclined to purchase. Based on these selections, the present invention delivers a link to a video advertisement corresponding to one of the products and/or services to the consumer. The consumer may subsequently "click on" the link to activate and view the video advertisement at his convenience. In one embodiment of the present invention, the link and/or the video advertisement may subsequently direct the consumer to an appropriate site where the consumer may purchase the product or service. Such a site may include a "bricks and mortar" site, a conventional e-commerce site, or preferably a vCommerce site.

In one embodiment of the video shopping agent, various incentives may be made to subscribers that purchase products or services via the video advertisement. Such incentives may include special discounts or other promotional offers. These incentives may be redeemed at a "bricks-and-mortar" location using a coupon or similar device, or at an e-commerce or vCommerce location, by electronically tagging the consumer with a "cookie" or similar device. In the e-commerce/vCommerce example, this tagging may be used to provide the consumer with special pricing or incentives on the website or access to portions of the website reserved for preferred customers.

The features and advantages of the invention will become apparent from the following drawings and description.

Brief Description of the Drawings The present invention is described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Additionally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears. FIG. 1 illustrates a video system architecture according to the present invention.

FIG. 2 illustrates the flow of a video image through the video system architecture according to the present invention.

FIG. 3 illustrates an architecture of a video server according to the present invention.

FIG. 4 illustrates various system layers in video system architecture according to the present invention.

FIG. 5 illustrates a dynamic delivery layer of the present invention.

FIG. 6 is a flow chart illustrating how a video production is ordered according to the present invention.

FIG. 7 is a flow chart illustrating how a video production order is fulfilled according to the present invention.

FIG. 8 is a flow chart illustrating how a jacket cover is generated.

FIG. 9 illustrates a typical web portal with a portal shopping service.

FIG. 10 illustrates a consumer subscribing to a vCommerce shopping service.

FIG. 1 1 illustrates a vCommerce profile wherein the consumer designates products and/or service for which he wishes to receive video advertisements.

FIG. 12 illustrates a desktop according to one embodiment of the present invention.

FIG. 13 illustrates links delivered to the consumer's desktop.

FIG. 14 illustrates a media player for viewing video advertisements.

FIG. 15 illustrates a website where the product associated with the video advertisement may be purchased. FIG. 16 illustrates a shopping service process according to one embodiment of the present invention.

FIG. 17 illustrates a streaming format process according to an embodiment of the present invention.

Detailed Description

While the present invention is described below with respect to various explanatory embodiments, various features of the present invention may be extended to other applications as would be apparent.

The present invention is now described with reference to FIG. 1. FIG. 1 illustrates a video system architecture 100 including a video image capture device 105 (illustrated as video image capture devices 105A-C), a network upload device 1 15 (illustrated as network upload devices 1 15A-D), a video server 1 10, and a network download device 145 (illustrated as network download devices 145A-C). In general, video image capture device 105 collects or "captures" a video image and stores it to an appropriate medium (e.g., a videotape, a silicon or magnetic memory, a disk, etc.). Later, video image capture device 105 communicates the video image to network upload device 115 via an appropriate interface as would be apparent. Alternately, video image capture device 105 may communicate the video image directly to network upload device 115 without storing it to any medium.

As used herein, a video image is defined as a recording of a scene over a period of time. A video image is distinguished from a still image in that the video image captures and records continuous changes in the scene over the period of time whereas the still image captures the scene at one instant in time. A video image may include audio information. This audio information may be contemporaneous with the scene, or may be background audio information such as music or a narrative.

Network upload device 1 15 is coupled to video server 1 10 via a Java-enabled client layer 120 (or other suitable interface including vendor provided "plug-ins") and a suitable communication link, such as a broadband communication link 125 (e.g., DS1, DS3, DSL, ADSL, cable, bi-directional satellite, wireless, LAN, etc.) or a narrowband communication link 127 (e.g., an analog or digital/ISDN modem, etc.) Network upload device 1 15 uploads the video image onto video server 110, which stores the video image. Depending on broadband communication link 125, the video image may be uploaded to video server 1 10 in real time and compressed at video server 1 10. For example, DVD quality video (e.g., MPEG2) may be communicated to video server 1 10 from network upload device 1 15 at rates between 4 and 10 megabits per second. Using narrowband communication link 127, the video image may be compressed prior to uploading it onto video server 1 10.

Video server 1 10 stores the video image onto one or more memory devices internal to itself or onto an external memory device such as an SSA disk array 150, a tape or optical drive 160, or other similar memory device. In a preferred embodiment of the present invention, video server 1 10 is coupled to the external memory device(s) via a high-speed communication link such as a fiber optic channel. The external memory device(s) are useful for purposes of long-term storage or archival purposes as would be apparent.

Video server 1 10 is coupled to a network download device 145 via a second Java-enabled client layer 140 (or other suitable interface including vendor provided "plug-ins") and a suitable communication link, such as a second broadband communication link 135 or a second narrowband communication link 137, similar to those discussed above. Network download device 145 allows an end user to perform various functions on the video image. These functions may include viewing, editing (in particular, non-linear editing), archiving, and retrieving the video image. These functions may also include combining the video image (or a portion thereof) with other video images (or portions thereof). Other functions may include the online creation and ordering of one or more still images from the video image. Still other functions may include the copying and ordering of the video image onto DVD, VHS or other videotape format. These functions are discussed in further detail below.

Video image capture device 105 may be one of several different video cameras available for capturing a video image, several of which are illustrated in FIG. 1. These may include a digital video image capture device 105A, an analog video image capture device 105B, and a digital still camera with video burst capability 105C. Digital video image capture device 105 A receives optical information from a scene and transforms that optical information into a digital video signal. The digital video signal may then be recorded onto a suitable recording medium such as a digital tape, disk drive, memory device, or a similar mechanism for storing digital information as would be apparent. The digital video signal may also be communicated directly to network upload device 1 15 as a direct video feed.

Analog video image capture device 105B also receives optical information from a scene, but transforms that optical information into an analog video signal. The analog video signal may then be recorded onto a suitable recording medium such as a VHS tape, an 8mm tape, or similar analog video recording medium.

Digital still camera 105C may include a video burst mode that captures a series of video frames of a scene and records them as a digital video signal. Typically, digital still camera 105C includes a relatively small amount of memory or similar recording medium. Thus, the duration of the digital video signal may only be a few seconds in length. However, recent developments in technology, particularly "memory stick" and other similar device technologies, promise to increase this duration by orders of magnitude.

Digital video image capture device 105A and digital still camera 105C generate digital signals directly from the optical information from the scene. Thus, these devices 105 are able to communicate their signals directly to network upload device 115 without further conversion operations. However, analog video image capture device 105B generates analog signals from the optical information from the scene. The analog signals from analog video image capture device 105B must first be digitized and converted to digital signals prior to or contemporaneous with being communicated to network upload device 115.

Video image capture devices are presently available with a wide range of features and functionality from a number of suppliers and manufacturers. Many of these devices also function as video playback devices as would be apparent.

Network upload device 1 15 may be one of several different network upload devices available for collecting video images from video image capture device 105 and uploading a digital video image onto video server 1 10. Several of these devices are illustrated in FIG. 1, including a television with a set top box or Internet terminal

("TV/STB") 1 15A, a television with a digital satellite transceiver ("TV/DST") 1 15B, a personal computer with a video image capture device ("PC/VCD") 1 15C, and a personal computer with a memory reading device ("PC/MS") 1 15D.

TV/STB 1 15 A, which is representative of what is sometimes referred to as a "thin client," functions as a basic interface to a network such as the Internet, cable network, etc. TV/STB 115A includes a processor having the necessary functionality to upload a digital video image captured by video image capture device 105. In a preferred embodiment of the present invention, TV/STB 1 15A preferably functions as a Java-enabled client to video server 110. In other words, video server 110 downloads a scripting language, such as Java or similar code, which runs on TV/STB 1 15 A to acquire and upload the digital video image to video server 1 10.

TV/DST 1 15B functions as a wireless interface to either a network such as the Internet to directly to video server 1 10. TV/DST 1 15B includes the necessary functionality to upload digital video image captured by video image capture device 105. Again, in a preferred embodiment of the present invention, TV/DST 1 15B preferably functions as a Java-enabled client to video server 110.

PC/VCD 1 15C functions as a fully functional interface to a network such as the Internet. PC/VCD 1 15C includes the necessary hardware for interfacing with and receiving video images from video image capture device 105, particularly those having traditional video (either digital or analog) formats. This hardware varies depending on the particular video image capture device 105 used as would be apparent. Typically, this hardware may include a video capture board, i.Link™ port, firewire (i.e., "1394") devices, or other similar hardware, including a digitizer for digitizing analog video signals if necessary, to receive video images from video image capture device 105 and store them as a digital video image on the personal computer.

PC/MS 1 15D also functions as a fully functional interface to a network such as the Internet. PC/MS 1 15D includes the necessary hardware for interfacing with and receiving video images from video image capture device 105, particularly those storing digital video images in a memory device. This hardware varies depending on the particular video image capture device 105 used as would be apparent. Typically, this hardware may include a disk drive (e.g., a 3.5" floppy drive), a memory interface (e.g., a PCMCIA memory interface) or other similar hardware memory interface including an interface for reading memory sticks and/or other installed or detachable memory devices, including wireless connection technology. This memory interface allows PC/MS 115D to receive video images from video image capture device 105 and store them as a digital video image on the personal computer.

Network download device 145 may be one of several different network download devices for downloading and/or manipulating a digital video image on video server 110. Several of these devices are illustrated in FIG. 1 , including a TV/STB 145A, a TV/DST 145B, and a PC 145C. Generally, network download devices 145 operate similarly to their counterpart network upload devices 115. In some embodiments of the present invention, these devices may, in fact, be the exact same devices. In other words, a given set of physical equipment may function as both a network upload device 1 15 as well as a network download device 145. In other embodiments of the present invention, different sets of physical equipment are used and may, in fact, reside at remote locations coupled together by a network such as an intranet or the Internet as would be apparent.

TV/STB 145 A includes a processor having the necessary functionality to download the digital video image from video server 1 10 via a network such as the

Internet. In a preferred embodiment of the present invention, TV/STB 145 A preferably functions as a Java-enabled client to video server 110. In other words, video server 110 downloads a Java script or similar code that runs on TV/STB 145 A to download the digital video image from video server 1 10. TV/DST includes a digital satellite transceiver and a processor having the necessary functionality to download the digital video image from video server 110 via a wireless connection. In a preferred embodiment of the present invention, TV/DST 145B preferably functions as a Java-enabled client to video server 1 10. In other words, video server 1 10 downloads a Java script or similar code that runs on TV/DST 145B to download the digital video image from video server 1 10 via the wireless connection.

PC 145C includes a typical personal computer that runs various software programs, including a web browser. PC 145C also preferably functions as a Java- enabled client to video server 1 10. Using the browser, PC 145C downloads Java script from video server 1 10 which allows PC 145C to locate and download the desired digital video image from video server 110.

FIG. 2, illustrates a functional overview of video system architecture 100 according to the present invention. As illustrated, video image capture device 105 captures a digital video image 200. Alternatively, video image capture device 105 captures an analog video image which is subsequently digitized into digital video image 200. Digital video image 200 is communicated to network upload device 1 15, which uploads digital video image 200 to video server 1 10. Video server 1 10 stores digital video image 200 in a variety of formats in temporary or permanent storage as would be apparent. Once digital video image 200 is stored on video server 1 10, video system architecture 100 provides a user with a wide range of consumer operations.

Through network download device 145, the user may perform many consumer operations on digital video image 200. These consumer operations may include playback and editing. With a playback operation, the user may playback digital video image 200 through network download device 145 as he would a conventional video playback device. The user may play, rewind, fast forward, or pause digital video image 200. The user may also take advantage of the digital nature of digital video image 200 and use advanced playback operations such as non-linear reverse and non-linear forward. These playback operations are non-linear to the extent that each frame does not have to be accessed sequentially with digital video image 200. In other words, the user may access a particular frame in digital video image 200 from any other frame without accessing or scanning through any frames that may be disposed between them.

The user may also use network download device 145 as a playback device to record digital video image 200 to another medium such as a videotape. In one embodiment of the present invention, this aspect of the present invention may be provided as a service to the user whereby the user might order a VHS tape or a DVD with digital video image 200 recorded thereon.

The playback operation allows the user to use video system architecture 100 as he would any other playback device. Thus, the present invention may be used to store a users entire video library on video server 110. The benefits of video system architecture 100 used in this manner include a reduction in the number of videotapes (or other recording medium) and their associated "on-site" storage problems; a safe, secure storage system for "valuable" (either actual or sentimental) video images; an efficient organization, location and retrieval scheme for video images; and a simple mechanism to allow other users to view his videotapes.

Advanced playback operations may also include a pause feature, a frame advance feature, and a frame reverse feature that collectively may allow the user to access and manipulate a particular frame within the video image. Once the user identifies the particular frame, the user may create a still image from the particular frame within digital video image 200 for printing, e-mailing, sharing, or storing.

With editing operations, the user may edit digital video image 200, preferably in a non-linear fashion as opposed to a linear fashion. Non-linear editing allows a user to instantly locate any frame within digital video image 200 without having to rewind/fast forward the tape until the frame is located. Video and audio search technologies that seek and identify specific content or dialog may be employed in this regard. In other words, any particularly frame may be randomly accessed in digital video image 200. In this manner, portions of digital video image 200 may be readily located thereby eliminating the tedious and time-consuming task of editing linear videotape images. These portions of digital video image 200 may be individually saved and stored. Related portions of digital video image 200 may be stored together, undesired portions may discarded, and other portions (e.g., other personal digital video images, digital video images from other users, and/or commercial digital video images) may be combined together using "cut" and "paste" operations or "drag" and "drop" operations. In addition, the user may add text overlays and add audio including background music and/or voice narration. Editing functions are provided by video system architecture 100 through the Internet to the user as a Java client without having an editing suite resident on network download device 145.

Other consumer operations may include management operations on digital video image 200. These management operations may include organizational operations, safeguarding operations, maintenance operations, access grant operations, and house cleaning operations.

Video system architecture 100 also provides other consumer operations to the user including various e-commerce applications. For example, the user may request that a particular digital video image 200 be transferred to a storage medium such as a DVD disc 225 or a videotape 220. These digital video images 200 may include images that were uploaded from a video image capture device 105 and uploaded onto video server 110, or may include digital video images 200 that were edited and/or combined with other images to form a related collection of digital video images 200. Digital video image 200 may be forwarded onto a production house with the capability to record digital video image 200 onto the desired storage medium. Multiple copies of these digital video images 200 may be created and provided to the user.

Another consumer operation provided by video system architecture 100 allows the user to obtain "the perfect shot." Amateur photographers are seldom able to capture the "perfect shot" using still photography. With the video system architecture 100, a video image captured via a video image capture device 115 may be scanned to locate a particular frame that the user desires as a still image. Once the particular frame is located, a still image may be created from the frame and stored and subsequently communicated to a photo developer 210. The photo developer 210 may then print the still image as a photograph 215 and subsequently provide it to the user. Video server 1 10 is now described with reference to FIG. 3. As illustrated therein, video server 1 10 includes an accounting component 310, a capture video image component 320, a catalog video image component 330, a stored video image component 340, a video/image merchandising component 350, a playback component 360, a third-party gateway component 370, and a video editing component 380. Each of these components is described in further detail below.

Capture video image component 320 receives digital video image 200 from network upload component 1 15 via communication link 125, 127. Capture video image component 320 differs from digital video image capture device 105 in that it merely acquires digital video image 200 from network upload component 1 15 while video image capture device 105 functions as a "video camera."

Cataloging video image component 330 receives digital video image 200 from capture video image component 115 and catalogs any meta-data associated therewith. This meta-data may include an identification of the device on which digital video image 200 was captured, a time and/or a date of capture, annotations, and other similar data as would be apparent. Cataloging video image component 330 passes digital video image 200 along with its associated meta-data onto stored video image component 340.

Stored video image component 340 manages the storage and location of digital video image 200. In a preferred embodiment of the present invention, each digital video image 200 is stored as a file according to well known techniques onto various recording medium including tape, optical disc, RAID, etc. Stored video image component 340 may manage the availability of a cache associated with video server 110 as would be apparent. Stored video image component 340 may also manage the migration of digital video image 200 from one storage device onto another. For example, stored video image component 340 may manage the migration from temporary (or online) storage to long-term (or near line) storage and/or to permanent (or archive) storage. Stored video image component 340 may also track and/or record usage of digital video image 200. Stored video image component 340 may also manage a format of digital video image 200. For example, stored video image component 340 may convert digital video image 200 from one digital format to another as required by various other components of video server 1 10. Stored video image component 340 also manages and stores any still images that may have been created or extracted from digital video image 200. Preferably, stored video image component 340 includes an Oracle8I or similar database that provides an object-oriented database architecture with efficient management and delivery capabilities and flexible storage options.

Video editing component 380 may access digital video image 200 from disk array 150 or from another memory storage device. Video editing component 380 manages and performs the editing, and preferably, the non-linear editing, of the digital video image 200. Digital video editors are generally well known. Video editing component 380 interfaces with dynamic delivery layer 130 to provide various on-line editing and viewing features to the user.

Playback component 360 manages how digital video image 200 is delivered to multiple network download devices 145. In particular, playback component 360 interfaces with dynamic delivery layer 130 to optimize the delivery of digital video image 200 to network download device 145 based on a bandwidth of communication link 135, 137 and the delivery of the downloaded digital video image 200 to the user based on a nature of network download device 145. Dynamic delivery layer 130 is described in further detail below. Playback component 360 manages video streaming based on a format of digital video image 200. These formats may include, for example, MPEG1, MPEG2, MPEG4, etc., as well as other video streaming formats such as RealNetwork's RealVideo™, Microsoft's Advanced Streaming Format™, and Apple's QuickTime™.

Video/image merchandising component 350 manages all e-commerce transactions associated with digital video image 200 including ordering a copy of digital video image 200 on a videotape, either digital or analog, such as a VHS tape, a DVD, diskette, etc. Video/image merchandising component 350 may also facilitate the ordering and processing of still images created from digital video image 200 including providing photographic prints, etc. Video/image merchandising component 350 may also manage the sending digital video image 200 (or link or address thereto) to various

.8 persons as indicated by the user.

Accounting component 310 manages the financial aspects of the transaction. In a preferred embodiment of the present invention, credit/debit card clearing may be performed via a third party clearinghouse software such as that provided by Cybercash, Visa, etc. Accounting component 310 preferably includes a disbursement engine for calculating and paying royalties to third parties, calculating consumer discounts, and determining benefits provided by loyalty programs, etc. Accounting component 310 preferably integrates with corporate financial systems to facilitate transfer of information and consolidated reporting.

Third party gateway 370 acts as an interface to third parties for providing additional value-added services to the user. These services may include a still imaging service such as Sony's ImageStation to access still images for e-commerce activities. These services may also include providing content delivery from content providers for transaction revenue opportunities. Third party gateway 360 also provides accessibility to other web properties such as Yahoo!, Excite@ Home, AT&T, Earthlink, etc.

FIG. 4 illustrates three functional layers that organize the operation of video system architecture 100 according to a preferred embodiment of the present invention. These three functional layers include a client layer 410, a transport layer 420, and a server layer 430. Client layer 410 includes the tasks performed by network upload device 1 15 and network download device 145. Generally speaking, devices 1 15, 145 are referred to as "clients." Similarly, server layer 430 includes the tasks performed by video server 1 10, which is generally referred to as a "server." Transport layer 420 includes the tasks required to "transport" (i.e., communicate or transmit) information, programs, and/or data between server layer 430 and client layer 410. Transport layer 420 includes communications network layer 424, which includes various well-known communication protocols for operating on a network such as an intranet or the Internet. Transport layer 420 also includes a dynamic delivery layer 422 disposed between client layer 410 and communications network layer 424. Dynamic delivery layer 422 is described in further detail below. Client layer 410 performs several tasks that are performed at the client level (e.g., network upload device 1 15, network download device 145). These tasks include a capture task 412, a playback task 414, an editing task 416, and an ordering task 418. Other tasks may also be performed such as providing a mechanism for e-mailing digital video image 200 (or links thereto on video server 1 10) to users.

Capture task 412 controls the acquisition and upload of digital video image 200 from a video image capture device 105 to network upload device 1 15 prior to uploading it onto video server 1 10. Capture task 412 is typically performed by network upload device 115. Various implementations of capture tasks 412 exist and are well known and are generally associated with a particular video image capture device 105.

Playback task 414 controls the playing of digital video image 200 after it has been downloaded from video server 1 10. Playback task 414 manages video stream control including play, pause, volume control, non-linear forward/reverse, etc. Playback task 414 is typically performed by network download device 145. Various implementations of playback task 414 exist and are also well known.

Editing task 416 performs the editing of digital video image 200. Preferably, editing task 416 performs non-linear editing of digital video image 200. Editing task 416 may be performed either on network upload device 1 15 prior to uploading digital video image 200 onto video server 1 10, on video server 1 10 itself, or on network download device 145 after downloading digital video image 200 from video server 110. In the latter case, after digital video image 200 has been edited, it may be uploaded back onto video server 110 as would be apparent. Editing task 414 controls a "cutting and pasting" or "dragging and dropping" of video clips (i.e., digital video image 200 or portions thereof), an insertion and/or overlaying of video clips into other video clips, an addition of background audio, an adjustment of an audio level, etc. Various implementations of editing task 416 exist and are also well known.

Ordering task 418 controls ordering various products associated with digital video image 200, preferably using e-commerce. In a preferred embodiment of the present invention, ordering task 418 controls ordering of two types of products associated with digital video image 200: still image ordering and video image ordering. Still image ordering handles ordering for photo prints, novelty gifts, or other related photo-related merchandise from a still image created from a particular frame in digital video image 200. Video image ordering handles ordering for full-motion video of digital video image 200 on a desired videotape (e.g., a particular desired physical medium such as a VHS tape, a DVD, a video CD or other computer memory such as a diskette, etc.). In both cases, ordering task 418 receives an order from the user and directs the order to the appropriate third-party production house or to an in-house production facility.

As would be apparent, not all the tasks of client layer 410 need be performed on a particular client with respect to a particular digital video image 200. For example, one client may perform capture task 412 on digital video image 200, while another client may perform playback task 414 on digital video image 200. Thus, according to one embodiment of the present invention, one client may share digital video image 200 with another client.

As would also be apparent, some tasks of client layer 410 may be performed on a particular client, and in fact, may be performed by the same physical device. For example, both capture task 412 and playback task 414 may be performed by the same client with respect to the same digital video image 200. In other words, the same physical device may function as both network upload device 1 15 and network download device 145.

Server layer 430 performs several tasks that are performed at the server level (e.g., video server 110). These tasks, though tailored toward digital video images 200, include many well known tasks performed by servers generally including data storage tasks 432, data cataloging tasks 434, data delivery tasks 438, e-commerce processing tasks 436, third party gateway tasks 439, and routine system administration tasks such as maintaining user accounts, maintaining system/network security, performing system backups, etc. These tasks may also include other tasks pertinent to the present invention including usage sensitive billing, recompression of digital video image 200, archival of digital video image 200 for long term storage, etc. Dynamic delivery layer 130 provides an "intelligent" delivery layer for digital video image 200 between video server 1 10 and client layer 410 (i.e., network download devices 145). More particularly, dynamic delivery layer 130 provides a cross-platform interface to deliver digital video image 200 across streaming links of varying capacity, such as broadband communication link 135 and narrowband streaming link 137.

Dynamic delivery layer 130 receives digital video image 200 from video server 1 10, and optimizes various aspects of digital video image 200.

Based on one or more characteristics of network download devices 145, dynamic delivery layer 130 formats, encodes, transcodes and optimizes digital video image 200 using well-known techniques. Dynamic delivery layer 130 optimizes a delivery of digital video image 200 depending upon a bandwidth of link 135, 137, and the capabilities of network downloading device 145. Additionally, dynamic delivery layer 130 may optimize a delivery format of digital video image 200 depending the hardware and operating system of network download device 145, the installed viewer software, the codecs supported by the viewer software, etc.

FIG. 5 illustrates dynamic delivery layer 130 in further detail. Dynamic delivery layer 130 is illustrated as a number of steps 510-560 that represent various modules. Each of the modules is implemented in hardware and/or software to perform steps 510-560 as would be apparent. As illustrated, dynamic delivery layer 130 interfaces with video server 1 10 and facilitates the delivery of digital video image 200 from video server 110 to network download devices 145 via broadband streaming link 135 and narrowband streaming link 137. Because video system architecture 100 contemplates a number of streaming links having varying levels of bandwidth, such as broadband streaming link 135 and narrowband streaming link 137, the operation of dynamic delivery layer 130 is described in terms of communications link 135, 137.

In order for dynamic delivery layer 130 to determine the rate at which digital video image 200 may ultimately be transmitted to network download devices 145, it is helpful to determine data carrying capacity of communications link 135, 137. In a step 510, dynamic delivery layer 130 determines the bandwidth of streaming link 135, 137. The techniques employed to determine data carrying capacity will depend upon the particular scenario by which digital video image 200 is delivered to communications link 135, 137. For example, under certain circumstances, the data carrying capacity of communications link 135, 137 may be known. Communications link 135, 137 may be a leased data line, a virtual network connection, or telecommunications connection of known capacity. In one example, a telecommunications provider may provide a list of TCP/IP addresses and associated data carrying capacities for particular ones of communications link 135, 137. In yet another example, user 1 10 may provide the data carrying capacity of communications link 135, 137 to dynamic delivery layer 130 via an interface, such as a selection in the viewer software.

Alternatively, in step 510, dynamic delivery layer 130 may determine the data carrying capacity of communications link 135, 137 directly. In such cases, the data carrying capacity of communications link 135, 137 is not known and must be determined. One method of determining the data carrying capacity of communications link 135, 137 is through the use of a small client application, such as an applet, loaded from dynamic delivery layer 130 to the Java-enabled client layer 140 or directly onto network download devices 145. Preferably, the client application sets up a data transfer loop between dynamic delivery layer 130 and Java-enabled client layer 140 or network download devices 145. Dynamic delivery layer 130 determines the data carrying capacity of communications link 135, 137 by measuring the rate at which data is transferred between dynamic delivery layer 130 and network download devices 145.

Additionally, dynamic delivery layer 130 may use the range of TCP/IP addresses to infer data carrying capacity. In such a case, dynamic delivery layer 130 associates data carrying capacities of particular communications link 135, 137 with their TCP/IP addresses. As more TCP/IP addresses are mapped to their respective data carrying capacities, patterns may emerge. Consider, for example, the case where a telecommunications provider, such as a cable modem service company, provides cable modem service to users. Typically, a cable modem service is assigned a range, or block, of TCP/IP addresses. Dynamic delivery layer 130 may determine the data carrying capacity of the cable modem service, either as provided by the cable modem service company, or by measuring the data carrying capacity. Based on patterns in TCP/IP addresses identified by dynamic delivery layer 130 (such as consecutive addresses) and the data carrying capacity of related addresses, dynamic delivery layer 130 may infer the data carrying capacity of other, contiguous, TCP/IP addresses. After dynamic delivery layer 130 has determined the carrying capacity of content provider 130 in step 510, the process of FIG. 5 continues in step 520.

In a step 520, dynamic delivery layer 130 determines a display or viewer capability associated with network download device 145. This step of determining display capability is performed to optimize the delivery format of digital video image 200. For example, some displays may be capable of displaying digital video image 200 in a DV format whereas others may only be capable of displaying digital video image 200 in an MPEG format. Delivering digital video image 200 in a format suitable for the display enhances the user experience by providing an optimal image quality for the display in real time. For example, the display capabilities of a personal digital assistant ("PDA") that includes only a monochrome liquid crystal display ("LCD") display, or a small format color LCD display is different than the display capabilities of PC 145C that includes a large color CRT.

Dynamic delivery layer 130 first determines what environment information, such as variables, parameters, etc., are available at Java-enabled client layer 140 and network download devices 145. Environment information is associated with the viewing environment at network download devices 145. Java-enabled client layer 140 and network download devices 145 include environment information with any requests for data, such as digital video image 200, to video server 110. For example, the format and header of the requests from network download devices 145 provides information about the viewer, such as a browser type and version. Additionally, dynamic delivery layer 130 may query Java-enabled client layer 140 and network download devices 145 for environment information. An example of such a query is a script, such as

JavaScript, that reads and returns the viewer software transmitted to network download devices 145.

Environment information provides dynamic delivery layer 130 with a number of parameters that may be used to optimize the transmission of digital video image 200 to network download devices 145. Dynamic delivery layer 130 may determine the hardware and operating system from environment information received in step 520. For example, if network download devices 145 includes a browser as part of the viewer, information describing the browser, such as type, version, etc., is included with requests from the browser to video server 1 10. Preferably, the information identifies the type (e.g., Microsoft™, Netscape™, PalmOS™, etc.) and version of the browser. From type and version of the browser, dynamic delivery layer 130 may infer the hardware and operating systems of network download devices 145. For example, a Windows™ based browser indicate that a particular one of network download devices 145 is a PC type device with a Windows™ operating system.

Environment information may also provide dynamic delivery layer 130 with the types of viewer software installed on Java-enabled client layer 140 and network download devices 145. Dynamic delivery layer 130 may use the types of viewer software available on network download devices 145 to select the codec and format for transmission of digital video image 200. Preferably, dynamic delivery layer 130 queries Java-enabled client layer 140 and network download devices 145 to determine the particular type of viewer software. Examples of typical viewer software are Windows™ Media Player™, Apple™ QuickTime™, RealNetworks™ RealPlayer™, SUN™ Java Media Framework, etc. For example, if Java-enabled client layer 140 or network download devices 145 includes browser software, the viewer software is typically installed as a "plug-in" to the browser. Dynamic delivery layer 130 may determine which viewers are "plugged-in" to the browser software by transmitting script information, for example JavaScript, that is run at Java-enabled client layer 140 or network download devices 145. The script reads the browser plug-in list and returns it to dynamic delivery layer 130.

Environment information may also provide dynamic delivery layer 130 with the type and nature of the display hardware at network download devices 145. Dynamic delivery layer 130 may use information about the display hardware at network download devices 145 to optimize the format, codec, and other parameters for the transmission of digital video image 200. First, hardware may be inferred from the viewer type and version. For example, if the viewer at network download devices 145 is a Windows™ based browser, dynamic delivery layer 130 may infer that the hardware supporting the browser is consistent with a PC. Alternately, dynamic delivery layer 130 may infer the hardware is a PDA if the particular viewer type and version is associated with PalmOS

In a step 530, dynamic delivery layer 130 determines the codecs supported by Java-enabled client layer 140 and network download devices 145. Codecs compress and decompress digital video image 200 for transmission and playback. For example, one particular codec may be used to convert a Digital Video ("DV") format to an MPEG2 format. Codecs are generally well known. Once the bandwidth and display capabilities are determined, the proper format may be selected and the corresponding codec determined to convert digital video image into a delivery format. Part of this determination is based on the original format of digital video image 200.

Typically, viewers support a set of codecs, such as MPEG, Indeo, Cinepak, Sorenson, H.261, etc. Often, a particular viewer will support a number of codecs, thereby facilitating playback of video compressed with any of the number of codecs. In step 530, dynamic delivery layer 130 determines the set of codecs supported by the viewer or viewers installed at Java-enabled client layer 140 and network download device 145, as determined in step 520. This list represents the codecs with which digital video image 200 may be compressed for transmission to network download device 145. After step 530, the process of FIG. 5 continues in step 540.

In step 540, dynamic delivery layer 130 infers the optimal parameters for encoding and transmitting digital video image 200 to network download devices 145. Dynamic delivery layer 130 has a list of supported codecs as determined in step 530. In step 540, dynamic delivery layer 130 may determine optimal parameters for transmitting digital video image 200 to network download devices 145, such as frame rate, compression rate, frame size, frame format, codec, number of colors, and viewer software. The optimal parameters are determined, at least in part, based on at least one of communications link 135, 137 bandwidth, hardware and operating system, viewer software, available codecs, and other information determined in steps 510, 520, and 530. Dynamic delivery layer 130 uses knowledge base 570 to infer the optimal parameters for encoding and transmitting digital video image 200 to network download devices 145. Dynamic delivery layer 130 incorporates an inference engine, which, when combined with knowledge base 570, represents an expert system. Expert systems are a class of computer applications that make selections based on matching data, such as information from communications link 135, 137, Java-enabled client layer 140, and network download devices 145 with information in knowledge base 570. Knowledge base 570 represents a set of conditions, rules, and results that define scenarios for selecting optimal parameters. As an example, dynamic delivery layer 130 determines the viewer software, supported codecs, hardware, and operating system platform of a particular network download device 145. Dynamic delivery layer 130 also determines the bandwidth of communications link 135, 137. This bandwidth information and network download device 145 environment information defines a particular scenario. Dynamic delivery layer 130 compares this given scenario with information in knowledge base 570 to identify the optimal paramaters with which to encode and transmit digital video image 200 to network download device 145.

In a step 550, dynamic delivery layer 130 performs real-time recompression. The output of real-time recompression step 550 is digital video image 200 compressed in a format and with parameters for transmission to network download devices 145. Digital video image 200 may or may not be compressed in a format suitable for compression and transmission. In the case where the format of digital video image 200 is not suitable, dynamic delivery layer 130 may first decompress digital video image 200 into an intermediate format suitable for recompression. Dynamic delivery layer 130 may compress digital video image 200 according to any or all of the optimal parameters determined in step 540. For example, digital video image 200 may be compressed for transmission with a frame rate, compression rate, frame size, frame format, codec, number of colors, viewer software, etc., optimized for the particular network download devices 145 to which digital video image 200 it to be transmitted.

According to another feature of the present invention, an original quality of digital video image 200 is maintained once it is uploaded onto video server 1 10. In other words, if digital video image 200 is originally uploaded onto video server 1 10 in a first DV format, digital video image 200 is stored and maintained on video server 1 10 in the first DV format (or at least stored in a fashion so that the first DV format may be recovered without appreciable loss of quality). This is discussed in further detail elsewhere. According to another feature of the present invention, once digital video image 200 is compressed according to a set of optimal parameters, dynamic delivery layer 130 may cache the compressed image for a lower latency and less processor intensive transmission. For example, once digital video image 200 is compressed according to the optimal parameters for a first network download device 145, the compressed image is stored at dynamic delivery layer 130. When a second network download device 145, which, coincidentally, has the same optimal parameters requests digital video image 200, dynamic delivery layer 130 transmits the compressed video image without real-time recompression step 550.

In a step 560, dynamic delivery layer 130 begins streaming digital video image 200 across communications link 135, 137, as appropriate, to network download device 145. In a preferred embodiment of the present invention, step 560 includes a step of caching or look ahead to improve burst and playback performance. The caching step stages portions, or fragments, of digital video image 200 in a cache memory that has a high probability of being accessed soon. For example, if a playback stream is paused (that is, if the user selected "pause" during the delivery of digital video image 200), the caching step may cache the next few seconds (e.g., 5 seconds) of digital video image 200 as they will likely be accessed when "pause" is released.

While a preferred embodiment of the present invention has been described in terms of "optimal parameters" and "optimizing delivery of content," it should be understood that various embodiments of the present invention are contemplated where appropriate parameters are selected for an appropriate delivery of content. While appropriate parameters are something short of optimal parameters and appropriate delivery is something short of optimal delivery, at times appropriate parameters and appropriate delivery are nonetheless useful for providing reasonable, improved delivery of content over conventional systems.

In order to ensure that the optimal format is available for a given user, it is also important to consider the fact that, over time, available streaming formats (i.e., compression/decompression technologies, or codecs) may be updated or otherwise improved upon. For example, the MPEG standard is known to include MPEGl, MPEG 2 and MPEG 4. Additionally, an entirely new streaming format may be developed which is more advanced than any present streaming format.

It is preferable to store the original video image in its original format, because the amount of information included within a particular video image is finite, and cannot be increased or improved regardless of subsequent re-formatting. In fact, without using the original video image, repeated re- formatting would result in a deterioration of the video image quality.

Nevertheless, a video image viewed in an outdated streaming format will suffer in comparison to more recently uploaded video images. Therefore, the present invention advantageously allows video images to be streamed in the best and most recent streaming format. Moreover, the present invention achieves the above feature dynamically, and in a manner which is essentially transparent to a user.

FIG. 17 is a flow chart that illustrates an exemplary manner in which video server 110 operates in conjunction with the dynamic delivery layer 130 to dynamically update and optimize the streaming format of video image 200.

In step 1710, a user uploads video image 200 to the video server 110, where it is stored in its original streaming format (of course, the image may be stored in an external memory, such as disk array 150). In one embodiment of the invention, this streaming format is checked in step 1720 to determine whether it is the highest quality (e.g., the most recent codec version) available at the time of the upload. If not, then video image 200 is encoded in what is the highest quality streaming format available in step 1730, and additionally stored in step 1740.

Video image 200 remains stored on the video server 1 10 until a user requests it for download and viewing in step 1750. Then, the system checks in step 1760 to see whether the video image 200 is available in a format which is the best available at the time of the user request. If so, then video image 200 is streamed to the user in that format in step 1780, using the DDL, as described above. If not, then video image 200 must be re-encoded in the highest quality streaming format available in step 1770, before streaming can occur in step 1780.

It is possible that, if desired, the re-encoded video image could be additionally stored on the server. In this way, the video image will be immediately available to the user if it is subsequently requested before an even newer streaming format is developed. However, as mentioned above, any future re-encoding should nevertheless occur directly from the originally uploaded version of the video image to preserve image quality.

Also, although steps 1770 and 1780 are shown as discrete steps in FIG. 17, these steps are preferably enacted "on the fly," so that a first portion of the video image 200 is re-encoded and delivered, and a second portion of the video image 200 is re- encoded during delivery of the first portion (and subsequently delivered during re- encoding of a third portion). This process is repeated until the user receives the entire video image 200, so that the user receives the video image 200 in the fastest and most transparent manner possible. Thereafter, the system waits for the next user request.

As mentioned above, one of the features of the present invention is that a user may request that a particular digital video image 200 be transferred onto a storage medium such as a DVD disc 225, a videotape 220, or other appropriate storage medium. The processes by which the present invention operates to perform these tasks are referred to as "video image ordering," "video image production" and "video image fulfillment." These tasks are discussed with reference to FIGS. 6 and 7.

FIG. 6 is a flow chart illustrating the steps performed by a user while ordering the production of a digital video image 200. In a step 610, the user organizes one or more personal video images into a virtual video production using the editing tools provided by the present invention as discussed above. As also discussed above, these personal video images may include video images that were uploaded by the requesting user or another user.

In step 610, the user may arrange and organize one or more personal video images as he sees fit. The user may also overlay various audio tracks onto the virtual video production including music, narration, audio information from the scene, etc. The user may also include subtitles or other textual information with the virtual video production as would be apparent.

In an optional step 620, the user may select additional licensed video images (in contrast with personal video images) to be included in his virtual video production. These additional licensed video images may include licensed content similar to that discussed above, including "time bomb" content (e.g., video footage of events that occurred in the time frame selected by the customer from a content library), movie clips, etc. If the user wishes to add such licensed content, the user selects the content he wishes to add to his virtual video production and organizes it accordingly.

In a step 630, the user orders an actual physical production of his virtual video production. Preferably, step 630 is performed on-line via a network such as the Internet. In this step, the user selects a virtual video production that he would like to be produced onto a storage medium. In one embodiment of the present invention, the user may select a particular format or storage medium for his production. These formats and storage media may vary as would be apparent. In another embodiment of the present invention, the virtual video production is produced on a Digital Versatile Disc ("DVD") in an appropriate DVD format.

In a step 640, the user may add user information to his virtual video production.

This user information may include a title to the overall virtual video production, subtitles to various portions or chapters associated with the virtual video production, etc., as well as date information associated with the virtual video image. The date information may be used to identify one or more of the personal video images or used to incorporate any time bomb content described above.

In a step 650, the user confirms his desire that the virtual video production be produced into an actual video production. In a step 660, the user provides payment information in order to pay for the production of the virtual video production. This payment information may include credit or debit card information, electronic banking information, electronic checking, electronic cash, etc. as would be apparent. Various mechanisms exist for handing payment information in e-commerce applications. These mechanisms are well known and are not discussed in further detail.

In a step 670, once the user has provided proper payment information and the virtual video production is produced onto the appropriate storage medium, the user receives the actual video production via the mail or other delivery service as would be apparent.

The production of a virtual video production onto a storage medium is well known and is not discussed in further detail herein. Various techniques may be used depending on the format and medium selected as would be apparent.

FIG. 7 is a flow chart illustrating video production fulfillment according to the present invention. In a step 710, video system architecture 100 preferably receives approval with respect to payment information from an on-line payment clearing house such as CyberCash™, Visa™, MasterCard™, Paymentec™, etc. Alternately, video system architecture 100 may include its own payment handling system.

In a step 720, once payment approval is received, video system architecture 100 writes production interface information onto the storage medium. This step is typically performed with embodiments having a user interface associated with the storage medium, such as with DVDs, etc. The production interface information includes menu information that allows the user to access particular chapters on a DVD or other portions of the video production as would be apparent. Other embodiments of the present invention do not require such production information, e.g. VHS tapes, etc.

In a step 730, video system architecture 100 determines whether the user selected additional licensed video images to be included in the virtual video production. If so, video system architecture 100 writes the additional licensed video images onto the storage medium.

In a step 740, video system architecture 100 writes the personal video images organized into the virtual video production onto the storage medium. In an embodiment where the storage medium is a DVD, video system architecture 100 writes various portions of the virtual video production into chapter files on the DVD as would be apparent. At this point, video system architecture 100 has produced an actual video production of the user's virtual video onto the storage medium that is ready for mailing to the user as discussed below with reference to a step 780.

In a preferred embodiment of the present invention, additional fulfillment steps are performed. These steps are now described. In a step 750, a jacket cover is generated for the actual video production. The jacket cover may then be printed in a step 760 and matched with the storage medium in a step 770 prior to mailing the actual video production to the user in step 780.

FIG. 8 is a flow chart that illustrates the process of generating a jacket cover according to one embodiment of the present invention that uses a DVD as the storage medium. Other jacket covers may be generated for other forms of consumer storage media as will become apparent from reading the following description.

In a step 810, a calculation is performed on the virtual video image to determine the number of minutes included in the content to be written to the DVD. This number is referred to herein as the number of content minutes. In a step 820, the number of content minutes is divided by a predetermined number of thumbnail images to be printed on the jacket cover to determine a frame grab interval.

In a step 830, a still image is pulled from the virtual video production at a rate of one still image per frame grab interval to extract the predetermined number of thumbnail images to be printed on the jacket cover. Preferably, a minimum of one still image is extracted from each chapter of the DVD. Each still image is stored as a thumbnail image in a temporary space for printing.

Once the thumbnail images are stored, the jacket cover is printed in step 760 discussed above with the thumbnail images and the title and dates provided by the user.

In an alternate embodiment of the present invention, the thumbnail images are incorporated into a user interface associated with a DVD (or similar storage medium) to direct the user to various chapters (and thus particular video images) on the DVD.

In one embodiment of the present invention, additional content may be added to the content provided and selected by the user. This additional content may include commercial advertisements, promotional information, or other content provided by the production house. Preferably, this additional content may be written to the storage medium as either an introduction to the user's content or a conclusion to the user's content.

In addition to the various consumer applications described above, the present invention may be extended to a commercial video advertising environment operating over the Internet. Such an environment is generally referred to herein as video commerce or "vCommerce" and is described in further detail below.

In one embodiment, the present invention follows a subscriber-based model. In this model, a consumer preferably subscribes to a shopping service. From time to time, the consumer may select, from a menu associated with the service, products and/or services (hereinafter "offerings") in which the consumer is interested in purchasing. Based on these selections, the present invention delivers to the consumer a link to a video advertisement or advertisement corresponding to at least one of the offerings. After receiving the link, the consumer may click on the link or otherwise activate the video advertisement. In one embodiment, the sponsor of the ad hosts the video advertisement from its own website. In another embodiment, an organizer and distributor of such video advertisements such as iFrame Video, Inc., Reston, Virginia, hosts the video advertisement.

In addition, the link and/or the video advertisement may subsequently direct the consumer to an appropriate site where the present invention presents the consumer with an opportunity to purchase the offering or to receive further information regarding the offering. Such a site may include a "bricks and mortar" site, a conventional e- commerce site, or preferably a vCommerce site.

In one embodiment of the present invention, various incentives may be made to subscribers that purchase offerings through the present invention. Such incentives may include special discounts or other offers as would be apparent. In some embodiments of the present invention, these incentives may be redeemed using a coupon or similar device. In other embodiments, particularly those employing e-commerce or vCommerce transactions, purchase transactions may be tagged as having originated via an appropriate e-commerce or vCommerce website. In addition to its use as a coupon, this tagging may be used to provide the consumer with special pricing or incentives on the website or access to websites or portions of websites reserved for preferred customers.

The present invention is now described with reference to FIGS. 9-15. FIG. 9 illustrates a typical web portal 900 with a portal shopping service 910 associated therewith. As illustrated, one such example of web portal 900 is My Yahoo!™, which is accessible at http:Wwww.my.yahoo.com. Similarly, one example of portal shopping service 910 is Yahoo! Shopping, which is accessible at http:Wshopping.yahoo.com. Other web portals 900 or portal shopping services 910 may be used as would be apparent.

When portal shopping service 910 is accessed, the present invention provides the consumer with an opportunity to subscribe to a vCommerce shopping service 1010 as illustrated in FIG. 10. When the consumer subscribes to vCommerce shopping service 1010, the present invention provides the consumer with a profile 1 1 10 as illustrated in FIG. 1 1. Profile 1 110 includes one or more offering categories or other offering indicia 1 120 (illustrated in FIG. 1 1 as exemplary offering categories 1 120A-D) that the consumer may select. The consumer may select one or more offering categories 1120 about which the consumer may be interested in receiving advertising or other information.

Once the consumer subscribes to vCommerce shopping service 1010, the present invention periodically provides the consumer with one or more video advertisements. As illustrated in FIG. 12, in a preferred embodiment of the present invention, the video advertisement is delivered to a desktop tray 1220 on a desktop 1210 such as are available, for example, with Microsoft Windows™. In one embodiment of the present invention, rather than deliver the video advertisement directly to desktop 1210, a graphical link to the video advertisement is delivered to desktop 1210. This link is preferably accessed by a video tool icon 1230 that is preferably located in desktop tray 1220.

Upon selecting video tool icon 1230, the present invention provides the consumer with one or more links 1320 to video advertisements (illustrated in FIG. 13 as links 1320A-D). These links 1320 may be organized into one or more link categories 1310 (illustrated as link categories 1310A-C) associated with offering categories 1120 that the consumer selected in profile 1 110. As illustrated in FIG. 13, the consumer is presented with four links 1320 to video advertisements associated with various golf-related offerings. The consumer may select one of links 1320 in order to view the associated video advertisement. In a preferred embodiment of the present invention, once the consumer selects one of links 1320, the video advertisement is delivered to the consumer desktop in a streaming or burst manner. Preferably, the delivery is optimized according to other aspects of the present invention as described above. Once delivered, as illustrated in FIG. 14, an appropriate media player 1410 plays a video advertisement 1420.

After video advertisement 1420 has been played, the present invention may provide the consumer with an opportunity to purchase the offering associated with video advertisement 1420. In one embodiment of the present invention, after video advertisement 1420 has been played, the present invention automatically directs the consumer to a website where the offering may be purchased via an e-commerce or vCommerce transaction. In an alternate embodiment of the present invention, the present invention may provide the consumer with various links selectable by the consumer to websites where the offering may be purchased. FIG. 15 illustrates a website 1510 where the offering associated with video advertisement 1420 may be purchased. In yet another alternate embodiment, the present invention may direct the consumer to one or more preferred "bricks and mortar" sites where the offering may be purchased.

FIG. 16 illustrates an operation of the present invention according to one embodiment. In a step 1610 a consumer establishes a profile on portal shopping service 910. In a step 1620, the consumer elects to participate in vCommerce shopping service 1010. In a step 1630, the consumer selects one or more offering categories 1 120 from profile 1 1 10 for which the consumer would like to receive information and/or advertising. In a step 1640, links 1320 to video advertisements 1420 are delivered to the consumer, preferably to vCommerce tool icon 1230 in desktop tray 1220 based on the consumer selected offering categories 1 120.

In a step 1650, the consumer selects a particular link 1320 to a video advertisement 1420 for an offering in which the consumer is interested. In a step 1660, video advertisement 1420 is delivered to desktop 1210 for viewing by the consumer. In a preferred embodiment of the present invention, after viewing video advertisement 1420, the consumer, in a step 1670, is directed to a site where they may learn more about the offering and/or purchase the offering.

While the invention has been described in detail and with reference to specific embodiments thereof, it will be apparent to one skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope thereof. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims

What is claimed is:

1. A method for storing video images in a networked environment comprising: receiving a video image from a first client at a video server, said first client remote from said video server; storing said video image on said video server; providing a second client with a video editor to edit said video image, said second client remote from said video server; and providing said edited video image to a third client for viewing, said third client remote from said video server.

2. The method of claim 1, wherein said first client is remote from said second client.

3. The method of claim 1, wherein said first client is remote from said third client.

4. The method of claim 1, wherein said video image is captured on a video capture device.

5. The method of claim 4, wherein said video image is captured on a digital capture device.

6. The method of claim 4, wherein said video image is captured on an analog capture device.

7. The method of claim 1, wherein said providing comprises providing said second client with a nonlinear video editor to edit said video image.

8. The method of claim 1 , further comprising storing said edited video image on a videotape.

9. The method of claim 8, wherein said storing said edited video image on a videotape comprises storing said edited video image on a digital video disc ("DVD").

10. The method of claim 8, wherein said storing said edited video image on a videotape comprises storing said edited video image on a computer storage device.

1 1. The method of claim 1 , wherein said providing said second client with a nonlinear editor to edit said video image comprises allowing said second client to locate a particular frame in said video image.

12. The method of claim 1 1 , wherein said providing said second client with a nonlinear editor to edit said video image comprises allowing said second client to create a still image from said located particular frame.

13. The method of claim 12, further comprising printing said still image.

14. The method of claim 1, further comprising sending said edited video image to said third party via a network.

15. The method of claim 1, further comprising sending a link to said edited video image via a network.

16. A method for purchasing a consumer storage media having a personal video image recorded thereon comprising: selecting a personal video image to be recorded on a storage medium; and requesting production of said personal video image onto said storage medium.

17. The method of claim 16, further comprising providing payment information for said production of said storage medium.

18. The method of claim 16, wherein said requesting production of said personal video image on said storage medium comprises requesting production of said person video image on a digital versatile disc.

19. A method for purchasing a storage medium having a plurality of personal video images recorded thereon comprising: selecting a first personal video image; selecting a second personal video image; organizing said first and said second personal video images into a virtual video production; and requesting production of said virtual video production into an actual video production on a storage medium.

20. The method of claim 19, further comprising providing payment information for said actual video production.

21. The method of claim 19, wherein said requesting production of said virtual video production comprises requesting production of said virtual video production into an actual video production on a digital versatile disc.

22. The method of claim 19, further comprising selecting a licensed video image to be included in said virtual video production.

23. A method for providing a user with storage medium having at least one personal video image stored thereon, the method comprising: receiving a first personal video image selection from the user; receiving a second personal video image selection from the user; organizing said first and said second personal video image selections into a virtual video production as directed by the user; and receiving a request from the user to write said virtual video production as an actual video production on a storage medium.

24. The method of claim 23, further comprising receiving payment information for said actual video production.

25. The method of claim 24, wherein said receiving payment information comprises receiving payment approval for the user from a payment clearinghouse.

26. The method of claim 24, wherein said receiving payment information comprises receiving payment information from the user.

27. The method of clam 23, wherein said receiving a request from the user to produce said virtual video production comprises receiving a request from the user to produce said virtual video production into said actual video production on a digital versatile disc.

28. The method of claim 23, further comprising writing said virtual video production onto said computer storage medium.

29. The method of claim 23, further comprising receiving a selection for a licensed video image from the user to be included in said virtual video production.

30. The method of claim 23, further comprising generating a user interface associated with said storage medium, said user interface including at least one still image from one of said first personal video image selection and said second personal video image selection.

31. A method for delivering a video image from a server to a client comprising: determining a parameter associated with the client; determining an appropriate delivery format based on said parameter; formatting the video image based on said appropriate delivery format; and delivering said formatted video image to the client.

32. The method of claim 31 , wherein said determining a parameter associated with the client comprises determining a bandwidth of a communication link between the server and the client.

33. The method of claim 31, wherein said determining a parameter associated with the client comprises determining a display capability of the client.

34. The method of claim 31, wherein said determining a parameter associated with the client comprises determining a codec used to format the video image.

35. The method of claim 31 , wherein said determining a parameter associated with the client comprises determining a video characteristic of the client.

36. The method of claim 31 , wherein said determining an appropriate delivery format based on said parameter comprises determining an appropriate codec to be used to deliver the video image.

37. The method of claim 31, wherein said determining an appropriate delivery format based on said parameter comprises determining an appropriate frame rate to be used to deliver the video image.

38. The method of claim 31 , wherein said determining an appropriate delivery format based on said parameter comprises determining an appropriate compression rate to be used to deliver the video image.

39. The method of claim 31 , wherein said determining an appropriate delivery format based on said parameter comprises determining an appropriate number of colors to be used to deliver the video image.

40. The method of claim 31 , wherein said determining an appropriate delivery format based on said parameter comprises inferring said appropriate delivery format based on a knowledge base.

41. The method of claim 31 , further comprising maintaining the video image on the server in an original format.

42. A method for delivering a video image from a server to a client comprising: determining a parameter associated with the client; determining an optimal delivery format based on said parameter; formatting the video image based on said optimal delivery format; and delivering said formatted video image to the client.

43. The method of claim 42, wherein said determining an optimal delivery format based on said parameter comprises determining an optimal codec to be used to deliver the video image.

44. The method of claim 42, wherein said determining an optimal delivery format based on said parameter comprises determining an optimal frame rate to be used to deliver the video image.

45. The method of claim 42, wherein said determining an optimal delivery format based on said parameter comprises determining an optimal compression rate to be used to deliver the video image.

46. The method of claim 42, wherein said determining an optimal delivery format based on said parameter comprises determining an optimal number of colors to be used to deliver the video image.

47. The method of claim 42, wherein said determining an optimal delivery format based on said parameter comprises inferring said optimal delivery format based on a knowledge base.

48. A method for dynamically updating a format of a video image stored by a server for delivery to a client, comprising: storing the video image on the server in a first format; determining an optimal format for the video image at a time of delivery; and delivering the video image to the client in the optimal format.

49. The method of claim 48, wherein said determining an optimal format for the video image at a time of delivery further comprises determining an optimal format which maximizes a viewing quality of the video image.

50. The method of claim 48, wherein said determining an optimal format for the video image at a time of delivery further comprises determining an optimal format which minimizes a time needed to download the video image.

51. The method of claim 48, wherein said determining an optimal format for the video image at a time of delivery further comprises determining an optimal format which is a most recent version of a format used when the video image was originally stored on the server.

52. The method of claim 51 , wherein said delivering the video image to the client in the optimal format further comprises re-encoding the first format into the optimal format at the time of delivery.

53. The method of claim 48, where said delivering the video image to the client in the optimal format comprises re-encoding the first format into the optimal format at the time of delivery, during a time that the video image is read from the server.

54. The method of claim 48, wherein said storing the video image on the server in a first format further comprises storing an additional version of the video image using an optimal format at the time of storing.

55. A method for dynamically updating a streaming format of a video image which is stored by a server for delivery to a client, comprising the steps of: determining a need for delivery of the video image to the client; determining an optimal streaming format for the video image which exists at a time when the need for delivery has been determined; re-formatting a portion of the video image according to the optimal streaming format; and delivering the re-formatted portion of the video image to the client.

56. The method of claim 55, wherein said determining an optimal streaming format for the video image comprises determining an optimal streaming format which maximizes a viewing quality of the video image.

57. The method of claim 55, wherein said determining an optimal streaming format for the video image further comprises determining an optimal streaming format which minimizes a time needed to download the video image.

58. The method of claim 55, wherein said determining an optimal streaming format for the video image comprises determining an optimal format which is a most recent version of a streaming format used to format the video image when the video image was originally stored on the server.

59. A system for dynamically updating a format of a video image, comprising: a server which receives the video image from a video capture device and stores the video image for delivery to a client; and a network download device which receives the video image from the server for viewing by the client, wherein the server formats the video image in an optimal format at the time of delivery to the client.

60. The system of claim 59, wherein the server formats portions of the video image in the optimal format at the time of delivery, and delivers the optimally-formatted portions while any remaining portions of the video image are being formatted.

61. The system of claim 59, wherein the server determines the optimal format at the time of delivery by choosing a format which maximizes a viewing quality of the video image.

62. The system of claim 59, wherein the optimal format is one which minimizes a time needed to download the video image from the server to the client.

63. The system of claim 59, wherein the server determines the optimal format at the time of delivery by choosing a format which is a most recent version of a format used when the video image was originally stored on the server.

64. The system of claim 59, wherein the server additionally stores an additional version of the video image using an optimal format at the time of reception from the video capture device.

65. A method for advertising to a consumer comprising: obtaining a profile associated with the consumer; providing a link to a video advertisement based on said profile; and facilitating delivery of said video advertisement to the consumer after the consumer selects said link.

66. The method of claim 65, further comprising providing the consumer with an identification of a site where the consumer may purchase an offering associated with said video advertisement.

67. The method of claim 65, further comprising providing the consumer with an identification of a site where the consumer may find additional information about an offering associated with said video advertisement.

68. The method of claim 65, wherein said facilitating electronic delivery of said video advertisement comprises delivering said video advertisement to a desktop associated with the consumer.

69. The method of claim 65, wherein said facilitating electronic delivery of said video advertisement comprises directing a third party to deliver said video advertisement to a computer associated with the consumer.

70. The method of claim 65, wherein said facilitating electronic delivery of said video advertisement comprises directing the consumer to a third party that delivers said video advertisement to a computer associated with the consumer.

71. The method of claim 65, further comprising providing the consumer with an incentive to purchase said offering.

72. The method of claim 71 , wherein said providing the consumer with an incentive comprises electronically identifying the consumer as having viewed said video advertisement.