WO2008117232A2

WO2008117232A2 - Apparatus for creating a multimedia file list

Info

Publication number: WO2008117232A2
Application number: PCT/IB2008/051096
Authority: WO
Inventors: Fabio Vignoli
Original assignee: Koninklijke Philips Electronics N.V.
Priority date: 2007-03-27
Filing date: 2008-03-25
Publication date: 2008-10-02
Also published as: WO2008117232A3

Abstract

Apparatuses (1) for creating lists of multimedia files are provided with memories (2) for storing features of first and second multimedia files defined by first and second codes and with comparators (3) for comparing a characteristic of a third multimedia file with characteristics of the first and second multimedia files and with allocators (4) for, in response to first / second comparison results, allocating the first / second code to the third multimedia file. The list of multimedia files comprises multimedia files defined by same codes. Features may be identifications, titles, names. Multimedia files comprise audio, video, songs, movies. Codes may be classification codes. Characteristics may be tempos, rhythms, timbres, instrumentations, beat strengths. The comparators (3) may comprise calculators (5) for calculating distances between characteristics of the multimedia files. The first and second codes for the first and second multimedia files are generated in response to user actions or search engine actions.

Description

Apparatus for creating a multimedia file list

FIELD OF THE INVENTION

The invention relates to an apparatus for creating a list of multimedia files, to a device comprising the apparatus, to a method for creating a list of multimedia files, to a computer program product for performing the steps of the method and to a medium for storing and comprising the computer program product.

Examples of such an apparatus are processors, and examples of such a device are consumer products and non-consumer products. Examples of such a method are services.

BACKGROUND OF THE INVENTION WO 2005/071569 discloses a creation of a play- list based on artist and song similarities. By using a similarity module, an artist selector selects an artist from a list provided by this similarity module. Thereto, a distance threshold level is set to include distantly similar artists. By using a song selector, a particular song by the selected artist is selected. Thereto, clustering is used for grouping items having similar characteristics. Each item in a collection is associated with a corresponding point in an N-dimensional space.

Attributes of a song determine the corresponding point in the N-dimensional space. This N- dimensional space is partitioned into clusters, and an item is a member of a cluster whose center of gravity is closest to the item.

SUMMARY OF THE INVENTION

It is an object of the invention to provide an apparatus for creating a list of multimedia files in a different way.

Further objects of the invention are to provide a device, to provide a method, to provide a computer program product and to provide a medium for creating a list of multimedia files in a different way.

A first aspect of the invention provides an apparatus for creating a list of multimedia files, the apparatus comprising

- a memory for storing at least a feature of a first multimedia file and for storing at least a feature of a second multimedia file, which first multimedia file is defined by a first code and which second multimedia file is defined by a second code, the first and second multimedia files being different multimedia files and the first and second codes being different codes, a comparator for comparing a characteristic of a third multimedia file with a characteristic of the first multimedia file and with a characteristic of the second multimedia file, and an allocator for, in response to a first comparison result, allocating the first code to the third multimedia file and for, in response to a second comparison result, allocating the second code to the third multimedia file, the first and second comparison results being different comparison results and the list of multimedia files comprising multimedia files defined by a same code.

A memory stores at least a feature of a multimedia file and may further store a further part of a multimedia file or an entire multimedia file. A feature is for example an identification such as a title or a name of the multimedia file. A multimedia file comprises audio and/or video such as a song or a movie. A multimedia file is defined by a code such as a classification code. A comparator compares a characteristic of a not yet classified multimedia file with characteristics of differently classified multimedia files and an allocator classifies the not yet classified multimedia file in response to comparison results.

A first (second, third) multimedia file may be a first (second, third) set of multimedia files, a feature may be a set of features, a first (second) code may be a first (second) set of codes, a characteristic may be a set of characteristics, a first (second) comparison result may be a first (second) set of comparison results, and further multimedia files, further codes and further comparison results are not to be excluded.

According to an embodiment, an apparatus is defined by the list of multimedia files belonging to a group of multimedia files and the first code defining a first sub-group of the group and the second code defining a second sub-group of the group, the first and second sub-groups being different groups. Preferably, a group of multimedia files is classified into different sub-groups of the group.

According to an embodiment, an apparatus is defined by the group of multimedia files being songs from an artist or a band or a composer or an entity and the first and second sub-groups being typical and non-typical songs from the artist or the band or the composer or the entity. Preferably, typical songs, such as common songs, and non-typical songs, such as non-common songs, are different classes of songs of an artist or a band or a composer or an entity. According to an embodiment, an apparatus is defined by the characteristic being at least one of a tempo, a rhythm, a timbre, an instrumentation, a beat strength and a multimedia characteristic.

According to an embodiment, an apparatus is defined by the comparator comprising a calculator for calculating a first distance between the characteristic of the third multimedia file and the characteristic of the first multimedia file and for calculating a second distance between the characteristic of the third multimedia file and the characteristic of the second multimedia file, the first comparison result defining the first distance to be respectively smaller than or equal to the second distance and the second comparison result defining the first distance to be respectively equal to or larger than the second distance. Preferably, distances between characteristics of a not yet classified multimedia file and classified multimedia files are used for classifying the not yet classified multimedia file.

According to an embodiment, an apparatus is defined by the first code being allocated to the first multimedia file and the second code being allocated to the second multimedia file in response to a user action or in response to a search engine action. Via a user action, a user may classify at least first and second multimedia files, after which classification the apparatus may classify a third multimedia file etc. Via a search engine, a search in a local database or in a non-local database or in a global database will result in a search result that may be used for classifying at least first and second multimedia files, after which classification the apparatus may classify a third multimedia file etc.

A second aspect of the invention provides a device comprising the apparatus and further comprising a first port to be coupled to a source and/or further comprising a second port to be coupled to a destination. The source such as a database or an interface to be coupled to a database may form part of the device or not. The destination such as a loudspeaker or a display may form part of the device or not.

A third aspect of the invention provides a method for creating a list of multimedia files, the method comprising the steps of storing at least a feature of a first multimedia file and storing at least a feature of a second multimedia file, which first multimedia file is defined by a first code and which second multimedia file is defined by a second code, the first and second multimedia files being different multimedia files and the first and second codes being different codes, comparing a characteristic of a third multimedia file with a characteristic of the first multimedia file and with a characteristic of the second multimedia file, and in response to a first comparison result, allocating the first code to the third multimedia file and, in response to a second comparison result, allocating the second code to the third multimedia file, the first and second comparison results being different comparison results and the list of multimedia files comprising multimedia files defined by a same code. A fourth aspect of the invention provides a computer program product for performing the steps of the method and a fifth aspect of the invention provides a medium for storing and comprising the computer program product.

Embodiments of the device and the method and the computer program product and the medium correspond with the embodiments of the apparatus. An insight might be, that previous classifications of first and second multimedia files may be used for a future classification of a third multimedia file. A basic idea might be, that first and second multimedia files are to be classified in view of each other and that a third multimedia file is to be classified in view of the classifications of the first and second multimedia files. The invention solves a problem to provide an apparatus for creating a list of multimedia files in a different way. The invention is further advantageous in that, after first and second numbers of multimedia files have been classified into at least two classes in a relatively subjective way (for example via a user action) or in a relatively objective way (for example via a search machine action), a third number of multimedia files can be classified automatically.

These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS In the drawings:

Fig. 1 shows a schematic block diagram of an apparatus according to the invention, and

Fig. 2 shows a schematic block diagram of a device according to the invention comprising an apparatus according to the invention.

DETAILED DESCRIPTION

The apparatus 1 shown schematically in the Fig. 1 for creating a list of multimedia files comprises a memory 2 for storing at least a feature Al of a first multimedia file Bl and for storing at least a feature A2 of a second multimedia file B2. These features Al and A2 are for example stored in a column A of the memory 2. In a column B of the memory 2, for example further parts of the multimedia files or the entire multimedia files Bl and B2 may be stored. In a column C of the memory 2, for example a first code Cl defining the first multimedia file Bl is stored and a second code C2 defining the second multimedia file B2 is stored. In a column D of the memory 2, for example a characteristic Dl of the first multimedia file Bl is stored and a characteristic D2 of the second multimedia file B2 is stored.

The apparatus 1 further comprises a module 10 with a comparator 3 for comparing a characteristic D3 of a third multimedia file B3 with a characteristic Dl of the first multimedia file Bl and with a characteristic D2 of the second multimedia file B2. The module 10 further comprises an allocator 4 for, in response to a first comparison result, allocating the first code Cl (or code value) to the third multimedia file B3 (in other words, in that case, C3 = Cl) and for, in response to a second comparison result, allocating the second code C2 (or code value) to the third multimedia file B3 (in other words, in that case, C3 = C2). The list of multimedia files comprises multimedia files defined by a same code (or code value).

Thereto, the module 10 for example further comprises a controller 6 coupled to the comparator 3 and to the allocator 4 and to a memory interface 7. The memory interface 7 is further coupled to the memory 2 and to a data in/output 9, and the controller 6 is further coupled to a control in/output 8.

A feature is for example an identification such as a title or a name of the multimedia file. A multimedia file comprises audio and/or video such as a song or a movie. A code such as a classification code defines a multimedia file. In this case, the comparator 3 compares a characteristic D3 of a not yet classified multimedia file B3 ("not yet classified" means that C3 has not yet been determined) with characteristics D1,D2 of differently classified multimedia files B1,B2 ("differently classified" means that Cl and C2 have got different values) and the allocator 4 classifies the not yet classified multimedia file B3 in response to comparison results.

Preferably, the list of multimedia files belongs to a group of multimedia files such as songs from an artist or a band or a composer or an entity or such as movies from a director or a producer and the first code defines a first sub-group of the group and the second code defines a second sub-group of the group. The first sub-group for example comprises typical songs for the artist or the band or the composer or the entity or typical movies for the director or the producer and second sub-group for example comprises non-typical songs for the artist or the band or the composer or the entity or non-typical movies for the director or the producer. Typical may be common or usual, and non-typical may be non-common or non-usual.

Preferably, the characteristic is at least one of a tempo, a rhythm, a timbre, an instrumentation, a beat strength and a multimedia characteristic in case the multimedia file is a song. Other characteristics may be defined in case the multimedia file is a movie.

Preferably, the comparator 3 comprises a calculator 5 for calculating a first distance between the characteristic D3 of the third multimedia file B3 and the characteristic Dl of the first multimedia file Bl and for calculating a second distance between the characteristic D3 of the third multimedia file B3 and the characteristic D2 of the second multimedia file B2. The first comparison result may define the first distance to be respectively smaller than or equal to the second distance and the second comparison result may define the first distance to be respectively equal to or larger than the second distance. Preferably, according to a first option, the first code is allocated to the first multimedia file and the second code is allocated to the second multimedia file in response to a user action. In this case, the first and second multimedia files are classified in a relatively subjective way (by letting a user make a selection), and the third multimedia file is then classified automatically by using the classifications of the first and second multimedia files. According to a second option, the first code is allocated to the first multimedia file and the second code is allocated to the second multimedia file in response to a search engine action. In this case, the first and second multimedia files are classified in a relatively objective way (by letting a search engine generate search results that for example indicate per multimedia file a number of web sites that cite this multimedia file), and the third multimedia file is then classified automatically by using the classifications of the first and second multimedia files. Further options are not to be excluded, such as using popularity information (by for example letting a group of users vote) or statistics (by for example retrieving chart statistics or by for example converting commercial results).

The device 11 shown schematically in the Fig. 2 comprises the apparatus 1 and further comprises an input/output interface 12 coupled to the control in/output 8 and to the data in/output 9 of the apparatus 1. The input/output interface 12 is further coupled to a first port 13 that is to be coupled to a source 21 and is further coupled to a second port 14 that is to be coupled to a destination 22. The source 21 may for example comprise a database or an interface to be coupled to a database and will usually be located outside the device 11. Alternatively such a source 21 may form part of the device 11. The destination 22 may for example comprise a loudspeaker or a display and may form part of the device 11 or not.

The comparator 3 may compare characteristics in an analog way or in a digital way and may be realized through hardware or through software or through a mixture of both. The allocator 4 may allocate codes by generating codes in response to comparison results or by converting comparison results into codes and may be realized through hardware or through software or through a mixture of both. The comparator 3 and the allocator 4 may be integrated into the controller 6. The module 10 may be a processor for running software functions for realizing one or more of said comparator 3, allocator 4, calculator 5 and controller 6, whereby the software functions could be stored in the memory 2. The module 10 may alternatively be a processor with dedicated hardware for realizing one or more of said comparator 3, allocator 4, calculator 5 and controller 6, or the module 10 may be dedicated hardware, without having excluded further options.

The memory interface 7 is an embodiment only and may for example be replaced by a bus or a switch. Alternatively, separate data connections and control connections are to be used between the controller 6 and the memory 2. The memory 2 will at least store one feature per multimedia file in the column A and, after being classified, one code per multimedia file in the column C. The memory 2 may further store further parts of the multimedia files or the entire multimedia files in the column B, alternatively these further parts or entire multimedia files may be downloaded and/or retrieved when necessary. The memory 2 may further store characteristics of the multimedia files in the column D, alternatively these characteristics may be downloaded and/or retrieved when necessary. The memory 2 may further store other features, other characteristics and/or other codes per multimedia file, for example in the columns G and H and/or in columns not shown. The content of the rows may be placed in the columns and vice versa. Instead of a memory based on rows and columns, other kinds of memories may be used, such as a memory based on fields and/or tables and/or addresses.

In other words, for example a way to create a play- list of typical / non-typical songs from a specific artist is described. Music augmentation may be employed to obtain one or more lists of most famous (most typical or most common) songs from a specific artists (e.g. songs that are mentioned more frequently on the web) and of least typical (uncommon) or non-typical (non-common) songs. The result is analyzed to extract relevant features (e.g. album names) and each song is analyzed to extract characteristics such as tempo/rhythm, timbre etc. From an overview of the most typical songs, for example a characteristic or classifier is trained to discriminate between typical and non-typical songs. The songs in a collection (e.g. a service with hundreds of thousands of songs) may be analyzed and a flag to discriminate between typical and non-typical songs for each artist can be set. The flag can be used to generate a play- list based on typical songs / non-typical songs at a request of one or more users or as a part of another service.

So, a play-list generation tool is able to create a play-list based on the most or the least typical songs recorded by for example a specific artist. A music download server has available about 1.000.000 songs of many artists (and its corresponding audio). One possible approach, without excluding other approaches, may be the following: 1) By using web searches is possible to create a set S+ of the most frequently mentioned songs of an artist.

2) Information about every song in the set S+ is obtained (e.g. album name, album year, etc). This data can be obtained by cross checking the title of the song with a database of all songs from the specific artist. 3) The audio of the songs in set S+ is analyzed to extract relevant characteristics such as tempo/rhythm, timbre, instrumentation, beat strength.

4) The other music of the artist is also analyzed to extract relevant characteristics.

5) The music in the set S+ is clustered and the other music is also clustered.

6) An algorithm may compute the distances between all clusters in the two groups of clusters. There will be songs close to the typical song clusters and songs more far away from the typical song clusters.

With the following pre-processing a flag can be set in a database to distinguish between typical songs from an artist and non-typical songs from the artist. A user interface may let a user create a play-list by specifying: 1) artists, and 2) typical / non-typical songs from the chosen artists. The system can generate a play-list based on the user requests.

The invention may take advantage of the web to generate a list of most typical songs for an artist. This may give an advantage with respect to a DSP method. The list of web-generated songs contains the most prototypical songs for that artist. To find these songs a simple way could be based on the following: For each song of an artist, search the web for artist + title (of the song), then check the number of pages returned. The songs with the most pages returned may be the most typical for that artist.

In yet other words, to create a play- list of typical / non-typical songs for a specific artist, firstly a first overview is obtained of the most famous songs from an artist (e.g. songs that are mentioned more frequently on the web). Secondly a second overview is obtained of least famous songs. Thirdly the first overview may be analyzed to extract relevant characteristics, e.g. tempo/rhythm, timbre etc. Fourthly the songs in the first overview are clustered and distances between each song of the first and second overviews and the cluster are calculated. Fifthly "typical" songs are close to the cluster, and "non- typical" songs are remote from the cluster. Sixthly a flag "typical" or "non-typical" is set in a song database for each song based on its distance to the cluster. Seventhly the flag may be used to generate a play- list based on typical songs / uncommon songs at the request of the users or as a part of another service. A typical song is for example defined as most frequently retrieved on the web (number of pages returned in a search engine - popularity). Summarizing, apparatuses 1 for creating lists of multimedia files are provided with memories 2 for storing features of first and second multimedia files defined by first and second codes and with comparators 3 for comparing a characteristic of a third multimedia file with characteristics of the first and second multimedia files and with allocators 4 for, in response to first / second comparison results, allocating the first / second code to the third multimedia file. The list of multimedia files comprises multimedia files defined by same codes. Features may be identifications, titles, names. Multimedia files comprise audio, video, songs, movies. Codes may be classification codes. Characteristics may be tempos, rhythms, timbres, instrumentations, beat strengths. The comparators 3 may comprise calculators 5 for calculating distances between characteristics of the multimedia files. The first and second codes for the first and second multimedia files are generated in response to user actions or search engine actions.

While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.

Claims

CLAIMS:

1. An apparatus (1) for creating a list of multimedia files, the apparatus (1) comprising a memory (2) for storing at least a feature of a first multimedia file and for storing at least a feature of a second multimedia file, which first multimedia file is defined by a first code and which second multimedia file is defined by a second code, the first and second multimedia files being different multimedia files and the first and second codes being different codes, a comparator (3) for comparing a characteristic of a third multimedia file with a characteristic of the first multimedia file and with a characteristic of the second multimedia file, and an allocator (4) for, in response to a first comparison result, allocating the first code to the third multimedia file and for, in response to a second comparison result, allocating the second code to the third multimedia file, the first and second comparison results being different comparison results and the list of multimedia files comprising multimedia files defined by a same code.

2. An apparatus (1) as claimed in claim 1, the list of multimedia files belonging to a group of multimedia files and the first code defining a first sub-group of the group and the second code defining a second sub-group of the group, the first and second sub-groups being different groups.

3. An apparatus (1) as claimed in claim 2, the group of multimedia files being songs from an artist or a band or a composer or an entity and the first and second sub-groups being typical and non-typical songs from the artist or the band or the composer or the entity.

4. An apparatus (1) as claimed in claim 1, the characteristic being at least one of a tempo, a rhythm, a timbre, an instrumentation, a beat strength and a multimedia characteristic.

5. An apparatus (1) as claimed in claim 1, the comparator (3) comprising a calculator (5) for calculating a first distance between the characteristic of the third multimedia file and the characteristic of the first multimedia file and for calculating a second distance between the characteristic of the third multimedia file and the characteristic of the second multimedia file, the first comparison result defining the first distance to be respectively smaller than or equal to the second distance and the second comparison result defining the first distance to be respectively equal to or larger than the second distance.

6. An apparatus (1) as claimed in claim 1, the first code being allocated to the first multimedia file and the second code being allocated to the second multimedia file in response to a user action or in response to a search engine action.

7. A device comprising the apparatus (1) as defined in claim 1 and further comprising a first port (13) to be coupled to a source (21) and/or further comprising a second port (14) to be coupled to a destination (22).

8. A method for creating a list of multimedia files, the method comprising the steps of storing at least a feature of a first multimedia file and storing at least a feature of a second multimedia file, which first multimedia file is defined by a first code and which second multimedia file is defined by a second code, the first and second multimedia files being different multimedia files and the first and second codes being different codes, comparing a characteristic of a third multimedia file with a characteristic of the first multimedia file and with a characteristic of the second multimedia file, and - in response to a first comparison result, allocating the first code to the third multimedia file and, in response to a second comparison result, allocating the second code to the third multimedia file, the first and second comparison results being different comparison results and the list of multimedia files comprising multimedia files defined by a same code.

9. A computer program product for performing the steps of the method as claimed in claim 8.

10. A medium for storing and comprising the computer program product as claimed in claim 9.