WO2009065424A1 - Light-driven music - Google Patents

Light-driven music Download PDF

Info

Publication number
WO2009065424A1
WO2009065424A1 PCT/EP2007/010115 EP2007010115W WO2009065424A1 WO 2009065424 A1 WO2009065424 A1 WO 2009065424A1 EP 2007010115 W EP2007010115 W EP 2007010115W WO 2009065424 A1 WO2009065424 A1 WO 2009065424A1
Authority
WO
WIPO (PCT)
Prior art keywords
time
varying
parameters
light
measurement
Prior art date
Application number
PCT/EP2007/010115
Other languages
French (fr)
Inventor
Jakke Mäkelä
Niko Santeri Porjo
Original Assignee
Nokia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation filed Critical Nokia Corporation
Priority to PCT/EP2007/010115 priority Critical patent/WO2009065424A1/en
Publication of WO2009065424A1 publication Critical patent/WO2009065424A1/en

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/02—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
    • G10H1/04—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation
    • G10H1/053—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only
    • G10H1/055—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only by switches with variable impedance elements
    • G10H1/0553—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only by switches with variable impedance elements using optical or light-responsive means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Definitions

  • Embodiments of the present invention relate to light-driven music.
  • Music is at present important to users of apparatus. They may, for example, select one apparatus over another because it has better bass output or the ability to play MP3 music files.
  • a method comprising: processing multiple time-varying light measurement values to determine at least two time-varying parameters; and converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
  • a processor-readable medium tangibly encoded with a computer program comprising computer program instructions which when read by the processor enable the processor to: process multiple time-varying light measurement values to determine at least two time-varying parameters; and convert the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
  • an apparatus comprising: light sensors configured to provide time-varying light measurement values; means for processing multiple time-varying light measurement values to determine at least two time-varying parameters; and means for converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
  • a method of generating music comprising: providing a changing distribution of multi- colored light to a plurality of light sensors; converting the changing output of the sensors to a multi-tonal musical output.
  • a processor-readable medium tangibly encoded with a computer program comprising: means for processing multiple time-varying light measurement values to determine at least two time-varying parameters; and means for converting the at least two time-varying parameters into at least one time- varying signal for producing time-varying music.
  • the user can control musical output.
  • Fig. 1 schematically illustrates an apparatus that is operable as a light- sensor driven musical instrument
  • Fig 2 schematically illustrates a process performed by the processor
  • Fig. 3 illustrates an alternative embodiment
  • Fig 4 illustrates a continuous function F converting a measurement vector into a musical vector
  • Figs 5A, 5B and 5C illustrate time evolution of a measurement vector.
  • Fig. 1 schematically illustrates an apparatus 1 that is operable as a light- sensor driven musical instrument.
  • the apparatus 1 may be a dedicated instrument or it may be an apparatus that has multiple functions.
  • the apparatus 1 may be a hand-portable electronic device such as, for example, a mobile cellular telephone, personal digital assistant or personal music player.
  • the apparatus may be a fixed, stationary or mobile consumer device.
  • the apparatus 1 has a plurality of light sensors 2.
  • the sensors 2 may be dedicated to the purpose of music production or may be used for multiple purposes including music production.
  • the light sensors may, in some embodiments, be part of a digital camera.
  • Each sensor 2 has a measurement channel 3 over which a time-varying measurement output signal is transmitted by the respective sensor 2.
  • a sensor 2 may be any suitable type of light sensor. It may be, for example, a Charge coupled device (CCD) sensor or a complimentary metal oxide semiconductor (CMOS) sensor.
  • CCD Charge coupled device
  • CMOS complimentary metal oxide semiconductor
  • Each sensor typically measures a spectrum of electromagnetic radiation.
  • the spectrum may be determined by the operational characteristics of the sensor itself or by the use of chromatic filters or prisms.
  • the spectrum may be wholly within the visible spectrum or may be in the invisible ultraviolet or infrared light spectrums.
  • a sensor may measure the intensity of red (R) light, green (G) light, or blue (B) light or even be a clear channel sensor (C) which measures overall intensity across the visible light spectrum.
  • R red
  • G green
  • B blue
  • C clear channel sensor
  • the time- varying output signals are dependent upon the intensity of light measured by a sensor.
  • some or all of the sensors may have integrated op- amp differentiators such that the time-varying output signal is a time derivative of the intensity of light measured by the sensor.
  • the measurement channel 3 of a sensor may be distinguished from the other measurement channels by the measurement spectrum of the associated sensor and, possibly, the associated sensor's location.
  • the measurement channels 3 of the light sensors 2 in this example are input to a processor 4.
  • the processor 4 is connected to read from and write to a memory 6 and to provide a time-varying output signal 14 to an audio output device 10 for producing time-varying multi-tonal music.
  • the operation of the processor 4 is controlled by a computer program 8 stored (tangibly encoded) in the processor-readable memory 6.
  • the computer program 8 has computer program instructions that control the operation of the apparatus 1 when loaded into the processor 4.
  • the computer program instructions provide the logic and routines that enables the electronic device to perform the method illustrated in Fig 2.
  • the computer program instructions may arrive at the apparatus 1 via an electromagnetic carrier signal or be copied from a processor-readable physical entity 11 such as a computer program product, a memory device or a record medium such as a CD-ROM or DVD.
  • the apparatus 1 may propagate or transmit the computer program 8 as a computer data signal.
  • Fig 2 schematically illustrates a process performed by the processor 2.
  • the processor processes multiple time-varying light measurement values received via the channels 3 to determine at least two time-varying parameters, such as components of a measurement vector.
  • the time-varying output measurements from the sensors 2 will, if necessary be converted from analogue to digital.
  • the measurements may need pre- processing to convert the measurements to a particular color space (e.g. RGB, YUV).
  • the time-varying measurement vector may be stored in memory 6.
  • the processor 4 converts the time-varying measurement vector into a time-varying musical vector 14 for producing time-varying multi-tonal music.
  • the processor 4 is used to associate different measurement vectors M and/or transformations of the measurement vector with different musical vectors.
  • a user of the apparatus 1 may be able to edit the associations and thereby control the musical output.
  • a continuous function F may be used to convert the measurement vector into the musical vector X as illustrated schematically in Fig 4:
  • X ⁇ l fa , fo, .... ⁇ is a musical vector that defines an intensity (amplitude) at different audible frequencies (pitches) fa, fb, ....
  • the musical vector X may be stored in memory 6 and/or output as a time- varying output signal 14 to the audio output device 10.
  • the audio device 10 may be a synthesizer for producing time-varying multi- tonal music or music data such as MIDI messages.
  • Figs 5A, 5B and 5C illustrate the time evolution of a measurement vector M.
  • the measurement vector has three components (channels) labeled 1 , 2 and 3 along the x-axis.
  • the three components are for three different color channels Red, Green, Blue at the same location.
  • the magnitude of the respective components is labeled on the y-axis.
  • the measurement vector is ⁇ 01 , 10, 01 ⁇ .
  • the measurement vector is ⁇ 10, 11 , 00 ⁇ .
  • the measurement vector is ⁇ 11 , 01 , 01 ⁇ .
  • the measurement vector M is converted to a musical vector X which has three components for each of three different pitches f1 , f2, f3.
  • the musical vectors are respectively ⁇ 4,8,4 ⁇ , ⁇ 10,15,0 ⁇ , ⁇ 15,5,5 ⁇ .
  • a component m is dependent upon how the time-varying signal values are distributed across the multiple measurement channels and in particular upon a magnitude of the time-varying signal value for the ith channel.
  • a component x is in this example also dependent upon how the time-varying signal values are distributed across the multiple measurement channels and upon the total intensity across all channels.
  • the measurement vector M is converted to a musical vector X which has three components for each of three different pitches f1 , f2, f 3
  • the magnitude of the ith component of the measurement vector m corresponds to the magnitude of the ith component of the musical vector x, according the following continuous function:
  • ⁇ m, (tn) - m, (tn-1) ⁇ is set to 0 if less than 0.
  • the musical vectors are respectively ⁇ 2, 3, 0 ⁇ and ⁇ 3, 0, 1 ⁇
  • a component m is dependent upon how the time-varying signal values are distributed across the multiple measurement channels and in particular upon a magnitude of the time-varying signal value for the ith channel.
  • a component Xj is in this example also dependent upon how the distribution of time-varying signal values across the multiple measurement channels changes in time.
  • the musical vector is dependent upon the rate of change of the measurement vector.
  • Fig. 3 illustrates an alternative embodiment. This embodiment also performs the process illustrated in Fig 2.
  • a pitch parameter 12A is a continuously variable signal that controls musical pitch and an intensity parameter 12B is a continuously variable signal that controls musical intensity.
  • the pitch parameter 12A is typically dependent upon how the time-varying signal values are distributed across the multiple measurement channels.
  • the intensity parameter 12B is typically dependent upon how the magnitude of the time-varying signal values.
  • VCO voltage controlled oscillator
  • VCA voltage controlled amplifier
  • the pitch parameter 12A provides a voltage input to the VCO 15 and the output of the VCO 15 is provided as an input to the VCA 16.
  • the intensity parameter 12B from the controller 13 is used as the voltage control signal for the VCA 15.
  • the output of the VCA is the time-varying output signal 14. This may be provided to an audio output device such as a loudspeaker 10 to produce a musical output.
  • each combination may receive its own pitch and intensity parameters and may provide additional independent time- varying output signals 14 which will typically be at a different pitches and intensities and which in combination produce time-varying multi-tonal music at the audio output device 10.
  • the apparatus 1 may be used to produce music by placing the apparatus 1 adjacent a multi-colored surface. As the apparatus 1 is drawn by a user over the surface, the distribution of colors at the portion of the multi-colored surface adjacent the sensors 2 of the apparatus 1 varies. The distribution of
  • a change in the color distribution sensed may result in a change in the distribution of intensity across individual tones within the music and a change in the distance of the apparatus from the multi-colored surface may result in a 0 change in the total intensity of the music.
  • Different music may therefore be created by controlling the speed at which the apparatus 1 is drawn over the multi-colored surface and its distance from the multi-colored surface.
  • the music may be generated by moving different-colored objects in front of the sensors while the apparatus is 5 stationary.
  • the apparatus 1 does not need to determine actual colors it need only translate changes in hues and intensities to changes in music. Changes in distribution of sensed hues may predominantly or 0 exclusive affect the distribution of tones within the output music. Changes in intensity may predominantly or exclusive affect the musical intensity.
  • the blocks illustrated in Fig 2 may represent steps in a method and/or sections of code in the computer program 8.

Abstract

A method including: processing multiple time-varying light measurement values to determine at least two time-varying parameters; and converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.

Description

TITLE Light-driven music
FIELD OF THE INVENTION
Embodiments of the present invention relate to light-driven music.
BACKGROUND TO THE INVENTION
Music is at present important to users of apparatus. They may, for example, select one apparatus over another because it has better bass output or the ability to play MP3 music files.
It would be desirable to enable creation of music by a user of an apparatus in a way that is intuitive and fun and does not require formal music training.
BRIEF DESCRIPTION OF VARIOUS EMBODIMENTS OF THE INVENTION
According to various embodiments of the invention there is provided a method comprising: processing multiple time-varying light measurement values to determine at least two time-varying parameters; and converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
According to various embodiments of the invention there is provided a processor-readable medium tangibly encoded with a computer program comprising computer program instructions which when read by the processor enable the processor to: process multiple time-varying light measurement values to determine at least two time-varying parameters; and convert the at least two time-varying parameters into at least one time-varying signal for producing time-varying music. According to various embodiments of the invention there is provided an apparatus comprising: light sensors configured to provide time-varying light measurement values; means for processing multiple time-varying light measurement values to determine at least two time-varying parameters; and means for converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
According to various embodiments of the invention there is provided a method of generating music comprising: providing a changing distribution of multi- colored light to a plurality of light sensors; converting the changing output of the sensors to a multi-tonal musical output.
According to various embodiments of the invention there is provided a processor-readable medium tangibly encoded with a computer program comprising: means for processing multiple time-varying light measurement values to determine at least two time-varying parameters; and means for converting the at least two time-varying parameters into at least one time- varying signal for producing time-varying music.
By controlling the sensors exposure to light by for example controlling the distribution of intensities of color hues sensed, the user can control musical output.
BRIEF DESCRIPTION OF THE DRAWINGS
For a better understanding of various embodiments of the present invention reference will now be made by way of example only to the accompanying drawings in which:
Fig. 1 schematically illustrates an apparatus that is operable as a light- sensor driven musical instrument;
Fig 2 schematically illustrates a process performed by the processor;
Fig. 3 illustrates an alternative embodiment; Fig 4 illustrates a continuous function F converting a measurement vector into a musical vector;
Figs 5A, 5B and 5C illustrate time evolution of a measurement vector.
DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS OF THE INVENTION
Fig. 1 schematically illustrates an apparatus 1 that is operable as a light- sensor driven musical instrument. The apparatus 1 may be a dedicated instrument or it may be an apparatus that has multiple functions. As an example, the apparatus 1 may be a hand-portable electronic device such as, for example, a mobile cellular telephone, personal digital assistant or personal music player. As another example the apparatus may be a fixed, stationary or mobile consumer device.
The apparatus 1 has a plurality of light sensors 2. The sensors 2 may be dedicated to the purpose of music production or may be used for multiple purposes including music production. As an example, the light sensors may, in some embodiments, be part of a digital camera.
Each sensor 2 has a measurement channel 3 over which a time-varying measurement output signal is transmitted by the respective sensor 2.
A sensor 2 may be any suitable type of light sensor. It may be, for example, a Charge coupled device (CCD) sensor or a complimentary metal oxide semiconductor (CMOS) sensor.
Each sensor typically measures a spectrum of electromagnetic radiation. The spectrum may be determined by the operational characteristics of the sensor itself or by the use of chromatic filters or prisms. The spectrum may be wholly within the visible spectrum or may be in the invisible ultraviolet or infrared light spectrums. As an example a sensor may measure the intensity of red (R) light, green (G) light, or blue (B) light or even be a clear channel sensor (C) which measures overall intensity across the visible light spectrum. In this example, the time- varying output signals are dependent upon the intensity of light measured by a sensor.
In some embodiments, some or all of the sensors may have integrated op- amp differentiators such that the time-varying output signal is a time derivative of the intensity of light measured by the sensor.
It should be appreciated that some of the sensors may be housed or integrated adjacent one another in the same component device. It should also be appreciated that some of the sensors may be located in different locations of the apparatus 1. The measurement channel 3 of a sensor may be distinguished from the other measurement channels by the measurement spectrum of the associated sensor and, possibly, the associated sensor's location.
The measurement channels 3 of the light sensors 2 in this example are input to a processor 4. The processor 4 is connected to read from and write to a memory 6 and to provide a time-varying output signal 14 to an audio output device 10 for producing time-varying multi-tonal music.
The operation of the processor 4 is controlled by a computer program 8 stored (tangibly encoded) in the processor-readable memory 6.
The computer program 8 has computer program instructions that control the operation of the apparatus 1 when loaded into the processor 4. The computer program instructions provide the logic and routines that enables the electronic device to perform the method illustrated in Fig 2. The computer program instructions may arrive at the apparatus 1 via an electromagnetic carrier signal or be copied from a processor-readable physical entity 11 such as a computer program product, a memory device or a record medium such as a CD-ROM or DVD. The apparatus 1 may propagate or transmit the computer program 8 as a computer data signal.
Fig 2 schematically illustrates a process performed by the processor 2.
At block 5, the processor processes multiple time-varying light measurement values received via the channels 3 to determine at least two time-varying parameters, such as components of a measurement vector.
The time-varying output measurements from the sensors 2 will, if necessary be converted from analogue to digital. The measurements may need pre- processing to convert the measurements to a particular color space (e.g. RGB, YUV). The sensor measurements, with or without pre-processing, are processed to create a time-varying measurement vector M(t)= {li(t), ^(t), I3(t)..} where ln(t) is the time-varying measurement value for channel n. This process includes correctly ordering the time-varying measurement values and, perhaps, quantizing those values.
The time-varying measurement vector may be stored in memory 6.
At block 7, the processor 4 converts the time-varying measurement vector into a time-varying musical vector 14 for producing time-varying multi-tonal music.
The processor 4 is used to associate different measurement vectors M and/or transformations of the measurement vector with different musical vectors.
A user of the apparatus 1 may be able to edit the associations and thereby control the musical output. A continuous function F may be used to convert the measurement vector into the musical vector X as illustrated schematically in Fig 4:
X=F(M)
where X{lfa , fo, ....} is a musical vector that defines an intensity (amplitude) at different audible frequencies (pitches) fa, fb, ....
The musical vector X may be stored in memory 6 and/or output as a time- varying output signal 14 to the audio output device 10.
The audio device 10 may be a synthesizer for producing time-varying multi- tonal music or music data such as MIDI messages.
Figs 5A, 5B and 5C illustrate the time evolution of a measurement vector M. In this simplified example, the measurement vector has three components (channels) labeled 1 , 2 and 3 along the x-axis. In this particular example, the three components are for three different color channels Red, Green, Blue at the same location. The magnitude of the respective components is labeled on the y-axis.
In Fig 5A, at time T1 , the measurement vector is {01 , 10, 01 }. In Fig 5B, at time T2, the measurement vector is {10, 11 , 00}. In Fig 5C, at time T3, the measurement vector is {11 , 01 , 01}.
In one illustrative embodiment, the measurement vector M is converted to a musical vector X which has three components for each of three different pitches f1 , f2, f3.
The magnitude of the ith component of the measurement vector nrij corresponds to the magnitude of the ith component of the musical vector Xj according the following continuous function: X, = m, * Σ rτiι
For Figs 5A1 5B and 5C, the musical vectors are respectively {4,8,4}, {10,15,0}, {15,5,5}.
A component m, is dependent upon how the time-varying signal values are distributed across the multiple measurement channels and in particular upon a magnitude of the time-varying signal value for the ith channel.
A component x, is in this example also dependent upon how the time-varying signal values are distributed across the multiple measurement channels and upon the total intensity across all channels.
In a different illustrative embodiment, the measurement vector M is converted to a musical vector X which has three components for each of three different pitches f1 , f2, f 3
The magnitude of the ith component of the measurement vector m, corresponds to the magnitude of the ith component of the musical vector x, according the following continuous function:
x, (tn) = { m, (tn) - m, (tn-1) } * m, (tn)
where { m, (tn) - m, (tn-1) } is set to 0 if less than 0.
For Figs 5B and 5C, the musical vectors are respectively {2, 3, 0} and {3, 0, 1}
A component m, is dependent upon how the time-varying signal values are distributed across the multiple measurement channels and in particular upon a magnitude of the time-varying signal value for the ith channel. A component Xj is in this example also dependent upon how the distribution of time-varying signal values across the multiple measurement channels changes in time.
The musical vector is dependent upon the rate of change of the measurement vector.
Fig. 3 illustrates an alternative embodiment. This embodiment also performs the process illustrated in Fig 2.
At block 5, multiple time-varying light measurement values received via the channels 3 at controller 13 are used to determine at least two time-varying parameters 12A, 12B. A pitch parameter 12A is a continuously variable signal that controls musical pitch and an intensity parameter 12B is a continuously variable signal that controls musical intensity.
The pitch parameter 12A is typically dependent upon how the time-varying signal values are distributed across the multiple measurement channels. The intensity parameter 12B is typically dependent upon how the magnitude of the time-varying signal values.
At block 7, a cascaded combination of voltage controlled oscillator (VCO) 14 and voltage controlled amplifier (VCA) 16 converts the time-varying pitch parameter 12A and the time-varying intensity parameter 12B into a time- varying output signal 14.
The pitch parameter 12A provides a voltage input to the VCO 15 and the output of the VCO 15 is provided as an input to the VCA 16. The intensity parameter 12B from the controller 13 is used as the voltage control signal for the VCA 15. The output of the VCA is the time-varying output signal 14. This may be provided to an audio output device such as a loudspeaker 10 to produce a musical output.
It should be appreciated that there may be more than one serial connected 5 combination of VCO and VCA. Each combination may receive its own pitch and intensity parameters and may provide additional independent time- varying output signals 14 which will typically be at a different pitches and intensities and which in combination produce time-varying multi-tonal music at the audio output device 10.
I O
The apparatus 1 may be used to produce music by placing the apparatus 1 adjacent a multi-colored surface. As the apparatus 1 is drawn by a user over the surface, the distribution of colors at the portion of the multi-colored surface adjacent the sensors 2 of the apparatus 1 varies. The distribution of
15 measurement values across the measurement channels 3 consequently also varies which in turn result in a variation in the music output by the apparatus 1. A change in the color distribution sensed may result in a change in the distribution of intensity across individual tones within the music and a change in the distance of the apparatus from the multi-colored surface may result in a 0 change in the total intensity of the music. Different music may therefore be created by controlling the speed at which the apparatus 1 is drawn over the multi-colored surface and its distance from the multi-colored surface. In a possible alternate embodiment, the music may be generated by moving different-colored objects in front of the sensors while the apparatus is 5 stationary.
It should be appreciated that the apparatus 1 does not need to determine actual colors it need only translate changes in hues and intensities to changes in music. Changes in distribution of sensed hues may predominantly or 0 exclusive affect the distribution of tones within the output music. Changes in intensity may predominantly or exclusive affect the musical intensity. The blocks illustrated in Fig 2 may represent steps in a method and/or sections of code in the computer program 8.
Although embodiments of the present invention have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the invention as claimed.
Features described in the preceding description may be used in combinations other than the combinations explicitly described.
Whilst endeavoring in the foregoing specification to draw attention to those features of the invention believed to be of particular importance it should be understood that the Applicant claims protection in respect of any patentable feature or combination of features hereinbefore referred to and/or shown in the drawings whether or not particular emphasis has been placed thereon.
I/we claim:

Claims

1. A method comprising
5 processing multiple time-varying light measurement values to determine at least two time-varying parameters; and converting the at least two time-varying parameters into at least one time- varying signal for producing time-varying music.
I O 2. A method as claimed in claim 1 , wherein the time-varying parameters are time-varying components of a multi-component measurement vector.
3. A method as claimed in claim 1 or 2, wherein the time-varying signal is a time-varying multi-component musical vector.
15
4. A method as claimed in claim 3, further comprising associating different measurement vectors with different musical vectors.
5. A method as claimed in claim 3, further comprising associating different 0 transformations between sequentially occurring measurement vectors with different musical vectors.
6. A method as claimed in claim 3, 4 or 5 wherein a continuous function is for used to convert the time-varying parameters into the time-varying signal. 5
7. A method as claimed in any preceding claim wherein the time-varying parameters include a pitch parameter and an intensity parameter.
8. A method as claimed in claim 7, wherein the time-varying signal is an 0 oscillating voltage signal having a frequency controlled by the pitch parameter and an amplitude controlled by the intensity parameter.
9. A method as claimed in any preceding claim wherein a first one of the parameters is dependent upon a distribution of time-varying signal values across the multiple measurement channels.
5
10. A method as claimed in any preceding claim wherein a second one of the parameters is dependent upon a magnitude of at least one time-varying signal value of the multiple measurement channels.
I O 11. A method as claimed in any one of claims 1 to 8, wherein a first one of the components is dependent upon a change in relative distribution of time- varying signal values across the multiple measurement channels.
12. A method as claimed in any one of claims 1 to 8 or claim 11 , wherein a 15 second one of the components is dependent upon at least a change in magnitude of a time-varying signal value of the multiple measurement channels.
13. A method as claimed in any preceding claim, wherein a user can control 0 the conversion of time-varying parameters into a time-varying signal.
14. A processor-readable medium tangibly encoded with a computer program comprising computer program instructions which when read by the processor enable the processor to: 5 process multiple time-varying light measurement values to determine at least two time-varying parameters; and convert the at least two time-varying parameters into at least one time-varying signal for producing time-varying music. 0
15. A processor-readable medium as claimed in claim 14, wherein the time- varying parameters are time-varying components of a measurement vector and the time-varying signal is a time-varying musical vector.
16. A processor-readable medium as claimed in claim 15, that enables association of different measurement vectors with different musical vectors.
17. A processor-readable medium as claimed in claim 15, that enables association of different transformations of the measurement vector with different musical vectors.
18. A processor-readable medium as claimed in claim 16 or 17, that enables user control of the associations.
19. An apparatus comprising: light sensors configured to provide time-varying light measurement values; means for processing multiple time-varying light measurement values to determine at least two time-varying parameters; and means for converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
20. An apparatus as claimed in claim 19 wherein the means for processing and means for converting are provided by a processor.
21. An apparatus as claimed in claim 19, wherein the means for converting comprises a voltage controlled oscillator and a voltage controller amplifier.
22. An apparatus comprising: light sensors configured to provide time-varying light measurement values; circuitry configured to process multiple time-varying light measurement values to determine at least two time-varying parameters and to convert the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
23. A method of generating music comprising: a) providing a changing distribution of multi-colored light to a plurality of light sensors; b) converting the changing output of the sensors to a multi-tonal musical output.
24. A method as claimed in claim 23, wherein the distribution of multi-colored light is provided by the light reflecting from a multi-colored surface and the changing distribution is provided by relative movement between the multi- colored surface and the light sensors.
25. A processor-readable medium tangibly encoded with a computer program comprising: means for processing multiple time-varying light measurement values to determine at least two time-varying parameters; and means for converting the at least two time-varying parameters into at least one time-varying signal for producing time-varying music.
PCT/EP2007/010115 2007-11-22 2007-11-22 Light-driven music WO2009065424A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/EP2007/010115 WO2009065424A1 (en) 2007-11-22 2007-11-22 Light-driven music

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2007/010115 WO2009065424A1 (en) 2007-11-22 2007-11-22 Light-driven music

Publications (1)

Publication Number Publication Date
WO2009065424A1 true WO2009065424A1 (en) 2009-05-28

Family

ID=39684286

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/010115 WO2009065424A1 (en) 2007-11-22 2007-11-22 Light-driven music

Country Status (1)

Country Link
WO (1) WO2009065424A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9281793B2 (en) 2012-05-29 2016-03-08 uSOUNDit Partners, LLC Systems, methods, and apparatus for generating an audio signal based on color values of an image

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1984002416A1 (en) * 1982-12-10 1984-06-21 France Etat Sound generating device
FR2539242A1 (en) * 1983-01-07 1984-07-13 Serrano Jacques Optical control by light variation of a computer controlling a sound synthesiser and an image synthesiser
FR2547093A1 (en) * 1983-06-03 1984-12-07 Girves Jean Electronic musical system
US5310962A (en) * 1987-09-11 1994-05-10 Yamaha Corporation Acoustic control apparatus for controlling music information in response to a video signal
EP1020843A1 (en) * 1996-09-13 2000-07-19 Hitachi, Ltd. Automatic musical composition method
US6388183B1 (en) * 2001-05-07 2002-05-14 Leh Labs, L.L.C. Virtual musical instruments with user selectable and controllable mapping of position input to sound output
US6501012B1 (en) * 1997-12-11 2002-12-31 Roland Corporation Musical apparatus using multiple light beams to control musical tone signals
US20060132714A1 (en) * 2004-12-17 2006-06-22 Nease Joseph L Method and apparatus for image interpretation into sound
WO2007105927A1 (en) * 2006-03-16 2007-09-20 Harmonicolor System Co., Ltd. Method and apparatus for converting image to sound

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1984002416A1 (en) * 1982-12-10 1984-06-21 France Etat Sound generating device
FR2539242A1 (en) * 1983-01-07 1984-07-13 Serrano Jacques Optical control by light variation of a computer controlling a sound synthesiser and an image synthesiser
FR2547093A1 (en) * 1983-06-03 1984-12-07 Girves Jean Electronic musical system
US5310962A (en) * 1987-09-11 1994-05-10 Yamaha Corporation Acoustic control apparatus for controlling music information in response to a video signal
EP1020843A1 (en) * 1996-09-13 2000-07-19 Hitachi, Ltd. Automatic musical composition method
US6501012B1 (en) * 1997-12-11 2002-12-31 Roland Corporation Musical apparatus using multiple light beams to control musical tone signals
US6388183B1 (en) * 2001-05-07 2002-05-14 Leh Labs, L.L.C. Virtual musical instruments with user selectable and controllable mapping of position input to sound output
US20060132714A1 (en) * 2004-12-17 2006-06-22 Nease Joseph L Method and apparatus for image interpretation into sound
WO2007105927A1 (en) * 2006-03-16 2007-09-20 Harmonicolor System Co., Ltd. Method and apparatus for converting image to sound

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9281793B2 (en) 2012-05-29 2016-03-08 uSOUNDit Partners, LLC Systems, methods, and apparatus for generating an audio signal based on color values of an image

Similar Documents

Publication Publication Date Title
US6664460B1 (en) System for customizing musical effects using digital signal processing techniques
JP5081250B2 (en) Command input device and method, media signal user interface display method and implementation thereof, and mix signal processing device and method
CN101702316B (en) Method for converting MIDI music into color information and system thereof
US7812239B2 (en) Music piece processing apparatus and method
US20150078584A1 (en) Live Sound Mixer User Interface
US20150332660A1 (en) Musical Instrument and Method of Controlling the Instrument and Accessories Using Control Surface
US20080160943A1 (en) Method and apparatus to post-process an audio signal
KR100885699B1 (en) Apparatus and method for inputting a key command
US8471679B2 (en) Electronic device including finger movement based musical tone generation and related methods
US9105260B1 (en) Grid-editing of a live-played arpeggio
KR20230052298A (en) Comparative training on music generators
US7767900B2 (en) Mobile communication terminal with light effects editor
US9514728B2 (en) Musical performance apparatus that emits musical performance tones and control tones for controlling an apparatus
WO2009065424A1 (en) Light-driven music
CN111831250B (en) Audio processing method and device, storage medium and electronic equipment
JP2019057889A5 (en)
Turchet et al. Ubiquitous musical activities with smart musical instruments
JP5621136B2 (en) Rhythm pattern generator
JP2015076625A (en) Control apparatus, control method, and program
CN106384603A (en) Music play method and music play device
JP6291168B2 (en) INPUT DEVICE, SOUND DEVICE, INPUT DEVICE CONTROL METHOD, AND PROGRAM
KR20160141070A (en) apparatus for music playing by using image, method for music playing by using image and storage medium for music playing by using image
US20110208332A1 (en) Method for operating an electronic sound generating device and for generating context-dependent musical compositions
JPH10222168A (en) Sound volume controller for electronic musical instrument
US7071403B2 (en) Method of enabling MIDI functions in a portable device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07846731

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07846731

Country of ref document: EP

Kind code of ref document: A1