WO2014029902A1 - Musical puzzle - Google Patents
Musical puzzle Download PDFInfo
- Publication number
- WO2014029902A1 WO2014029902A1 PCT/FI2013/000030 FI2013000030W WO2014029902A1 WO 2014029902 A1 WO2014029902 A1 WO 2014029902A1 FI 2013000030 W FI2013000030 W FI 2013000030W WO 2014029902 A1 WO2014029902 A1 WO 2014029902A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- tiles
- musical piece
- user
- pattern
- route
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B15/00—Teaching music
- G09B15/02—Boards or like means for providing an indication of notes
- G09B15/023—Electrically operated
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
- A63F13/2145—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/814—Musical performances, e.g. by evaluating the player's ability to follow a notation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B15/00—Teaching music
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/45—Controlling the progress of the video game
- A63F13/46—Computing the game score
Definitions
- the invention relates to a method and system for playing musical pieces.
- the playing is a game that engages a user in correctly reproducing the duration of notes to reproduce a melody from a sequence of notes.
- the system disclosed engages a user to reproduce a melody from a sequence of notes by selecting durations for notes.
- the melody becomes recognizable, when the durations are approximately correct.
- the processing system may score the selected durations and provide feedback * to the gamer.
- the device, by which the system is used, can be a tablet, smart phone or similar one.
- successive notes are displayed on a touch screen. They are for example adjoining tiles, which form a pattern.
- the display indicates the pitches of the notes providing the tiles with different codes, such as colors.
- the user moves a finger e.g. by sliding along a specified path, or route, trying to linger longer over notes with a longer duration and pass more quickly over notes with a shorter duration.
- the duration may be quantized to any note fraction, such as an eighth or quarter note.
- the viewing surface can be also a mere display, rather than a touch screen, in which case a stylus or other actuator is used to "touch" the tiles on the display.
- the tiles on the display can be arranged as a closed loop e.g. around the perimeter of the display area, making the path endless that is easily followed without lifting a finger. The next few tiles may become emphasized to guide the user's finger. Following the emphasized path, a user can play the game by sliding a finger from one tile to the next.
- the tiles on the display are shuffled so that the path corresponding to the song is unknown. Instead, the user knows the title of a song, and he/she can try to solve the correct path, or route, by exploring, e.g. on trial and error.
- a rest can be given a duration by lifting the finger.
- reversing the direction of the slide or moving out of the direct path between adjoining tiles can signal a rest.
- the difficulty associated with using multiple fingers to select keys or controls in various positions is alleviated by a control sequence that can be operated with a continuous sliding touch.
- Another advantage of the invention is that a player can produce melodies without having an ability to actually play instruments.
- FIG. 1 presents an example of the system according to the invention as a simplified block diagram
- Fig. 2 illustrates different patterns that can be setup using the tiles, which correspond different notes
- Fig. 3 presents examples of different geometric shapes of the tiles
- Fig. 4 presents different coding schemes that can be used to indicate the musical information attached to tiles.
- Fig. 5 shows examples how color based coding scheme can correspond to different musical notes.
- Fig. 6 shows examples of tile patterns shaped as a matrix
- Fig. 7 shows examples of different routes within matrix pattern.
- Fig. 1 presents an example of the system according to the invention as a simplified block diagram.
- the system comprises a physical device with basic software and an application according to the invention. From the device there is seen only a touch screen 101, user interface 102 based on it and an audio part 103.
- the application 110 comprises a game engine 111, user data 112 and song library 113.
- the game engine 111 evaluates user song recognition, implements game rules and manages game state and play.
- the game engine interacts with an user through the user interface and touch screen and it uses the user data and song library.
- the user data 112 contains, when the system ia used, i.a. the player properties, high scores and different game parameters.
- the song library 113 contains melodies of a plurality of songs, or pieces, which can be played with the system.
- the application 110 comprises an audio engine 114, controlled by the game engine, and an audio library 115.
- the audio engine implements the sound synthesis and outputs the voice signals to the audio part 103 of the device.
- the audio engine also implements the audio playback function.
- the audio library 115 contains e.g. sound effects related to different instruments, which effects the audio engine can use in the synthesis.
- the application 110 is located in the memory of said device.
- Fig.2 shows four examples of patterns consisting of the tiles, as tiles 211, 212, which correspond different notes.
- the pattern 210 forms a rectangular closed loop.
- the pattern is a matrix with four rows and five columns.
- the pattern forms an oval closed loop resembling a running track with two straight portions and two semicircles at the opposite ends.
- Fig. 2d represents a free form pattern. The track turns first sharply to right and then after a straight portion it curves to left continuing in an arbitrary way.
- the intended routes, as route 205 are marked with dashed lines in Figs. 2a to 2d.
- Fig. 3 shows examples of different geometric shapes of the tiles.
- the presented shapes are in order a square, square with rounded corners, trapezoid, parallelogram, polygon, triangle, pentagram, hexagon, diamond, circular trapezoid, circle and ellipse.
- Fig.4 presents different coding schemes, or briefly codes, which can be used to indicate the musical information such as pitch or pitches of notes attached to tiles.
- the codes are based on different colors or fill patterns.
- Fig. 4b the codes are based on different characters and glyphs.
- Fig. 4c the codes are based on different graphical symbols and images. In the examples there are a note, heart and star with five cusps.
- Fig. 4 presents different coding schemes, or briefly codes, which can be used to indicate the musical information such as pitch or pitches of notes attached to tiles.
- the codes are based on different colors or fill patterns.
- Fig. 4b the codes are based on different characters and glyphs.
- Fig. 5 shows examples of the color codes.
- the musical note "C” is coded using some color (here white), musical note "C#", or C sharp, using another color (here vertical hatching) and musical note “D” using a third color (here horizontal hatching) and so one.
- Figure demonstrates an example of mapping between color coded tiles and different notes on a piano keyboard.
- a glyph based coding is also presented. In that case the tiles are simply marked by the symbols C, C# and D.
- Fig. 6 shows examples of matrix pattern with different number of tile rows and tile columns.
- the matrix is lxl, in other words it has only one tile.
- the matrixes 3x3, 4x5 and 5x7 are presented.
- the actual dimensions of a matrix depends naturally on the physical size and dimensions of the used computer display or a touch screen.
- Fig. 7 shows four examples of the hidden routes in a 4x5 matrix 720.
- the routes 705 are shown with dashed lines, in the game situation they are not visible, of course. The player has to find the correct route before the musical piece will be played.
- the game play disclosed produces the technical effect of audibly reproducing a melody that becomes recognizable when the user selects an approximately correct duration for successive notes, optionally including rests (pauses) between notes.
- the user's attention is focused on note duration by controls that reproduce a specified sequence of notes and leave it to the user to progress through the notes with user-selected durations that reveal the corresponding melody.
- particular problems of musical game play are solved.
- the problem of engaging a user with the rhythm of a melody and providing feedback on whether the rhythm is matched by the user's performance can be solved by providing a path of adjoining tiles coded to indicate pitches, notes, frequencies or chords of a melody. Responsive to this display, receiving successive user selections of the adjoining tiles with respective durations, scoring whether the respective durations match the melody, and providing feedback. Wrapping the adjoining tiles around a closed loop can enhance the solution according to the invention, so that tiles that have been selected can be replaced by new tiles. On a touch screen the adjoining tiles can be selected with continuous sliding touch.
- a system for playing musical pieces that includes an audio part, a touch screen and user interface based on it and a control part with a memory and an application.
- the melody of a plurality of musical pieces is in the memory during use of the system.
- the application is arranged to produce on the screen a pattern of adjoining tiles, each tile in the pattern being provided with a code, which corresponds to a sound with at least one defined frequency.
- the application is arranged control the audio part to generate a sound with at least one defined frequency when a tile in the pattern is touched.
- the application is arranged to place tiles in the pattern so that variation in the sound follows the melody of a particular musical piece when a touch of the tiles is moved along a defined route in the pattern.
- the application is arranged to change content of the pattern responsive to a user control so that new content corresponds to a new musical piece.
- system can further include the musical piece being played while being hidden after setting the content of the pattern, and the route being known, in which case the musical piece is to be recognized if the touch is moved along said route.
- the pattern is a matrix
- the route is unknown after setting the content of the matrix and the musical piece to be played is shown, in which case the route producing this musical piece is to be solved by exploring.
- the system can also be further arranged to evaluate whether durations of user touches at the tiles approximately match the musical piece to be recognized and to provide feedback to the user about his/her performance by showing the evaluating result, or score.
- durations of user touches at the tiles approximately match the musical piece to be recognized and to provide feedback to the user about his/her performance by showing the evaluating result, or score.
- Differences in duration can produce better scores (similar durations) and worse scores (different durations). Differences can be calculated as ratios, such as a half note vs. a quarter note is 2: 1. Close may be +/- 10 or 20 or 50 percent. Close may vary through the musical piece, taking into account any variation in tempo as a user plays faster or slower.
- Differences also may be calculated in increments of time, such as a quarter note being .25 seconds and close being +/- .10 or .15 or .20 seconds, regardless of the length of note.
- the parameters chosen for closeness may vary by a selected expertise level.
- the route may form a closed loop, and the application may in that case replace the tiles already touched, from a starting point of the loop, with new tiles during the touch being moved along the route so that the musical piece in question proceeds without discontinuity when passing the starting point point in a second or subsequent turn.
- the system can further include each tile in the pattern being provided with a code, which indicates a pitch of the musical piece in question.
- the adjoining tiles may be arranged on the touch screen to allow a continuous sliding touch of the screen.
- the invention can also be described as a method.
- melodies of a plurality of musical pieces has been stored in a memory.
- the method comprises producing on a touch screen a pattern of adjoining tiles. Each tile in the pattern is provided with a code, which corresponds to a sound with at least one defined frequency. That said sound is generated when a tile is touched. Tiles are placed in the pattern so that variation in said sound follows a melody of a musical piece, when a tiles are touched along a defined route in the pattern. Content of the pattern is changed responsive to a user control so that new content corresponds to a new musical piece
- the musical piece being played can be hidden after setting the content of the pattern, and the route is known, in which case the musical piece is recognized if the touch is moved along said route.
- the pattern can be a matrix and the route can be unknown after setting the content of the matrix and the musical piece to be played, in which case the route producing this musical piece is to be solved by exploring.
- it can also evaluate whether durations of user touches at the tiles match the musical piece to be recognized and providing feedback to the user about his/her performance by showing the evaluating result, or score.
- the method can also include the route forming a closed loop, and further replacing the tiles, from a starting point of the loop, with new tiles during the touch is moved along the route so that the musical piece in question proceeds without discontinuity when passing the starting point. It can further include the adjoining tiles being arranged on the touch screen to allow a continuous sliding touch of the touch screen.
- implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform a method as described above.
- implementations may include a system including memory and one or more processors operable to execute instructions, stored in the memory, to perform a method as described above.
- a system is described that engages a user with a rhythm of a musical piece and provides feedback on whether a user's performance approximately matches the rhythm.
- the system further comprises an audio part, and a processor that controls the touch display and the audio part.
- the processor executes instructions arranged to provide a path of adjoining tiles, to be displayed with code to indicate pitches, notes, chords or frequencies of the musical piece.
- the instructions are further arranged to play the pitches of the musical piece as a user selects the adjoining tiles with respective durations of touches.
- the instructions are further arranged to score whether the respective durations match the musical piece and provide feedback to the user.
- the system can further include instructions that are arranged to display the adjoining tiles on the touch screen in a closed loop and to replace tiles that have been selected with new tiles as the musical piece proceeds. It can also include the adjoining tiles being arranged on the touch screen to allow section with a continuous sliding touch of the touch screen.
- the method can further include a quiz mode allowing user to prove that user has recognized the musical piece in question and providing feedback to the user based on the evidence user has given.
- the user can prove recognition by selecting or supplying words, typed or spoken, that recognize the composer or title of the piece.
- the user also can prove recognition by playing the piece using a keyboard on screen or to a microphone connected to the audio part, for the audio part to recognize.
- implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to constitute a system and methodically perform it as described above.
- the implementations of the technology disclosed can each optionally include one or more of the following features and/or features described in connection with additional systems disclosed.
- the combinations of features disclosed in this application are not individually enumerated and are not repeated with each base set of features. The reader will understand how features identified in this section can readily be combined with other sets of base features identified as implementations.
- the invention relates to a method and system for playing musical pieces.
- the playing is a game that engages a user in correctly reproducing the duration of notes to reproduce a melody from a sequence of notes.
- the system disclosed engages a user to reproduce a melody from a sequence of notes by selecting durations for notes.
- the melody becomes recognizable, when the durations are approximately correct.
- the processing system may score the selected durations and provide feedback to the gamer.
- the device, by which the system is used, can be a tablet, smart phone or similar one.
- successive notes are displayed on a touch screen. They are for example adjoining tiles, which form a pattern.
- the display indicates the pitches of the notes providing the tiles with different codes, such as colors.
- the user moves a finger e.g. by sliding along a specified path, or route, trying to linger longer over notes with a longer duration and pass more quickly over notes with a shorter duration.
- the duration may be quantized to any note fraction, such as an eighth or quarter note.
- the viewing surface can be also a mere display, rather than a touch screen, in which case a stylus or other actuator is used to "touch" the tiles on the display.
- the tiles on the display can be arranged as a closed loop e.g.
Abstract
A method and system for playing musical pieces. The system disclosed engages a user to reproduce a melody from a sequence of notes by selecting durations for notes. The melody becomes recognizable, when the durations are approximately correct. The processing system may score the selected durations and provide feedback to the gamer. The device, by which the system is used, can be a tablet, smart phone or similar one. Successive notes may be displayed on a touch screen. They are for example adjoining tiles (211, 212), which form a pattern (210). The display indicates the pitches of the notes providing the tiles (211, 212) with different codes. Typically the user moves a finger e.g. by sliding along a specified route (205) trying to linger longer over notes with a longer duration and vice versa. The tiles (211, 212) on the display can be arranged as a closed loop making the route (205) endless. The next few tiles (211, 212) may become emphasized to guide the user's finger.
Description
Musical puzzle
The invention relates to a method and system for playing musical pieces. The playing is a game that engages a user in correctly reproducing the duration of notes to reproduce a melody from a sequence of notes. BACKGROUND
There are a variety of music-oriented games, such as Guitar Hero, that challenge a user to hit notes following a pattern displayed. Similarly, there are teaching programs that show what notes a user should play or what keys a user should press. Some of these games and programs use simulated instruments and others use computer displays or touch screens. For example the publications US2010/00356685 and US2008/028680 disclose systems, in which the user follows a symbolic presentation of a musical piece on a display and participates by playing with a touch screen. The system checks, how accurately the user keeps up with the presentation and cores respectively. SUMMARY OF THE INVENTION
The system disclosed engages a user to reproduce a melody from a sequence of notes by selecting durations for notes. The melody becomes recognizable, when the durations are approximately correct. As a game, the processing system may score the selected durations and provide feedback* to the gamer. The device, by which the system is used, can be a tablet, smart phone or similar one.
In one implementation, successive notes are displayed on a touch screen. They are for example adjoining tiles, which form a pattern. The display indicates the pitches of the notes providing the tiles with different codes, such as colors. The user moves a finger e.g. by sliding along a specified path, or route, trying to linger longer over notes with a longer duration and pass more quickly over notes with a shorter duration. In some implementations, the duration may be quantized to any note fraction, such as an eighth or quarter note. The viewing surface can be also a mere display, rather than a touch screen, in which case a stylus or other actuator is used to "touch" the tiles on the display. In one implementation the tiles on the display can be arranged as a closed loop e.g. around the perimeter of the display area, making the path endless that is easily followed without lifting a finger. The next few tiles may become emphasized to guide
the user's finger. Following the emphasized path, a user can play the game by sliding a finger from one tile to the next.
In one implementation the tiles on the display are shuffled so that the path corresponding to the song is unknown. Instead, the user knows the title of a song, and he/she can try to solve the correct path, or route, by exploring, e.g. on trial and error.
In some implementations, a rest (pause) can be given a duration by lifting the finger. In others, reversing the direction of the slide or moving out of the direct path between adjoining tiles can signal a rest. The difficulty associated with using multiple fingers to select keys or controls in various positions is alleviated by a control sequence that can be operated with a continuous sliding touch. Another advantage of the invention is that a player can produce melodies without having an ability to actually play instruments.
BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 presents an example of the system according to the invention as a simplified block diagram,
Fig. 2 illustrates different patterns that can be setup using the tiles, which correspond different notes,
Fig. 3 presents examples of different geometric shapes of the tiles,
Fig. 4 presents different coding schemes that can be used to indicate the musical information attached to tiles.
Fig. 5 shows examples how color based coding scheme can correspond to different musical notes.
Fig. 6 shows examples of tile patterns shaped as a matrix, and
Fig. 7 shows examples of different routes within matrix pattern.
DETAILED DESCRIPTION
Fig. 1 presents an example of the system according to the invention as a simplified block diagram. The system comprises a physical device with basic software and an application according to the invention. From the device there is seen only a touch screen 101, user interface 102 based on it and an audio part 103. The application
110 comprises a game engine 111, user data 112 and song library 113. The game engine 111 evaluates user song recognition, implements game rules and manages game state and play. The game engine interacts with an user through the user interface and touch screen and it uses the user data and song library. The user data 112 contains, when the system ia used, i.a. the player properties, high scores and different game parameters. The song library 113 contains melodies of a plurality of songs, or pieces, which can be played with the system. In addition the application 110 comprises an audio engine 114, controlled by the game engine, and an audio library 115. The audio engine implements the sound synthesis and outputs the voice signals to the audio part 103 of the device. The audio engine also implements the audio playback function. The audio library 115 contains e.g. sound effects related to different instruments, which effects the audio engine can use in the synthesis. Naturally, the application 110 is located in the memory of said device.
Fig.2 shows four examples of patterns consisting of the tiles, as tiles 211, 212, which correspond different notes. In Fig. 2a the pattern 210 forms a rectangular closed loop. In Fig. 2b the pattern is a matrix with four rows and five columns. In Fig. 2c the pattern forms an oval closed loop resembling a running track with two straight portions and two semicircles at the opposite ends. Fig. 2d represents a free form pattern. The track turns first sharply to right and then after a straight portion it curves to left continuing in an arbitrary way. The intended routes, as route 205, are marked with dashed lines in Figs. 2a to 2d.
Fig. 3 shows examples of different geometric shapes of the tiles. The presented shapes are in order a square, square with rounded corners, trapezoid, parallelogram, polygon, triangle, pentagram, hexagon, diamond, circular trapezoid, circle and ellipse. Fig.4 presents different coding schemes, or briefly codes, which can be used to indicate the musical information such as pitch or pitches of notes attached to tiles. In Fig. 4a the codes are based on different colors or fill patterns. In Fig. 4b the codes are based on different characters and glyphs. In Fig. 4c the codes are based on different graphical symbols and images. In the examples there are a note, heart and star with five cusps. Fig. 4d represents different combinations of the above-mentioned codes. One tile 401 has some color and the note-symbol, another tile 402 has some other color and letter F with glyph #. The third tile 403 has a third color and letter C with note-symbol. Generally, any combination of colors, glyphs and other graphical symbols and images can be used to visualize the musical information provided with a tile.
Fig. 5 shows examples of the color codes. In these examples the musical note "C" is coded using some color (here white), musical note "C#", or C sharp, using another color (here vertical hatching) and musical note "D" using a third color (here horizontal hatching) and so one. Figure demonstrates an example of mapping between color coded tiles and different notes on a piano keyboard. As an alternative, a glyph based coding is also presented. In that case the tiles are simply marked by the symbols C, C# and D.
Fig. 6 shows examples of matrix pattern with different number of tile rows and tile columns. In the trivial case 601 the matrix is lxl, in other words it has only one tile. Also the matrixes 3x3, 4x5 and 5x7 are presented. The actual dimensions of a matrix depends naturally on the physical size and dimensions of the used computer display or a touch screen.
Fig. 7 shows four examples of the hidden routes in a 4x5 matrix 720. In the figure the routes 705 are shown with dashed lines, in the game situation they are not visible, of course. The player has to find the correct route before the musical piece will be played.
The game play disclosed produces the technical effect of audibly reproducing a melody that becomes recognizable when the user selects an approximately correct duration for successive notes, optionally including rests (pauses) between notes. The user's attention is focused on note duration by controls that reproduce a specified sequence of notes and leave it to the user to progress through the notes with user-selected durations that reveal the corresponding melody.
In some implementations, particular problems of musical game play are solved. The problem of engaging a user with the rhythm of a melody and providing feedback on whether the rhythm is matched by the user's performance can be solved by providing a path of adjoining tiles coded to indicate pitches, notes, frequencies or chords of a melody. Responsive to this display, receiving successive user selections of the adjoining tiles with respective durations, scoring whether the respective durations match the melody, and providing feedback. Wrapping the adjoining tiles around a closed loop can enhance the solution according to the invention, so that tiles that have been selected can be replaced by new tiles. On a touch screen the adjoining tiles can be selected with continuous sliding touch.
In one implementation, a system is described for playing musical pieces that includes an audio part, a touch screen and user interface based on it and a control part with a
memory and an application. The melody of a plurality of musical pieces is in the memory during use of the system. The application is arranged to produce on the screen a pattern of adjoining tiles, each tile in the pattern being provided with a code, which corresponds to a sound with at least one defined frequency. The application is arranged control the audio part to generate a sound with at least one defined frequency when a tile in the pattern is touched. The application is arranged to place tiles in the pattern so that variation in the sound follows the melody of a particular musical piece when a touch of the tiles is moved along a defined route in the pattern. The application is arranged to change content of the pattern responsive to a user control so that new content corresponds to a new musical piece.
In one embodiment the system can further include the musical piece being played while being hidden after setting the content of the pattern, and the route being known, in which case the musical piece is to be recognized if the touch is moved along said route. In another embodiment of the system the pattern is a matrix, the route is unknown after setting the content of the matrix and the musical piece to be played is shown, in which case the route producing this musical piece is to be solved by exploring.
The system can also be further arranged to evaluate whether durations of user touches at the tiles approximately match the musical piece to be recognized and to provide feedback to the user about his/her performance by showing the evaluating result, or score. By approximately, we mean having a similar duration. Differences in duration can produce better scores (similar durations) and worse scores (different durations). Differences can be calculated as ratios, such as a half note vs. a quarter note is 2: 1. Close may be +/- 10 or 20 or 50 percent. Close may vary through the musical piece, taking into account any variation in tempo as a user plays faster or slower. Differences also may be calculated in increments of time, such as a quarter note being .25 seconds and close being +/- .10 or .15 or .20 seconds, regardless of the length of note. The parameters chosen for closeness may vary by a selected expertise level. The route may form a closed loop, and the application may in that case replace the tiles already touched, from a starting point of the loop, with new tiles during the touch being moved along the route so that the musical piece in question proceeds without discontinuity when passing the starting point point in a second or subsequent turn.
The system can further include each tile in the pattern being provided with a code, which indicates a pitch of the musical piece in question. In addition, the adjoining tiles may be arranged on the touch screen to allow a continuous sliding touch of the screen. The invention can also be described as a method. In the method, melodies of a plurality of musical pieces has been stored in a memory. The method comprises producing on a touch screen a pattern of adjoining tiles. Each tile in the pattern is provided with a code, which corresponds to a sound with at least one defined frequency. That said sound is generated when a tile is touched. Tiles are placed in the pattern so that variation in said sound follows a melody of a musical piece, when a tiles are touched along a defined route in the pattern. Content of the pattern is changed responsive to a user control so that new content corresponds to a new musical piece
According to the method the musical piece being played can be hidden after setting the content of the pattern, and the route is known, in which case the musical piece is recognized if the touch is moved along said route.
According to the method the pattern can be a matrix and the route can be unknown after setting the content of the matrix and the musical piece to be played, in which case the route producing this musical piece is to be solved by exploring. According to the method it can also evaluate whether durations of user touches at the tiles match the musical piece to be recognized and providing feedback to the user about his/her performance by showing the evaluating result, or score.
The method can also include the route forming a closed loop, and further replacing the tiles, from a starting point of the loop, with new tiles during the touch is moved along the route so that the musical piece in question proceeds without discontinuity when passing the starting point. It can further include the adjoining tiles being arranged on the touch screen to allow a continuous sliding touch of the touch screen.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform a method as described above. Yet another implementation may include a system including memory and one or more processors operable to execute instructions, stored in the memory, to perform a method as described above.
In another implementation, a system is described that engages a user with a rhythm of a musical piece and provides feedback on whether a user's performance approximately matches the rhythm. The system further comprises an audio part, and a processor that controls the touch display and the audio part. The processor executes instructions arranged to provide a path of adjoining tiles, to be displayed with code to indicate pitches, notes, chords or frequencies of the musical piece. The instructions are further arranged to play the pitches of the musical piece as a user selects the adjoining tiles with respective durations of touches. The instructions are further arranged to score whether the respective durations match the musical piece and provide feedback to the user.
The system can further include instructions that are arranged to display the adjoining tiles on the touch screen in a closed loop and to replace tiles that have been selected with new tiles as the musical piece proceeds. It can also include the adjoining tiles being arranged on the touch screen to allow section with a continuous sliding touch of the touch screen.
The method can further include a quiz mode allowing user to prove that user has recognized the musical piece in question and providing feedback to the user based on the evidence user has given. The user can prove recognition by selecting or supplying words, typed or spoken, that recognize the composer or title of the piece. The user also can prove recognition by playing the piece using a keyboard on screen or to a microphone connected to the audio part, for the audio part to recognize.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to constitute a system and methodically perform it as described above. The implementations of the technology disclosed can each optionally include one or more of the following features and/or features described in connection with additional systems disclosed. In the interest of conciseness, the combinations of features disclosed in this application are not individually enumerated and are not repeated with each base set of features. The reader will understand how features identified in this section can readily be combined with other sets of base features identified as implementations.
Musical puzzle
The invention relates to a method and system for playing musical pieces. The playing is a game that engages a user in correctly reproducing the duration of notes to reproduce a melody from a sequence of notes. BACKGROUND
There are a variety of music-oriented games, such as Guitar Hero, that challenge a user to hit notes following a pattern displayed. Similarly, there are teaching programs that show what notes a user should play or what keys a user should press. Some of these games and programs use simulated instruments and others use computer displays or touch screens. For example the publications US2010/00356685 and US2008/028680 disclose systems, in which the user follows a symbolic presentation of a musical piece on a display and participates by playing with a touch screen. The system checks, how accurately the user keeps up with the presentation and cores respectively. SUMMARY OF THE INVENTION
The system disclosed engages a user to reproduce a melody from a sequence of notes by selecting durations for notes. The melody becomes recognizable, when the durations are approximately correct. As a game, the processing system may score the selected durations and provide feedback to the gamer. The device, by which the system is used, can be a tablet, smart phone or similar one.
In one implementation, successive notes are displayed on a touch screen. They are for example adjoining tiles, which form a pattern. The display indicates the pitches of the notes providing the tiles with different codes, such as colors. The user moves a finger e.g. by sliding along a specified path, or route, trying to linger longer over notes with a longer duration and pass more quickly over notes with a shorter duration. In some implementations, the duration may be quantized to any note fraction, such as an eighth or quarter note. The viewing surface can be also a mere display, rather than a touch screen, in which case a stylus or other actuator is used to "touch" the tiles on the display. In one implementation the tiles on the display can be arranged as a closed loop e.g. around the perimeter of the display area, making the path endless that is easily fnllnwfarl with™ it liftinn a f nne>r Thp np t fpw tilp<; mav hprnmp pmnhs<;i7Pfl tn ni iirtp
Claims
1. A system for playing musical pieces, comprising an audio part (103), a touch screen (101) and user interface (102) based on it and a control part with a memory and an application (110),
characterized in that melodies of a plurality of musical pieces is in the memory (113) during use of the system and said application is arranged to
- produce on the screen (101) a pattern (210) of tiles (211, 212), each tile in the pattern being provided with a code, which corresponds to a sound with at least one defined frequency
- control the audio part (103) to generate said sound when a tile is touched
- place tiles in the pattern so that variation in said sound follows the melody of a particular musical piece, when a touch of the tiles is moved along a defined route in the pattern and
- change content of the pattern responsive to a user control so that new content corresponds to a new musical piece.
2. The system according to claim 1, characterized in that the musical piece to be played is hidden after setting the content of the pattern, and said route (205) is known, in which case the musical piece is to be recognized if the touch is moved along said route.
3. The system according to claim 1, characterized in that said pattern (720) is a matrix, said route (705) is unknown after setting the content of the matrix and the musical piece to be played is shown, in which case the route producing this musical piece is to be solved by exploring.
4. The system according to claim 2, characterized in that said application further is arranged to
- evaluate whether durations of user touches at the tiles match the musical piece to be recognized and
- provide feedback to the user about his/her performance by showing the result of the evaluating, or score.
5. The system according to claim 2, characterized in that the user touches a tile using a finger, stylus or other actuator.
6. The system according to any of claims 2 and 4, characterized in that said route forms a closed loop, and said application is further arranged to replace tiles that have been touched, from a starting point of the loop, with new tiles, during the touch
9 is moved along the route so that the musical piece in question proceeds without discontinuity when passing the starting point.
7. The system according to claim 1, characterized in that the adjoining tiles are arranged on the touch screen to allow a continuous sliding touch of the touch screen.
8. A method for playing musical pieces, wherein melody of a plurality of musical pieces has been stored in a memory, characterized in that
- a pattern of tiles is produced on a playing area, each tile in the pattern being provided with a code, which corresponds to a sound with at least one defined frequency
- said sound is generated when a tile is touched
- tiles are placed in the pattern so that variation in said sound follows a melody of a musical piece, when a tiles are touched along a defined route in the pattern and
- content of the pattern is changed responsive to a user control so that new content corresponds to a new musical piece.
9. The method according to claim 8, characterized in that the musical piece to be played is hidden after setting the content of the pattern, and said route is known, in which case the musical piece is to be recognized if the touch is moved along said route.
10. The method according to claim 8, characterized in that said pattern is a matrix, said route is unknown after setting the content of the matrix and the musical piece to be played is shown, in which case the route producing this musical piece is to be solved by exploring.
11. The, method according to claim 9, characterized in that it further comprises:
- evaluating whether durations of touching the tiles match the musical piece to be recognized; and
- providing feedback to the user about his/her performance by showing the result of the evaluating, or score.
12. The method according to claim 9, characterized in that said route has been formed as a closed loop, and the method further comprises replacing the tiles, from a starting point of the loop, with new tiles when the touch is moved along the route so that the musical piece in question proceeds without discontinuity when passing the starting point.
10
13. The method according to any of claim 8, characterized in that the adjoining tiles are arranged on the play area to allow continuous sliding along the tiles.
14. A system that engages a user with a rhythm of a musical piece and provides feedback on whether a user's performance matches the rhythm, the system comprising a touch screen, an audio part and a processor that controls the touch screen and the audio part,
characterized in that the processor is arranged to execute instructions to:
- provide a path of adjoining tiles, each tile to be displayed with a code to indicate pitches, notes, chords or frequencies of the musical piece,
- play the pitches of the musical piece as a user touches the adjoining tiles with respective durations of touches,
- evaluate whether the respective durations match the musical piece, and
- provide feedback to the user.
15. The system of claim 14, characterized in that instructions are further arranged to display the adjoining tiles on the touch screen in a closed loop and to replace tiles that have been selected with new tiles as the musical piece proceeds.
16. The system of claim 14, characterized in that the adjoining tiles are arranged on the touch screen to allow touching with a continuous sliding.
17. A method that engages a user with a rhythm of a musical piece and providing feedback on whether a user's performance matches the rhythm, characterized in that the method comprises steps:
- executing instructions on a processor, providing a path of adjoining tiles, each tile to be displayed with a code to indicate pitches, notes, chords or frequencies of the musical piece,
- playing the pitches of the musical piece as a user touches the adjoining tiles with respective durations of touching,
- evaluating whether the respective durations match the musical piece, and
- providing feedback to the user.
18. The method of claim 17, characterized in that it further comprises providing a display of the adjoining tiles on the touch screen in a closed loop and replacing tiles that have been touched with new tiles as the musical piece proceeds.
19. The method of any of claim 17, wherein the adjoining tiles are arranged on the touch screen to allow selection with a continuous sliding touch of the touch screen.
11
20. A computer readable storage medium, characterized in that it comprises program instructions that, when run on a processor, carry out a method as described in any of the method claims above.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13831009.9A EP2959471A4 (en) | 2012-08-20 | 2013-08-20 | Musical puzzle |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261691224P | 2012-08-20 | 2012-08-20 | |
US61/691,224 | 2012-08-20 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014029902A1 true WO2014029902A1 (en) | 2014-02-27 |
Family
ID=50100409
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/FI2013/000030 WO2014029902A1 (en) | 2012-08-20 | 2013-08-20 | Musical puzzle |
Country Status (3)
Country | Link |
---|---|
US (1) | US9691295B2 (en) |
EP (1) | EP2959471A4 (en) |
WO (1) | WO2014029902A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9691295B2 (en) | 2012-08-20 | 2017-06-27 | Mubik Entertainment Ltd. | Musical puzzle |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6216120B2 (en) * | 2013-01-22 | 2017-10-18 | 任天堂株式会社 | GAME PROGRAM, GAME DEVICE, GAME SYSTEM, AND GAME PROCESSING METHOD |
FI20135621L (en) * | 2013-06-04 | 2014-12-05 | Berggram Dev Oy | Grid-based user interface for a chord performance on a touchscreen device |
KR101922894B1 (en) * | 2016-04-11 | 2018-11-28 | 주식회사 네오위즈 | A music game device and computer-readable medium for recording program therefor |
US10509529B2 (en) | 2017-09-29 | 2019-12-17 | Apple Inc. | Dynamic navigation object for a step-sequencer |
US11367363B1 (en) | 2022-03-07 | 2022-06-21 | Bennett Samuel Lin | Systems, methods, and apparatuses for operating a music educational tool |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005198974A (en) * | 2004-01-19 | 2005-07-28 | Nintendo Co Ltd | Music game device and program |
US20060287088A1 (en) * | 2005-06-07 | 2006-12-21 | Nintendo Co., Ltd. | Storage medium storing game program, game apparatus and game control method |
JP2007034115A (en) * | 2005-07-29 | 2007-02-08 | Sanyo Electric Co Ltd | Music player and music performance system |
US20080280680A1 (en) * | 2007-05-08 | 2008-11-13 | Disney Enterprises, Inc. | System and method for using a touchscreen as an interface for music-based gameplay |
US20090143140A1 (en) * | 2007-11-30 | 2009-06-04 | Nintendo Co., Ltd. | Game system |
US20090288545A1 (en) * | 2007-10-23 | 2009-11-26 | Mann Steve William George | Andantephone: Sequential interactive multimedia environment, device, system, musical sculpture, or method of teaching musical tempo |
US20100035685A1 (en) | 2008-08-05 | 2010-02-11 | Cha Seung-Hee | Method for providing audio game, apparatus and computer-readable recording medium with program therefor |
WO2010055501A1 (en) * | 2008-11-14 | 2010-05-20 | Tunewiki Ltd. | A method and a system for lyrics competition, educational purposes, advertising and advertising verification |
US20100287471A1 (en) | 2009-05-11 | 2010-11-11 | Samsung Electronics Co., Ltd. | Portable terminal with music performance function and method for playing musical instruments using portable terminal |
WO2011059402A1 (en) * | 2009-11-10 | 2011-05-19 | Kwok Liang Joash Chee | A system for playing music on a media device |
US20120071241A1 (en) | 2010-09-16 | 2012-03-22 | Neowiz Games Co., Ltd. | Method, apparatus and recording medium for game using touch input |
US20120166947A1 (en) * | 2010-12-28 | 2012-06-28 | Yamaha Corporation | Online real-time session control method for electronic music device |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7989689B2 (en) * | 1996-07-10 | 2011-08-02 | Bassilic Technologies Llc | Electronic music stand performer subsystems and music communication methodologies |
CN1833265B (en) * | 2003-06-25 | 2010-10-13 | 雅马哈株式会社 | Method for teaching music |
US20070213111A1 (en) * | 2005-11-04 | 2007-09-13 | Peter Maclver | DVD games |
US8414395B2 (en) | 2008-06-11 | 2013-04-09 | Activision Publishing, Inc. | Strum processing for music video game on handheld device |
US9524047B2 (en) * | 2009-01-27 | 2016-12-20 | Disney Enterprises, Inc. | Multi-touch detection system using a touch pane and light receiver |
KR101611511B1 (en) | 2009-05-12 | 2016-04-12 | 삼성전자주식회사 | A method of composing music in a portable terminal having a touchscreen |
US9041521B2 (en) * | 2009-06-04 | 2015-05-26 | The Royal Institution For The Advancement Of Learning/Mcgill University | Floor-based haptic communication system |
US20130157761A1 (en) * | 2011-10-05 | 2013-06-20 | Real Keys Music Inc | System amd method for a song specific keyboard |
US9691295B2 (en) | 2012-08-20 | 2017-06-27 | Mubik Entertainment Ltd. | Musical puzzle |
-
2013
- 2013-08-20 US US13/971,787 patent/US9691295B2/en active Active
- 2013-08-20 WO PCT/FI2013/000030 patent/WO2014029902A1/en active Application Filing
- 2013-08-20 EP EP13831009.9A patent/EP2959471A4/en not_active Ceased
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005198974A (en) * | 2004-01-19 | 2005-07-28 | Nintendo Co Ltd | Music game device and program |
US20060287088A1 (en) * | 2005-06-07 | 2006-12-21 | Nintendo Co., Ltd. | Storage medium storing game program, game apparatus and game control method |
JP2007034115A (en) * | 2005-07-29 | 2007-02-08 | Sanyo Electric Co Ltd | Music player and music performance system |
US20080280680A1 (en) * | 2007-05-08 | 2008-11-13 | Disney Enterprises, Inc. | System and method for using a touchscreen as an interface for music-based gameplay |
US20090288545A1 (en) * | 2007-10-23 | 2009-11-26 | Mann Steve William George | Andantephone: Sequential interactive multimedia environment, device, system, musical sculpture, or method of teaching musical tempo |
US20090143140A1 (en) * | 2007-11-30 | 2009-06-04 | Nintendo Co., Ltd. | Game system |
US20100035685A1 (en) | 2008-08-05 | 2010-02-11 | Cha Seung-Hee | Method for providing audio game, apparatus and computer-readable recording medium with program therefor |
WO2010055501A1 (en) * | 2008-11-14 | 2010-05-20 | Tunewiki Ltd. | A method and a system for lyrics competition, educational purposes, advertising and advertising verification |
US20100287471A1 (en) | 2009-05-11 | 2010-11-11 | Samsung Electronics Co., Ltd. | Portable terminal with music performance function and method for playing musical instruments using portable terminal |
WO2011059402A1 (en) * | 2009-11-10 | 2011-05-19 | Kwok Liang Joash Chee | A system for playing music on a media device |
US20120071241A1 (en) | 2010-09-16 | 2012-03-22 | Neowiz Games Co., Ltd. | Method, apparatus and recording medium for game using touch input |
US20120166947A1 (en) * | 2010-12-28 | 2012-06-28 | Yamaha Corporation | Online real-time session control method for electronic music device |
Non-Patent Citations (1)
Title |
---|
See also references of EP2959471A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9691295B2 (en) | 2012-08-20 | 2017-06-27 | Mubik Entertainment Ltd. | Musical puzzle |
Also Published As
Publication number | Publication date |
---|---|
EP2959471A4 (en) | 2017-06-14 |
EP2959471A1 (en) | 2015-12-30 |
US9691295B2 (en) | 2017-06-27 |
US20140051512A1 (en) | 2014-02-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014029902A1 (en) | Musical puzzle | |
Shultz | Music theory in music games | |
Collins | Game sound: an introduction to the history, theory, and practice of video game music and sound design | |
US7435169B2 (en) | Music playing apparatus, storage medium storing a music playing control program and music playing control method | |
US8550908B2 (en) | Simulating musical instruments | |
US8642871B2 (en) | Instructional music reading and instrument playing system and method | |
US20080280680A1 (en) | System and method for using a touchscreen as an interface for music-based gameplay | |
US9842577B2 (en) | Improvised guitar simulation | |
McAlpine | Bits and pieces: A history of chiptunes | |
JP2001212369A (en) | Amusement system with typing practice function, typing practice system, and computer-readable memory medium | |
CN107481581B (en) | Computer-aided method and computer system for piano teaching | |
Summers | Playing the tune: Video game music, gamers, and genre | |
US9620093B2 (en) | Simple music—next generation keyboard | |
Wang | Game Design for Expressive Mobile Music. | |
Mice et al. | Super size me: Interface size, identity and embodiment in digital musical instrument design | |
Michalakos | Designing musical games for electroacoustic improvisation | |
US10002598B2 (en) | Selective pitch emulator for electrical stringed instruments | |
O’Meara | Rocksmith and the shaping of player experience | |
Enns | Game scoring: Towards a broader theory | |
JP2015116271A (en) | Control device for music game, control method thereof, control program therefor, and information storage medium with the program stored thereon | |
Egozy | Approaches to musical expression in Harmonix video games | |
Aristopoulos | A portfolio of recombinant compositions for the videogame Apotheon | |
JP6782314B2 (en) | Program and game system | |
Jamali et al. | Eira: A Rhythm Game for Conceptualizing Mathematical Series & Recursive Functions | |
Dineiro | The Flex Voice in the Soundtracks for the Nintendo Game Boy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13831009 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013831009 Country of ref document: EP |