WO2009125331A1

WO2009125331A1 - Method and system providing a gui for selecting an item by moving graphical representations of data

Info

Publication number: WO2009125331A1
Application number: PCT/IB2009/051434
Authority: WO
Inventors: Sudhir M. Prabhu
Original assignee: Koninklijke Philips Electronics N.V.
Priority date: 2008-04-07
Filing date: 2009-04-06
Publication date: 2009-10-15

Abstract

A method provides a Graphical User Interface enabling a user to select an item of data by moving graphical representations (24-27) of data made available for selection relative to at least a part (21) of a display in a display area (4). The method includes making representations of individual data items available for selection. On receipt of a certain user input signal, representations (24-27) of a plurality of disjoint sub-sets of data items are substituted for representations of individual data items in those sub-sets amongst the representations made available for selection. The disjoint sub-sets are established by partitioning a set of at least some of the data items of which representations were made available prior to receipt of the certain user input signal.

Description

Method and system providing a GUI for selecting an item by moving graphical representations of data

FIELD OF THE INVENTION

The invention relates to a method of providing a graphical User Interface enabling a user to select an item of data by moving graphical representations of data made available for selection relative to at least a part of a display in a display area. The invention also relates to a system for providing a graphical User Interface enabling a user to select an item of data. The invention also relates to a computer programme.

BACKGROUND OF THE INVENTION

File managers providing a user interface for working with file systems typically display files in a hierarchy. A navigational file manager, such as Windows Explorer, uses folders to group items and expands folders or collapses their contents to give an overall view of the contents of a particular folder or of the available folders in the form of a list that can be scrolled. A problem occurs when many files are grouped in the same folder, or the file system has a flat hierarchy. In that case, scrolling the list requires relatively lengthy user interaction. This need to scroll a long list can be prevented by using a more intricate hierarchy, but browsing then requires even more user interaction as navigation up and down the hierarchy is required to move from folder to folder.

SUMMARY OF THE INVENTION It is an object of the invention to provide a method, system and computer programme of the types mentioned above, that allow for browsing through data items by means of user interaction over a relatively short period of time.

In furtherance of this object there is provided a method of providing a Graphical User Interface enabling a user to select an item of data by moving graphical representations of data made available for selection relative to at least a part of a display in a display area, including: making representations of individual data items available for selection, and on receipt of a certain user input signal, substituting representations of a plurality of disjoint sub-sets of data items for representations of individual data items in those sub-sets amongst the representations made available for selection, the disjoint sub-sets being established by partitioning a set of at least some of the data items of which representations were made available prior to receipt of the certain user input signal.

Graphical data representations can be labels or simple lines of text, just as the selection artefact can be simply a space at the top of a list, i.e. not especially emphasized as such.

Because representations of a plurality of disjoint sub-sets of data items are substituted for representations of any individual data items in those sub-sets amongst the representations made available for selection, the number of representations decreases in the second mode. Thus, to effect a selection, less movement of data representations relative to at least the part of the screen forming a graphical selection artefact is required, because there are fewer of them. The method avoids repeated moves up and down a hierarchy, because a set of at least some of the data items of which representations were made available prior to receipt of the certain user input signal is partitioned to establish the plurality of disjoint sub-sets of data items of which representations are made available for selection. Thus, a list of items (at a same level in any hierarchy) is compacted by grouping them. By contrast, a hierarchical file system browser moves between representations of all items in a folder to representations of that folder and all other folders at the same level in the hierarchy. If a folder contains many items, then the user will still have to scroll through a long list using a graphical file browser. The present method, on the other hand, allows for dynamic compaction of a list of items.

An embodiment includes making representations of at least the individual data items in a selected one of the disjoint data-sets available for selection upon receipt of a further user input signal.

Thus, a user can scroll through the representations of the disjoint sub-sets, select one of them, and then browse through representations of only individual data items in that sub-set. An effect is that a quicker method of selecting an individual data item is provided by introducing an intermediate phase of browsing batches of data items.

In an embodiment, the disjoint sub-sets are established such as to group individual data items according to values of at least one attribute associated therewith. An effect is to provide a logical grouping that will allow the user to deduce which individual data item is included in which group, and thus to select the correct representation of a disjoint sub-set. The partition is not tied to a particular pre-determined hierarchy. In a particular variant, at least one attribute is selected upon making the individual data items available for selection.

An effect is that the grouping process is adapted dynamically to the characteristics of the individual data items of which graphical representations are displayed. In a particular variant, the graphical representations of individual data items are displayed in an ordered array, and wherein the selected attribute corresponds to an attribute determining the order.

Thus, the view presented to the user switches from a list of data items ordered to some criterion, to a list of groups of data items. The groups of data items each correspond to a particular one of consecutive sub-sections of the list. This facilitates intuitive selection of the correct graphic representation of a group.

In an embodiment, user input signals are received via a device for recognizing gestures.

An effect is to simplify the user interface, making it suitable in particular for portable devices. Peripheral devices such as a computer mouse or joystick are not required. Furthermore, space is freed on small form- factor devices provided with a user interface implemented using this method.

In a variant, user input signals are received via a device for tracking at least two reference points on a body. An effect is to make the provision of user input less error-prone, since a sufficiently broad range of gestures can be implemented without resorting to complicated movements of single reference points.

In a variant, the certain user input signal is obtained by tracking at least two reference points on a body and responsive to at least one of detecting an increase and detecting a decrease in separation between the two reference points.

An effect is to make the user interface very intuitive, since a change in separation between two reference points has the effect of making a display of graphical representations more compact.

In an embodiment, data representations are moved responsive to detecting movement of at least one of the tracked reference points and in correspondence with movement in one of two opposing senses along a path.

An effect is to contribute to making the user interface more intuitive, since movement of data representations made available for selection relative to at least a graphical selection artefact in a display area is brought about responsive to movement of a point of reference on the user.

In a particular variant, the certain user input signal is obtained by tracking at least two reference points on a body and responsive to at least one of detecting an increase and detecting a decrease in separation between the two reference points, wherein the separation is measured along the path.

An effect is to allow the use of a one-dimensional input device for tracking movement of point of reference on the user's body. Such a device can be relatively simple (compared e.g. to touch pads), thus cheaper. Moreover, such a device takes up less space. According to another aspect of the invention, there is provided a system for providing a Graphical User Interface enabling a user to select an item of data, including: a first interface for receiving user input selecting a graphical representation in a pre-determined spatial relationship to at least a part of a display provided in the display area, memory for storing individual data items, and a second interface for receiving user input allowing a user to cause graphical representations made available for selection to move relative to at least a part of the display provided in the display area, which system is arranged, on receipt of a certain user input signal, to substitute representations of a plurality of disjoint sub-sets of a set of data items for representations of individual data items in those sub-sets amongst the representations provided in the display area; and to establish the disjoint sub-sets by partitioning the set of data items.

The system is able to provide a means for browsing through graphical representations relatively quickly.

In an embodiment, the system is configured, prior to receiving the certain user input signal, to display graphical representations of only some of the set of data items, and to replace graphical representations of individual data items by graphical representations of individual data items loaded from memory as the replaced graphical representations are caused to move out of the display area.

Thus, the system is configured to allow scrolling of graphical representations of individual data items, and to speed up such a scrolling process by switching to scrolling of graphical representations of sub-sets of individual data items. In an embodiment, the system is configured to carry out a method according to the invention.

According to another aspect of the invention, there is provided a computer programme including a set of instructions capable, when incorporated in a machine-readable medium, of causing a system having information processing capabilities to perform a method according to the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be explained in further detail with reference to the accompanying drawings, in which:

Fig. 1 is a schematic front plan view of a portable media player provided with Graphical User Interface;

Fig. 2 is a schematic diagram illustrating several components of the media player; Fig. 3 is an illustration of multi-point input to the media player, provided by two user digits;

Fig. 4 is a first screen view comprised in a menu provided by the media player's Graphical User Interface;

Fig. 5 is a second screen view; Fig. 6 is a third screen view; and

Fig. 7 is a simple flow chart illustrating some steps in a method of providing a Graphical User Interface.

DETAILED DESCRIPTION A portable media player 1 comprises a housing 2, a multi-point touch-sensitive strip 3, and a screen 4 of a display device. In the illustrated embodiment, keys 5 are further provided as means for providing user input. The keys 5 are omitted in another embodiment.

Referring to Fig. 2, the portable media player 1 is provided with a data processor 6 and working memory 7. The data processor 6 controls the operation of the portable media player 1 by executing instructions stored in non- volatile memory 8. The nonvolatile memory 8 comprises any one or more of a solid-state memory device, an optical disk, a magnetic hard drive etc. As an example, audio files are stored in the non- volatile memory 8. An audio decoder 9 decompresses and/or decodes a digital signal comprised in a music file. Sound comes to the user by means of an audio output stage 10.

A graphics processor 11 and display driver 12 provide signals controlling the display device having the screen 4. An input interface 13 interprets signals from the touch- sensitive strip 3.

The touch-sensitive strip 3 (see Fig. 3) is of a multi-point type. It is capable of tracking at least two points of reference on the user's body, e.g. two fingers held against the touch-sensitive strip 3 simultaneously. Tracking is carried out in one dimension, in that only positions 14,15 along the length of the strip 3 are tracked. The portable media player 1 recognizes multi-point gestures conveyed through fingers moving along the strip 3.

Fig. 3 shows four basic types of gesture. Movement of fingers towards (situation (a)) each other corresponds to a pinch gesture 16. Movement of fingers to increase their separation (situation (b)) along the strip 3 corresponds to an expansion gesture 17. Synchronous or quasi- synchronous movement of both fingers in one of two opposite directions (situations (c),(d)) along the path defined by the strip 3 corresponds to first and second linear movement gestures 18, 19, respectively.

In an embodiment, the files corresponding to audio tracks stored in nonvolatile memory 8 are stored in a flat hierarchy or at the same level in any file hierarchy maintained by the portable media player 1. Upon activation of e.g. one of the keys 5, a first screen view 20 is presented on the screen 4. It corresponds to a menu of available options for displaying a list of audio tracks on the screen 4.

In the menu section corresponding to the first screen view 20 - as in the menu sections corresponding to other screen views to be described below - a user may cause a selection bar 21 to move from item to item in the list, using the touch-sensitive strip 3 and one of the gestures illustrated in Fig. 3(c) and (d). In another embodiment, the selection bar 21 stays in one place relative to the boundaries of the screen 4, and the list of names moves. Scrolling is provided for, if required, in that only some of all items (menu options, files, etc.) made available for selection are displayed at any one time. As the names move relative to the selection bar 21, some fall off one edge of the screen 4, to be replaced at an opposite edge by others loaded from non- volatile memory 8, or at least from working memory 7 into memory (not shown separately) accessible by the graphics processor 11. A menu item highlighted by the selection bar 21 is selected e.g. by tapping the touch-sensitive strip 3, or depressing one of the keys 5. Although vertical scrolling is implemented in the illustrated embodiment, horizontal or diagonal scrolling can be used in another embodiment. Furthermore, menu items or other data items can be graphically represented by icons or other graphical artefacts in addition to or instead of text strings. The graphical representations need not be arranged in a one-dimensional linear array, but can be arranged in a circle, for example. In such an embodiment, linear movement of one or two fingers along the touch-sensitive strip 3 is translated into rotary movement of the graphical representations made available for selection and shown on the screen 4.

A second screen view 22 is provided upon selection of the second option displayed in the first screen view 20. In the second screen view 22, the audio tracks are listed in alphabetical order according to their title attribute. It is noted that the menu of the first screen view 20 equally allowed for the audio tracks to be listed in alphabetical order by artist attribute, or by name of album attribute. Combinations are also possible in some embodiments, e.g. in alphabetical order by album name attribute unless the track was not part of an album, in which case its title determines its place in the order.

The set of all audio tracks made available for selection is too large to allow graphical representations of all individual audio tracks to be displayed at any one time. However, scrolling is provided for. The touch-sensitive strip 3 can be used by a user to cause the displayed ones of the graphical representations made available for selection to move relative to the display area. As one moves off the edge of the screen 4, a graphical representation of another one is added to the display at an opposite edge.

In order that the user need not scroll through the whole list in a laborious manner, a facility is provided to switch to a third screen view 23 (Fig. 6), in which graphical representations 24-27 of disjoint sub-sets of the set of all audio tracks available for selection are displayed in an ordered array. At least one of the graphical representations 24-27 replaces a plurality of the text strings representing the audio tracks forming the represented sub-set. Thus, a first graphical representation 24 replaces the names of all audio tracks starting with the letter "A", except for the first one. Indications 28-31 of the values of the attribute according to which the audio tracks have been grouped are provided in relation to each of the graphical representations 24,25,26,27 as well.

It is noted that the graphical representations 24-27 are of groups containing more audio tracks than were represented in the second screen view 22 prior to receipt of a command to switch to the third screen view 23. This command thus causes the portable media player 1 to load more data for representing audio tracks from the non- volatile memory 8 in order to create the third screen view 23. Alternatively, the further data can be loaded from a further non-volatile memory (not shown), or moved within working memory 7 to a sector reserved to enable build-up of the display by the graphics processor 11.

In the menu section corresponding to the third screen view 23, the user can cause the graphical representations 24-27 to move relative to the screen 4. As one falls off an edge of the screen, a further one is added to the display at an opposite edge. It is thus possible to scroll the graphical representations 24-27 of the groups of audio tracks in the same way as it was possible to scroll the audio track names individually in the second screen view 22.

In the illustrated embodiment, the graphical representation at the top of the screen 4 is selected upon receipt of an appropriate input signal from the user (e.g. a tap on the touch-sensitive strip 3, depression of one of the keys 5 or a voice command). Upon receipt of this further input signal, only the group corresponding to the selected one of the graphical representations 24-27 is expanded to provide a list of graphical representations of only the individual data items contained therein. This smaller list can again be scrolled to select a particular individual data item. Of course, if the list fits the screen, scrolling is not required, but a cursor may be moved along the list, or the list moved relative to a selection area, so that the user can highlight a particular graphical representation of an individual data item for selection.

The methodology behind the user interface is briefly illustrated in Fig. 7, which shows steps carried out by the data processor 6. In an embodiment, this method is carried out starting from the third screen view 23. A variant is carried out starting from the second screen view 22, as will be explained.

In a first step 32, the portable media player 1 detects a gesture via the touch- sensitive strip 3. The gesture is classified as one or both of a linear movement and a change in distance between the first finger position 14 and the second finger position 15. In case of linear movement in one of two opposing senses along the path defined by the touch-sensitive strip 3, the list of graphical representations 24-27 (in the third screen view 23) or audio track names (in the second screen view 22) is scrolled (step 33).

In case of relative movement of the finger positions 14,15, one of the pinch gesture 16 and the expansion gesture 17 is recognized.

If it is the pinch gesture 16 and the second screen view 22 is being provided, the data items corresponding to groups of audio tracks are grouped (step 34) according to values of at least one attribute associated therewith, as explained. The partitioning of the set of all audio tracks available for selection by scrolling through the list is effected only upon receipt of the input signal corresponding to the pinch gesture 16. In an embodiment, the attribute of which the values determine the grouping is also only determined at that point in time.

As previously mentioned, the attribute may be the first letter of the name of the audio track. In another embodiment, it is the attribute determining the order of the audio tracks in the list of the second screen view 22. This makes the interface relatively intuitive to use. Alternatively, a user may set the attribute separately, choosing from a list of options, for example. These could include the duration of the audio track when rendered, the size of the file corresponding to the audio track, the compression ratio (indicator of the reproduction quality) in case of compressed audio files, etc.

If the third screen view 23, rather than the second screen view 22 is the current screen view when the pinch gesture 16 is detected, one embodiment of the method allows for the list of graphical representations 24-27 of groups of audio tracks to be further stacked into groups of groups of audio tracks, or a new partitioning of the audio tracks into fewer groups. If the gesture recognized by the portable media player 1 is the expansion gesture 17, the third screen view 23 is the current screen view and one of the graphical representations 24-27 is highlighted, then representations of individual audio tracks contained in the currently highlighted group are made available for selection (step 35). At least some of them are displayed (step 36). If there is sufficient screen space, the graphical representations of other groups remain visible (but not of audio tracks in those groups). The user can move the graphical representations of the sub-set of audio tracks relative to a screen area or other graphical artefact in order to select one of them. This scrolling involves a far shorter list than if the audio tracks had not first been grouped to allow the user to narrow in on a sub-set of audio tracks available for selection. From this set-up, the user can revert to a fully expanded list by providing the expansion gesture 17 whilst an individual data item in the currently expanded group is highlighted. The portable media player 1 will then expand all remaining groups as well, returning to the second screen view 22.

It should be noted that the embodiments described above illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

For example, use is made of a touch screen device in another embodiment. Soft keys may be provided in such an embodiment to effect the actions carried out in response to the "pinch" movement of the illustrated embodiment. Alternatively, an artefact similar to the touch sensitive strip 3 may be provided in an area of such a touch screen. It is further noted that only one relative gesture is used in another embodiment, resulting in stacking upon first detection and expansion upon second detection.

The invention is similarly not limited to GUIs for portable media players, but may be used to browse lists of other data items, including those corresponding to functions or routines carried out by a computer device.

Claims

CLAIMS:

1. Method of providing a graphical User Interface enabling a user to select an item of data by moving graphical representations (24-27) of data made available for selection relative to at least a part (21) of a display in a display area (4), including: making representations of individual data items available for selection, and on receipt of a certain user input signal, substituting representations (24-27) of a plurality of disjoint sub-sets of data items for representations of individual data items in those sub-sets amongst the representations made available for selection, the disjoint sub-sets being established by partitioning a set of at least some of the data items of which representations were made available prior to receipt of the certain user input signal.

2. Method according to claim 1, including making representations of at least the individual data items in a selected one of the disjoint data-sets available for selection upon receipt of a further user input signal.

3. Method according to claim 1 or 2, wherein the disjoint sub-sets are established such as to group individual data items according to values of at least one attribute associated therewith.

4. Method according to claim 3, wherein at least one attribute is selected upon making the individual data items available for selection.

5. Method according to claim 4, wherein the graphical representations of individual data items are displayed in an ordered array, and wherein the selected attribute corresponds to an attribute determining the order.

6. Method according to any one of the preceding claims, wherein user input signals are received via a device (3) for recognizing gestures.

7. Method according to claim 6, wherein user input signals are received via a device (3) for tracking at least two reference points (14,15) on a body.

8. Method according to claim 7, wherein the certain user input signal is obtained by tracking at least two reference points (14,15) on a body and responsive to at least one of detecting an increase and detecting a decrease in separation between the two reference points (14,15).

9. Method according to claim 7 or 8, wherein data representations (24-27) are moved responsive to detecting movement of at least one of the tracked reference points (14,15) and in correspondence with movement in one of two opposing senses along a path.

10. Method according to claim 9, wherein the certain user input signal is obtained by tracking at least two reference points (14,15) on a body and responsive to at least one of detecting an increase and detecting a decrease in separation between the two reference points (14,15), wherein the separation is measured along the path.

11. System for providing a graphical User Interface enabling a user to select an item o f data, including : a first interface (3,5,13) for receiving user input selecting a graphical representation (24-27) in a pre-determined spatial relationship to at least a part (21) of a display provided in a display area (4), memory (7,8) for storing individual data items, and a second interface (3,5,13) for receiving user input allowing a user to cause graphical representations made available for selection to move relative to at least a part (21) of a display provided in the display area (4), which system is arranged, on receipt of a certain user input signal, to substitute representations (24-27) of a plurality of disjoint sub-sets of a set of data items for representations of individual data items in those sub-sets amongst the representations provided in the display area (4); and to establish the disjoint sub-sets by partitioning the set of data items.

12. System according to claim 11, wherein the system is configured, prior to receiving the certain user input signal, to display graphical representations of only some of the set of data items, and to replace graphical representations of individual data items by graphical representations of individual data items loaded from memory (8) as the replaced graphical representations are caused to move out of the display area (4).

13. System according to claim 11, configured to carry out a method according to any one of claims 1-10.

14. Computer programme including a set of instructions capable, when incorporated in a machine-readable medium, of causing a system (1,6) having information processing capabilities to perform a method according to any one of claims 1-10.