|Publication number||US20070290990 A1|
|Application number||US 11/838,845|
|Publication date||20 Dec 2007|
|Filing date||14 Aug 2007|
|Priority date||22 Oct 2001|
|Also published as||DE20221853U1, EP1438719A2, EP1438719B1, EP2261909A2, EP2261909A3, US7345671, US7710394, US7710409, US20030095096, US20070080938, US20070083822, WO2003036642A2, WO2003036642A3, WO2003036642A9|
|Publication number||11838845, 838845, US 2007/0290990 A1, US 2007/290990 A1, US 20070290990 A1, US 20070290990A1, US 2007290990 A1, US 2007290990A1, US-A1-20070290990, US-A1-2007290990, US2007/0290990A1, US2007/290990A1, US20070290990 A1, US20070290990A1, US2007290990 A1, US2007290990A1|
|Inventors||Jeffrey Robbin, Steve Jobs, Philip Schiller|
|Original Assignee||Robbin Jeffrey L, Steve Jobs, Schiller Philip W|
|Export Citation||BiBTeX, EndNote, RefMan|
|Referenced by (32), Classifications (17)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a divisional of U.S. patent application Ser. No. 10/259,159, filed Sep. 26, 2002, and entitled “METHOD AND APPARATUS FOR USE OF ROTATIONAL USER INPUTS,” which is hereby incorporated by reference herein, and which claims benefit of priority from: (i) U.S. Provisional Patent Application No. 60/346,237, filed Oct. 22, 2001, entitled “METHOD AND SYSTEM FOR LIST SCROLLING,” and is hereby incorporated by reference herein; (ii) U.S. Provisional Patent Application No. 60/359,551, filed Feb. 25, 2002, entitled “TOUCH PAD FOR HANDHELD DEVICE,” and is hereby incorporated by reference herein; and (iii) U.S. Provisional Patent Application No. 60/387,692, filed Jun. 10, 2002, entitled “METHOD AND APPARATUS FOR USE OF ROTATIONAL USER INPUTS,” and is hereby incorporated by reference herein.
This application is also related to U.S. patent application Ser. No. 10/072,765, filed Feb. 7, 2002, and entitled “MOUSE HAVING A ROTARY DIAL,” now U.S. Pat. No. 7,084,856, and is hereby incorporated by reference herein.
1. Field of the Invention
The present invention relates generally to a computing device and, more particularly, to a handheld computing device having a rotational input unit.
2. Description of the Related Art
There exist today many styles of input devices for performing operations with respect to a consumer electronic device. The operations generally correspond to moving a cursor and making selections on a display screen. By way of example, the input devices may include buttons, switches, keyboards, mice, trackballs, touch pads, joy sticks, touch screens and the like. Each of these devices has advantages and disadvantages that are taken into consideration when designing the consumer electronic device. In handheld computing devices, the input devices are typically buttons and switches. Buttons and switches are generally mechanical in nature and provide limited control with regard to the movement of a cursor (or other selector) and the making of selections. For example, they are generally dedicated to moving the cursor in a specific direction (e.g., arrow keys) or to making specific selections (e.g., enter, delete, number, etc.). In the case of handheld personal digital assistants (PDAs), the input devices tend to utilize touch-sensitive display screens. When using a touch screen, a user makes a selection on the display screen by pointing directly to objects on the screen using a stylus or finger.
In portable computing devices such as laptop computers, the input devices are commonly touch pads. With a touch pad, the movement of an input pointer (i.e., cursor) corresponds to the relative movements of the user's finger (or stylus) as the finger is moved along a surface of the touch pad. Touch pads can also make a selection on the display screen when one or more taps are detected on the surface of the touch pad. In some cases, any portion of the touch pad may be tapped, and in other cases, a dedicated portion of the touch pad may be tapped. In stationary devices such as desktop computers, the input devices are generally selected from keyboards, mice and trackballs. With a mouse, the movement of the input pointer corresponds to the relative movements of the mouse as the user moves the mouse along a surface. With a trackball, the movement of the input pointer corresponds to the relative movements of a ball as the user rotates the ball within a housing. Both mice and trackball devices generally include one or more buttons for making selections on the display screen.
In addition to allowing input pointer movements and selections with respect to a Graphical User Interface (GUI) presented on a display screen, the input devices may also allow a user to scroll across the display screen in the horizontal or vertical directions. For example, mice may include a scroll wheel that allows a user to simply roll the scroll wheel forward or backward to perform a scroll action. In addition, touch pads may provide dedicated active areas that implement scrolling when the user passes his or her finger linearly across the active area in the x and y directions. Both devices may also implement scrolling via horizontal and vertical scroll bars as part of the GUI. Using this technique, scrolling is implemented by positioning the input pointer over the desired scroll bar, selecting the desired scroll bar, and moving the scroll bar by moving the mouse or finger in the y direction (forwards and backwards) for vertical scrolling or in the x direction (left and right) for horizontal scrolling.
Further, consumer electronic products other than computers, such as cordless telephones, stereo receivers and compact-disc (CD) players, have used dials to enable users to select a phone number, a radio frequency and a specific CD, respectively. Here, typically, a limited-resolution display is used together with the dial. The display, at best, displays only a single item (number, frequency or label) in a low resolution manner using a character generator LCD. In other words, these devices have used single line, low resolution LCD readouts.
Thus, there is always a need for improved user input devices that facilitate greater ease of use of computing devices.
The present invention relates to improved approaches for users of computing devices to interact with graphical user interfaces. According to one aspect of the invention, a rotational user action supplied by a user at a user input device is transformed into linear action with respect to a graphical user interface. According to another aspect of the invention, a portion of an extended list of items is displayed by a graphical user interface and, through rotational user actions at a user input device, the portion of the list being displayed can be varied with welcomed ease of use. Although the type of computing device can vary, the invention is particularly well-suited for use with a media player.
Other aspects and advantages of the invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the invention.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
The present invention relates to improved approaches for users of computing devices to interact with graphical user interfaces. According to one aspect of the invention, a rotational user action supplied by a user at a user input device is transformed into linear action with respect to a graphical user interface. According to another aspect of the invention, a portion of an extended list of items is displayed by a graphical user interface and, through rotational user actions at a user input device, the portion of the list being displayed can be varied with welcomed ease of use. Although the type of computing device can vary, the invention is particularly well-suited for use with a portable media player.
Other aspects of the invention will become apparent below. In any case, the aspects are not limiting and the various aspects of the invention can be used separately or in combination.
Embodiments of the invention are discussed below with reference to
The media player 100 typically has connection capabilities that allow a user to upload and download data to and from a host device such as a general purpose computer (e.g., desktop computer or portable computer). For example, in the case of a camera, photo images may be downloaded to the general purpose computer for further processing (e.g., printing). With regard to music players, songs and playlists stored on the general purpose computer may be downloaded into the music player. In one embodiment, the media player 100 can be a pocket-sized handheld MP3 music player that allows a user to store a large collection of music.
As shown in
The media player 100 also includes a display screen 104. The display screen 104 is used to display a Graphical User Interface (GUI) as well as other information to the user (e.g., text, objects, graphics). By way of example, the display screen 104 may be a liquid crystal display (LCD). In one particular embodiment, the display screen corresponds to a high-resolution display with a white LED backlight to give clear visibility in daylight as well as in low-light conditions. Additionally, according to one embodiment, the display screen 104 can be about 2 inches (measured diagonally) and provide a 160-by-128 pixel resolution. The display screen 104 can also operate to simultaneously display characters of multiple languages. As shown in
The media player 100 includes a rotational input device 110. The rotational input device 110 receives a rotational input action from a user of the media player 100. The rotational input action is used to control one or more control functions for controlling or interacting with the media player 100 (or application operating thereon). In one embodiment, the control function corresponds to a scrolling feature. The direction of scrolling can vary depending on implementation. For example, scrolling may be implemented vertically (up or down) or horizontally (left or right). For example, in the case of a music player, the moving finger may initiate a control function for scrolling through a song menu displayed on the display screen 104. The term “scrolling” as used herein generally pertains to moving displayed data (e.g., text or graphics) across a viewing area on a display screen 104 so that a new item of data (e.g., line of text or graphics) is brought into view in the viewing area. In most cases, once the viewing area is full, each new item of data appears at the edge of the viewing area and all other sets of data move over one position. That is, the new item of data appears for each item of data that moves out of the viewing area. In essence, the scrolling function allows a user to view consecutive sets of data currently outside of the viewing area. The viewing area may be the entire viewing area of the display screen 104 or it may be only a portion of the display screen 104 (e.g., a window frame).
By way of example, in the case of a music player (e.g., MP3 player), the scrolling feature may be used to help browse through songs stored in the music player. To elaborate, the display screen 104, during operation, may display a list of media items (e.g., songs). A user of the media player 100 is able to linearly scroll through the list of media items by providing a rotational input action using the rotational input device 110. The displayed items from the list of media items are varied commensurate with the rotational input action such that the user is able to effectively scroll through the list of media items. However, since the list of media items can be rather lengthy, the invention provides the ability for the user to rapidly traverse (or scroll) through the list of media items. In effect, the user is able to accelerate their traversal of the list of media items by providing the rotational input action at greater speeds. The direction of the rotational input action may be arranged to control the direction of scrolling.
In addition to above, the media player 100 may also include one or more buttons 112. The buttons 112 are configured to provide one or more dedicated control functions for making selections or issuing commands associated with operating the media player 100. By way of example, in the case of a music player, the button functions may be associated with opening a menu, playing a song, fast forwarding a song, seeking through a menu and the like. In most cases, the button functions are implemented via a mechanical clicking action. The position of the buttons 112 relative to the rotational input device 110 may be widely varied. For example, they may be adjacent to one another or spaced apart. In the illustrated embodiment, the buttons 112 are configured to surround the inner and outer perimeter of the rotational input device 110. In this manner, the buttons 112 may provide tangible surfaces that define the outer boundaries of the rotational input device 110. As shown, there are four buttons 112A that surround the outer perimeter and one button 112B disposed in the center or middle of the rotational input device 110. By way of example, the plurality of buttons 112 may consist of a menu button, play/stop button, forward seek button, reverse seek button, and the like.
Moreover, the media player 100 may also include a power switch 114, a headphone jack 116 and a data port 118. The power switch 114 is configured to turn the media device 100 on and off. The headphone jack 116 is capable of receiving a headphone connector associated with headphones configured for listening to sound being outputted by the media device 100. The data port 118 is capable of receiving a data connector/cable assembly configured for transmitting and receiving data to and from a host device, such as a general purpose computer. By way of example, the data port 118 may be used to upload or download songs to and from the media device 100. The data port 118 may be widely varied. For example, the data port may be a PS/2 port, a serial port, a parallel port, a USB port, a FireWire port, and the like. In some cases, the data port 118 may be a radio frequency (RF) link or optical infrared (IR) link to eliminate the need for a cable. Although not shown in
The media player 200 includes a processor 202 that pertains to a microprocessor or controller for controlling the overall operation of the media player 200. The media player 200 stores media data pertaining to media items in a file system 204 and a cache 206. The file system 204 is, typically, a storage disk or a plurality of disks. The file system typically provides high capacity storage capability for the media player 200. However, since the access time to the file system 204 is relatively slow, the media player 200 also includes a cache 206. The cache 206 is, for example, Random-Access Memory (RAM) provided by semiconductor memory. The relative access time to the cache 206 is substantially shorter than for the file system 204. However, the cache 206 does not have the large storage capacity of the file system 204. Further, the file system 204, when active, consumes more power than does the cache 206. The power consumption is particularly important when the media player 200 is a portable media player that is powered by a battery (not shown).
The media player 200 also includes a user input device 208 that allows a user of the media player 200 to interact with the media player 200. For example, the user input device 208 can take a variety of forms, such as a button, keypad, dial, etc. Still further, the media player 200 includes a display 210 (screen display) that can be controlled by the processor 202 to display information to the user. A data bus 211 can facilitate data transfer between at least the file system 204, the cache 206, the processor 202, and the coder/decoder (CODEC) 212. The media player 200 can also include an audio feedback unit (not shown) to provide audio feedback for user interactions (such as with the user input device 208).
In one embodiment, the media player 200 serves to store a plurality of media items (e.g., songs) in the file system 204. When a user desires to have the media player play a particular media item, a list of available media items is displayed on the display 210. Then, using the user input device 208, a user can select one of the available media items. The processor 202, upon receiving a selection of a particular media item, supplies the media data (e.g., audio file) for the particular media item to a coder/decoder (CODEC) 212. The CODEC 212 then produces analog output signals for a speaker 214. The speaker 214 can be a speaker internal to the media player 200 or external to the media player 200. For example, headphones or earphones that connect to the media player 200 would be considered an external speaker.
The computing system 250 includes a housing 252 that exposes a rotational input device 254. The housing 252 can be a computer's housing or an input/output device's housing. The rotational input device 254 permits a user to interact with the computing system 250 through a rotational action. The rotational action results from either rotation of the rotational input device 254 itself or rotation of a stylus or user's finger about the rotational input device 254. As examples, the rotational input device 254 can be a rotary dial (including, e.g., a navigational wheel or a scroll wheel) capable of being rotated or a touch pad capable of rotational sensing. A rotation pickup unit 256 couples to the rotational input device 254 to sense the rotational action. For example, the rotational pickup unit 256 can be optically or electrically coupled to the rotational input device 254.
The computing system 250 further includes a processor 258, a display 260 and an audio feedback unit 262. Signals pertaining to the rotational action are supplied to the processor 258. The processor 258 not only performs processing operations for application programs hosted by the computing system 250 but also can control the display 260 and the audio feedback unit 262. Alternatively, a specialized controller or other circuitry can support the processor 258 in controlling the display 260 or the audio feedback unit 262.
The processor 258 causes a display screen to be produced on the display 260. In one implementation, the display screen includes a selectable list of items (e.g., media items) from which a user may select one or more of the items. By the user providing a rotational action with respect to the rotational input device 254, the list can be scrolled through. The processor 258 receives the signals pertaining to the rotational action from the rotation pickup unit 256. The processor 258 then determines the next items of the list that are to be presented on a display screen by the display 260. In making this determination, the processor 258 can take into consideration the length of the list. Typically, the processor 258 will determine the rate of the rotational action such that the transitioning to different items in the media list can be performed at a rate proportional to the rate of the rotational action.
The processor 258 can also control the audio feedback unit 266 to provide audio feedback to a user. The audio feedback can, for example, be a clicking sound produced by the audio feedback unit 262. In one embodiment, the audio feedback unit 262 is a piezoelectric buzzer. As the rate of transitioning through the list of items increases, the frequency of the clicking sounds can increase. Alternatively, when the rate that the rotational input device 254 is turned slows, the rate of transitioning through the list of items decreases, and thus the frequency of the clicking sounds correspondingly slows. Hence, the clicking sounds provide audio feedback to the user as to the rate in which the items (i.e., media items) within the list of items are being traversed.
The user input processing 400 displays 402 a graphical user interface. Then, a rotational movement associated with a user input action is received 404. Here, the user input action is generally angular, as opposed to linear, and thus pertains to a rotational movement. As discussed in more detail below, the rotational movement can be provided by the user input action. In one example, the rotational movement can be caused by a user acting to rotate a navigational wheel through a user input action. In another example, the rotational movement can be caused by a user's finger or a stylist being moved in a rotational manner through a user input action with respect to a touch pad. After the rotational movement has been received 404, the rotational movement is converted 406 into a linear movement. The linear movement is then applied 408 to at least one object of the graphical user interface. For example, the object of the graphical user interface can be a list, menu or other object having a plurality of selectable items. The linear movement can effect a scroll type action with respect to the object (e.g., list or menu). Alternatively, the linear movement can effect a level adjustment (e.g., volume adjustment). After the linear movement has been applied 408, the user input processing 400 is complete and ends.
The operations 402-408 performed by the user input processing 450 are similar to those like operations performed by the user input processing 400 illustrated in
The user input processing 500 begins by the display 502 of a portion of a list of items together with a select bar. The select bar typically points to or highlights one or more of the items of the list of items. In general, the select bar can be associated with any sort of visual indication specifying one or more of the items of the list of items. Hence, the select bar is one type of visual indicator. Next, a decision 504 determines whether a rotational movement input has been received. When the decision 504 determines that a rotational movement input has not yet been received, then a decision 506 determines whether another input has been received. Here, the inputs are provided by a user of the computing device performing or associated with the user input processing 500. When the decision 506 determines that another input has been received, then other processing is performed 508 to perform any operations or actions caused by the other input. Following the operation 508, the user input processing 500 is complete and ends. On the other hand, when the decision 506 determines that no other input has been received, then the user input processing 500 returns to repeat the decision 504.
Once the decision 504 determines that a rotational movement input has been received, then the rotational movement is converted 510 to a linear movement. Then, a next portion of the list of items (and placement of the select bar over one of the items) is determined 512. Thereafter, the next portion of the list of items is displayed 514. The linear movement operates to move the select bar (or other visual identifier) within the list. In other words, the select bar is scrolled upwards or downwards by the user in accordance with the linear motion. As the scrolling occurs, the portion of the list being displayed changes. Following the operation 514, the user input processing 500 is complete and ends. However, if desired, the user input processing 500 can continue following operation 514 by returning to the decision 504 such that subsequent rotational movement inputs can be processed to view other portions of the list items in a similar manner.
The rotary input display system 600 also includes a control assembly 612 that is coupled to the rotational input device 602. The control assembly 612 is configured to acquire the position signals from the sensors and to supply the acquired signals to a processor 614 of the system. By way of example, the control assembly 612 may include an application-specific integrated circuit (ASIC) that is configured to monitor the signals from the sensors to compute the angular location and direction (and optionally speed and acceleration) from the monitored signals and to report this information to the processor 614.
The processor 614 is coupled between the control assembly 612 and the display screen 604. The processor 614 is configured to control display of information on the display screen 604. In one sequence, the processor 614 receives angular motion information from the control assembly 612 and then determines the next items of the media list 611 that are to be presented on the display screen 604. In making this determination, the processor 614 can take into consideration the length of the media list 611. Typically, the processor 614 will determine the rate of movement such that the transitioning to different items in the media list 611 can be performed faster when moved at greater speeds. In effect, to the user, the more rapid the rotational motion or acceleration, the faster the transitioning through the list of media items 611. Alternatively, the control assembly 612 and processor 614 may be combined in some embodiments.
Although not shown, the processor 614 can also control a buzzer to provide audio feedback to a user. The audio feedback can, for example, be a clicking sound produced by a buzzer 616. In one embodiment, the buzzer 616 is a piezoelectric buzzer. As the rate of transitioning through the list of media items increases, the frequency of the clicking sounds increases. Alternatively, when the rate of transitioning slows, the frequency of the clicking sounds correspondingly slows. Hence, the clicking sounds provide audio feedback to the user as to the rate in which the media items within the list of media items are being traversed.
The various aspects or features of the invention described above can be used alone or in various combinations. The invention is preferably implemented by a combination of hardware and software, but can also be implemented in hardware or software. The invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium include read-only memory, random-access memory, CD-ROMs, DVDs, magnetic tape, optical data storage devices, and carrier waves. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
The advantages of the invention are numerous. Different embodiments or implementations may yield one or more of the following advantages. It should be noted that this is not an exhaustive list and there may be other advantages which are not described herein. One advantage of the invention is that a user is able to traverse through a displayed list of items (e.g., media items) using a rotational user input action. Another advantage of the invention is that a user is able to easily and rapidly traverse a lengthy list of items (e.g., media items).
The many features and advantages of the present invention are apparent from the written description, and thus, it is intended by the appended claims to cover all such features and advantages of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention.
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7671837||14 Feb 2006||2 Mar 2010||Apple Inc.||Scrolling input arrangements using capacitive sensors on a flexible membrane|
|US7683918||17 Mar 2006||23 Mar 2010||Motorola, Inc.||User interface and method therefor|
|US7710393||13 Dec 2006||4 May 2010||Apple Inc.||Method and apparatus for accelerated scrolling|
|US7710394||13 Dec 2006||4 May 2010||Apple Inc.||Method and apparatus for use of rotational user inputs|
|US7710409||13 Dec 2006||4 May 2010||Apple Inc.||Method and apparatus for use of rotational user inputs|
|US7795553||11 Sep 2006||14 Sep 2010||Apple Inc.||Hybrid button|
|US7880729||4 Aug 2006||1 Feb 2011||Apple Inc.||Center button isolation ring|
|US7910843||4 Sep 2008||22 Mar 2011||Apple Inc.||Compact input device|
|US7932897||15 Aug 2005||26 Apr 2011||Apple Inc.||Method of increasing the spatial resolution of touch sensitive devices|
|US8022935||6 Jul 2006||20 Sep 2011||Apple Inc.||Capacitance sensing electrode with integrated I/O mechanism|
|US8044314||27 Jul 2010||25 Oct 2011||Apple Inc.||Hybrid button|
|US8059099||11 Sep 2006||15 Nov 2011||Apple Inc.||Techniques for interactive input to portable electronic devices|
|US8125461||5 Sep 2008||28 Feb 2012||Apple Inc.||Dynamic input graphic display|
|US8274479||18 Jun 2007||25 Sep 2012||Apple Inc.||Gimballed scroll wheel|
|US8330061||18 Mar 2011||11 Dec 2012||Apple Inc.||Compact input device|
|US8395590||1 Jun 2009||12 Mar 2013||Apple Inc.||Integrated contact switch and touch sensor elements|
|US8416198||5 Sep 2008||9 Apr 2013||Apple Inc.||Multi-dimensional scroll wheel|
|US8446370||30 Jul 2007||21 May 2013||Apple Inc.||Touch pad for handheld device|
|US8482530||21 Aug 2007||9 Jul 2013||Apple Inc.||Method of capacitively sensing finger position|
|US8514185||1 Aug 2007||20 Aug 2013||Apple Inc.||Mutual capacitance touch sensing device|
|US8537132||23 Apr 2012||17 Sep 2013||Apple Inc.||Illuminated touchpad|
|US8552990||1 Aug 2007||8 Oct 2013||Apple Inc.||Touch pad for handheld device|
|US8683378||9 Jan 2008||25 Mar 2014||Apple Inc.||Scrolling techniques for user interfaces|
|US8743060||6 Jul 2009||3 Jun 2014||Apple Inc.||Mutual capacitance touch sensing device|
|US8749493||30 Jul 2007||10 Jun 2014||Apple Inc.||Movable touch pad with added functionality|
|US8816967||25 Sep 2008||26 Aug 2014||Apple Inc.||Capacitive sensor having electrodes arranged on the substrate and the flex circuit|
|US8820133||30 Sep 2008||2 Sep 2014||Apple Inc.||Co-extruded materials and methods|
|US8866780||8 Apr 2013||21 Oct 2014||Apple Inc.||Multi-dimensional scroll wheel|
|US8872771||7 Jul 2009||28 Oct 2014||Apple Inc.||Touch sensing device having conductive nodes|
|US8933890||1 Aug 2007||13 Jan 2015||Apple Inc.||Techniques for interactive input to portable electronic devices|
|US8952886||19 Dec 2007||10 Feb 2015||Apple Inc.||Method and apparatus for accelerated scrolling|
|US9009626||19 Dec 2007||14 Apr 2015||Apple Inc.||Method and apparatus for accelerated scrolling|
|International Classification||G09G5/00, G06F3/033, G06F3/048, G06F1/16|
|Cooperative Classification||G06F1/1626, G06F1/1662, G06F1/169, G06F3/03543, G06F3/0362, G06F3/0482|
|European Classification||G06F1/16P9K, G06F1/16P9P6, G06F3/0354M, G06F3/0482, G06F3/0362, G06F1/16P3|