WO2007082140A1 - Telephone interface for a portable communication device - Google Patents

Telephone interface for a portable communication device Download PDF

Info

Publication number
WO2007082140A1
WO2007082140A1 PCT/US2007/060120 US2007060120W WO2007082140A1 WO 2007082140 A1 WO2007082140 A1 WO 2007082140A1 US 2007060120 W US2007060120 W US 2007060120W WO 2007082140 A1 WO2007082140 A1 WO 2007082140A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
rotary dial
image
click wheel
icons
Prior art date
Application number
PCT/US2007/060120
Other languages
French (fr)
Inventor
Steven P. Jobs
Scott Forstall
Greg Christie
Bas Ording
Imran Chaudhri
Stephen O. Lemay
Marcel Van Os
Freddy A. Anzures
Mike Matos
Original Assignee
Apple Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Inc. filed Critical Apple Inc.
Publication of WO2007082140A1 publication Critical patent/WO2007082140A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/56Arrangements for indicating or recording the called number at the calling subscriber's set
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • G06F3/0236Character input methods using selection techniques to select from displayed items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • G06F3/0237Character input methods using prediction or retrieval techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/23Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/23Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
    • H04M1/233Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof including a pointing device, e.g. roller key, track ball, rocker switch or joystick
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • the disclosed embodiments relate to user interfaces, and in particular, to ( telephone user interfaces that include a click wheel.
  • the disclosed portable communication device 5 thai includes a telephone user interface.
  • a method includes displaying a first image of a rotary dial in a display of the portable communications device in response to a first contact by a user with a click wheel.
  • the first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial.
  • the plurality of icons include numbers.
  • the method may include scrolling around at least a portion of the first image of the rotary dial in response to one or more navigation commands received from the click wheel.
  • the one or more navigation commands may correspond to the user moving the first contact around at least a portion of the click wheel.
  • a respective icon in the plurality of icons corresponding to a current position on the first image of the rotary dial may be highlighted.
  • the method may include receiving a first user command using the click wheel.
  • the first user command may correspond to a selection of a respective icon in the plurality of icons.
  • the first user command may include pushing down on the click wheel.
  • the method may include displaying a sequence of one or more selected icons in the display.
  • one or more letters corresponding to the respective icon are displayed along a radial direction of the first image of the rotary dial. In some embodiments, one or more letters corresponding to the respective icon are displayed in a central region of the first image of the rotary dial. ? [001 1 ] In some embodiments, the method includes displaying a second image of the rotary dial in the display of the device in response to the user breaking the first contact with the click wheel. The second image of the rotary dial has a different shading pattern than the first image of the rotary dial. The second image of the rotary dial may be displayed if the user breaks the first contact for a time interval greater than a pre-determined value.
  • the first image of the rotary dial may be faded out and the second image of the rotary dial may be faded in over a pre-determined time interval.
  • the first image of the rotary dial may correspond to a character entry mode of operation and the second image of the rotary dial may correspond to a character correction mode of operation.
  • the method includes removing one or more previously selected icons in response to receiving a second user command using the click wheel, wherein the second user command includes pressing on a delete symbol on the click wheel.
  • the second image of the rotary dial may include an icon corresponding to the delete symbol 5 on the click wheel.
  • the method includes dialing a telephone number corresponding to the sequence of selected icons in response to receiving a third user command.
  • the third user command may include pressing a click wheel button, such as a button at the center of the click wheel.
  • the first image of the rotary dial may be modified in 1 accordance with an animation sequence during the dialing.
  • Music such as a portion of a music file, may be played during the dialing.
  • Volume may be adjusted during a telephone call in response to motion of a second contact by the user with the click wheel around at least a portion of the click wheel.
  • the method includes disconnecting from the dialed 5 telephone number in response to receiving a fourth user command.
  • the fourth user command may include pressing the button at the center of the click wheel.
  • the aforementioned methods may be performed by a portable electronic device having a touch-sensitive display with a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the 0 memory for performing these methods.
  • GUI graphical user interface
  • the portable electronic device provides a plurality of functions, including wireless communication.
  • Instructions for performing the aforementioned methods may be included in a computer program product configured for execution by one or more processors.
  • FIG. 1 is a block diagram illustrating an embodiment of an architecture for a portable communication device.
  • Figure 2 is a schematic diagram illustrating an embodiment of a user interface for a portable communication device.
  • Figure 3 A is a schematic diagram illustrating an embodiment ot a telephone user interface for a portable communication device.
  • FIG. 3 B is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
  • Figure 3C is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
  • Figure 3D is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
  • Figure 4A is a schematic diagram illustrating an embodiment of a telephone ( user interface for a portable communication device.
  • Figure 4B is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
  • Figure 5 is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
  • Figure 6 is a flow diagram of an embodiment of a telephone number dialing process.
  • Figure 7 is a block diagram illustrating an embodiment of an address book data structure.
  • Figure 8 ⁇ is a schematic diagram illustrating an embodiment of a text entry 0 user interface for a portable communication device.
  • Figure 8B is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
  • Figure 8C is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
  • Figure 8D is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
  • Figure 8E is a schematic diagram illustrating an embodiment of a text entry user interlace for a portable communication device.
  • Figure 9A is a schematic diagram illustrating an embodiment of a text entry 0 user interface for a portable communication device.
  • Figure 9B is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
  • Figure 10 is a flow diagram of an embodiment of a text entry process.
  • Figure 1 1 is a flow diagram of an embodiment of a scrolling process.
  • Figure 12A is a schematic diagram illustrating an eraDo ⁇ imem oi repiay recommendations in a user interface for a portable communication device.
  • Figure 12B is a schematic diagram illustrating an embodiment of replay recommendations in a user interface for a portable communication device. . ⁇
  • Figure 12C is a schematic diagram illustrating an embodiment of replay recommendations in a user interface for a portable communication device.
  • Figure 13 is a flow diagram of an embodiment of a replay recommendation process.
  • Figure 14A is a block diagram illustrating an embodiment of a user word
  • Figure 14B is a block diagram illustrating an embodiment of a language data structure system.
  • the device may be a portable communications device.
  • the user interface may include a click wheel and/or touch screen.
  • a click wheel is a physical
  • a user-interface device may provide navigation commands based on an angular displacement of the wheel or a point of contact with the wheel by a user of the device.
  • a click wheel may also be used to provide a user command corresponding to selection of one or more items, for example, when the user of the device presses down on at least a portion of the wheel, lor simplicity, in the discussion that follows, a portable communications device (e.g.,
  • 3D a cellular telephone that may also contain other functions, such as PDA and music player Functions) that includes a click wheel is used as an exemplary embodiment. It should be understood, however, that the user interfaces and associated processes may be applied to other devices, such as personal computers and laptops, that may include one or more other
  • the device may support a variety of applications, such as a telephone, text messaging and a music player.
  • the music player may be compatible with one or more file formats, such as MP3 and/or AAC.
  • the device includes an iPod music player (trademark of Apple Computer, Inc.).
  • the various applications that may be executed on the device may use at least one common physical user-interface device, such as the click wheel.
  • One or more functions of the click wheel as well as corresponding information displayed on the device may be adjusted and/or varied from one application to the next and/or within a respective application. In this way.
  • a common physical architecture (such as the click wheel) of the device may ( support the variety of applications with user interfaces that are intuitive and transparent.
  • FIG. 1 is a block diagram illustrating an architecture for a portable communication device 100, according to some embodiments of the invention.
  • the device 100 may include a memory 1 02 (which may include one or more computer readable storage mediums), a memory f controller 122, one or more processing units (CPU's) 120, a peripherals interface 1 18, RF circuitry 1 08, audio circuitry 1 10, a speaker 1 1 1 , a microphone 1 13, an input/output (I/O) subsystem 106, a display system 1 12 (which may include a touch screen), a click wheel 1 14, other input or control devices 1 16, and an external port 124.
  • These components may communicate over one or more communication buses or signal lines 103.
  • the device 100 may be any portable electronic device, including but not limited to a handheld computer, a tablet computer, a mobile phone, a media player, a personal digital assistant (PDA), or the like, including a combination of two or more of these items.
  • the device 1 00 may not be portable, such as a desktop personal computer.
  • the device 100 is only one example of a portable : electronic device 1 00, and that the device 100 may have more or fewer components than shown, may combine two or more components, or a may have a different configuration or arrangement of the components.
  • the various components shown in Figure 1 may be implemented in hardware, software or a combination of both hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the memory 102 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. In some embodiments, the memory 102 may further include storage remotely located from the one or more processors 120. for instance network attached storage accessed via the RF circuitry 108 or the external port 124 and a communications network (not shown) such as the internet, mtranet(s), Local Area Networks (LANs), Wide Local Area Networks (WLANs), Storage Area Networks (SANs) and the like, or any suitable combination thereof. Access to the memory 102 by other components of the device 100, such as the CPU 120 and the peripherals interface 1 18, may be controlled by the memory controller 122.
  • non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices.
  • the memory 102 may further include storage remotely located from the one or more processors 120. for instance network attached storage accessed via the RF circuitry
  • the peripherals interface 1 18 couples the input and output peripherals of the device to the CPU 120 and the memory 102.
  • the one or more processors 120 run or execute various software programs and/or sets of instructions stored in the memory 102 to perform various functions for the device 100 and to process data.
  • peripherals interface 118, the CPU 120, and the memory controller 122 may be implemented on a single chip, such as a chip 104. In some other embodiments, they may be implemented on separate chips.
  • the RF (radio frequency) circuitry 108 receives and sends electromagnetic waves.
  • the RF circuitry 108 converts electrical signals to/from electromagnetic waves and
  • the RF circuitry 108 may include well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth.
  • the RF circuitry may include well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth.
  • SIM subscriber identity module
  • 2( i 108 may communicate with networks, such as the Internet, also referred to as the World
  • WWW Wide Web
  • LAN wireless local area network
  • MAN metropolitan area network
  • the wireless communication may use any of a plurality of communications standards, protocols and technologies, including but not limited t io Global System for Mobile Communications (GSM), Enhanced Data GSM Environment
  • EDGE wideband code division multiple access
  • W-CDMA wideband code division multiple access
  • CDMA code division multiple access
  • TDMA time division multiple access
  • Wi-Fi Wireless Fidelity
  • IEEE 802.1 I a IEEE 802.1 Ib, IEEE 802.1 I g and/or IEEE 802.1 In
  • VoIP voice over Internet Protocol
  • Wi-MAX a protocol for email, instant messaging, and/or Short Message
  • the audio circuitry 1 10, the speaker 1 1 1, and the microphone 1 13 provide an audio interface between a user and the device 100.
  • the audio circuitry 1 10 receives audio data from the peripherals interface 1 18, converts the audio data to an electrical signal, and transmits the electrical signal to the speaker 1 1 1.
  • the speaker 1 1 1 converts the electrical signal to human-audible sound waves.
  • the audio circuitry 1 10 also receives electrical signals converted by the microphone 1 13 from sound waves.
  • the audio circuitry 1 10 converts the electrical signal to audio data and transmits the audio data to the peripherals interface 1 18 for : ⁇ processing. Audio data may be may be retrieved from and/or transmitted to the memory 102 and/or the RF circuitry 108 by the peripherals interface 1 18.
  • the audio circuitry 1 1 0 also includes a headset jack (not shown).
  • the headset jack provides an interface between the audio circuitry 1 10 and removable audio input/output peripherals, such as output-only headphones or a headset with both output (headphone for one or both ears) and
  • the I/O subsystem 106 provides the interface between input/output peripherals on the device 100, such as the display system 112, the click wheel 1 14 and other input/control devices 1 16, and the peripherals interface 1 18.
  • the I/O subsystem 106 may include a display controller 156, a click wheel controller 158 and one or more input
  • the one or more input controllers 160 receive/send electrical signals from/to other input or control devices 160.
  • the other input/control devices 160 may include physical buttons (e.g. , push buttons, rocker buttons, ere. ). dials, slider switches, sticks, and so forth.
  • the display system 1 12 provides an output interface and/or an input interface ( between the device and a user.
  • the display controller 156 receives and/or sends electrical signals from/to the display system 1 12.
  • the display system 1 12 displays visual output to the user.
  • the visual output may include text, icons, graphics, video, and any combination thereof. In some embodiments, some or all of the visual output may correspond to user- interface objects, further details of which are described below.
  • the display system 1 12 also accepts input from the user based on haptic and/or tactile contact.
  • the display system 1 12 forms a touch-sensitive surface that accepts user input.
  • the display system 112 and the display controller 1 56 (along with any associated modules and/or sets of instructions in the memory 102) detect
  • a point of contact between a touch screen in the display system 1 12 and the user corresponds to one or more digits of the user.
  • a touch screen in the display system 112 and the display controller 156 may delect contact and any movement or breaking thereof using any of a plurality of touch sensitivity technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with a touch screen in the display system 112.
  • a touch- sensitive display in some embodiments of the display system 112 may be analogous to the multi-touch sensitive tablets described in the following U.S.
  • a touch screen in the display system 1 12 displays visual output from the portable device 100, whereas touch sensitive tablets do not provide visual output.
  • the touch screen in the display system 1 12 may have a resolution in excess of 100 dpi. In an exemplary embodiment, the touch screen in the display system may have a resolution of approximately 168 dpi.
  • the device 100 may include a touchpad (not shown) for activating or deactivating particular functions.
  • the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output.
  • the touchpad may be a touch-sensitive surface that is separate from the touch screen in the display system 112 or an extension of the touch- sensitive surface formed by the touch screen.
  • 0060J The device 100 may include a click wheel 114.
  • a user may navigate among one or more graphical objects (henceforth referred to as icons) displayed in the display system 1 12 by rotating the click wheel 1 14 or by moving (e.g., angular displacement) of a point of contact with the click wheel 1 14.
  • the click wheel 1 14 may also be used to select one or more of the displayed icons.
  • the user may press down on at least a portion of the click wheel 1 14 or an associated physical button.
  • User commands and navigation commands provided by the user via the click wheel 114 may be processed by the click wheel controller 158 as well as one or more of the modules and/or sets of instructions in the memory 102.
  • the device 100 also includes a power system 162 for powering the various components.
  • the power system 162 may include a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.
  • a power management system one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.
  • power sources e.g., battery, alternating current (AC)
  • AC alternating current
  • a recharging system e.g., a recharging system
  • a power failure detection circuit e.g.,
  • the software components stored in the memory 102 may include an operating system 126, a communication module (or set of instructions) 128, a contact/motion module (or set of instructions) 130, a graphics module (or set of instructions) i n 132. one or more applications (or set of instructions) 136, a timer module (or set of instructions) 144, a word prediction module (or set of instructions) 146, an address book 148, a user word history 150, one or more character sets 152, and one or more lexicography models 154.
  • the graphics module 132 may include an icon effects module (or set of instructions) 134.
  • the applications module 136 may include a telephone module (or set of
  • 1 5 instructions 138, a text messaging module (or set of instructions) 140 and/or a music player module (or set of instructions) 142.
  • the operating system 126 e.g., Darwin, RTXC, LINUX, UNIX, OS X,
  • WINDOWS or an embedded operating system such as Vx Works
  • WINDOWS includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory ( management, storage device control, power management, etc .) and facilitates communication between various hardware and software components.
  • general system tasks e.g., memory ( management, storage device control, power management, etc .
  • Vx Works includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory ( management, storage device control, power management, etc .) and facilitates communication between various hardware and software components.
  • the communication module 128 facilitates communication with other devices over one or more external ports 124 and also includes various software components for handling data received by the RF circuitry 108 and/or the external port 124.
  • the external 5 port 124 e.g.. Universal Serial Bus (USB) 5 FIREWIRE, etc.
  • USB Universal Serial Bus
  • the contact/motion module 130 may detect contact with the click wheel 1 14 and/or a touch screen in the display system 1 12 (in conjunction with the display controller 156).
  • the contact/motion module 130 includes various software components for performing
  • Determining movement of the point of contact may include determining speed (magnitude), velocity (magnitude and direction), and/or an acceleration (including magnitude and/or direction) of the point of contact.
  • the contact/motion module 130 and the display controller 156 also detects contact on a touchpad.
  • the graphics module 132 includes various known software components for
  • graphics module 132 includes the icon effects
  • the icon effects module 134 may modify a displayed position of one or more icons on the display system 1 12 (in conjunction with the display controller 156) based on an animation sequence.
  • the one or more applications 136 may include any i 5 applications installed on the device 100, including without limitation, a browser, the address book 148, contact list, email, instant messaging, word processing, keyboard emulation, widgets. JAVA-enabled applications, encryption, digital rights management, voice recognition, voice replication, location determination capability (such as that provided by the global positioning system (GPS)), etc.
  • GPS global positioning system
  • the telephone module 138 may be used to enter a sequence of characters corresponding to a telephone number, access one or more telephone 5 numbers in the address book 148, modify a telephone number that has been entered, dial a respective telephone number, conduct a conversation and disconnect or hang up when the conversation is completed.
  • Embodiments of user interfaces and associated processes corresponding to the telephone module 138 are described further below with reference to Figures 3-6.
  • the text messaging module 140 may be used to enter a sequence of characters corresponding to a text message, to modify previously entered characters, to transmit a respective text message (for example, using a Short Message
  • transmitted and/or received text messages may include graphics, photos, audio files, video files and/or other attachments as are supported in a Multimedia Message Service (MMS) and/or an Enhanced Messaging Service (EMS).
  • MMS Multimedia Message Service
  • EMS Enhanced Messaging Service
  • the display system controller 156 In conjunction with the display system 1 12, the display system controller 156, the click wheel 1 14, the click wheel controller 158, the audio circuitry 110, the speaker 1 11 and/or the microphone 1 13, the music player module 142 allows the user to play back
  • the device 100 may include the functionality of an MP3 player, such as an iPod (trademark of Apple Computer, Inc.).
  • the device 100 may, therefore, include a 36-pin connector that is compatible with the iPod.
  • the timer module 144 may provide a time reference and/or time stamps for
  • the word prediction module 146 may be used in conjunction with one or more of the applications 136, such as the text messaging module 140.
  • the word prediction module 146 may suggest one or more words or symbols (such as punctuation marks, pronunciation 0 marks or spaces) in accordance with a context.
  • the context may be based on one or more of the lexicography models 154 (for example, grammatical and/or syntax rules associated with one or more languages) and/or a user word history 150.
  • the context may include one or more previously entered words, characters, and/or symbols.
  • the context may depend on which of the applications 136 is being used. For example, there may be different contexts for 5 an email application as opposed to a word processing application.
  • the user word history 150 may include static content (such as that associated with a dictionary) and/or dynamic content (such as that associated with characters, symbols and/or words that are routinely and/or recently used by the user).
  • the user word history 150 may include a static dictionary built up by scanning a user's address book, emails, and other 0 documents.
  • the user word history 150 may include weighted scores or probabilities for predicted words based on a set of characters, symbols and/or words that are provided by the user to the device 100, for example, using the click wheel 114 and the click wheel controller 1 58.
  • the user word history 150 may also include use statistics (e.g., time of use and/or frequency of use) of one or more characters, symbols and/or words that are provided by the user.
  • use statistics e.g., time of use and/or frequency of use
  • the character sets 152 may include one or more sets of characters corresponding t ⁇ numbers, letters and/or symbols.
  • the letters and/or symbols may ; correspond to one or more languages.
  • the character sets 152 may be used by one or more of the applications 136, such as the text messaging module 140.
  • the device 100 may include one or more optional optical sensors (not shown), such as CMOS or CCD image sensors, for use in imaging applications.
  • CMOS or CCD image sensors for use in imaging applications.
  • the device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen in the display system 1 12 and/or a touchpad.
  • a touch screen and/or a touchpad as the primary input/control device for operation of the device 100, the number of physical input/control devices (such as push buttons, dials, and the like) on the device 100 may be
  • the device 100 includes a touch screen, a touchpad, a push button for powering the device on/off and locking the device, a volume adjustment rocker button and a slider switch for toggling ringer profiles.
  • the push button may be used to turn the power on/off on the device by depressing the button and holding the button in the depressed state for a predefined time interval, or may be used to lock the device by 0 depressing the button and releasing the button before the predefined time interval has elapsed.
  • the device 100 also may accept verbal input for activation or deactivation of some functions through the microphone 1 13.
  • the predefined set of functions that may be performed exclusively through a touch screen and/or a touchpad include navigation between user interfaces.
  • the touchpad when touched by the user, navigates the device 100 to a main, home, or root menu from any user interface that may be displayed on the device 100.
  • the touchpad may be referred to as a "menu button.”
  • the menu button may be a physical push button or other physical input/control device instead of a touchpad.
  • the device 100 is a device where operation of a predefined set of functions on the device is performed exclusively or at least in part through the click wheel 1 14.
  • FIG. 2 is a schematic diagram illustrating an embodiment of a user interface for a portable communication device 300.
  • the device 300 includes a click wheel 310 and a display 312.
  • the click wheel constitutes a physical interface for receiving user commands (such as selection of one of more items and/or icons that are displayed on the display 312) and/or navigation commands (which may, for example, control scrolling through the items and/or icons that are displayed on the display 312).
  • the user may use the click wheel 310 by touching it (making a point of contact) and then moving the point of contact while maintaining contact. Such angular displacement may indicate a navigation command to scroll through the items and/or icons that are displayed on the display 312.
  • a click wheel button 308 e.g., at the center of the click wheel
  • the user may select one or more items and/or icons that are displayed on the display 312.
  • a pressing down gesture may indicate a user command corresponding to selection.
  • the device 300 may display a menu or hierarchy of the applications 136 that may be executed or run on the device 300. Such a menu is illustrated in Figure 2 in the display 312.
  • the displayed icons for the applications 136 include 'Favorites' for popular applications for this user, 'Recent' for calls that have been made, answered, and/or missed within a first pre-determined value (such as the last day, week or month), 'Contacts' (which corresponds to the address book 148 in Figure 1), 'Dial' (which corresponds to the telephone module 138 in Figure 1) and 'SMS' (which corresponds to the text messaging module 140 in Figure 1 ).
  • the 'Music', 'Extras', 'Settings' and 'Now playing' icons may correspond to the music player module 142 ( Figure 1 ).
  • the arrow icons on the right-hand side of the display 3 12 may provide a visual clue to the user that selection of a respective icon will move down through the menu hierarchy down to the corresponding application (with a commensurate modification of the information displayed in the display 312).
  • the display 312 may also include an icon, such as that shown in the upper right-hand corner, that indicates a remaining stored power level for the device 300.
  • the telephone module 138 Figure 1 may be executed.
  • Figure 3A-3D Embodiments of telephone user interlaces for the portable communication device 300 that correspond to the telephone module 138 ( Figure 1) are illustrated in Figure 3A-3D. While the device 300 in these figures has been illustrated with certain components (including displayed information) and a particular arrangement of these components, it should be understood that there may be fewer or more components, two or more components may be combined, and positions of one or more components may be changed.
  • the rotary dial image 314- 1 may correspond to a character entry mode of i ⁇ operation in the telephone module 138 ( Figure 1), e.g., a mode of operation where the user may enter in characters, such as numbers, that correspond to a telephone number the user wishes to dial.
  • the contact is maintained for more than a second predetermined time interval prior to the device 100 transitioning to the character entry mode of operation.
  • the second pre-determined time interval may be 0.5, 1 or 2 s.
  • the rotary dial image 314_1 may include a plurality of icons arranged proximate to a periphery of the rotary dial image.
  • the plurality of icons may include numbers.
  • the rotary dial image includes the numbers 1 -9 arranged as on a clock face, with the 10, 11, and 12 o'clock positions replaced with 0. * . and #, respectively.
  • the displayed icons are arranged in a
  • the display 312 may include icons, such as those shown in the upper left-hand corner, that indicate a signal strength of signals used to communicate with a network, such as a cellular telephone network.
  • the display 312 may include icons 316 corresponding to a sequence of one or more displayed icons that have been
  • These icons 31 6 may be numbers in a set of numbers, e.g., a telephone number, that the user wishes to dial. The selection process is described further below.
  • the user may provide navigation commands to the device 300.
  • the user may provide navigation commands to the device 300.
  • navigation commands may correspond to scrolling through the icons displayed on the display
  • the scrolling may be around the circumference of the rotary dial image 3 14_1 .
  • the user may scroll through the icons corresponding io numbers.
  • a respective icon 320 which corresponds to a current position, may be highlighted.
  • there is an absolute angular relationship between contact points on the clickwheel 310 and icon positions on the rotary dial image 3 14 e.g., the 3 o'clock position on the clickwheel 310 corresponds to the 3 o'clock position in the rotary dial image 3 14, the 6 o'clock position on the clickwheel 31 0 corresponds to the 6 o'clock position in the rotary dial image 314, etc.).
  • the user in order for the rotary dial image 314 1 to continue to be displayed (e.g., the device 300 remains in the character entry mode of operation) the user maintains the contact with the click wheel 314 even while moving around at least a portion of the click wheel 3 14 1 to provide navigation commands.
  • the rotary dial image 314_1 continues to be displayed even if the user breaks contact with the click
  • I wheel 3 14 if the break in contact is for less than a third pre-determined amount of time or time interval. For example, for time intervals less than 0.5, 1 or 2 s.
  • This functionality may allow the user to break contact with the click wheel 314 while moving around at least a portion of the click wheel 314 (e.g., while providing navigation commands). If the user breaks contact with the click wheel 314, the navigation commands may be determined based
  • the user may select the respective icon 320 (i.e., provide the user command corresponding to selection) by pressing down on the click wheel 310 and/or by pressing on the button 308 ( Figure 2).
  • a corresponding character or U number may be added to the displayed sequence of selected icons 316.
  • one or more icons 322 corresponding to one or more letters associated with the respective icon 320 may be displayed in a central region of the rotary dial image 314 1.
  • sets of one or more icons, such as icon 324, corresponding to one or more 5 letters associated with at least a subset of the plurality of icons in the rotary dial image 314 1 may be displayed along a radial direction of the rotary dial image 314 1.
  • the user may transition to the character correction mode of operation by breaking contact with the click wheel 314 or by breaking contact with the click wheel 314 for more than the third pre-determined time interval.
  • a new icon or set of icons corresponding to rotary dial image 314_2 may be displayed on the display 312.
  • the rotary dial image 314_2 has different shading or coloring than the rotary dial image 314_1 ( Figures 3A-3D) to indicate to the user that the mode of operation has changed.
  • the transition from the display of the rotary dial image 5 3 14 1 ( Figures 3A-3D) to the rotary dial image 314_2 is continuous.
  • the rotary dial image 314_1 ( Figures 3 A-3D) may be faded out and the rotary dial image 314_2 may be faded in over a fourth pre-determined time interval.
  • the fourth pre-determined time interval may be 0.5. 1 or 2 s. In some embodiments, the fourth time interval is a time interval greater than a pre-determined value.
  • the user may provide a user command to the device 400 that indicates one or more characters corresponding to one or more previously selected icons should be removed. For example, the user may press on the click wheel 31 0 over or proximate to a symbol 326 that corresponds to a delete function. When a character is deleted the displayed icons 316 may be modified to indicate the change.
  • an icon or set of icons corresponding to a rotary dial image 314_3 may include icon 330 that provides a visual clue to the user as to the functionality corresponding to the symbol 326 on the click wheel 310.
  • the user may make contact with the click wheel for at least a fifth pre-determined time interval in order to return ( to the character entry mode of operation.
  • the fifth pre-determined time interval may be 0.5,
  • the user may return to the character entry mode of operation by clicking on a predetermined location on the clickwheel 310, such as symbol 336 on the elickwbeel 3 10.
  • the user may return to the character entry mode of operation by moving a point of contact a predetermined amount or angle on the clickwheel 3 1 0. In this mode, the user may select one or more additional icons to complete the sequence ol " characters corresponding to the telephone number that the user wishes to dial.
  • rotary dial image 314_3 may include an icon that provides a visual clue to the user as to the functionality corresponding to the symbol 336 on 5 the click wheel 310, analogous to the visual cue that icon 330 provides for symbol 326.
  • the user may provide a user command to the device 400 corresponding to dialing the previously entered telephone number by pressing on the button 308.
  • An icon 328 in the display 312 may be displayed to
  • one or more additional icons corresponding to one or more functions of the click wheel 3 10 may be displayed on the display 3 12 in the device 300 ( Figures 3A-3B), the device 400 ( Figures 4A-4B) and/or a device 500 ⁇ Figure 5). [0097
  • the device 400 may enter a dialing mode of operation.
  • An embodiment of telephone user interfaces for the portable communication device 500 that correspond to this mode of operation is illustrated in Figure 5. While the device 500 has been illustrated with certain components (including displayed information) and a particular arrangement of these components, it should be understood that there may be fewer or more ⁇ components, two or more components may be combined, and positions of one or more components may be changed.
  • an icon or a set of icons corresponding to a rotary dial image 314_4 may be displayed.
  • the rotary dial image 314_4 may be modified during the dialing.
  • the modification may be in accordance with an animation : sequence.
  • the rotary dial image 314_4 may be rotated clockwise or counter clockwise.
  • music such as a portion of a music file may be played during the dialing.
  • the user may adjust a volume of the speaker 1 1 1
  • the device 500 may remain in the dialing mode of operation even if the user maintains the contact with the click wheel 310 for more than a pre-determined time interval, such as the fifth predetermined time interval.
  • the rotary dial image 314_4 may include an icon 332 that provides a visual clue to the user as to how he or she should disconnect the telephone call when he or she wishes to.
  • the icon 322 indicates that by providing a user command (e.g., by pressing on the button 308) the user may disconnect or end the telephone call.
  • the device 500 may return to the character correction mode ol ' operation.
  • FIG. 6 is a flow diagram of an embodiment of a telephone number dialing process 600. While the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the telephone number dialing process 600 described below includes a number of operations that appear to occur in a
  • I f - process 600 can include more or fewer operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation.
  • a first image of a rotary dial on a display is displayed in response to a first
  • a respective icon in a plurality of icons corresponding to a first position on the first image of the rotary dial is highlighted (614).
  • a first user command corresponding to selection of the respective icon is received using the click wheel (616).
  • a sequence of one or more selected icons is ( displayed on the display (618).
  • a second image of the rotary dial is optionally displayed on the display in response to the user breaking the first contact with the click wheel (620).
  • One or more previously selected icons are optionally removed in response to receiving a second user command (622).
  • the second user command may include pressing a delete symbol on the click wheel.
  • a telephone number corresponding to the sequence of selected icons is : dialed or disconnected in response to receiving a third user command (624).
  • the third user command includes pressing a click wheel button (e.g., 308).
  • Figure 7 is a block diagram illustrating an embodiment of an address book data
  • the address book 148 may include multiple contacts 712. ⁇ respective contact, such as the contact 712-1, may include one or more names 714-1 , one or more addresses 71 6-1 , one or more telephone numbers 718-1 , one or more email addresses 720-1, as well as other information 722-1.
  • the address book data structure 700 may include fewer or more components. Two or more components may be combined and un order of two or more components may be changed.
  • the device 800 has several trays 810 displayed on the display
  • a respective tray in the trays 810 includes a region of the display 312.
  • a tray 810J2 may include one or more symbols that provide visual clues and/or explanations to the user as to current functions (in a current mode of
  • the tray 810_2 includes explanations for
  • a delete function a space function and instructions as to how to obtain a capitalized letter or character.
  • These functions may be selected by pressing on an appropriate portion of the click wheel 310 and/or pressing on the click wheel 310 for at least a sixth pre-determined time interval. For example, the user may obtain a capitalized letter or character by highlighting a corresponding icon on the display 312 and pressing down on the click wheel 310 or a click
  • a tray 810_3 may include a plurality of icons 812 1 corresponding to a set of characters (in this example, letters in the English alphabet) and one or more recommended words 814.
  • the one or more recommended words 814 may be provided based on a language data structure system 1450 ( Figure 14B). In some embodiments, the one or more ⁇ recommended words 814 are provided before receiving any characters selected by the user.
  • the one or more recommended words 814 may be in accordance with an application 136 and the user word history 150 ( Figure 1).
  • a current position in the tray 810_3 may be indicated by highlighting (e.g., shading) of a respective icon (a current position icon) in the l ⁇ . tray 810 3, in this case, of the word 'hello'.
  • the icons 812_1 and the one or more recommended words 814 may constitute a set.
  • the user may scroll or move through this set by providing navigation commands using the click wheel 310 in an analogous fashion to that discussed above with reference to Figures 3A-3D.
  • the user may provide a plurality of user commands using the click wheel 310, including selection of
  • the user may provide navigation commands (by moving a point of contact with at least a portion of the click wheel 310) and user commands (by pressing on the click wheel 310) while maintaining contact with the click wheel 310.
  • This may increase a number of characters, symbols and/or words that the user may select per minute and may make it easier for the user to use the ( device 800.
  • the device 800 includes one or more additional trays. This is illustrated in Figure 8B, which includes a tray 810_4.
  • the tray 810_4 may include a plurality of icons 812_2 corresponding to a set of characters (in this case, numbers).
  • the icons 812 1, the icons 812__2 and the one or more recommended words : 814 may constitute a set. The user may scroll or move through this set by providing navigation commands using the click wheel 310 in an analogous fashion to that discussed above with reference to Figures 3A-3D.
  • the tray 810_4 may include icons corresponding to inserting a space in a message and to sending a message. The user may select one of these icons by providing 0 commands using the click wheel 310. In some embodiments, a space may be automatically added after one or more of the recommended words 814 ( Figure 8A) are selected by the user. [00 UO] In some embodiments, the tray 810_3 may include a display adjustment icon
  • a space that was automatically added to a message after one or more of the recommended words 814 ( Figure 1 ) was selected may be automatically removed if a next user command corresponds to the display adjustment icon 816. For example, if selecting the display adjustment icon 816 corresponding to the displaying of the
  • the device 800 may display one or more icons corresponding to pronunciation marks 820 after a respective icon is selected. This is illustrated in Figure 8E, which shows 1 icons corresponding to pronunciation marks 820 displayed in the tray 810_3. Selecting one of these icons may modify the previously selected respective icon to include the corresponding pronunciation mark.
  • FIGS 9A and 9R illustrate additional embodiments of user interfaces for text messaging.
  • tray 810 1 displays a message that is being composed, including
  • Tray 810_3 includes a plurality of icons, including a 'JUMP' icon 910 and alternate character set icons 912 and 914. Selecting one or the alternate character set icons 912 and 914 may result in additional icons corresponding to additional character sets being displayed on the display 312. Selecting the 'JUMP' icon 910 may lead to a discontinuous change in the current position in
  • Figure 10 is a flow diagram of an embodiment of a text entry process 1000.
  • Io display one or more characters selected by a user using a click wheel and the second tray may include a first plurality of icons corresponding to characters and one or more recommended words. At least a portion of the first plurality of icons and one or more recommended words are scrolled through in accordance with one or more navigation commands received from the click wheel (1012).
  • a third tray is optionally displayed (1014).
  • the third tray includes a second plurality of icons.
  • the second plurality of icons includes numbers.
  • a respective icon in the first plurality of icons corresponding to a current position in the second tray is highlighted (1016).
  • a first user command corresponding to selection of the respective icon is received (1018).
  • the first user command may include pushing down on the click wheel or a click wheel button. In some embodiments, after the first user command
  • the respective icon remains highlighted.
  • the first recommended word icon is highlighted, which makes it easier for the user to select the first recommended word. Explanation of one or more functions corresponding to one or more symbols on the click wheel may be optionally displayed on the display ( 1020). A space may be automatically added after receiving a second user command
  • the second user command may correspond to a selection of one or more of the recommended words. Icons corresponding to punctuation marks may be optionally displayed in accordance with one or more characters that are selected by the user (1024). 1001 17] A sensitivity of the scrolling through the trays 810 in Figures 8A-8E and 9A-
  • Figure 1 1 is a flow diagram of an embodiment of a scrolling process 1100. While the scrolling process 1 100 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the process 1100 can include more or fewer ? ( operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation.
  • a plurality of icons displayed on a display arc scrolled through (1 1 10).
  • the scrolling is in accordance with a speed and/or an acceleration of a point of contact by a user with a click wheel.
  • a scroll rate is slower for a pre-determined angular displacement of the contact just after the scrolling is started, just prior to stopping the scrolling and/or when a direction of the scrolling is reversed (1 1 12).
  • a scroll rate is slower for a pre-determined time interval of the contact just after the scrolling is . ⁇ started, jusl prior to stopping the scrolling and/or when a direction of the scrolling is reversed
  • the device 100 may determine that there is a potential replay condition, i.e., that it may be appropriate to provide one or more recommended words as part of a replay recommendation, based on the user deleting one or more previously entered words ( in a message.
  • the potential replay recommendation may be in accordance with zero or more additional words, characters or symbols that the user adds to the message after deleting one or more words.
  • FIGS. 12A-12C are schematic diagrams illustrating embodiments of user interfaces that may be implemented on a device 1200 during a replay recommendation d process. While the device 1200 in these figures has been illustrated with certain components
  • a current set of characters 1210_l that have been selected by the user include a spelling error.
  • the current set of characters 1210_l includes a current sequence of words.
  • the current set of characters 1210_l includes a grammatical error and/or a 5 lexicography error.
  • the current set of characters 1210_l includes a misspelled word (e.g., "djde”, as shown in Figure 12A) or an extra word (e.g., "Hey dude, how how are you doing?", not shown).
  • a misspelled word e.g., "djde", as shown in Figure 12A
  • an extra word e.g., "Hey dude, how how are you doing?", not shown.
  • the user commands may be provided using the click wheel 310. In other embodiments, the user
  • I ( i commands may be provided using one hand or one finger, for example, using a touch-sensitive display.
  • word is added to a current set of characters 1210_3 and is removed from the recommended words 814.
  • a next deleted word in the reverse sequential order of deleted words is displayed with the recommended words 814. This process may be repeated until the message is completed, i.e., the current set of characters 1210_l ( Figure 12A) is restored without the spelling error (i.e., the spelling error in 1210 1 is corrected).
  • the recommended words 814 may include additional words, characters and/or symbols that were not deleted. These words, characters and/or symbols may be determined using the language data structure system 1450 ( Figure 14B). In some embodiments, the additional recommendations may include punctuation marks and/or pronunciation marks.
  • a space may be automatically inserted in the message after one or more of the recommended words 814 are accepted. In some embodiments, such a space is automatically removed if a next user command corresponds to selection of a punctuation mark.
  • one or more words in the current sequence of words 1210_3 may be capitalized in accordance with a context of the one or more words, characters and/or symbols in the current sequence of words 1210_3.
  • FIG. 13 is a flow diagram of an embodiment of a replay recommendation process 1300. While the replay recommendation process 1300 described below includes a 5 number of operations that appear to occur in a specific order, it should be apparent that the process 1300 can include more or fewer operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation. 0 [00129] A current set of characters is received in response to user commands (1310).
  • the set of characters includes a sequence of words. Additional user commands that specify characters to delete from and/or add to the current set of characters are received (1312). Replay recommendations for words to be added to the current set of characters are provided ( 1 3 14).
  • the replay recommendations include one or more deleted words that correspond to : ; the deleted characters.
  • a user command corresponding to acceptance of a respective recommended word is received, the respective recommended word is removed from the replay recommendations, and the respective word is added to the current set of characters ( 13 16). Operations 1312 and 1314 may be optionally repeated 1318.
  • Figure 14A is a block diagram illustrating an embodiment of a user word history data structure 1400.
  • the user word history 150 may include a deleted word stack 1410 and multiple words 1416.
  • the words 1416 may include : one or more characters and/or one or more symbols.
  • the deleted word stack 1410 includes one or more words 1414 in a sequential order in which the one or more words 1414 were deleted by the user in an application, such as the text messaging module 140 ( Figure 1).
  • the deleted word stack 1410 may be used in the device 1200 ( Figures 12A-12C) and in the replay recommendation process 1300 ( Figure 13).
  • D (00131 1
  • a respective word in the words 1416, such as word 1416-M, may include multiple records.
  • a respective record may include a time-weighted score 1418, use statistics 1420 (such as a time of use and/or a frequency of use), a context 1422 and one or more applications 1424.
  • the time-weighted score 1418 may indicate a probability that the word
  • the 1416-M is a next predicted word based on the context 1422 (one or more characters, symbols and/ ⁇ r words that have previously been provided by the user) and/or the application 1424.
  • the time-weighted score 1418 for an. email application may be different than the time-weighted score for the text messaging module 140 ( Figure 1).
  • the time-weighted score 1418 may be computed to favorably weight (e.g., give a higher probability) to words that are 5 used recently.
  • the time-weighted score 1418 may give favorable weighting to words 1416 that are used within the last 24 hours or week.
  • Words 1416 used on longer time scales may have their corresponding time-weighted scores 141 8 reduced by a pre-determined ratio (such as 0.9) for each additional time interval (e.g., each day or week) since the words 1416 were last used.
  • a pre-determined ratio such as 0.9
  • the user history data structure 1400 may include static information (for example, corresponding to a dictionary and/or grammatical and syntax rules for one or more languages) as well as dynamic information (based on recent usage statistics and/or patterns).
  • the user word history data structure 1400 may include a static dictionary built up by scanning a user's address book, emails, and other documents.
  • FIG. 1 5 1400 may be dynamically updated continuously, after pre-determined time intervals, or when a new word or syntax is employed by the user.
  • the user history data structure 1400 may include fewer or more components. Two or more components may be combined and an order of two or more components may be changed.
  • Figure 14B is a block diagram illustrating an embodiment of a language data
  • the data structure system 1450 may be used to provide recommended words in the device 800 ( Figures 8A-8R).
  • a sequence of symbols 1462 (including one or more characters, symbols and/or words) may be provided by the user.
  • a set of symbols 1462 corresponding to a context 1422-1 may be processed by a context map 1460.
  • the context 1422-1 may be a null set, e.g., one or more recommended words
  • the context 1422-1 may include one or more previously entered or provided words as well as one or more symbols, such as the first one, two or three letters in a current word that the user is providing.
  • the context map 1460 may include a select and hashing module 1464 and a hash map 1466. The hash map 1466 may select one or more
  • the entries in the application-specific dictionary 1468 may include contexts 1470, predicted words 1472, and time- weighted scores 1472.
  • the application-specific dictionary 1468 may utilize the records in the user history data structure 1400. As a consequence, the application-specific dictionary 1468 may be dynamically updated continuously, after prc-dctermined time intervals, or when a new word or syntax is employed by the user.
  • the language data structure system 1450 may be used to provide one or more recommended words based on the context 1422-1.
  • the context map 1460 may find a top-5 or 5 top- 10 best context 1470 matches.
  • the corresponding predicted words 1472 may be recommended to the user in accordance with the time-weighted scores 1474.
  • only a subset of the predicted words 1470 corresponding to the best context ] 470 matches may be presented to the user (e.g., just the top-1, top-2, or top-3 predicted words).
  • the language data structure system 1450 may provide one or more recommended words in accordance with a state machine (corresponding to a Markov sequence or process) that corresponds to a language.
  • a state machine corresponding to a Markov sequence or process
  • the application- specific dictionary 1468 may be based on a stochastic model of the relationships among letters, characters, symbols and/or words in a language.
  • a path memory (such as up to three characters in a word that is currently being entered and/or two or three previously entered words) of the probabilistic model represents a tradeoff between accuracy and the processing and power capabilities (for example, battery life) of the portable communication device 100 ( Figure 1).
  • a probabilistic model may be based on a lexicography and usage that is
  • user emails, address book and/or other documents may be analyzed to determine an appropriate probabilistic model for that user based on the syntax and/or lexicography (including names and slang) that are employed by the user.
  • the probabilistic model may be updated continuously, after pre-determined time intervals, or when a new word or syntax is employed
  • the probabilistic model may be based on one or more mistakes made by the user when using the click wheel 1 14 ( Figure 1) and/or a touch-sensitive display in the display system 1 12 ( Figure 1). For example, if the user accidentally selects the wrong icon when typing a respective word, the probabilistic model may be updated to
  • a mistake may be determined based on a user activation of an icon corresponding to the delete function.
  • This adaptability of the portable communication device 100 may allow correction of user interface errors (such as parallax and/or left-right symmetry) associated with which finger(s) the user is using and how the user is holding the portable communication device 100 ( Figure 1 ) while using it.
  • This adaptability of the portable communication device 100 may also be used to prevent the recommendation of misspelled words (e.g., by deleting such words from the user word history 150 or giving such words very low weighted scores).
  • the language data structure system 1450 may include fewer or more components, Two or more components may be combined and an order of two or more components may be changed.

Abstract

A method of using a portable communications device includes displaying a first image of a rotary dial in a display of the portable communications device in response to a first contact by a user with a click wheel. The first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial. The plurality of icons include numbers.

Description

TELEPHONE INTERFACE FOR A PORTABLE COMMUNICATION DEVICE
RELATED APPLICATIONS
[0001 J This application claims priority to U.S. Provisional Patent Application No. r 60/756,83 1 , filed January 5, 2006, entitled "Telephone Interface for Portable Communication
Device," which application is incorporated by referenced herein in its entirety.
TECHNICAL FIELD
|00021 The disclosed embodiments relate to user interfaces, and in particular, to ( telephone user interfaces that include a click wheel.
BACKGROUND
|0003] As portable devices become more compact, and the amount of information to be processed and stored increases, it has become a significant challenge to design a user f interface that allows users to easily interact with the device. This is unfortunate since the user interface is the gateway through which users receive not only content but also responses to user actions or behaviors, including user attempts to access a device's features or tools. Some portable communication devices (e.g., mobile phones) have resorted to adding more pushbuttons, increasing the density of push buttons, overloading the functions of pushbuttons, (ι or using complex menu systems to allow a user to access, store and manipulate data. These conventional user interfaces often result in complicated key sequences and menu hierarchies that must be memorized by the user. In addition, as the number of pushbuttons has increased, the proximity of neighboring buttons often makes it difficult for users to activate a desired pushbutton. : [0004] Many conventional user interfaces, such as those that include physical pushbuttons, are also inflexible. This is unfortunate because it may prevent a user interface from being configured and/or adapted by either an application running on the portable device or by users. When coupled with the time consuming requirement to memorize multiple key sequences and menu hierarchies, and the difficulty in activating a desired pushbutton, such ( > inflexibility is frustrating to most users.
[0005] Accordingly, there is a need for more transparent and intuitive user interfaces for portable electronic devices that are easy to use, configure, and/or adapt. SUMMARY OF EMBODIMENTS
[0006] The above deficiencies and other problems associated with user interfaces for portable devices are reduced or eliminated by the disclosed portable communication device 5 thai includes a telephone user interface.
[0007] In some embodiments, a method includes displaying a first image of a rotary dial in a display of the portable communications device in response to a first contact by a user with a click wheel. The first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial. The plurality of icons include numbers. ( [0008] The method may include scrolling around at least a portion of the first image of the rotary dial in response to one or more navigation commands received from the click wheel. The one or more navigation commands may correspond to the user moving the first contact around at least a portion of the click wheel. A respective icon in the plurality of icons corresponding to a current position on the first image of the rotary dial may be highlighted. f Explanations of one or more functions corresponding to one or more symbols on the click wheel in the display may be displayed.
[0009] The method may include receiving a first user command using the click wheel.
The first user command may correspond to a selection of a respective icon in the plurality of icons. The first user command may include pushing down on the click wheel. The method ( may include displaying a sequence of one or more selected icons in the display.
[0010] In some embodiments, one or more letters corresponding to the respective icon are displayed along a radial direction of the first image of the rotary dial. In some embodiments, one or more letters corresponding to the respective icon are displayed in a central region of the first image of the rotary dial. ? [001 1 ] In some embodiments, the method includes displaying a second image of the rotary dial in the display of the device in response to the user breaking the first contact with the click wheel. The second image of the rotary dial has a different shading pattern than the first image of the rotary dial. The second image of the rotary dial may be displayed if the user breaks the first contact for a time interval greater than a pre-determined value. For 0 example, the first image of the rotary dial may be faded out and the second image of the rotary dial may be faded in over a pre-determined time interval. The first image of the rotary dial may correspond to a character entry mode of operation and the second image of the rotary dial may correspond to a character correction mode of operation. [0012| In some embodiments, the method includes removing one or more previously selected icons in response to receiving a second user command using the click wheel, wherein the second user command includes pressing on a delete symbol on the click wheel. The second image of the rotary dial may include an icon corresponding to the delete symbol 5 on the click wheel.
[0013| In some embodiments, the method includes dialing a telephone number corresponding to the sequence of selected icons in response to receiving a third user command. The third user command may include pressing a click wheel button, such as a button at the center of the click wheel. The first image of the rotary dial may be modified in 1 accordance with an animation sequence during the dialing. Music, such as a portion of a music file, may be played during the dialing. Volume may be adjusted during a telephone call in response to motion of a second contact by the user with the click wheel around at least a portion of the click wheel. [0014] In some embodiments, the method includes disconnecting from the dialed 5 telephone number in response to receiving a fourth user command. The fourth user command may include pressing the button at the center of the click wheel.
[0015] The aforementioned methods may be performed by a portable electronic device having a touch-sensitive display with a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the 0 memory for performing these methods. In some embodiments, the portable electronic device provides a plurality of functions, including wireless communication.
[0016] Instructions for performing the aforementioned methods may be included in a computer program product configured for execution by one or more processors.
: BRIEF DESCRIPTION OF THE DRAWINGS
[0017 J For a better understanding of the aforementioned embodiments of the invention as well as additional embodiments thereof, reference should be made to the Description of Embodiments below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures. ( [0018] Figure 1 is a block diagram illustrating an embodiment of an architecture for a portable communication device.
[0019] Figure 2 is a schematic diagram illustrating an embodiment of a user interface for a portable communication device. (0020] Figure 3 A is a schematic diagram illustrating an embodiment ot a telephone user interface for a portable communication device.
[0021 j Figure 3 B is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device. : [0022J Figure 3C is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
10023] Figure 3D is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
[0024] Figure 4A is a schematic diagram illustrating an embodiment of a telephone ( user interface for a portable communication device.
[0025] Figure 4B is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device.
[0026) Figure 5 is a schematic diagram illustrating an embodiment of a telephone user interface for a portable communication device. 5 [0027] Figure 6 is a flow diagram of an embodiment of a telephone number dialing process.
[0028| Figure 7 is a block diagram illustrating an embodiment of an address book data structure.
[00291 Figure 8Λ is a schematic diagram illustrating an embodiment of a text entry 0 user interface for a portable communication device.
[0030] Figure 8B is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
[0031 ] Figure 8C is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device. 5 [0032] Figure 8D is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
[0033] Figure 8E is a schematic diagram illustrating an embodiment of a text entry user interlace for a portable communication device.
[0034] Figure 9A is a schematic diagram illustrating an embodiment of a text entry 0 user interface for a portable communication device.
10035 ] Figure 9B is a schematic diagram illustrating an embodiment of a text entry user interface for a portable communication device.
[0036] Figure 10 is a flow diagram of an embodiment of a text entry process.
[0037] Figure 1 1 is a flow diagram of an embodiment of a scrolling process. |0038] Figure 12A is a schematic diagram illustrating an eraDoαimem oi repiay recommendations in a user interface for a portable communication device. |00391 Figure 12B is a schematic diagram illustrating an embodiment of replay recommendations in a user interface for a portable communication device. .~ [0040] Figure 12C is a schematic diagram illustrating an embodiment of replay recommendations in a user interface for a portable communication device. [0041 ] Figure 13 is a flow diagram of an embodiment of a replay recommendation process.
100421 Figure 14A is a block diagram illustrating an embodiment of a user word
1 ( » history data structure.
[0043 j Figure 14B is a block diagram illustrating an embodiment of a language data structure system.
DESCRIPTION OF EMBODIMENTS
1 :> [0044] Reference will now be made in detail to embodiments, examples of which arc illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that the present invention may be practiced without these specific details. In other instances, well-known
2t i methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
[0045] Embodiments of user interfaces and associated processes for using a device are described. In some embodiments, the device may be a portable communications device. The user interface may include a click wheel and/or touch screen. A click wheel is a physical
2.i user-interface device that may provide navigation commands based on an angular displacement of the wheel or a point of contact with the wheel by a user of the device. A click wheel may also be used to provide a user command corresponding to selection of one or more items, for example, when the user of the device presses down on at least a portion of the wheel, lor simplicity, in the discussion that follows, a portable communications device (e.g.,
3D a cellular telephone that may also contain other functions, such as PDA and music player Functions) that includes a click wheel is used as an exemplary embodiment. It should be understood, however, that the user interfaces and associated processes may be applied to other devices, such as personal computers and laptops, that may include one or more other
physical user-interface devices, such as a keyboard, a mouse and/or a joystick. [0046] The device may support a variety of applications, such as a telephone, text messaging and a music player. The music player may be compatible with one or more file formats, such as MP3 and/or AAC. In an exemplary embodiment, the device includes an iPod music player (trademark of Apple Computer, Inc.). c [0047] The various applications that may be executed on the device may use at least one common physical user-interface device, such as the click wheel. One or more functions of the click wheel as well as corresponding information displayed on the device may be adjusted and/or varied from one application to the next and/or within a respective application. In this way. a common physical architecture (such as the click wheel) of the device may ( support the variety of applications with user interfaces that are intuitive and transparent.
[0048] Attention is now directed towards embodiments of the device. Figure 1 is a block diagram illustrating an architecture for a portable communication device 100, according to some embodiments of the invention. The device 100 may include a memory 1 02 (which may include one or more computer readable storage mediums), a memory f controller 122, one or more processing units (CPU's) 120, a peripherals interface 1 18, RF circuitry 1 08, audio circuitry 1 10, a speaker 1 1 1 , a microphone 1 13, an input/output (I/O) subsystem 106, a display system 1 12 (which may include a touch screen), a click wheel 1 14, other input or control devices 1 16, and an external port 124. These components may communicate over one or more communication buses or signal lines 103. The device 100 ( < may be any portable electronic device, including but not limited to a handheld computer, a tablet computer, a mobile phone, a media player, a personal digital assistant (PDA), or the like, including a combination of two or more of these items. In other embodiments, the device 1 00 may not be portable, such as a desktop personal computer. [0049] It should be appreciated that the device 100 is only one example of a portable : electronic device 1 00, and that the device 100 may have more or fewer components than shown, may combine two or more components, or a may have a different configuration or arrangement of the components. The various components shown in Figure 1 may be implemented in hardware, software or a combination of both hardware and software, including one or more signal processing and/or application specific integrated circuits. ( ' |0050] The memory 102 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. In some embodiments, the memory 102 may further include storage remotely located from the one or more processors 120. for instance network attached storage accessed via the RF circuitry 108 or the external port 124 and a communications network (not shown) such as the internet, mtranet(s), Local Area Networks (LANs), Wide Local Area Networks (WLANs), Storage Area Networks (SANs) and the like, or any suitable combination thereof. Access to the memory 102 by other components of the device 100, such as the CPU 120 and the peripherals interface 1 18, may be controlled by the memory controller 122.
[0051] The peripherals interface 1 18 couples the input and output peripherals of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs and/or sets of instructions stored in the memory 102 to perform various functions for the device 100 and to process data.
1 ( i [0052] In some embodiments, the peripherals interface 118, the CPU 120, and the memory controller 122 may be implemented on a single chip, such as a chip 104. In some other embodiments, they may be implemented on separate chips.
[0053] The RF (radio frequency) circuitry 108 receives and sends electromagnetic waves. The RF circuitry 108 converts electrical signals to/from electromagnetic waves and
] : communicates with communications networks and other communications devices via the electromagnetic waves. The RF circuitry 108 may include well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth. The RF circuitry
2( i 108 may communicate with networks, such as the Internet, also referred to as the World
Wide Web (WWW), an Intranet and/or a wireless network, such as a cellular telephone network, a wireless local area network (LAN) and/or a metropolitan area network (MAN), and other devices by wireless communication. The wireless communication may use any of a plurality of communications standards, protocols and technologies, including but not limited t io Global System for Mobile Communications (GSM), Enhanced Data GSM Environment
( EDGE), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.1 I a, IEEE 802.1 Ib, IEEE 802.1 I g and/or IEEE 802.1 In), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for email, instant messaging, and/or Short Message
3( Service (SMS)), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document..
[0054] The audio circuitry 1 10, the speaker 1 1 1, and the microphone 1 13 provide an audio interface between a user and the device 100. The audio circuitry 1 10 receives audio data from the peripherals interface 1 18, converts the audio data to an electrical signal, and transmits the electrical signal to the speaker 1 1 1. The speaker 1 1 1 converts the electrical signal to human-audible sound waves. The audio circuitry 1 10 also receives electrical signals converted by the microphone 1 13 from sound waves. The audio circuitry 1 10 converts the electrical signal to audio data and transmits the audio data to the peripherals interface 1 18 for :< processing. Audio data may be may be retrieved from and/or transmitted to the memory 102 and/or the RF circuitry 108 by the peripherals interface 1 18. In some embodiments, the audio circuitry 1 1 0 also includes a headset jack (not shown). The headset jack provides an interface between the audio circuitry 1 10 and removable audio input/output peripherals, such as output-only headphones or a headset with both output (headphone for one or both ears) and
K ) input (microphone).
[0055] The I/O subsystem 106 provides the interface between input/output peripherals on the device 100, such as the display system 112, the click wheel 1 14 and other input/control devices 1 16, and the peripherals interface 1 18. The I/O subsystem 106 may include a display controller 156, a click wheel controller 158 and one or more input
1 5 controllers 160 for other input or control devices. The one or more input controllers 160 receive/send electrical signals from/to other input or control devices 160. The other input/control devices 160 may include physical buttons (e.g. , push buttons, rocker buttons, ere. ). dials, slider switches, sticks, and so forth. [0056] The display system 1 12 provides an output interface and/or an input interface ( between the device and a user. The display controller 156 receives and/or sends electrical signals from/to the display system 1 12. The display system 1 12 displays visual output to the user. The visual output may include text, icons, graphics, video, and any combination thereof. In some embodiments, some or all of the visual output may correspond to user- interface objects, further details of which are described below. : 10057] In some embodiments, such as those that include a touch screen, the display system 1 12 also accepts input from the user based on haptic and/or tactile contact. In embodiments with a touch screen, the display system 1 12 forms a touch-sensitive surface that accepts user input. In these embodiments, the display system 112 and the display controller 1 56 (along with any associated modules and/or sets of instructions in the memory 102) detect
)( contact (and any movement or breaking of the contact) on the display system 1 12 and converts the detected contact into interaction with user-interface objects, such as one or more soft keys, that are displayed on a touch screen. In an exemplary embodiment, a point of contact between a touch screen in the display system 1 12 and the user corresponds to one or more digits of the user. |0058] In embodiments with a touch screen, the touch screen in the display system
1 12 may use LCD (liquid crystal display) technology, or LPD (light emitting polymer display) technology, although other display technologies may be used in other embodiments. A touch screen in the display system 112 and the display controller 156 may delect contact and any movement or breaking thereof using any of a plurality of touch sensitivity technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with a touch screen in the display system 112. A touch- sensitive display in some embodiments of the display system 112 may be analogous to the multi-touch sensitive tablets described in the following U.S. Patents: 6,323,846 (Westerman et al ), 6,570,557 (Westerman et al.), and/or 6,677,932 (Westerman), and/or U.S. Patent Publication 2002/0015024A1 , each of which is hereby incorporated by reference. However, a touch screen in the display system 1 12 displays visual output from the portable device 100, whereas touch sensitive tablets do not provide visual output. The touch screen in the display system 1 12 may have a resolution in excess of 100 dpi. In an exemplary embodiment, the touch screen in the display system may have a resolution of approximately 168 dpi. The user may make contact with the toiich screen in the display system 112 using any suitable object or appendage, such as a stylus, finger, and so forth. |0059] In some embodiments, in addition to touch screen, the device 100 may include a touchpad (not shown) for activating or deactivating particular functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad may be a touch-sensitive surface that is separate from the touch screen in the display system 112 or an extension of the touch- sensitive surface formed by the touch screen. |0060J The device 100 may include a click wheel 114. A user may navigate among one or more graphical objects (henceforth referred to as icons) displayed in the display system 1 12 by rotating the click wheel 1 14 or by moving (e.g., angular displacement) of a point of contact with the click wheel 1 14. The click wheel 1 14 may also be used to select one or more of the displayed icons. For example, the user may press down on at least a portion of the click wheel 1 14 or an associated physical button. User commands and navigation commands provided by the user via the click wheel 114 may be processed by the click wheel controller 158 as well as one or more of the modules and/or sets of instructions in the memory 102. [0061 ] The device 100 also includes a power system 162 for powering the various components. The power system 162 may include a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.
|0062] In some embodiments, the software components stored in the memory 102 may include an operating system 126, a communication module (or set of instructions) 128, a contact/motion module (or set of instructions) 130, a graphics module (or set of instructions) i n 132. one or more applications (or set of instructions) 136, a timer module (or set of instructions) 144, a word prediction module (or set of instructions) 146, an address book 148, a user word history 150, one or more character sets 152, and one or more lexicography models 154. The graphics module 132 may include an icon effects module (or set of instructions) 134. The applications module 136 may include a telephone module (or set of
1 5 instructions) 138, a text messaging module (or set of instructions) 140 and/or a music player module (or set of instructions) 142.
10063] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X,
WINDOWS, or an embedded operating system such as Vx Works) includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory ( management, storage device control, power management, etc .) and facilitates communication between various hardware and software components.
[0064] The communication module 128 facilitates communication with other devices over one or more external ports 124 and also includes various software components for handling data received by the RF circuitry 108 and/or the external port 124. The external 5 port 124 (e.g.. Universal Serial Bus (USB)5 FIREWIRE, etc.) is adapted for coupling directly to other devices or indirectly over a network (e.g., the Internet, wireless LAN, etc.). ]0065| The contact/motion module 130 may detect contact with the click wheel 1 14 and/or a touch screen in the display system 1 12 (in conjunction with the display controller 156). The contact/motion module 130 includes various software components for performing
7<- various operations related to detection of contact, such as determining if contact has occurred, determining if there is movement of the contact and tracking the movement across the click wheel 1 14 and/or a touch screen in the display system 1 12, and determining if the contact has been broken (i. e., if the contact has ceased). Determining movement of the point of contact may include determining speed (magnitude), velocity (magnitude and direction), and/or an acceleration (including magnitude and/or direction) of the point of contact. In some embodiments, the contact/motion module 130 and the display controller 156 also detects contact on a touchpad.
[0066] The graphics module 132 includes various known software components for
5 rendering and displaying graphics on the display system 112. Note that the term "graphics" includes any object that can be displayed to a user, including without limitation text, web pages, icons (such as user-interface objects including soft keys), digital images, videos, animations and the like. [0067| In some embodiments, the graphics module 132 includes the icon effects
1 (; module 134. The icon effects module 134 may modify a displayed position of one or more icons on the display system 1 12 (in conjunction with the display controller 156) based on an animation sequence.
[0068] In addition to the telephone module 138, the text messaging module 140 and/or the music player module 142, the one or more applications 136 may include any i 5 applications installed on the device 100, including without limitation, a browser, the address book 148, contact list, email, instant messaging, word processing, keyboard emulation, widgets. JAVA-enabled applications, encryption, digital rights management, voice recognition, voice replication, location determination capability (such as that provided by the global positioning system (GPS)), etc. A data structure associated with the address book 148 0 is discussed further below with reference to Figure 7.
[0069] In conjunction with the RF circuitry 108, the audio circuitry 110, the speaker
1 1 1 . the microphone 1 13, the display system 1 12, the display controller 156, the click wheel 1 14 and/or the click wheel controller 158, the telephone module 138 may be used to enter a sequence of characters corresponding to a telephone number, access one or more telephone 5 numbers in the address book 148, modify a telephone number that has been entered, dial a respective telephone number, conduct a conversation and disconnect or hang up when the conversation is completed. Embodiments of user interfaces and associated processes corresponding to the telephone module 138 are described further below with reference to Figures 3-6. 0 |0070] In conjunction with the display system 1 12, the display controller 156, the click wheel 1 14 and/or the click wheel controller 158, the text messaging module 140 may be used to enter a sequence of characters corresponding to a text message, to modify previously entered characters, to transmit a respective text message (for example, using a Short Message
Service or SMS protocol), to receive text messages and to view received text messages. In some embodiments, transmitted and/or received text messages may include graphics, photos, audio files, video files and/or other attachments as are supported in a Multimedia Message Service (MMS) and/or an Enhanced Messaging Service (EMS). Embodiments of user interlaces and associated processes corresponding to the text messaging module 140, and more generally, to text entry and communication are described further below with reference to Figures 8- 10, 12 and 13.
[0071 ) In conjunction with the display system 1 12, the display system controller 156, the click wheel 1 14, the click wheel controller 158, the audio circuitry 110, the speaker 1 11 and/or the microphone 1 13, the music player module 142 allows the user to play back
K' recorded music stored in one or more files, such as MP3 or AAC files. In some embodiments, the device 100 may include the functionality of an MP3 player, such as an iPod (trademark of Apple Computer, Inc.). The device 100 may, therefore, include a 36-pin connector that is compatible with the iPod. [00721 The timer module 144 may provide a time reference and/or time stamps for
15 user commands received by the device 100, for example, using the click wheel 114 and the click wheel controller 158.
[0073] The word prediction module 146 may be used in conjunction with one or more of the applications 136, such as the text messaging module 140. The word prediction module 146 may suggest one or more words or symbols (such as punctuation marks, pronunciation 0 marks or spaces) in accordance with a context. The context may be based on one or more of the lexicography models 154 (for example, grammatical and/or syntax rules associated with one or more languages) and/or a user word history 150. The context may include one or more previously entered words, characters, and/or symbols. The context may depend on which of the applications 136 is being used. For example, there may be different contexts for 5 an email application as opposed to a word processing application.
10074] The user word history 150 may include static content (such as that associated with a dictionary) and/or dynamic content (such as that associated with characters, symbols and/or words that are routinely and/or recently used by the user). The user word history 150 may include a static dictionary built up by scanning a user's address book, emails, and other 0 documents. The user word history 150 may include weighted scores or probabilities for predicted words based on a set of characters, symbols and/or words that are provided by the user to the device 100, for example, using the click wheel 114 and the click wheel controller 1 58. The user word history 150 may also include use statistics (e.g., time of use and/or frequency of use) of one or more characters, symbols and/or words that are provided by the user. The user word history 150 is discussed further below with reference to Figures 14A and MU.
[00751 The character sets 152 may include one or more sets of characters corresponding tυ numbers, letters and/or symbols. The letters and/or symbols may ; correspond to one or more languages. The character sets 152 may be used by one or more of the applications 136, such as the text messaging module 140.
[0076| In some embodiments, the device 100 may include one or more optional optical sensors (not shown), such as CMOS or CCD image sensors, for use in imaging applications.
K i [0077] In some embodiments, the device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen in the display system 1 12 and/or a touchpad. By using a touch screen and/or a touchpad as the primary input/control device for operation of the device 100, the number of physical input/control devices (such as push buttons, dials, and the like) on the device 100 may be
1 ; reduced. In one embodiment, the device 100 includes a touch screen, a touchpad, a push button for powering the device on/off and locking the device, a volume adjustment rocker button and a slider switch for toggling ringer profiles. The push button may be used to turn the power on/off on the device by depressing the button and holding the button in the depressed state for a predefined time interval, or may be used to lock the device by 0 depressing the button and releasing the button before the predefined time interval has elapsed.
In an alternative embodiment, the device 100 also may accept verbal input for activation or deactivation of some functions through the microphone 1 13.
|0078| The predefined set of functions that may be performed exclusively through a touch screen and/or a touchpad include navigation between user interfaces. In some 5 embodiments, the touchpad, when touched by the user, navigates the device 100 to a main, home, or root menu from any user interface that may be displayed on the device 100. In such embodiments, the touchpad may be referred to as a "menu button." In some other embodiments, the menu button may be a physical push button or other physical input/control device instead of a touchpad. 0 [0079 J In some embodiments, the device 100 is a device where operation of a predefined set of functions on the device is performed exclusively or at least in part through the click wheel 1 14. By using the click wheel 1 14 as the primary input/control device for operation of the device 100, the number of other physical input/control devices (such as push buttons, dials, and the like) on the device 100 may be reduced. [0080] Attention is now directed towards embodiments of user interfaces and associated processes that may be implemented on the device 100. Figure 2 is a schematic diagram illustrating an embodiment of a user interface for a portable communication device 300. The device 300 includes a click wheel 310 and a display 312. The click wheel constitutes a physical interface for receiving user commands (such as selection of one of more items and/or icons that are displayed on the display 312) and/or navigation commands ( which may, for example, control scrolling through the items and/or icons that are displayed on the display 312). The user may use the click wheel 310 by touching it (making a point of contact) and then moving the point of contact while maintaining contact. Such angular displacement may indicate a navigation command to scroll through the items and/or icons that are displayed on the display 312. By pressing down on the click wheel 310, or a click wheel button 308 (e.g., at the center of the click wheel), the user may select one or more items and/or icons that are displayed on the display 312. Thus, a pressing down gesture may indicate a user command corresponding to selection. 10081 ] The device 300 may display a menu or hierarchy of the applications 136 that may be executed or run on the device 300. Such a menu is illustrated in Figure 2 in the display 312. The displayed icons for the applications 136 include 'Favorites' for popular applications for this user, 'Recent' for calls that have been made, answered, and/or missed within a first pre-determined value (such as the last day, week or month), 'Contacts' (which corresponds to the address book 148 in Figure 1), 'Dial' (which corresponds to the telephone module 138 in Figure 1) and 'SMS' (which corresponds to the text messaging module 140 in Figure 1 ). The 'Music', 'Extras', 'Settings' and 'Now playing' icons may correspond to the music player module 142 (Figure 1 ). The arrow icons on the right-hand side of the display 3 12 may provide a visual clue to the user that selection of a respective icon will move down through the menu hierarchy down to the corresponding application (with a commensurate modification of the information displayed in the display 312). The display 312 may also include an icon, such as that shown in the upper right-hand corner, that indicates a remaining stored power level for the device 300. [0082] As discussed previously, if the user selects the 'Dial' icon in the display 312, the telephone module 138 (Figure 1) may be executed. Embodiments of telephone user interlaces for the portable communication device 300 that correspond to the telephone module 138 (Figure 1) are illustrated in Figure 3A-3D. While the device 300 in these figures has been illustrated with certain components (including displayed information) and a particular arrangement of these components, it should be understood that there may be fewer or more components, two or more components may be combined, and positions of one or more components may be changed.
(0083] As shown in Figure 3A, if a user touches the click wheel 310, for example with a finger 318 (not drawn to scale in the figure), when the telephone module 138 (Figure r> 1 ) is running, an icon or a set of icons corresponding to a rotary dial image 314_1 may be displayed in the display 312. Prior to the user touching the click wheel 310, no image is displayed or an image other than a rotary dial image is displayed (e.g., the menu illustrated in Figure 2, a sleep mode image, or an image corresponding to another application may be displayed). The rotary dial image 314- 1 may correspond to a character entry mode of i υ operation in the telephone module 138 (Figure 1), e.g., a mode of operation where the user may enter in characters, such as numbers, that correspond to a telephone number the user wishes to dial. In some embodiments, the contact is maintained for more than a second predetermined time interval prior to the device 100 transitioning to the character entry mode of operation. The second pre-determined time interval may be 0.5, 1 or 2 s.
I 5 f 0084] The rotary dial image 314_1 may include a plurality of icons arranged proximate to a periphery of the rotary dial image. The plurality of icons may include numbers. As shown in Figure 3 A, in some embodiments, the rotary dial image includes the numbers 1 -9 arranged as on a clock face, with the 10, 11, and 12 o'clock positions replaced with 0. * . and #, respectively. In other embodiments, the displayed icons are arranged in a
20 pattern corresponding to a conventional rotary dial interface for a telephone.
[0085] As shown in Figure 3 A, the display 312 may include icons, such as those shown in the upper left-hand corner, that indicate a signal strength of signals used to communicate with a network, such as a cellular telephone network. The display 312 may include icons 316 corresponding to a sequence of one or more displayed icons that have been
Z 5 previously selected by the user. These icons 31 6 may be numbers in a set of numbers, e.g., a telephone number, that the user wishes to dial. The selection process is described further below.
[0086] By moving a point of contact around at least a portion of the click wheel 310, the user may provide navigation commands to the device 300. As discussed previously, the
30 navigation commands may correspond to scrolling through the icons displayed on the display
3 12. For the rotary dial image 314_1 , the scrolling may be around the circumference of the rotary dial image 3 14_1 . For example, the user may scroll through the icons corresponding io numbers. As shown in Figure 3B, in some embodiments a respective icon 320, which corresponds to a current position, may be highlighted. In some embodiments, there is an absolute angular relationship between contact points on the clickwheel 310 and icon positions on the rotary dial image 3 14 (e.g., the 3 o'clock position on the clickwheel 310 corresponds to the 3 o'clock position in the rotary dial image 3 14, the 6 o'clock position on the clickwheel 31 0 corresponds to the 6 o'clock position in the rotary dial image 314, etc.).
5 | 0087] Tn some embodiments, in order for the rotary dial image 314 1 to continue to be displayed (e.g., the device 300 remains in the character entry mode of operation) the user maintains the contact with the click wheel 314 even while moving around at least a portion of the click wheel 3 14 1 to provide navigation commands. In some embodiments, the rotary dial image 314_1 continues to be displayed even if the user breaks contact with the click
! ( I wheel 3 14 if the break in contact is for less than a third pre-determined amount of time or time interval. For example, for time intervals less than 0.5, 1 or 2 s. This functionality may allow the user to break contact with the click wheel 314 while moving around at least a portion of the click wheel 314 (e.g., while providing navigation commands). If the user breaks contact with the click wheel 314, the navigation commands may be determined based
! 5 on intervals where there is a point of contact (e.g., in a time interval preceding the breaking of contact and in a time interval after the contact has been reestablished). 10088) The user may select the respective icon 320 (i.e., provide the user command corresponding to selection) by pressing down on the click wheel 310 and/or by pressing on the button 308 (Figure 2). When the respective icon is selected, a corresponding character or U number may be added to the displayed sequence of selected icons 316.
|0089] As shown in Figure 3C, in some embodiments one or more icons 322 corresponding to one or more letters associated with the respective icon 320 may be displayed in a central region of the rotary dial image 314 1. As shown in Figure 3D, in some embodiments sets of one or more icons, such as icon 324, corresponding to one or more 5 letters associated with at least a subset of the plurality of icons in the rotary dial image 314 1 may be displayed along a radial direction of the rotary dial image 314 1. |0090] While embodiments of user interfaces for the character entry mode of operation the device 300 have been described, in other embodiments (not shown) the user may use the device 300 to access the address book 148 (Figure 1) to select one or more 0 telephone numbers that he or she wishes to dial.
10091 ] When a user has completed entering in a telephone number that he or she wishes to dial, or if the user makes a mistake while entering in the telephone number that he or she wishes to correct, the user may transition to a character correction mode of operation in the telephone module 138 (Figure 1). Embodiments of telephone user interfaces for a portable communication device 400 that correspond to this mode of operation are illustrated in Figure 4A and 4B. While the device 400 in these figures has been illustrated with certain components (including displayed information) and a particular arrangement of these components, it should be understood that there may be fewer or more components, two or 5 more components may be combined, and positions of one or more components may be changed.
[ϋ()92| The user may transition to the character correction mode of operation by breaking contact with the click wheel 314 or by breaking contact with the click wheel 314 for more than the third pre-determined time interval. When the device 300 transitions to the (. character correction mode of operation, a new icon or set of icons corresponding to rotary dial image 314_2 may be displayed on the display 312. The rotary dial image 314_2 has different shading or coloring than the rotary dial image 314_1 (Figures 3A-3D) to indicate to the user that the mode of operation has changed. 10093] In some embodiments, the transition from the display of the rotary dial image 5 3 14 1 (Figures 3A-3D) to the rotary dial image 314_2 is continuous. For example, the rotary dial image 314_1 (Figures 3 A-3D) may be faded out and the rotary dial image 314_2 may be faded in over a fourth pre-determined time interval. The fourth pre-determined time interval may be 0.5. 1 or 2 s. In some embodiments, the fourth time interval is a time interval greater than a pre-determined value. ( [0094] In the character correction mode of operation, the user may provide a user command to the device 400 that indicates one or more characters corresponding to one or more previously selected icons should be removed. For example, the user may press on the click wheel 31 0 over or proximate to a symbol 326 that corresponds to a delete function. When a character is deleted the displayed icons 316 may be modified to indicate the change. : As shown in Figure 4B3 in some embodiments an icon or set of icons corresponding to a rotary dial image 314_3 may include icon 330 that provides a visual clue to the user as to the functionality corresponding to the symbol 326 on the click wheel 310. (0095] After deleting one or more previously selected characters, the user may make contact with the click wheel for at least a fifth pre-determined time interval in order to return ( to the character entry mode of operation. The fifth pre-determined time interval may be 0.5,
1 or 2 s. In some embodiments, the user may return to the character entry mode of operation by clicking on a predetermined location on the clickwheel 310, such as symbol 336 on the elickwbeel 3 10. In some embodiments, the user may return to the character entry mode of operation by moving a point of contact a predetermined amount or angle on the clickwheel 3 1 0. In this mode, the user may select one or more additional icons to complete the sequence ol" characters corresponding to the telephone number that the user wishes to dial. In some embodiments (not shown in Figure 4B), rotary dial image 314_3 may include an icon that provides a visual clue to the user as to the functionality corresponding to the symbol 336 on 5 the click wheel 310, analogous to the visual cue that icon 330 provides for symbol 326.
[0096] If the user does not need to delete any characters or does not need to select any additional characters after deleting one or more characters, the user may provide a user command to the device 400 corresponding to dialing the previously entered telephone number by pressing on the button 308. An icon 328 in the display 312 may be displayed to
I (; provide the user a visual clue as to the current functionality of the button 308. In some embodiments, one or more additional icons corresponding to one or more functions of the click wheel 3 10 may be displayed on the display 3 12 in the device 300 (Figures 3A-3B), the device 400 (Figures 4A-4B) and/or a device 500 {Figure 5). [0097| When the user presses on the button 308, the device 400 may dial the selected
1 5 telephone number. The device 400, therefore, may enter a dialing mode of operation. An embodiment of telephone user interfaces for the portable communication device 500 that correspond to this mode of operation is illustrated in Figure 5. While the device 500 has been illustrated with certain components (including displayed information) and a particular arrangement of these components, it should be understood that there may be fewer or more ι components, two or more components may be combined, and positions of one or more components may be changed.
[00981 During the dialing mode of operation, an icon or a set of icons corresponding to a rotary dial image 314_4 may be displayed. The rotary dial image 314_4 may be modified during the dialing. The modification may be in accordance with an animation : sequence. For example, the rotary dial image 314_4 may be rotated clockwise or counter clockwise. In some embodiments, music, such as a portion of a music file may be played during the dialing.
|00991 1° some embodiments, the user may adjust a volume of the speaker 1 1 1
( Figure 1 ) by moving a point of contact with the click wheel 310 approximately clockwise d and/or counter clockwise around at least a portion of the click wheel 310. The device 500 may remain in the dialing mode of operation even if the user maintains the contact with the click wheel 310 for more than a pre-determined time interval, such as the fifth predetermined time interval. [00100] The rotary dial image 314_4 may include an icon 332 that provides a visual clue to the user as to how he or she should disconnect the telephone call when he or she wishes to. In particular, the icon 322 indicates that by providing a user command (e.g., by pressing on the button 308) the user may disconnect or end the telephone call. After a 5 respective telephone call is ended, the device 500 may return to the character correction mode ol' operation.
[(X)I Ul I Figure 6 is a flow diagram of an embodiment of a telephone number dialing process 600. While the telephone number dialing process 600 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the
I f - process 600 can include more or fewer operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation. [001021 A first image of a rotary dial on a display is displayed in response to a first
1 i contact by a user with a click wheel (610). At least a portion of the first image of the rotary dial is scrolled around in response to one or more navigation commands (612). A respective icon in a plurality of icons corresponding to a first position on the first image of the rotary dial is highlighted (614). A first user command corresponding to selection of the respective icon is received using the click wheel (616). A sequence of one or more selected icons is ( displayed on the display (618). A second image of the rotary dial is optionally displayed on the display in response to the user breaking the first contact with the click wheel (620). One or more previously selected icons are optionally removed in response to receiving a second user command (622). The second user command may include pressing a delete symbol on the click wheel. A telephone number corresponding to the sequence of selected icons is : dialed or disconnected in response to receiving a third user command (624). The third user command includes pressing a click wheel button (e.g., 308).
[00103] Attention is now directed towards embodiments of data structures that may be used in implementing the telephone module 138 (Figure 1) and/or other applications 136 { Figure 1 ). Figure 7 is a block diagram illustrating an embodiment of an address book data
3d structure 700. The address book 148 may include multiple contacts 712. Λ respective contact, such as the contact 712-1, may include one or more names 714-1 , one or more addresses 71 6-1 , one or more telephone numbers 718-1 , one or more email addresses 720-1, as well as other information 722-1. In some embodiments the address book data structure 700 may include fewer or more components. Two or more components may be combined and un order of two or more components may be changed.
[001041 Attention is now directed towards additional embodiments of user interfaces and associated processes that may be implemented on the device 100 (Figure 1). As .? discussed previously, if the user selects the 'SMS' icon in the display 312 (Figure 2), the text messaging module 140 (Figure 1) may be executed. Embodiments of text messaging user interfaces for a portable communication device 800 that correspond to the text messaging module 140 (Figure 1) are illustrated in Figure 8A-8E and 9A-9B. While the device 800 in these figures has been illustrated with certain components (including displayed information)
1 ( and a particular arrangement of these components, it should be understood that there may be fewer or more components, two or more components may be combined, and positions of one or more components may be changed.
[00105) In Figure 8A, the device 800 has several trays 810 displayed on the display
312. A respective tray in the trays 810 includes a region of the display 312. A tray 810_l
1 : may be configured to display one or more characters that are selected by the user. The user ma\ select a respective character using the click wheel 310. The user may provide a user command that indicates such a selection in an analogous fashion to that discussed above with reference to Figures 3A-3D. A tray 810J2 may include one or more symbols that provide visual clues and/or explanations to the user as to current functions (in a current mode of
2(ι operation) corresponding to one or more symbols on the click wheel 310. In this way, the user may be alerted to changes in the functionality of the click wheel 310 without changing the symbols on the click wheel 310. In other embodiments, one or more symbols displayed on the click wheel 310 may be modified in accordance with a current function(s) of the click wheel 310. In the embodiment shown in Figure 8 A, the tray 810_2 includes explanations for
2;- a delete function, a space function and instructions as to how to obtain a capitalized letter or character. These functions may be selected by pressing on an appropriate portion of the click wheel 310 and/or pressing on the click wheel 310 for at least a sixth pre-determined time interval. For example, the user may obtain a capitalized letter or character by highlighting a corresponding icon on the display 312 and pressing down on the click wheel 310 or a click
) wheel button 308 for longer than the sixth pre-determined time interval. The letter or character may be selected (i.e., the user command may be provided) when the user presses down on or breaks contact with the click wheel 310 or the button 308. The sixth predetermined time interval may be 0.5, 1 or 2 s. [00106] A tray 810_3 may include a plurality of icons 812 1 corresponding to a set of characters (in this example, letters in the English alphabet) and one or more recommended words 814. The one or more recommended words 814 may be provided based on a language data structure system 1450 (Figure 14B). In some embodiments, the one or more ^ recommended words 814 are provided before receiving any characters selected by the user.
For example, the one or more recommended words 814 may be in accordance with an application 136 and the user word history 150 (Figure 1).
|00107] As illustrated in Figure 8A, a current position in the tray 810_3 may be indicated by highlighting (e.g., shading) of a respective icon (a current position icon) in the l ι. tray 810 3, in this case, of the word 'hello'. The icons 812_1 and the one or more recommended words 814 may constitute a set. The user may scroll or move through this set by providing navigation commands using the click wheel 310 in an analogous fashion to that discussed above with reference to Figures 3A-3D. In some embodiments, the user may provide a plurality of user commands using the click wheel 310, including selection of
15 multiple icons, while maintaining contact with the click wheel 310. Thus, the user may provide navigation commands (by moving a point of contact with at least a portion of the click wheel 310) and user commands (by pressing on the click wheel 310) while maintaining contact with the click wheel 310. This may increase a number of characters, symbols and/or words that the user may select per minute and may make it easier for the user to use the ( device 800.
|()0108] In some embodiments, the device 800 includes one or more additional trays. This is illustrated in Figure 8B, which includes a tray 810_4. The tray 810_4 may include a plurality of icons 812_2 corresponding to a set of characters (in this case, numbers). In some embodiments, the icons 812 1, the icons 812__2 and the one or more recommended words : 814 may constitute a set. The user may scroll or move through this set by providing navigation commands using the click wheel 310 in an analogous fashion to that discussed above with reference to Figures 3A-3D.
[00109] The tray 810_4 may include icons corresponding to inserting a space in a message and to sending a message. The user may select one of these icons by providing 0 commands using the click wheel 310. In some embodiments, a space may be automatically added after one or more of the recommended words 814 (Figure 8A) are selected by the user. [00 UO] In some embodiments, the tray 810_3 may include a display adjustment icon
81 6. If the user selects the display adjustment icon 816, additional icons may be displayed in the tray 810_3. This is illustrated in Figure 8C. After selecting the display adjustment icon 81 6. the one or more recommended words 814 (Figure 8A) are replaced by icons corresponding to punctuation marks 818. In some embodiments, selecting the display adjustment icon 81 6 a second time will replace the icons corresponding to punctuation marks 818 with the one or more recommended words 814 (Figure 8A).
5 [001 1 11 In some embodiments, other icons corresponding to additional characters or sets of characters may be displayed if the display adjustment icon 816 is selected a second lime and i f the user presses down on the click wheel 310 or the click wheel button 308 for longer than a pre-determined time interval, such as the sixth pre-determined time interval. fhis is illustrated in Figure 8D, which shows icons 812_3 (which in this case correspond to
I U numbers).
[00112] In some embodiments, a space that was automatically added to a message after one or more of the recommended words 814 (Figure 1 ) was selected may be automatically removed if a next user command corresponds to the display adjustment icon 816. For example, if selecting the display adjustment icon 816 corresponding to the displaying of the
1 5 icons corresponding to the punctuation marks 818 (Figure 8C), the automatically added space may not be needed in the message and may, therefore, be automatically removed. [001 13J Depending on the character sets that are being used by the user, in some embodiments the device 800 may display one or more icons corresponding to pronunciation marks 820 after a respective icon is selected. This is illustrated in Figure 8E, which shows 1 icons corresponding to pronunciation marks 820 displayed in the tray 810_3. Selecting one of these icons may modify the previously selected respective icon to include the corresponding pronunciation mark.
[00114] Figures 9A and 9R illustrate additional embodiments of user interfaces for text messaging. In Figure 9Λ, tray 810 1 displays a message that is being composed, including
2: characters and/or words that have been previously selected by the user. Tray 810_3 includes a plurality of icons, including a 'JUMP' icon 910 and alternate character set icons 912 and 914. Selecting one or the alternate character set icons 912 and 914 may result in additional icons corresponding to additional character sets being displayed on the display 312. Selecting the 'JUMP' icon 910 may lead to a discontinuous change in the current position in
3 ( ' the tray 810_3. This is illustrated in Figure 9B, which shows the highlighting corresponding to the current position moving from the 'JUMP' icon 910 to the number 6. [001 15] Figure 10 is a flow diagram of an embodiment of a text entry process 1000.
While the text entry process 1000 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the process 1000 can include more or fewer operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation. [OUl 161 A first tray and a second tray are displayed (1010). The first tray is configured
5 Io display one or more characters selected by a user using a click wheel and the second tray may include a first plurality of icons corresponding to characters and one or more recommended words. At least a portion of the first plurality of icons and one or more recommended words are scrolled through in accordance with one or more navigation commands received from the click wheel (1012). A third tray is optionally displayed (1014).
1 ( The third tray includes a second plurality of icons. The second plurality of icons includes numbers. A respective icon in the first plurality of icons corresponding to a current position in the second tray is highlighted (1016). A first user command corresponding to selection of the respective icon is received (1018). The first user command may include pushing down on the click wheel or a click wheel button. In some embodiments, after the first user command
1 : is received, the respective icon remains highlighted. In other embodiments, after the first user command is received, the first recommended word icon is highlighted, which makes it easier for the user to select the first recommended word. Explanation of one or more functions corresponding to one or more symbols on the click wheel may be optionally displayed on the display ( 1020). A space may be automatically added after receiving a second user command
21 ( 1022). The second user command may correspond to a selection of one or more of the recommended words. Icons corresponding to punctuation marks may be optionally displayed in accordance with one or more characters that are selected by the user (1024). 1001 17] A sensitivity of the scrolling through the trays 810 in Figures 8A-8E and 9A-
C)B as a function of the motion of the point of contact by the user may be adjusted and/or
2 r varied over time. Similar adjustment and/or variation in the scrolling sensitivity may be implemented in other applications 136 (Figure 1), such as the telephone module 138. Figure 1 1 is a flow diagram of an embodiment of a scrolling process 1100. While the scrolling process 1 100 described below includes a number of operations that appear to occur in a specific order, it should be apparent that the process 1100 can include more or fewer ?( operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation.
[001 18] A plurality of icons displayed on a display arc scrolled through (1 1 10). The scrolling is in accordance with a speed and/or an acceleration of a point of contact by a user with a click wheel. In some embodiments, a scroll rate is slower for a pre-determined angular displacement of the contact just after the scrolling is started, just prior to stopping the scrolling and/or when a direction of the scrolling is reversed (1 1 12). In some embodiments, a scroll rate is slower for a pre-determined time interval of the contact just after the scrolling is .ς started, jusl prior to stopping the scrolling and/or when a direction of the scrolling is reversed
( 1 1 14).
(001 19] Attention is now directed towards additional embodiments of user interfaces and associated processes for implementing replay recommendations on the device 100 (Figure 1 }. One challenge associated with using the click wheel 310 (Figure 9B) is that it 1 may be difficult for the user to navigate within an existing message to correct an error, such as a spelling or lexicography error. As a consequence, the user may have to delete multiple words in the message in order to fix the error. In the user interface and process described below, at least some of the words in an existing message that are deleted may be replayed, i.e.. provided to the user as recommended words, in a reverse sequential order to that when f the words were deleted. In this way, it may be easier for a user to reconstruct the remainder of the message after correcting the error.
|ϋϋ 12Oj The device 100 (Figure 1 ) may determine that there is a potential replay condition, i.e., that it may be appropriate to provide one or more recommended words as part of a replay recommendation, based on the user deleting one or more previously entered words ( in a message. In some embodiments, the potential replay recommendation may be in accordance with zero or more additional words, characters or symbols that the user adds to the message after deleting one or more words.
(00121 ] The user may select one or more of the recommended words in such a replay recommendation using the click wheel 1 14 (Figure 1) or by making a gesture (such as a r swipe) on a touch-sensitive display in the display system 1 12 (Figure 1). Once a word is accepted, it may be removed from the recommended words and a next word in the reverse sequence of previously deleted words may be provided/recommended. (00122] Figures 12A-12C are schematic diagrams illustrating embodiments of user interfaces that may be implemented on a device 1200 during a replay recommendation d process. While the device 1200 in these figures has been illustrated with certain components
( including displayed information) and a particular arrangement of these components, it should be understood that there may be fewer or more components, two or more components may be combined, and positions of one or more components may be changed. [00123] In Figure 12Λ, a current set of characters 1210_l that have been selected by the user (e.g., based on a sequence of user commands provided by the user) include a spelling error. The current set of characters 1210_l includes a current sequence of words. In some embodiments, the current set of characters 1210_l includes a grammatical error and/or a 5 lexicography error. In some embodiments, the current set of characters 1210_l includes a misspelled word (e.g., "djde", as shown in Figure 12A) or an extra word (e.g., "Hey dude, how how are you doing?", not shown). In some embodiments, the current set of characters
121 C) 1 is missing a word (e.g., "Hey dude, are you doing?", not shown). The user commands may be provided using the click wheel 310. In other embodiments, the user
I ( i commands may be provided using one hand or one finger, for example, using a touch- sensitive display.
[00124| In Figure 12B, the user has deleted (i.e., provided user commands to delete) characters in the current set of characters, resulting in a new current set of characters 1210_2. Based on a determination of a potential replay condition, the device 1200 displays replay
1 " recommendations in the recommended words 814. These correspond to at least a subset of the previously deleted words from the current set of characters 1210 1 . These previously deleted words are presented in reverse sequential order relative to an order in which at least the subset of the deleted words was deleted.
[00125] In Figure 12C, the user has selected one or the recommended words 814. The
2« word is added to a current set of characters 1210_3 and is removed from the recommended words 814. A next deleted word in the reverse sequential order of deleted words is displayed with the recommended words 814. This process may be repeated until the message is completed, i.e., the current set of characters 1210_l (Figure 12A) is restored without the spelling error (i.e., the spelling error in 1210 1 is corrected).
2r [00126] In some embodiments, the recommended words 814 may include additional words, characters and/or symbols that were not deleted. These words, characters and/or symbols may be determined using the language data structure system 1450 (Figure 14B). In some embodiments, the additional recommendations may include punctuation marks and/or pronunciation marks.
3( |00127] In some embodiments, a space may be automatically inserted in the message after one or more of the recommended words 814 are accepted. In some embodiments, such a space is automatically removed if a next user command corresponds to selection of a punctuation mark. In some embodiments, one or more words in the current sequence of words 1210_3 may be capitalized in accordance with a context of the one or more words, characters and/or symbols in the current sequence of words 1210_3.
[00128] Figure 13 is a flow diagram of an embodiment of a replay recommendation process 1300. While the replay recommendation process 1300 described below includes a 5 number of operations that appear to occur in a specific order, it should be apparent that the process 1300 can include more or fewer operations, which can be executed serially or in parallel (e.g., using parallel processors or a multi-threading environment), an order of two or more operations may be changed and/or two or more operations may be combined into a single operation. 0 [00129] A current set of characters is received in response to user commands (1310).
The set of characters includes a sequence of words. Additional user commands that specify characters to delete from and/or add to the current set of characters are received (1312). Replay recommendations for words to be added to the current set of characters are provided ( 1 3 14). The replay recommendations include one or more deleted words that correspond to :; the deleted characters. A user command corresponding to acceptance of a respective recommended word is received, the respective recommended word is removed from the replay recommendations, and the respective word is added to the current set of characters ( 13 16). Operations 1312 and 1314 may be optionally repeated 1318. 100130] Attention is now directed towards embodiments of data structure systems that ( may be used in implementing the text messaging module 140 (Figure 1), the text entry process ( 1000), the replay recommendation process 1300 (Figure 13) and/or other applications 136 on the device 100 (Figure 1). Figure 14A is a block diagram illustrating an embodiment of a user word history data structure 1400. The user word history 150 may include a deleted word stack 1410 and multiple words 1416. The words 1416 may include : one or more characters and/or one or more symbols. The deleted word stack 1410 includes one or more words 1414 in a sequential order in which the one or more words 1414 were deleted by the user in an application, such as the text messaging module 140 (Figure 1). The deleted word stack 1410 may be used in the device 1200 (Figures 12A-12C) and in the replay recommendation process 1300 (Figure 13). D (00131 1 A respective word in the words 1416, such as word 1416-M, may include multiple records. A respective record may include a time-weighted score 1418, use statistics 1420 (such as a time of use and/or a frequency of use), a context 1422 and one or more applications 1424. The time-weighted score 1418 may indicate a probability that the word
1416-M is a next predicted word based on the context 1422 (one or more characters, symbols and/υr words that have previously been provided by the user) and/or the application 1424. For example, the time-weighted score 1418 for an. email application may be different than the time-weighted score for the text messaging module 140 (Figure 1). The time-weighted score 1418 may be computed to favorably weight (e.g., give a higher probability) to words that are 5 used recently. For example, the time-weighted score 1418 may give favorable weighting to words 1416 that are used within the last 24 hours or week. Words 1416 used on longer time scales (e.g., more than a day or a week ago) may have their corresponding time-weighted scores 141 8 reduced by a pre-determined ratio (such as 0.9) for each additional time interval (e.g., each day or week) since the words 1416 were last used.
I d [00132] The user history data structure 1400 may include static information (for example, corresponding to a dictionary and/or grammatical and syntax rules for one or more languages) as well as dynamic information (based on recent usage statistics and/or patterns). The user word history data structure 1400 may include a static dictionary built up by scanning a user's address book, emails, and other documents. The user history data structure
1 5 1400 may be dynamically updated continuously, after pre-determined time intervals, or when a new word or syntax is employed by the user. In some embodiments the user history data structure 1400 may include fewer or more components. Two or more components may be combined and an order of two or more components may be changed. [00133] Figure 14B is a block diagram illustrating an embodiment of a language data
2i structure, system 1450. The data structure system 1450 may be used to provide recommended words in the device 800 (Figures 8A-8R). A sequence of symbols 1462 (including one or more characters, symbols and/or words) may be provided by the user. A set of symbols 1462 corresponding to a context 1422-1 may be processed by a context map 1460. In some embodiments, the context 1422-1 may be a null set, e.g., one or more recommended words
2r are provided before the user provides any symbols 1462 in a current application session. In other embodiments, the context 1422-1 may include one or more previously entered or provided words as well as one or more symbols, such as the first one, two or three letters in a current word that the user is providing. The context map 1460 may include a select and hashing module 1464 and a hash map 1466. The hash map 1466 may select one or more
30 appropriate entries in an application-specific dictionary 1468. The entries in the application- specific dictionary 1468 may include contexts 1470, predicted words 1472, and time- weighted scores 1472. The application-specific dictionary 1468 may utilize the records in the user history data structure 1400. As a consequence, the application-specific dictionary 1468 may be dynamically updated continuously, after prc-dctermined time intervals, or when a new word or syntax is employed by the user.
[UO 134] The language data structure system 1450 may be used to provide one or more recommended words based on the context 1422-1. The context map 1460 may find a top-5 or 5 top- 10 best context 1470 matches. The corresponding predicted words 1472 may be recommended to the user in accordance with the time-weighted scores 1474. In some embodiments, only a subset of the predicted words 1470 corresponding to the best context ] 470 matches may be presented to the user (e.g., just the top-1, top-2, or top-3 predicted words).
11 [00135J In some embodiments, the language data structure system 1450 may provide one or more recommended words in accordance with a state machine (corresponding to a Markov sequence or process) that corresponds to a language. For example, the application- specific dictionary 1468 may be based on a stochastic model of the relationships among letters, characters, symbols and/or words in a language.
I r [00136] A path memory (such as up to three characters in a word that is currently being entered and/or two or three previously entered words) of the probabilistic model represents a tradeoff between accuracy and the processing and power capabilities (for example, battery life) of the portable communication device 100 (Figure 1). In some embodiments, such a probabilistic model may be based on a lexicography and usage that is
20 user-specific and/or, as discussed previously, even application specific. For example, user emails, address book and/or other documents may be analyzed to determine an appropriate probabilistic model for that user based on the syntax and/or lexicography (including names and slang) that are employed by the user. The probabilistic model may be updated continuously, after pre-determined time intervals, or when a new word or syntax is employed
2.-' by the user.
[00137) In some embodiments, the probabilistic model may be based on one or more mistakes made by the user when using the click wheel 1 14 (Figure 1) and/or a touch-sensitive display in the display system 1 12 (Figure 1). For example, if the user accidentally selects the wrong icon when typing a respective word, the probabilistic model may be updated to
3" account lυr such errors in the future. In an exemplary embodiment, a mistake may be determined based on a user activation of an icon corresponding to the delete function. This adaptability of the portable communication device 100 (Figure 1) may allow correction of user interface errors (such as parallax and/or left-right symmetry) associated with which finger(s) the user is using and how the user is holding the portable communication device 100 (Figure 1 ) while using it. This adaptability of the portable communication device 100 (Figure 1 ) may also be used to prevent the recommendation of misspelled words (e.g., by deleting such words from the user word history 150 or giving such words very low weighted scores). (001381 In some embodiments the language data structure system 1450 may include fewer or more components, Two or more components may be combined and an order of two or more components may be changed.
(00139] The foregoing descriptions of specific embodiments of the present invention are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Rather, it should be appreciated that many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

f 001401 What is claimed is:
1 . A method, comprising displaying a first image of a rotary dial in a display of a portable communications device in response to a first contact by a user with a click wheel,
5 wherein the first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial, and wherein the plurality of icons include numbers.
2. The method of claim 1 , further comprising scrolling around at least a portion of the first image of the rotary dial in response to one or more navigation commands received from
1 (J the click wheel, wherein the one or more navigation commands correspond to the user moving the first contact around at least a portion of the click wheel.
3. The method of claim 1 , further comprising highlighting a respective icon in the plurality of icons corresponding to a current position on the first image of the rotary dial.
] ς
4. The method of claim 1 , wherein one or more letters corresponding to a respective icon in the plurality of icons are displayed along a radial direction of the first image of the rotary dial.
2',
5. The method of claim 1 , wherein one or more letters corresponding to a respective icon in the plurality of icons are displayed in a central region of the first image of the rotary dial.
6. The method of claim 1 , further comprising receiving a user command using the click wheel, wherein the user command corresponds to a selection of a respective icon in the
2.'1 plurality of icons, and wherein the user command includes pushing down on the click wheel.
7. The method of claim 1 , further comprising displaying a sequence of one or more selected icons πvthe display.
3D 8. The method of claim 1 , further comprising displaying a second image of the rotary dial in the display of the device in response to the user breaking the first contact with the click wheel, wherein the second image of the rotary dial has a different shading pattern than the lirst image of the rotary dial.
9. The method of claim 8, wherein the first image of the rotary dial is faded out and the second image of the rotary dial is faded in over a pre-determined time interval.
10. The method of claim 8, wherein the second image of the rotary dial is displayed if the user breaks the first contact for a time interval greater than a pre-determined value.
1 1. The method of claim 8, wherein the first image of the rotary dial corresponds to a character entry mode of operation and the second image of the rotary dial corresponds to a character correction mode of operation.
12. The method of claim 8, further comprising removing one or more previously selected icons in response to receiving a user command using the click wheel, wherein the user command includes pressing on a delete symbol on. the click wheel.
1 3. The method of claim 12, wherein the second image of the rotary dial includes an icon corresponding to the delete symbol on the click wheel.
14. The method of claim 1 , further comprising dialing a telephone number corresponding to a sequence of selected icons in response to receiving a first user command, wherein the first user command includes pressing a button at the center of the click wheel.
I 5. The method of claim 14, further comprising modifying the first image of the rotary dial in accordance with an animation sequence during the dialing.
16. The method of claim 14, further comprising playing a portion of a music file during the dialing.
1 7. The method of claim 14, further comprising disconnecting from the dialed telephone number in response to receiving a second user command, wherein the second user command includes pressing the button at the center of the click wheel.
1 8. The method of claim 14, further comprising adjusting volume during a telephone call in response to motion of a second contact by the user with the click wheel around at least a portion of the click wheel.
19. The method of claim 1, further comprising displaying explanations of one or more Functions corresponding to one or more symbols on the click wheel in the display.
.^ 20. A graphical user interface, comprising a first image of a rotary dial on a device, wherein the first image of the rotary dial is displayed in response to a first contact by a user with a click wheel, the first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial, and wherein the plurality of icons include numbers.
! ()
2 1 . A computer program product for use in conjunction with a portable communications device, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising instructions for displaying a first image of a rotary dial in a display of the device
! 5 sn response to a first contact by a user with a click wheel, wherein the first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial, and wherein the plurality of icons include numbers.
22. A portable communications device, comprising: ( ι a display; one or more processors; memory; and a program, wherein the program is stored in the memory and configured to be executed by the one or more processors, the program including: 5 instructions for displaying a first image of a rotary dial in the display of the device in response to a first contact by a user with a click wheel, wherein the first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial, and wherein the plurality of icons include numbers.
0 23. A portable communications device, comprising: display means; one or more processor means; memory means; and a program mechanism, wherein the program mechanism is stored in the memory means and configured to be executed by the one or more processors means, the program mechanism including: instructions for displaying a first image of a rotary dial in the display means of the device in response to a first contact by a user with a click wheel, wherein the first image of the rotary dial includes a plurality of icons arranged proximate to a periphery of the rotary dial, and wherein the plurality of icons include numbers.
PCT/US2007/060120 2006-01-05 2007-01-04 Telephone interface for a portable communication device WO2007082140A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US75683106P 2006-01-05 2006-01-05
US60/756,831 2006-01-05
US11/459,609 US7860536B2 (en) 2006-01-05 2006-07-24 Telephone interface for a portable communication device
US11/459,609 2006-07-24

Publications (1)

Publication Number Publication Date
WO2007082140A1 true WO2007082140A1 (en) 2007-07-19

Family

ID=37914001

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/060120 WO2007082140A1 (en) 2006-01-05 2007-01-04 Telephone interface for a portable communication device

Country Status (2)

Country Link
US (1) US7860536B2 (en)
WO (1) WO2007082140A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007054550A1 (en) * 2007-11-15 2009-05-20 Gbs Holding Gmbh Digital dictating machine has display device and controlling device that are corporate with each other in such manner that respective operating condition is displayed by display device in dictating cartridge
US8723808B2 (en) 2007-02-28 2014-05-13 Lg Electronics Inc. Mobile terminal including touch rotary dial display

Families Citing this family (139)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9722766D0 (en) 1997-10-28 1997-12-24 British Telecomm Portable computers
US7469381B2 (en) 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
US7312785B2 (en) 2001-10-22 2007-12-25 Apple Inc. Method and apparatus for accelerated scrolling
KR100433396B1 (en) * 2001-10-29 2004-06-02 삼성전자주식회사 On/off shifting appratus and method for electronic equipment
US7333092B2 (en) 2002-02-25 2008-02-19 Apple Computer, Inc. Touch pad for handheld device
US7587611B2 (en) 2003-05-30 2009-09-08 Privaris, Inc. In-circuit security system and methods for controlling access to and use of sensitive data
US20070152977A1 (en) 2005-12-30 2007-07-05 Apple Computer, Inc. Illuminated touchpad
US7499040B2 (en) 2003-08-18 2009-03-03 Apple Inc. Movable touch pad with added functionality
US7495659B2 (en) 2003-11-25 2009-02-24 Apple Inc. Touch pad for handheld device
US8059099B2 (en) 2006-06-02 2011-11-15 Apple Inc. Techniques for interactive input to portable electronic devices
CN100555200C (en) 2004-08-16 2009-10-28 苹果公司 The method of the spatial resolution of touch sensitive devices and raising touch sensitive devices
US7880729B2 (en) 2005-10-11 2011-02-01 Apple Inc. Center button isolation ring
US7509588B2 (en) 2005-12-30 2009-03-24 Apple Inc. Portable electronic device with interface reconfiguration mode
US20070152983A1 (en) 2005-12-30 2007-07-05 Apple Computer, Inc. Touch pad with symbols based on mode
US7546131B1 (en) * 2006-01-20 2009-06-09 Google Inc. Emulating a messaging operation for mobile devices
US7787618B2 (en) 2006-03-29 2010-08-31 Nokia Corporation Portable electronic device
US8296484B2 (en) * 2006-03-30 2012-10-23 Harris Corporation Alphanumeric data entry apparatus and method using multicharacter keys of a keypad
US8743060B2 (en) 2006-07-06 2014-06-03 Apple Inc. Mutual capacitance touch sensing device
US9360967B2 (en) 2006-07-06 2016-06-07 Apple Inc. Mutual capacitance touch sensing device
US8022935B2 (en) 2006-07-06 2011-09-20 Apple Inc. Capacitance sensing electrode with integrated I/O mechanism
DE102007032818A1 (en) * 2006-07-18 2008-02-14 Samsung Electro-Mechanics Co., Ltd., Suwon Information input device and input method therefor
US8014760B2 (en) 2006-09-06 2011-09-06 Apple Inc. Missed telephone call management for a portable multifunction device
US10313505B2 (en) 2006-09-06 2019-06-04 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US7864163B2 (en) 2006-09-06 2011-01-04 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US8842074B2 (en) 2006-09-06 2014-09-23 Apple Inc. Portable electronic device performing similar operations for different gestures
US7956849B2 (en) * 2006-09-06 2011-06-07 Apple Inc. Video manager for portable multifunction device
US20080055263A1 (en) * 2006-09-06 2008-03-06 Lemay Stephen O Incoming Telephone Call Management for a Portable Multifunction Device
US7795553B2 (en) 2006-09-11 2010-09-14 Apple Inc. Hybrid button
US8274479B2 (en) 2006-10-11 2012-09-25 Apple Inc. Gimballed scroll wheel
US8090087B2 (en) * 2006-10-26 2012-01-03 Apple Inc. Method, system, and graphical user interface for making conference calls
US20100005389A1 (en) * 2006-10-27 2010-01-07 Soren Borup Jensen Apparatus and method for a user to select one or more pieces of information
US8482530B2 (en) 2006-11-13 2013-07-09 Apple Inc. Method of capacitively sensing finger position
US8214768B2 (en) * 2007-01-05 2012-07-03 Apple Inc. Method, system, and graphical user interface for viewing multiple application windows
US20080168402A1 (en) 2007-01-07 2008-07-10 Christopher Blumenberg Application Programming Interfaces for Gesture Operations
US20080168478A1 (en) 2007-01-07 2008-07-10 Andrew Platzer Application Programming Interfaces for Scrolling
US7844915B2 (en) 2007-01-07 2010-11-30 Apple Inc. Application programming interfaces for scrolling operations
US20080165148A1 (en) * 2007-01-07 2008-07-10 Richard Williamson Portable Electronic Device, Method, and Graphical User Interface for Displaying Inline Multimedia Content
US7975242B2 (en) 2007-01-07 2011-07-05 Apple Inc. Portable multifunction device, method, and graphical user interface for conference calling
US8519964B2 (en) 2007-01-07 2013-08-27 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
KR100896055B1 (en) * 2007-01-15 2009-05-07 엘지전자 주식회사 Mobile terminal having a rotating input device and display method thereof
USD609714S1 (en) * 2007-03-22 2010-02-09 Fujifilm Corporation Electronic camera
BRPI0721584A2 (en) * 2007-04-20 2013-03-05 Kohler Co user interfaces
US9933937B2 (en) 2007-06-20 2018-04-03 Apple Inc. Portable multifunction device, method, and graphical user interface for playing online videos
US9772751B2 (en) 2007-06-29 2017-09-26 Apple Inc. Using gestures to slide between user interfaces
WO2009032898A2 (en) 2007-09-04 2009-03-12 Apple Inc. Compact input device
US8619038B2 (en) 2007-09-04 2013-12-31 Apple Inc. Editing interface
US11126321B2 (en) 2007-09-04 2021-09-21 Apple Inc. Application menu user interface
US9619143B2 (en) 2008-01-06 2017-04-11 Apple Inc. Device, method, and graphical user interface for viewing application launch icons
US8683378B2 (en) 2007-09-04 2014-03-25 Apple Inc. Scrolling techniques for user interfaces
CN104200145B (en) 2007-09-24 2020-10-27 苹果公司 Embedded verification system in electronic device
US20090102818A1 (en) * 2007-10-22 2009-04-23 Motorola, Inc. Method and device for error-free keypad input
JP5340584B2 (en) * 2007-11-28 2013-11-13 インターナショナル・ビジネス・マシーンズ・コーポレーション Device and method for supporting reading of electronic message
US8416198B2 (en) 2007-12-03 2013-04-09 Apple Inc. Multi-dimensional scroll wheel
US8265689B2 (en) * 2007-12-28 2012-09-11 Google Inc. Multi-tapping numpad
US8600120B2 (en) 2008-01-03 2013-12-03 Apple Inc. Personal computing device control using face detection and recognition
JP2009171055A (en) * 2008-01-11 2009-07-30 Canon Inc Image processing apparatus and method of controlling the same
US8125461B2 (en) 2008-01-11 2012-02-28 Apple Inc. Dynamic input graphic display
US8820133B2 (en) 2008-02-01 2014-09-02 Apple Inc. Co-extruded materials and methods
US8667413B2 (en) * 2008-02-14 2014-03-04 Creative Technology Ltd Apparatus and method for information input in an electronic device with display
US8645827B2 (en) 2008-03-04 2014-02-04 Apple Inc. Touch event model
US8416196B2 (en) 2008-03-04 2013-04-09 Apple Inc. Touch event model programming interface
US8717305B2 (en) 2008-03-04 2014-05-06 Apple Inc. Touch event model for web pages
US8205157B2 (en) 2008-03-04 2012-06-19 Apple Inc. Methods and graphical user interfaces for conducting searches on a portable multifunction device
US9454256B2 (en) 2008-03-14 2016-09-27 Apple Inc. Sensor configurations of an input device that are switchable based on mode
US20100058251A1 (en) * 2008-08-27 2010-03-04 Apple Inc. Omnidirectional gesture detection
US8816967B2 (en) 2008-09-25 2014-08-26 Apple Inc. Capacitive sensor having electrodes arranged on the substrate and the flex circuit
JP5228755B2 (en) * 2008-09-29 2013-07-03 富士通株式会社 Portable terminal device, display control method, and display control program
US8395590B2 (en) 2008-12-17 2013-03-12 Apple Inc. Integrated contact switch and touch sensor elements
KR20100081577A (en) * 2009-01-06 2010-07-15 삼성전자주식회사 Apparatus and method for controlling navigation of object in a portable terminal
US8433376B2 (en) * 2009-01-29 2013-04-30 Darrel Self Small form factor communication device
US8406816B2 (en) * 2009-02-03 2013-03-26 Research In Motion Limited Method and apparatus for implementing a virtual rotary dial pad on a portable electronic device
US8589374B2 (en) 2009-03-16 2013-11-19 Apple Inc. Multifunction device with integrated search and application selection
US8285499B2 (en) 2009-03-16 2012-10-09 Apple Inc. Event recognition
US9684521B2 (en) 2010-01-26 2017-06-20 Apple Inc. Systems having discrete and continuous gesture recognizers
US8566045B2 (en) 2009-03-16 2013-10-22 Apple Inc. Event recognition
US9311112B2 (en) 2009-03-16 2016-04-12 Apple Inc. Event recognition
US9354751B2 (en) 2009-05-15 2016-05-31 Apple Inc. Input device with optimized capacitive sensing
US8872771B2 (en) 2009-07-07 2014-10-28 Apple Inc. Touch sensing device having conductive nodes
US8736561B2 (en) 2010-01-06 2014-05-27 Apple Inc. Device, method, and graphical user interface with content display modes and display rotation heuristics
US8438504B2 (en) 2010-01-06 2013-05-07 Apple Inc. Device, method, and graphical user interface for navigating through multiple viewing areas
US20110291946A1 (en) * 2010-05-26 2011-12-01 T-Mobile Usa, Inc. Touchpad interaction
US8552999B2 (en) 2010-06-14 2013-10-08 Apple Inc. Control selection approximation
EP2466436A1 (en) * 2010-12-13 2012-06-20 Research In Motion Limited Portable electronic device including keyboard and touch-sensitive display for second plurality of characters.
EP2466435A1 (en) * 2010-12-13 2012-06-20 Research In Motion Limited Portable electronic device including keyboard and touch-sensitive display for second plurality of characters.
US9285836B2 (en) 2010-12-13 2016-03-15 Blackberry Limited Portable electronic device including touch-sensitive display
WO2012098428A1 (en) * 2011-01-18 2012-07-26 Nokia Corporation Task performance
US9298363B2 (en) 2011-04-11 2016-03-29 Apple Inc. Region activation for touch sensitive surface
US8769624B2 (en) 2011-09-29 2014-07-01 Apple Inc. Access control utilizing indirect authentication
US9002322B2 (en) 2011-09-29 2015-04-07 Apple Inc. Authentication with secondary approver
JP6023879B2 (en) 2012-05-18 2016-11-09 アップル インコーポレイテッド Apparatus, method and graphical user interface for operating a user interface based on fingerprint sensor input
US20130326428A1 (en) * 2012-05-30 2013-12-05 Huawei Technologies Co., Ltd. Text input method and apparatus
CN102750003B (en) * 2012-05-30 2016-08-10 华为技术有限公司 The method and apparatus of text input
US8554875B1 (en) 2012-08-13 2013-10-08 Ribbon Labs, Inc. Communicating future locations in a social network
US8584051B1 (en) 2012-08-13 2013-11-12 Ribbon Labs, Inc. Location and time user interface dial
US8605094B1 (en) 2012-08-13 2013-12-10 Ribbon Labs, Inc. Graphical display of locations
US8589808B1 (en) 2012-08-13 2013-11-19 Ribbon Labs, Inc. Suggestions in a social network
CN102857637B (en) * 2012-09-03 2016-03-23 小米科技有限责任公司 A kind of associated person information acquisition methods, system and device
TW201414126A (en) * 2012-09-28 2014-04-01 Powertech Ind Co Ltd System and method for controlling device switching on/off, and mobile communication device therefor
US20150116309A1 (en) * 2012-11-05 2015-04-30 Andrew Ofstad Subtle camera motions in a 3d scene to anticipate the action of a user
US10423214B2 (en) 2012-11-20 2019-09-24 Samsung Electronics Company, Ltd Delegating processing from wearable electronic device
US11157436B2 (en) 2012-11-20 2021-10-26 Samsung Electronics Company, Ltd. Services associated with wearable electronic device
US11372536B2 (en) * 2012-11-20 2022-06-28 Samsung Electronics Company, Ltd. Transition and interaction model for wearable electronic device
US10551928B2 (en) 2012-11-20 2020-02-04 Samsung Electronics Company, Ltd. GUI transitions on wearable electronic device
US10185416B2 (en) 2012-11-20 2019-01-22 Samsung Electronics Co., Ltd. User gesture input to wearable electronic device involving movement of device
US11237719B2 (en) 2012-11-20 2022-02-01 Samsung Electronics Company, Ltd. Controlling remote electronic device with wearable electronic device
US8994827B2 (en) 2012-11-20 2015-03-31 Samsung Electronics Co., Ltd Wearable electronic device
US9477313B2 (en) 2012-11-20 2016-10-25 Samsung Electronics Co., Ltd. User gesture input to wearable electronic device involving outward-facing sensor of device
CN103965368A (en) * 2013-02-04 2014-08-06 陈朋 Bitter herbs polysaccharide extraction method
CN103152623B (en) * 2013-02-05 2016-09-21 深圳创维-Rgb电子有限公司 Remote controller is to the method for display device input character
US9134881B2 (en) * 2013-03-04 2015-09-15 Google Inc. Graphical input display having a carousel of characters to facilitate character input
DE102013004239A1 (en) * 2013-03-12 2014-09-18 Audi Ag Device associated with a vehicle with speller completion proposal
KR102130796B1 (en) * 2013-05-20 2020-07-03 엘지전자 주식회사 Mobile terminal and method for controlling the same
US9733716B2 (en) 2013-06-09 2017-08-15 Apple Inc. Proxy gesture recognizer
USD737847S1 (en) * 2013-06-10 2015-09-01 Apple Inc. Display screen or portion thereof with graphical user interface
US9898642B2 (en) 2013-09-09 2018-02-20 Apple Inc. Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs
USD750658S1 (en) 2013-09-10 2016-03-01 Apple Inc. Display screen or portion thereof with graphical user interface
USD749107S1 (en) * 2013-09-24 2016-02-09 Yamaha Corporation Display screen with animated graphical user interface
EP3080763A4 (en) * 2013-12-10 2017-07-26 De Lage Landen Financial Services Method and system for negotiating, generating, documenting, and fulfilling vendor financing opportunities
USD754182S1 (en) * 2013-12-20 2016-04-19 Teenage Engineering Ab Display screen or portion thereof with graphical user interface
US10691332B2 (en) 2014-02-28 2020-06-23 Samsung Electronics Company, Ltd. Text input on an interactive display
USD766318S1 (en) * 2014-03-07 2016-09-13 Apple Inc. Display screen or portion thereof with animated graphical user interface
US9483763B2 (en) 2014-05-29 2016-11-01 Apple Inc. User interface for payments
JP6238844B2 (en) 2014-06-17 2017-11-29 オリンパス株式会社 Surgical manipulator operating device and surgical manipulator system
US9411429B2 (en) * 2014-06-20 2016-08-09 Google Inc. Rotary controller arrangement
USD787553S1 (en) 2014-11-20 2017-05-23 General Electric Company Display screen or portion thereof with icon
KR20160123879A (en) 2015-04-17 2016-10-26 삼성전자주식회사 Electronic apparatus and method for displaying screen thereof
DK179186B1 (en) 2016-05-19 2018-01-15 Apple Inc REMOTE AUTHORIZATION TO CONTINUE WITH AN ACTION
KR101744124B1 (en) * 2016-08-26 2017-06-07 이진우 Character and function recognition apparatus and method to dual fuction of inputs and ouputs in character outputs area
JP1589813S (en) * 2016-12-02 2017-11-06
US10365823B2 (en) 2017-03-02 2019-07-30 International Business Machines Corporation Simplified text entry user interface for touch devices
GB2561220A (en) * 2017-04-06 2018-10-10 Sony Corp A device, computer program and method
JP6736686B1 (en) 2017-09-09 2020-08-05 アップル インコーポレイテッドApple Inc. Implementation of biometrics
KR102185854B1 (en) 2017-09-09 2020-12-02 애플 인크. Implementation of biometric authentication
USD877751S1 (en) * 2018-03-16 2020-03-10 Magic Leap, Inc. Display panel or portion thereof with graphical user interface
US11170085B2 (en) 2018-06-03 2021-11-09 Apple Inc. Implementation of biometric authentication
US11153687B1 (en) 2018-08-24 2021-10-19 Apple Inc. Wireless headphone interactions
US10860096B2 (en) 2018-09-28 2020-12-08 Apple Inc. Device control using gaze information
US11100349B2 (en) 2018-09-28 2021-08-24 Apple Inc. Audio assisted enrollment
USD916841S1 (en) * 2019-04-29 2021-04-20 Anhui Huami Information Technology Co., Ltd. Wearable device display screen with graphical user interface

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0588210A1 (en) * 1992-09-08 1994-03-23 Hitachi, Ltd. Portable radio telephone set
WO2001074133A2 (en) * 2000-03-31 2001-10-11 Ventris, Inc. Method and apparatus for input of alphanumeric text data from twelve key keyboards
US20020030665A1 (en) * 2000-09-11 2002-03-14 Matsushita Electric Industrial Co., Ltd. Coordinate input device and portable information apparatus equipped with coordinate input device
EP1510911A2 (en) * 2003-08-28 2005-03-02 Sony Corporation Information processing apparatus, information processing method, information processing program and storage medium containing information processing program

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL91183C (en) 1954-01-19
US5963671A (en) * 1991-11-27 1999-10-05 International Business Machines Corporation Enhancement of soft keyboard operations using trigram prediction
US5748512A (en) * 1995-02-28 1998-05-05 Microsoft Corporation Adjusting keyboard
US5801941A (en) * 1996-08-12 1998-09-01 International Business Machines Corporation Mobile client computer programmed to establish soft keyboard targeting sensitivity
US5883612A (en) 1996-10-24 1999-03-16 Motorola, Inc. Method for positioning a vibrating alert adjacent to a selected alert in selective call device
US5890181A (en) * 1996-11-14 1999-03-30 Kurzwell Applied Intelligence, Inc. System and method for remotely grouping contents of an action history stack
GB2322508A (en) * 1997-02-21 1998-08-26 Nokia Mobile Phones Ltd Display scrolling means for a radio telephone handset
US6185591B1 (en) * 1997-07-29 2001-02-06 International Business Machines Corp. Text edit system with enhanced undo user interface
KR100595924B1 (en) * 1998-01-26 2006-07-05 웨인 웨스터만 Method and apparatus for integrating manual input
US6011542A (en) * 1998-02-13 2000-01-04 Sony Corporation Graphical text entry wheel
US6359572B1 (en) * 1998-09-03 2002-03-19 Microsoft Corporation Dynamic keyboard
FI110216B (en) * 1998-12-29 2002-12-13 Nokia Corp Method and device for editing the entered text
US6710771B1 (en) 1999-05-13 2004-03-23 Sony Corporation Information processing method and apparatus and medium
US20030006956A1 (en) * 1999-05-24 2003-01-09 Charles Yimin Wu Data entry device recording input in two dimensions
US7286115B2 (en) * 2000-05-26 2007-10-23 Tegic Communications, Inc. Directional input system with automatic correction
US6407325B2 (en) * 1999-12-28 2002-06-18 Lg Electronics Inc. Background music play device and method thereof for mobile station
US6573844B1 (en) * 2000-01-18 2003-06-03 Microsoft Corporation Predictive keyboard
US6654733B1 (en) * 2000-01-18 2003-11-25 Microsoft Corporation Fuzzy keyboard
US6597345B2 (en) * 2000-03-03 2003-07-22 Jetway Technologies Ltd. Multifunctional keypad on touch screen
JP2001344039A (en) 2000-03-31 2001-12-14 Seiko Epson Corp Information processor and method for controlling the same and control program of the same
US6593914B1 (en) * 2000-10-31 2003-07-15 Nokia Mobile Phones Ltd. Keypads for electrical devices
JP2002101178A (en) * 2000-09-21 2002-04-05 Sony Corp Portable communication terminal and image displaying method
JP2002207561A (en) * 2001-01-05 2002-07-26 Sony Corp Information processing method and device, and storage medium
US6677932B1 (en) * 2001-01-28 2004-01-13 Finger Works, Inc. System and method for recognizing touch typing under limited tactile feedback conditions
US6570557B1 (en) 2001-02-10 2003-05-27 Finger Works, Inc. Multi-touch system and method for emulating modifier keys via fingertip chords
US7312785B2 (en) * 2001-10-22 2007-12-25 Apple Inc. Method and apparatus for accelerated scrolling
US6604840B2 (en) 2001-11-27 2003-08-12 Marion H. Watson Lighting apparatus for a sign
US7149550B2 (en) * 2001-11-27 2006-12-12 Nokia Corporation Communication terminal having a text editor application with a word completion feature
US7083342B2 (en) * 2001-12-21 2006-08-01 Griffin Jason T Keyboard arrangement
US7111788B2 (en) * 2002-04-22 2006-09-26 Nokia Corporation System and method for navigating applications using a graphical user interface
US6867965B2 (en) 2002-06-10 2005-03-15 Soon Huat Khoo Compound portable computing device with dual portion keyboard coupled over a wireless link
FI20021162A0 (en) * 2002-06-14 2002-06-14 Nokia Corp Electronic device and a method for administering its keypad
FI112119B (en) * 2002-06-25 2003-10-31 Nokia Corp Touch screen control command interpreting method for electronic device e.g. mobile station, involves interpreting contact area larger than area before touch, as same area when area has been touched for release of touch
US7166791B2 (en) * 2002-07-30 2007-01-23 Apple Computer, Inc. Graphical user interface and methods of use thereof in a multimedia player
JP4091407B2 (en) * 2002-11-28 2008-05-28 富士通株式会社 Touch panel keyboard, POS system, touch panel keyboard display method, touch panel keyboard display program, and recording medium
CA2426867A1 (en) * 2003-04-30 2004-10-30 Naviform Holdings Ltd. Customizable keyboard
US20050125570A1 (en) 2003-10-23 2005-06-09 Robert Olodort Portable communication devices
WO2005081894A2 (en) * 2004-02-23 2005-09-09 Hillcrest Laboratories, Inc. Keyboardless text entry
US20050283724A1 (en) * 2004-06-18 2005-12-22 Research In Motion Limited Predictive text dictionary population
US7107147B2 (en) 2004-09-14 2006-09-12 Alpine Electronics, Inc Data correction method and apparatus using key filtering function for entering data in navigation system
US7561145B2 (en) * 2005-03-18 2009-07-14 Microsoft Corporation Systems, methods, and computer-readable media for invoking an electronic ink or handwriting interface
US7443316B2 (en) * 2005-09-01 2008-10-28 Motorola, Inc. Entering a character into an electronic device
US20070106732A1 (en) * 2005-11-10 2007-05-10 Nokia Corporation Mobile communication terminal and method therefor
US20070152983A1 (en) * 2005-12-30 2007-07-05 Apple Computer, Inc. Touch pad with symbols based on mode

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0588210A1 (en) * 1992-09-08 1994-03-23 Hitachi, Ltd. Portable radio telephone set
WO2001074133A2 (en) * 2000-03-31 2001-10-11 Ventris, Inc. Method and apparatus for input of alphanumeric text data from twelve key keyboards
US20020030665A1 (en) * 2000-09-11 2002-03-14 Matsushita Electric Industrial Co., Ltd. Coordinate input device and portable information apparatus equipped with coordinate input device
EP1510911A2 (en) * 2003-08-28 2005-03-02 Sony Corporation Information processing apparatus, information processing method, information processing program and storage medium containing information processing program

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Synaptics: Handy wie einen iPod bedienen", 21 September 2004, GOLEM.DE, XP002431736 *
NOKIA: "Bedienungsanleitung NOKIA 7280", 22 December 2005, NOKIA, XP002431735 *
NOKIA: "Interaktive Demos NOKIA 7280 (Screenshot)", 25 November 2005, NOKIA, XP002431737 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8723808B2 (en) 2007-02-28 2014-05-13 Lg Electronics Inc. Mobile terminal including touch rotary dial display
DE102007054550A1 (en) * 2007-11-15 2009-05-20 Gbs Holding Gmbh Digital dictating machine has display device and controlling device that are corporate with each other in such manner that respective operating condition is displayed by display device in dictating cartridge
DE102007054550B4 (en) * 2007-11-15 2011-07-07 GBS Holding GmbH, 85598 Digital dictaphone with "look and feel" of a tape recorder

Also Published As

Publication number Publication date
US20070155434A1 (en) 2007-07-05
US7860536B2 (en) 2010-12-28

Similar Documents

Publication Publication Date Title
US7574672B2 (en) Text entry interface for a portable communication device
US7860536B2 (en) Telephone interface for a portable communication device
US8918736B2 (en) Replay recommendations in a text entry interface
US11481112B2 (en) Portable electronic device performing similar operations for different gestures
US7694231B2 (en) Keyboards for portable electronic devices
US20070152980A1 (en) Touch Screen Keyboards for Portable Electronic Devices
US20190220155A1 (en) Portable multifunction device, method, and graphical user interface for interacting with user input elements in displayed content
US7667148B2 (en) Method, device, and graphical user interface for dialing with a click wheel
US7793228B2 (en) Method, system, and graphical user interface for text entry with partial word display
US7966578B2 (en) Portable multifunction device, method, and graphical user interface for translating displayed content
AU2008100011A4 (en) Positioning a slider icon on a portable multifunction device
US20080098331A1 (en) Portable Multifunction Device with Soft Keyboards
US20080165145A1 (en) Portable Multifunction Device, Method, and Graphical User Interface for Interpreting a Finger Swipe Gesture
US20140125609A1 (en) Portable Multifunction Device, Method, and Graphical User Interface for Adjusting an Insertion Point Marker
US20080165144A1 (en) Portrait-Landscape Rotation Heuristics for a Portable Multifunction Device
US20080167083A1 (en) Method, Device, and Graphical User Interface for Location-Based Dialing
US20080094356A1 (en) Methods for Determining a Cursor Position from a Finger Contact with a Touch Screen Display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07709956

Country of ref document: EP

Kind code of ref document: A1