US8218790B2 - Techniques for customizing control of volume level in device playback - Google Patents

Techniques for customizing control of volume level in device playback Download PDF

Info

Publication number
US8218790B2
US8218790B2 US12/198,803 US19880308A US8218790B2 US 8218790 B2 US8218790 B2 US 8218790B2 US 19880308 A US19880308 A US 19880308A US 8218790 B2 US8218790 B2 US 8218790B2
Authority
US
United States
Prior art keywords
volume
mapping
volume change
playback
change request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/198,803
Other versions
US20100054497A1 (en
Inventor
William Bull
Policarpo Wood
Kourtny Minh HICKS
Benjamin Andrew Rottler
Eric James Hope
Alan Cannistraro
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Inc filed Critical Apple Inc
Priority to US12/198,803 priority Critical patent/US8218790B2/en
Assigned to APPLE INC. reassignment APPLE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HICKS, KOURTNY MINH, HOPE, ERIC JAMES, ROTTLER, BENJAMIN ANDREW, WOOD, POLICARPO, CANNISTRARO, ALAN, BULL, WILLIAM
Assigned to APPLE INC. reassignment APPLE INC. CORRECTIVE ASSIGNMENT TO CORRECT THE DATE OF EXECUTION FOR INVENTOR KOURTNY MINH HICKS TO AUGUST 8, 2008 PREVIOUSLY RECORDED ON REEL 021449 FRAME 0686. ASSIGNOR(S) HEREBY CONFIRMS THE EXECUTION DATE OF INVENTOR KOURTNY MINH HICKS IS AUGUST 8, 2008. Assignors: HOPE, ERIC JAMES, ROTTLER, BENJAMIN ANDREW, WOOD, POLICARPO, CANNISTRARO, ALAN, BULL, WILLIAM, HICKS, KOURTNY MINH
Publication of US20100054497A1 publication Critical patent/US20100054497A1/en
Application granted granted Critical
Publication of US8218790B2 publication Critical patent/US8218790B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G3/00Gain control in amplifiers or frequency changers without distortion of the input signal
    • H03G3/02Manually-operated control

Definitions

  • the present invention relates generally to audio playback devices, and more particularly to controlling the output volume.
  • Media assets such as audio tracks, video tracks, or images (e.g., photos) can be stored, displayed, and/or played on a portable media device (“PMD”) or on a host computer executing a media management application (“MMA”).
  • PMD portable media device
  • MMA media management application
  • a portable media device acquires its media assets from a host computer executing an MMA, and the user may use the MMA to organize the collection of media assets.
  • PMD may be the iPod® portable media device, currently available from Apple Inc. of Cupertino, Calif.
  • An MMA may be iTunes® media management application, produced by Apple Inc.
  • Embodiments of the present invention operate to change playback volume in response to user input signals that request a volume change by mapping the user input signals to volume change control signals that actually control the volume.
  • the user input requesting a volume change/increase/decrease is often referred to simply as a volume change/increase/decrease request.
  • the user input can be provided by action on a user interface device, for example, by one or more of a gesture on a plurality of capacitive sensors, and/or an actuation of a movable element, and/or a manipulation of a displayed control element, which can be provided by a GUI engine.
  • Embodiments of the present invention recognize and address the possibility that there are times where the user requires the ability to change the volume more quickly (and/or more slowly) than usual.
  • An example of such a time is an interval (of a duration referred to as T Override ) following the start of playback.
  • T Override an interval (of a duration referred to as T Override ) following the start of playback.
  • Achieving a faster or slower volume change may entail, during those times, using a mapping between the user input signals and the volume change control signals that is different from the mapping that used at other times.
  • the different mapping is referred to as the override mapping to distinguish it from the default mapping. Since the override mapping is in effect before the default mapping, it is sometimes referred to as the first mapping and the default mapping is sometimes referred to as the second mapping.
  • start of playback is defined broadly to include situations in addition to the first time the user invokes playback of stored assets after power up.
  • playback should also be considered to have started when the user pauses playback in the middle of a track, for example by pressing a “Pause” button, and then resumes playback by pressing a “Play” button.
  • the two functions are often embodied in a single button that toggles between “Pause” and “Play.” Playback can also be considered to have started at the beginning of a track after the end of the previous track. While continuous playback of tracks can have brief periods of silence between the tracks, this is not necessary.
  • Another situation that is functionally similar to, and should be considered as, the start of playback is a situation during playback when the volume increases substantially after an interval of low-volume playback (i.e., where the volume has fallen below a threshold and remains there for a predetermined period).
  • PMDs portable media devices
  • MMAs media management applications
  • Other types of audio playback devices and systems represent additional environments that might benefit from the enhanced volume control provided by embodiments of the present invention.
  • a method of controlling playback volume on an audio output device where a volume change request is converted to a volume change control comprises, in response to a volume change request: if the elapsed time since playback started is less than a predetermined interval, using a first mapping to convert the volume change request to a volume change control; otherwise, for at least some elapsed times greater than the predetermined interval, using a second mapping to convert the volume change request to a volume change control, wherein the first mapping is different from the second mapping for at least some volume levels; and using the volume change control to modify the playback volume.
  • the predetermined interval comprises a plurality of subintervals
  • using the first mapping comprises using one or more of a plurality of sub-mappings, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into.
  • the method can further comprise: at the start of playback, establishing a first volume control state characterized by the first mapping; when the predetermined interval has elapsed, establishing a second volume control state characterized by the second mapping; and when a second predetermined interval has elapsed after the end of the first predetermined interval, at a time after the start of playback, but before the second volume control state is established, establishing a third volume control state characterized by a third mapping of volume change requests to volume change controls, wherein the third mapping is different from the first and second mappings for at least some volume levels.
  • a method of controlling playback volume on an audio output device where a volume change request is converted to a volume change control comprises, in response to a volume change request: at the start of playback, establishing a first volume control state characterized by a first mapping of volume change requests to volume change controls; at a time after the start of playback, establishing a second volume control state characterized by a second mapping of volume change requests to volume change controls, where the first mapping is different from the second mapping for at least some volume levels; and in response to a volume change request, changing the volume in accordance with the current volume control state.
  • the first volume control state comprises a plurality of sub-states characterized by a plurality of sub-mappings, at least some of which differ from one another, depending on which of the subintervals the volume change request falls into.
  • the method can further comprise: at a time after the start of playback, but before the second volume control state is established, establishing an intermediate volume control state characterized by an intermediate mapping of volume change requests to volume change controls, wherein the intermediate mapping is different from the first and second mappings for at least some volume levels.
  • a method of controlling playback volume on an audio output device where a volume change request is defined by respective values of a set of one or more parameters comprises: at the start of playback, establishing a first volume control state characterized by a first set of parameter values that define a response to a volume change request; after a given elapsed time after the start of playback, establishing a second volume control state characterized by a second set of parameter values, wherein the second set of parameter values define a different response to a volume change request than the response defined by the first set of parameter values; and in response to a volume change request, changing the volume in accordance with the current volume control state.
  • the given elapsed time comprises a plurality of subintervals
  • the first volume control state comprises a plurality of sub-states, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into
  • the first set of parameter values comprises a plurality of subsets of parameter values.
  • the method can further comprise establishing an intermediate volume control state between the times of establishing the first and second volume control states, wherein the intermediate volume control state is characterized by an intermediate set of parameter values that define a response that is different from the responses of the first and second volume control states.
  • an audio output device comprises: a user interface element operable by a user to provide signals representing volume change requests; a level change engine, responsive to volume change requests, for converting a volume change request to a volume change control signal; and a playback engine, responsive to input media signals and to the volume change control signal, for providing audio signals representing the input media signals at a playback volume derived from the volume change control signal.
  • the level change engine is configured to: use a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or otherwise, use a second mapping to convert the volume change request to a volume change control signal, wherein the first mapping is different from the second mapping for at least some volume levels.
  • the predetermined interval can comprise a plurality of subintervals, in which case the first mapping can comprise a plurality of sub-mappings, at least some of which differ from one another.
  • the audio output device can further comprise a storage medium and a processor coupled to the storage medium, wherein: the level change engine is implemented by program code stored in the storage medium and executed by the processor; and the first and second mappings are at least in part defined by volume change data stored in the storage medium.
  • the audio output device can further comprise override control that determines whether the level change engine uses the first mapping or the second mapping.
  • the override control can comprise a switch that selects between first and second volume level change generators in the level change engine.
  • the audio output device is a PMD, and further comprises a storage medium and media assets stored in the storage medium
  • a portable device comprises: a storage medium; a processor coupled to the storage medium; a user interface element operable by a user to provide signals representing volume change requests; computer code stored in the storage medium; and a playback engine.
  • the computer code when retrieved from the storage medium and executed by the processor: uses a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or otherwise, uses a second mapping to convert the volume change request to a volume change control signal, wherein the first mapping is different from the second mapping for at least some volume levels.
  • the playback engine is responsive to input media signals and to the volume change control signal, and provides audio signals representing the input media signals at a playback volume derived from the volume change control signal.
  • the predetermined interval can comprise a plurality of subintervals, in which case the first mapping can comprise a plurality of sub-mappings, at least some of which differ from one another.
  • a device comprises: a user interface element operable by a user to provide signals representing volume change requests; a controller coupled to receive the signals representing volume change requests; and a playback engine.
  • the controller is configured to: use a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or otherwise, use a second mapping to convert the volume change request to a volume change control signal, wherein the first mapping is different from the second mapping for at least some volume levels.
  • the playback engine is responsive to input media signals and to the volume change control signal, and provides audio signals representing the input media signals at a playback volume derived from the volume change control signal.
  • the predetermined interval can comprise a plurality of subintervals, in which case the first mapping can comprise a plurality of sub-mappings, at least some of which differ from one another.
  • a computer-readable medium contains program instructions, which when executed by a computer system in a portable device cause the computer system to execute a method of controlling playback volume on an audio output device where a volume change request is converted to a volume change control.
  • the method can be one of the methods described above in connection with other aspects of the invention.
  • the first and second mappings can differ only over a range of volume levels that is less than the full range of volume levels, or they can differ over the full range of volume levels.
  • the first and second mappings can differ for volume decrease requests for at least some volume levels.
  • the first mapping can provide a faster volume decrease than the second mapping for at least some volume levels.
  • the first and second mappings can differ for volume increase requests for at least some volume levels.
  • the first mapping can provide a slower volume increase than the second mapping for at least some volume levels, or a faster volume increase for at least some volume levels.
  • the first and second mappings differ for volume decrease requests for at least some volume levels, and also differ for volume increase requests for at least some volume levels.
  • the nature of the override can be tailored to take the current volume into account.
  • the acceleration of volume decreases can be reduced or disabled when the current volume is below a specified threshold.
  • the deceleration of volume increases can be increased when the current volume is above a specified threshold.
  • embodiments of the present invention can disable the override entirely for volumes below a specified threshold.
  • FIG. 1A is a block diagram of a device according to an embodiment of the present invention.
  • FIGS. 1B-1E are block diagrams showing different ways that the elements of FIG. 1A can be configured in separable modules
  • FIG. 2A is a front view of a portable media device (“PMD”) or similar device according to an embodiment of the present invention, and further includes a balloon view of volume control and playback components that can be implemented in the PMD;
  • PMD portable media device
  • FIG. 2B is a top view of the PMD shown in FIG. 2A ;
  • FIG. 2C is a bottom view of the PMD shown in FIG. 2A ;
  • FIG. 3 is a block diagram of a device according to an embodiment of the present invention.
  • FIG. 4A is a block diagram showing additional details of the playback engine and connected components relating to volume control in an embodiment of the present invention
  • FIG. 4B is a block diagram showing the playback engine and connected components relating to volume control in an alternative embodiment of the present invention.
  • FIGS. 5A , 5 B, and 5 C are graphs showing alternative override mappings for volume decrease requests
  • FIGS. 6A , 6 B, and 6 C are graphs showing alternative override mappings for volume increase requests.
  • FIG. 7 is a block diagram showing portions of the playback engine and connected components in an alternative embodiment of the present invention.
  • FIGS. 8A and 8B are flowcharts showing alternative ways of determining whether to use the override mapping or the default mapping.
  • FIG. 1A is a block diagram of a device according to an embodiment of the present invention that provides enhancements to volume control of output audio.
  • An audio source 2 provides audio signals to an audio output device 3 .
  • a volume control mechanism 5 is interposed between audio source 2 and audio output device 3 , and determines the output volume. Volume control mechanism 5 receives user input from a user input device 7 . A broad range of user input devices will be described below.
  • the volume control mechanism has default and override modes where the manner in which signals from user input device 7 are mapped to volume control signals differs during certain intervals following the start of playback.
  • start of playback or the like is defined broadly to include situations in addition to the first time the user invokes playback of stored assets after power up.
  • the start of playback is defined to occur when a user resumes playback after having paused it (for example by toggling a Play/Pause button), when a track begins after the end of the previous track, when the volume increases significantly after an interval of low-volume playback (i.e., where the volume has fallen below a threshold and remains there for a predetermined period).
  • Typical scenarios addressed by embodiments of the present invention include situations where the volume at the start of playback is higher than the volume the user was expecting or desiring. This can be addressed by accelerating a volume decrease request from the user (i.e., using a more aggressive mapping between the user input and the volume decrease). The acceleration can be continued during the entire decrease request, or can be diminished or stopped once the volume has fallen below a given level.
  • the user can specify override parameters as part of configuring the device.
  • a volume that is unexpectedly low at the start of playback also presents challenges.
  • a user may want to bring the volume up to a reasonably audible level quickly so as not to miss too much of the initial playback, but there is the danger of overshooting and ending up with an overly high volume. This can be addressed by accelerating the increase for volumes up to a certain threshold and then diminishing or stopping the volume increase once the volume reaches that threshold.
  • the default profile can specify a decelerated volume increase for a range of volumes without any accelerated volume increase.
  • the connections between the elements can be wired or wireless.
  • user input device 7 can be mounted on a remote control unit that communicates with volume control mechanism 5 using an infrared or an RF communications protocol.
  • the audio signal from audio source 2 can be wirelessly streamed to volume control 5 (e.g., via an RF protocol).
  • audio from volume control 5 can be wirelessly streamed to audio output device 3 .
  • Audio output device 3 can be any device that allows a user to hear, as audible sounds, audio corresponding to the audio signals generated or provided by audio source 2 and moderated by volume control mechanism 5 . This includes speakers, headphones, earpieces, and the like.
  • FIGS. 1B-1E replicate the elements of FIG. 1A , but show different ways that the elements of FIG. 1A can be configured in separable modules. These figures thus provide examples of how embodiments of the present invention can be deployed in different environments.
  • different combinations of elements are referred to as being tightly associated. This can be taken to mean that the elements share a common housing, or are connected with cables or the like in a manner that they are intended to remain connected for extended periods of time.
  • a statement that user input device 7 is tightly associated with volume control mechanism 5 should be taken to include the possibility that user input device 7 is on a remote control that communicates with volume control mechanism 5 .
  • FIG. 1B shows a configuration where all the elements are tightly associated.
  • Examples of this topology include portable and non-portable (e.g., table-top) players and computers that have built-in speakers and have provisions for storing music internally (possibly in removable media).
  • FIG. 1C shows a configuration where audio output device 3 is less tightly associated with the remaining elements, for example where audio source 2 , volume control mechanism 5 , and user input device 7 are tightly associated, and audio output is provided by external speakers.
  • Examples of this topology include portable and non-portable players that require external speakers or headphones.
  • a particular example is an iPod® portable media device (“PMD”) that includes connectors for accessory speakers and headphones.
  • PMD portable media device
  • FIG. 1D shows a configuration where audio source 2 is less tightly associated with the remaining elements, for example where audio output device 3 , volume control mechanism 5 , and user input device 7 are tightly associated, and the source of audio signals is outside.
  • audio source 2 is less tightly associated with the remaining elements, for example where audio output device 3 , volume control mechanism 5 , and user input device 7 are tightly associated, and the source of audio signals is outside.
  • One type of example of this topology is a radio that receives the audio over the airwaves and includes built-in speakers. With a clock radio, playback starts without user intervention, and the user may need or want to turn the volume down extremely quickly.
  • the audio source is a media player and the remaining elements are part of an accessory that has its own volume control.
  • FIG. 1E shows a configuration where audio source 2 and audio output device 3 are less tightly associated with the remaining elements, for example where volume control mechanism 5 and user input device 7 are tightly associated. Examples are discrete audio systems, computers, and other systems where the enhanced volume control is a stand-alone accessory.
  • FIGS. 1B-1E underscore the fact that embodiments of the present invention can be deployed in a wide variety of environments. While much of the following description refers to a portable device such as a portable media device (“PMD”), there is no need to consider the invention to be limited to portable devices, much less PMDs. Rather, embodiments of the present invention can find applicability to any device or system that is capable of outputting audio subject to user control of the output volume.
  • PMD portable media device
  • FIGS. 2A , 2 B, and 2 C are respective front, top, and bottom views of a PMD 10 or similar device according to an embodiment of the present invention.
  • FIG. 2A further includes a balloon view of selected components inside the PMD.
  • PMD 10 will be in terms of a device that, among other things, plays music.
  • PMDs such as Apple's iPod® devices are examples of devices in which embodiments of the present invention can be implemented.
  • Components of PMD 10 may be hidden inside, or visible from outside, a housing 15 .
  • Components disposed outside the housing or disposed to be visible outside the housing can include a display 20 , one or more user input devices such as a scroll wheel 25 and buttons 30 , one or more I/O connectors such as an accessory interface connector 35 and an audio out connector 40 , and one or more switches such as a hold switch 45 .
  • the specific PMD includes four buttons denoted by respective text or graphical legends (“Menu”, Play/Pause, Forward, Backward), and a fifth button, which is not marked and can be used for selecting items.
  • Scroll wheel 25 and buttons 30 are collectively referred to as a “click wheel.”
  • These components communicate with circuitry and components (not generally shown in FIG. 2A ) that are disposed inside housing 15 .
  • a number of the components disposed inside housing 15 are shown schematically as an unlabeled phantom circle.
  • FIG. 2A Also shown in FIG. 2A is a balloon view of some of the components inside the housing. Included among these components is a storage subsystem 50 that can be used to store media assets 55 (possibly including metadata not shown separately).
  • Media assets 55 can include any type of media content that can be stored in digital form and experienced by a user. Examples include music, podcasts, audiobooks, video clips, movies, recorded television or radio broadcasts, photographs, slide shows, other still images, and so on. Where the media assets include music, the individual items are sometimes referred to as “tracks” and certain pre-defined collections of tracks are sometimes referred to as “albums.” User-defined collections of tracks are sometimes referred to as “playlists.”
  • FIGS. 2A , 2 B, and 2 C While a specific PMD is shown in FIGS. 2A , 2 B, and 2 C, the drawing could also have been drawn as a black box with an input device with which a user interacts to invoke volume changes.
  • the details of PMD 10 beyond this are exemplary of a particular class of devices that can benefit from embodiments of the present invention.
  • Embodiments of the present invention deal with aspects of volume control for the playback of media assets that are of type that include audio output, and the remaining components shown in FIG. 2A are those whose function is to support the playback and to control the volume of the playback.
  • volume control is achieved by mapping a user input to an output volume.
  • the mapping of volume decrease requests is overridden (modified) during a short interval (referred to as T Override ) after playback starts so that the requested volume decrease is accelerated.
  • T Override a short interval
  • Some embodiments of the present invention also operate to override the mapping of volume increase requests.
  • the primary component responsible for audio playback is a playback engine 60 that operates on media asset data to provide a suitable output for playing the audio.
  • the playback engine can provide USB digital audio on an output interface coupled to a suitable connector such as accessory interface connector 35 as well as analog audio on audio out connector 40 and possibly on accessory interface connector 35 .
  • a volume control register 65 that receives a volume level signal and effects the appropriate volume control.
  • volume level signal that is communicated to volume control register 65 can be controlled by a user manipulating an interface element, with the user's actions converted by a user input signal generator 70 into an electrical signal representing the user's actions.
  • This signal which represents a volume change request, is then converted or mapped by a volume level change engine 75 having associated volume change data 75 ′ that supports default mapping and override mapping as determined by an override control 80 .
  • the override mapping feature can be enabled and disabled as a matter of user preference.
  • Volume change data 75 ′ can include, for example, parameter values, lookup tables, and the like to support the default mapping and one or more override mappings, as will be described in greater detail below.
  • Override control 80 determines which mapping is to be applied to the signal from user input signal generator 70 , for example by switching from override mapping to default mapping after T Override has elapsed from the start of playback.
  • the device can be considered to be in a selected one of first and second volume control states (referred to as default and override states).
  • Each volume control state can be considered to be characterized by a different mapping of volume change requests.
  • Additional embodiments of the present invention can include more than two volume control states. Further, the transition from one state to another need not be abrupt; rather override control 80 can be configured to provide a gradual transition from the override mapping to the default mapping.
  • override control 80 can cause volume level change engine 75 to prevent signals from passing at the start of playback, and only allow signals to pass in response to a volume change request, with the mapping depending on the elapsed time.
  • the volume level change engine can be initialized with the current volume setting and combine the current volume with the user-generated signals to provide absolute volume levels rather than specified volume level changes.
  • Embodiments of the present invention can be used with any electronic volume control mechanism.
  • the user turns a knob, and a potentiometer modifies an electrical signal in a manner that depends on the position of the knob. For example, if the knob is connected to a potentiometer that is connected as a voltage divider, the output signal is a voltage that is a fraction of the input signal.
  • the potentiometer may have a logarithmic profile that represents the human aural response so that equal amounts of rotation would lead to what would be perceived as equal changes in volume.
  • a user gesture for example moving a finger along a circular path while engaged with a scroll wheel (e.g., scroll wheel 25 ), generates an electrical signal that is communicated to circuitry or software that controls the output volume.
  • Other user interface controllers can be used to request a volume change.
  • a user may control volume by manipulating a displayed slider, by pressing volume Up/Down buttons (physical switches or displayed buttons), by gesturing on a touch pad, to name a few known ways.
  • volume level change engine 75 could impose a logarithmic mapping as mentioned above.
  • volume control register 65 user input signal generator 70 , volume level change engine 75 , and override control 80 can be separate hardware components, software components, or a combination. To the extent that some of these are implemented in software, the code that is executed can be stored in storage subsystem 50 .
  • the signal provided by user input signal generator 70 is referred to as the motion signal, even though some of the user actions (e.g., button presses, voice commands) do not entail movement of an actuator or a finger where the distance of the movement has significance.
  • Volume control register 65 user input signal generator 70 , volume level change engine 75 , and override control 80 are drawn as separate elements, the final output of which provides a volume level signal to playback engine 60 . This is for convenience only. Depending on the implementation, some of these elements could be more tightly integrated into the playback engine. Further, volume control register 65 , volume level change engine 75 , and override control 80 represent one way of implementing the functionality of volume control mechanism 5 shown in FIGS. 1A-1E .
  • FIG. 3 is a circuit block diagram of a device according to an embodiment of the present invention.
  • PMD 10 will be used, it being understood that PMDs and other devices according to embodiments of the present invention do not need to contain all the components shown, and further that they may contain additional components.
  • the description of PMD 10 will be in terms of a device that, among other things, plays music.
  • PMD 10 is preferably processor-based, and to that end typically includes at least one processor 85 , which can be a conventional microprocessor or microcontroller.
  • the processor can communicate with a number of peripheral devices via a bus subsystem 90 .
  • the processor is shown as implementing a graphical user interface (“GUI”) engine 95 , a database engine 100 , and playback engine 60 .
  • GUI graphical user interface
  • Bus subsystem 90 provides a mechanism for letting the various components and subsystems of PMD 10 communicate with each other as intended.
  • bus subsystem 90 is shown schematically as a single bus, embodiments of the bus subsystem may utilize multiple buses, and various of the components may have private connections.
  • the specifically described embodiments of the present invention are processor-based embodiments, other embodiments can be implemented with other types of controllers such as combinatorial logic.
  • the devices on the bus can include various interface controllers for interfacing to other devices or functional elements that do not interface to other devices.
  • the additional devices include a user output device interface 115 (shown coupled to coupled to display 20 ), a user input device interface 120 (shown coupled to scroll wheel 25 , buttons 30 , and switch 45 ), an I/O interface 125 (shown coupled to accessory interface connector 35 and one or more antenna(e)) 130 , and an optional dedicated playback engine 60 ′.
  • Embodiments of the present invention can be implemented with many different types of processor.
  • Many PMDs use an embedded processor such as processors using the ARM architecture (a RISC architecture designed by ARM Limited).
  • GUI engine 95 , database engine 100 , and playback engine 60 can be implemented, for example, in program code (software or firmware) stored in PMD 10 and running on a processor such one of processors 85 , in hardware, or in combinations of the two.
  • Database engine 100 which can be of conventional design, provides various capabilities related to searching, browsing, and selecting assets 55 or groups of assets 55 from storage subsystem 50 .
  • Playback engine 60 which can also be of conventional design, provides capabilities related to presenting selected media assets 55 from storage subsystem 50 to a user.
  • playback engine 60 may provide video portions of media assets 55 and/or audio portions of media assets 55 to the user.
  • the playback engine can provide USB digital audio as well as analog audio.
  • FIG. 3 shows dedicated playback engine 60 ′; while the playback functionality can be implemented in software by processor(s) 85 , as described above, some embodiments of the present invention may have a dedicated playback engine coupled to audio out connector 40 .
  • Dedicated playback engine 60 ′ provides decoding of encoded audio files (e.g., MP3, AAC) and digital-to-analog conversion for output at audio out connector 40 .
  • the playback engine is also coupled to accessory interface connector 35 .
  • I/O interface 125 can be provided with digital-to-analog conversion capability to drive audio out connector 40 .
  • volume change data 75 ′ that characterizes and supports the override mapping (and possibly the default mapping) of volume level change engine 75 .
  • the volume change data can be used by volume level change engine 75 as controlled by override control 80 to provide different desired mappings of volume change requests. For example, different sets of parameters could be read out of storage and loaded into registers before enabling any sound to be output. In other embodiments of the present invention, such parameters can be in firmware more closely bound to dedicated playback engine hardware.
  • Storage subsystem 50 can include various types of storage media, and stores the basic programming and data constructs that provide at least some of the functionality of PMD 10
  • the various program modules and databases implementing the functionality of the PMD may be stored in storage subsystem 50 .
  • the software modules are generally executed by processor(s) 130 .
  • the storage subsystem is used to store media assets 55 , which may account for a significant portion of the overall storage capacity.
  • Memory subsystem 105 typically includes a number of memories including a main random access memory (RAM) 135 for storage of instructions and data during program execution and a non-volatile memory (NVM) 140 in which fixed instructions and fixed system parameters are stored. While the non-volatile memory may be a ROM, rewritable non-volatile memories such as flash EPROMs may be used.
  • RAM main random access memory
  • NVM non-volatile memory
  • the non-volatile memory may be a ROM, rewritable non-volatile memories such as flash EPROMs may be used.
  • File storage subsystem 160 provides persistent (non-volatile) storage for program and data files, and may include, for example, one or more hard disk drives and/or flash memory drives. Additionally the file storage subsystem may support associated removable media 145 , e.g., flash memory cards such as those used in digital cameras and mobile phones. Possible types of flash memory cards include but are not limited to Secure Digital (SD), CompactFlash (CF), Memory Stick (MS), MultiMediaCard (MMC) xD-Picture Card (xD), and SmartMedia (SM).
  • SD Secure Digital
  • CF CompactFlash
  • MS Memory Stick
  • MMC MultiMediaCard
  • SmartMedia SmartMedia
  • some of the media assets, or portions thereof, that are stored in file storage subsystem 160 are transferred to a cache in memory subsystem 155 , and then read out from the cache by playback engine 60 . Transferring significant portions of a media stream to memory before playback can provide a measure of skip protection for hard-drive-based PMDs, and also provides the benefit of allowing the disk drive to be turned off while media are read out from the memory.
  • I/O interface 125 operates, for wired connections, to provide output signals and receive input signals to and from connectors outside housing 15 such as accessory interface connector 35 and audio out connector 40 . It operates, for wireless connections to provide output signals and receive input signals by use of antenna(e) 130 .
  • a number of accessories 147 designated Accessory( 1 ) . . . Accessory(Q) are shown coupled to the I/O interface.
  • Accessories 147 can provide additional functionality, and can include such items as earphones, external speakers, microphones, car stereo adapters, wireless adapters, and the like.
  • I/O interface 125 may include one or more peripheral interfaces such as USB, IEEE 1394 (Firewire), and Bluetooth (a short-range wireless communication standard developed by the Bluetooth SIG and licensed under the trademark Bluetooth®).
  • the I/O interface may also or alternatively include one or more wired networking interfaces (e.g., Ethernet) or wireless networking interfaces (e.g., Wi-Fi adhering to one of the 802.11 family standards, digital mobile phone technologies).
  • wired networking interfaces e.g., Ethernet
  • wireless networking interfaces e.g., Wi-Fi adhering to one of the 802.11 family standards, digital mobile phone technologies.
  • I/O interface 125 can provide an interface to one or more host computers, one or more networks, or accessories coupled to PMD 10 .
  • the I/O subsystem need not be configured for all these possibilities; it can be very limited in scope for some embodiments.
  • the I/O subsystem of some embodiments of the present invention may have the ability to couple PMD 10 to a host computer (via a wired or wireless connection) that provides additional asset management capabilities as can be provided by an MMA.
  • asset management capabilities include but are not limited to storing additional assets 55 in storage subsystem 50 , removing assets 55 from storage subsystem 50 and/or organizing assets in manners that facilitate desired uses. For example, music assets can be arranged into playlists.
  • the I/O subsystem of some embodiments of the present invention will have the ability to couple PMD 10 with a source of media assets (e.g., via a wireless connection to the Internet) so that the PMD can obtain media assets without connecting to a host computer.
  • the I/O subsystem of some embodiments of the present invention will have the ability to couple PMD 10 to accessories that expand the capabilities of the PMD (e.g., via accessory interface connector 35 or antenna(e) 130 ).
  • the I/O subsystem of some embodiments of the present invention will have the ability to couple PMD 10 to sources of wireless signals that allow the PMD to determine its location.
  • Wireless signals from global positioning satellites can be used for those PMDs that include a GPS receiver.
  • wireless signals from one or more cellular towers can be used by those PMDs that had the ability to triangulate or otherwise decode such signals.
  • the user input devices coupled to user input device interface 120 may include one or more of any or all of the following: keyboards; pointing devices such as mice, trackballs, touchpads, or graphics tablets; scanners, barcode scanners; touchscreens incorporated into displays; audio input devices such as voice recognition systems, microphones, and other types of input devices.
  • keyboards such as mice, trackballs, touchpads, or graphics tablets
  • scanners barcode scanners
  • touchscreens incorporated into displays
  • audio input devices such as voice recognition systems, microphones, and other types of input devices.
  • use of the term “user input device” is intended to include all possible types of devices and ways for a user to input information into PMD 10 . It is noted that some of the above-mentioned user input devices can be coupled to I/O interface 125 through accessory interface connector 35 .
  • the input devices can include such devices as a touch screen, a scroll wheel such as scroll wheel 25 in FIG. 2A , buttons such as buttons 30 shown in FIG. 2A , knobs, and the like to receive user input.
  • a PMD such as some versions of the iPod®
  • the user may invoke scrolling by touching a scroll wheel and moving a finger in a circular motion.
  • the scroll wheel has been implemented as an actual rotatable member, or as a series of fixed capacitive sensors disposed under a fixed annular region of the PMD body, which the user “moves” by touching and moving a finger in a circular motion.
  • PMDs and computers with touch interfaces allow various gestures to cause scrolling.
  • Additional types of input devices could be motion detectors such as accelerometers that can respond to a user's actually moving the device.
  • a clockwise (or counterclockwise) twist of the wrist can be interpreted in a manner analogous to a clockwise (or counterclockwise) actuation of a scroll wheel or a knob.
  • exemplary input devices were generally described as being mounted to or associated with the PMD or computer, reference to exemplary input devices should be considered to include such devices mounted to or associated with a remote control device.
  • Remote control devices can include wired (tethered) devices (e.g., connected to user input device interface 120 or I/O interface 125 , possibly using the accessory connector) and wireless devices communicating via one of antenna(e) 130 .
  • the only user output device coupled to user output device interface 115 is a display.
  • the present invention does not rely on any particular type of display, although suitable candidates can include liquid crystal displays (LCDs) or light emitting diode (LED) displays. Some PMDs can also provide non-visual display such as audio output.
  • LCDs liquid crystal displays
  • LED light emitting diode
  • Some PMDs can also provide non-visual display such as audio output.
  • use of the term “user output device” is intended to include all possible types of devices and ways to output information from PMD 10 to a user.
  • the primary display is a visual display, which is used to display visual characteristics of the media assets (e.g., in the case of videos, images, and the like) and metadata (perhaps displayed in lists or in hierarchical menus).
  • GUI engine 95 can interact with display 20 and user input devices such as scroll wheel 25 and buttons 30 to provide a graphical user interface, allowing a user to control operation of PMD 10 .
  • GUI engine 95 can control display 20 to present user interface elements such as text menus, icons or the like, and user input devices can be operated by a user to interact with the displayed user interface elements (e.g., selecting or activating an element, thereby giving an instruction to PMD 10 ).
  • user input devices can include a touch-sensitive element overlaying display 20 , providing a touch screen interface.
  • user input devices can include distinct devices such as one or more of a scroll wheel 25 , buttons 30 , a touch pad.
  • GUI engine 95 can reflect the operation of user input device(s) by updating display 20 , e.g., to change which item on a menu is highlighted for selection.
  • the GUI can enable the user to control any aspect of PMD 10 , including locating and selecting media assets 55 to be played, controlling playback (e.g., play, pause, fast forward, rewind, etc.), adjusting playback settings (volume, equalizer, etc.), and so on.
  • a significant aspect of the user output are the sound characteristics of the assets, such as the music or words of audio tracks and the soundtrack of videos. As such, some of the embodiments of the present invention are concerned with facilitating the playback of music.
  • FIG. 4A is a block diagram showing additional details of playback engine 60 or dedicated playback engine 60 ′ and connected components relating to volume control in an embodiment of the present invention.
  • the playback engine comprises a decoder 150 , a multiplier 155 , a digital-to-analog converter (“D/A converter” or “DAC”) 160 , and a preamplifier 165 .
  • the decoder and multiplier can be implemented in hardware or software, while the DAC and preamplifier are by nature hardware elements.
  • volume control register 65 can be one of the chip's on-chip registers.
  • Decoder 150 receives media asset data from storage subsystem 50 , decodes it, and passes the decoded values to multiplier 155 , which multiplies them by a value specified by volume control register 65 .
  • the digital values, at the specified volume, are communicated to bus subsystem 90 and also to DAC 160 .
  • the analog output of the DAC is amplified by preamplifier 165 to provide a line level output, which can be communicated to audio out connector 40 and/or accessory interface connector 35 (not shown).
  • the digital output from multiplier 155 shown as communicated to the bus subsystem, can be provided to accessory interface connector 35 (not shown) or any other digital output.
  • volume level change engine 75 is represented by a default volume level change generator 75 a and an override volume level change generator 75 b .
  • the signal that is received by volume control register 65 is a selected one of a first (default) signal provided by default volume level change generator 75 a and a second (override) signal provided by override volume level change generator 75 b , as determined by override control 80 , which is represented by a switch 80 ′.
  • the switch can be actuated at a time T Override following the start of playback to switch from override volume level change generator 75 b to default volume level change generator 75 a.
  • the device can be considered to be in a selected one of first and second volume control states (referred to as default and override states).
  • Each volume control state can be considered to be characterized by a different mapping of user volume change requests.
  • Additional embodiments of the present invention can include more than two volume control states. Further, the transition from one state to another need not be abrupt; rather it is possible to configure switch 80 so that it initially provides the override signal and during a transition interval mixes the two signals so that at the end of the interval the output is the default signal.
  • the notion of a switch selecting one of two volume level change generators is a schematic view.
  • the switch can select override volume level change generator 75 b at the start of playback, and then select default volume level change generator 75 a after the predetermined time interval T Override .
  • the switch can remain blocking at the start of playback, and only allow signals to pass in response to a volume change request, with the selected volume level change generator depending on the elapsed time.
  • the notion of multiple volume level change generators, at the broadest, should be taken to cover the case where different parameter values are loaded into the same set of registers.
  • the figure shows user input signal generator 70 , default volume level change generator 75 a (or override volume level change generator 75 b ), switch 80 , and volume control register 65 connected in series, as well as being coupled to bus subsystem 90 .
  • Embodiments of the present invention can utilize any combinations of these connections so long as the functionality of the signals passing from one block to the other remains. At one extreme, there are embodiments where there are no series connections, and all communications are over the bus subsystem. At the other extreme, there are embodiments where there are no bus connections and all communications are over the series paths from one block to the next. This is consistent with the statement in the Device Hardware Overview that the bus schematic is a simplification and there may be multiple buses and there might be private connections among devices. The operation of the volume control elements will now be described.
  • FIG. 4B is a block diagram showing the playback engine and connected components relating to volume control in an alternative embodiment of the present invention.
  • This embodiment differs from that shown in FIG. 4A in that there is an additional override volume level change generator 75 c in parallel with default volume level change generator 75 a and override volume level change generator 75 b , and switch 80 has three inputs rather than two.
  • This embodiment is an example of embodiments with more than two volume control states; in this specific example, the transition from an override state to the default state occurs in two steps. It is also possible to configure a single override volume level change generator to change its acceleration parameter(s) during the override volume control state.
  • the first and second states can be considered override states characterized by first and second predetermined intervals T Override and T Override ′ during which first and second override mappings are used.
  • the third (default) volume control state is established, characterized by a third mapping of volume change requests to volume change controls.
  • first two override states with their respective time intervals and mappings can be viewed as a single override interval with the override mapping having a time dependence.
  • first and second states can be viewed as constituting a single override state characterized by a single time interval and a single mapping.
  • the override state comprises two or more sub-states with respective sub-intervals and sub-mappings.
  • User input signal generator 70 generates a signal, referred to as the motion signal, that represents the user's interaction with a user interface element to request a volume change.
  • the motion signal encodes one or more characteristics of the user's motion (for example one or more of position, velocity, and acceleration). This is shown schematically as a graph (Motion Signal vs. User Actuation) to the right of user input signal generator 70 .
  • the motion signal can be a defined function of the user input. For simplicity, this is shown as a linear function in the figure, but other functional relationships are possible.
  • the user interface element is a scroll wheel that uses a plurality of capacitive sensors to detect finger position
  • the sensors provide electrical signals upon detecting the capacitance of the user's finger.
  • the user input signal generator can then transform these signals to a time dependent position signal.
  • this signal can represent user input specific to that context.
  • the scroll wheel can be used to scroll menu items as well as to control playback volume.
  • user input signal generator 70 while shown as part of the overall volume control functionality, can be a general purpose module (hardware, software, or a combination).
  • the output from user input signal generator 70 provides the position, and is updated sufficiently frequently that subsequent processing blocks can integrate and/or differentiate the signal to the extent that the total distance or the velocity is needed.
  • the output signal can provide the distance from the initial position or can provide the absolute position.
  • the user presses one or more buttons to request a volume change.
  • the term motion signal is used in connections with these embodiments where the user is not generating a displacement whose extent matters.
  • the output (motion) signal can be based on the number of button presses (clicks). Some implementations can provide a pair of buttons (Up/Down or ⁇ ). The output can vary linearly or non-linearly with respect to the number of presses. Further, an extended button press can be used to invoke a signal that increases or decreases in proportion to, or as a non-linear function of, the duration of the press. The output signal can also provide information on the intervals between repeated button presses.
  • volume level change engine 75 converts user input signal generator 70 's motion signal, which provides a measure of the user's action to control the volume, to a signal relating to a desired volume level. This is shown schematically as a graph (Default Volume Level vs. Motion Signal) to the right of default and override volume level change generators 75 and 75 b .
  • the discussion in this section is not limited to the embodiments of FIGS. 4A and 4B , but generally applies to other embodiments of the volume level change engine.
  • the output signal from user input signal generator 70 is a time dependent position signal.
  • the user input device is touch sensitive.
  • the signal can be used to control volume.
  • the location of the initial finger contact can be interpreted as requesting the intended volume, with subsequent finger motion (while maintaining contact) is ignored.
  • a mere touch can be used to set the volume.
  • the initial finger contact is ignored until some motion is detected.
  • the volume can be increased or decreased as a function of the direction and amount of movement. Similar considerations can apply in the case of indirect pointing devices with distinctions between the ways clicks and drags are interpreted.
  • the figure shows the dependence of Default Volume Level as increasing for motion to the right and decreasing for motion to the left, with upper and lower cutoffs for the maximum and minimum volume levels. What this means is that should the user continue moving the actuator or finger past the point where the volume level reaches one of the extreme values, further movement will have no further effect on the volume level.
  • the graph is stylized in the sense that the mapping depends on the volume level when the movement begins. For example, if the volume level is at the minimum, when the user starts movement to increase the volume, the volume trajectory will begin at the bottom left kink in the graph, and continue up the graph toward the right. Similarly, if the volume level is at the maximum, when the user starts movement to decrease the volume, the volume trajectory will begin at the upper right kink in the graph, and continue down the graph toward the left.
  • volume level as a linear function of the motion signal (i.e., characterized by a single slope parameter)
  • some implementations can provide a measure of acceleration/deceleration depending on the speed of the user's motion (i.e., on the rate of change of the motion signal).
  • short fast movements can be interpreted to result in as much volume level change as slower longer movements.
  • the characteristics of such acceleration can be specified by an analytic function such as a polynomial or an exponential, or can be specified in a lookup table (whether or not the function has an analytic form).
  • the possibility of providing acceleration or any other non-linear treatment to the mapping is a separate issue from the volume level override feature, which is described in greater detail below.
  • volume level change engine 75 also provides an override mapping between the motion signal and the volume level that differs from the default mapping. This is shown schematically as a graph (Override Volume Level vs. Motion Signal) to the right of switch 80 and volume control register 65 .
  • the mapping for the default volume level change generator is shown in phantom.
  • the override mapping is selected by override control 80 when playback starts.
  • the start of playback should be understood to include, for example, the user's starting playback after power up, the user's resuming playback after having paused playback, the start of a new track, or a volume increase after an interval of very soft playback.
  • the discussion in this section is not limited to the embodiments of FIGS. 4A and 4B , but generally applies to other embodiments of the volume level change engine.
  • the override mapping provided by volume level change engine 75 accelerates the decrease.
  • the slope parameter has a larger absolute value than the corresponding slope parameter for the default mapping provided by volume level change engine 75 .
  • the mapping for movements requesting a decrease in volume is shown as a heavy line. As noted above, this is separate from, and in addition to, any acceleration or deceleration provided for the default mapping. Possible reasons that the user might want a very rapid response to efforts to turn down the volume is that the volume may be significantly higher than the user was expecting. This could be uncomfortable for a user wearing earphones, and could be annoying or embarrassing where the device is playing through speakers.
  • the override profile is deselected after a predetermined time interval T Override (say 10-15 seconds), because by then the user is likely to have adjusted the volume or decided that the volume at the start of playback was acceptable.
  • T Override say 10-15 seconds
  • volume level change engine 75 when operating with the override mapping, also modifies the default mapping for user efforts to increase the volume.
  • the mapping for movements requesting an increase in volume is shown as a normal-weight solid line.
  • volume level change engine 75 decelerates the increase.
  • FIGS. 5A , 5 B, and 5 C are graphs showing alternative override mappings for requested decreases in volume.
  • the mapping is a uniform acceleration of the decrease (e.g., slope magnitude doubled) for all initial and subsequent volume levels.
  • FIG. 5A shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels above a middle volume level, and then a default decrease for volume levels below the middle volume level.
  • FIG. 5B shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels above the middle volume level, and then a decelerated decrease for volume levels below the middle volume level.
  • FIG. 5C shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels above a medium-loud volume level, and then a default decrease for volume levels below the medium-loud volume level.
  • FIGS. 6A , 6 B, and 6 C are graphs showing additional override mappings for requested increases in volume.
  • the mapping provides a uniform deceleration of the increase (e.g., slope at 2 ⁇ 3 the slope of default increase) for all initial and subsequent volume levels.
  • FIG. 6A shows an embodiment where the mapping provides an acceleration of the increase for initial and subsequent volume levels below a middle volume level, and then a decelerated increase for volume levels above the middle volume level.
  • FIG. 6B shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels below the middle volume level, and then a default increase for volume levels above the middle volume level.
  • FIG. 6C shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels below a medium-loud volume level, and then a decelerated increase for volume levels above the medium-loud volume level.
  • acceleration/deceleration profiles may depend on a number of considerations. For example, a more aggressive accelerated decrease in volume level can be used when the PMD is playing back through headphones, since user discomfort can be a greater consideration with headphones than with speakers. Since some PMD models can sense when they are connected to speakers, this can be done automatically.
  • embodiments of the present invention can also provide near-instantaneous volume decrease or increase to a predetermined level. For example, the mapping shown in FIG. 5C can be modified so that an initial segment of the graph is vertical (i.e., any volume decrease request during the override interval results in a substantially immediate drop to a lower volume.
  • volume level change engine 75 can be provided with absolute volume information before playback starts. In those embodiments of the present invention where volume level change engine 75 provides an absolute volume level rather than volume level increments, this would already be taken into account.
  • Different embodiments of the present invention can use different combinations of the override mappings shown for volume increase requests and volume decrease requests. Thus, for example, a particular embodiment can use any one of the mappings shown in FIGS. 5A , 5 B, and 5 C, combined with any of the mappings shown in 6 A, 6 B, and 6 C.
  • FIG. 7 is a block diagram showing portions of the playback engine and connected components in an alternative embodiment of the present invention.
  • the override functionality is provided by an override volume level change block 170 in series with a default volume level change generator 75 a .
  • the elements are also shown as being connected to bus subsystem 90 , and this embodiment can utilize any combinations of these connections so long as the functionality of the signals passing from one block to the other remains.
  • override volume level change block 170 is disabled at some time after playback has started. This can be achieved in a number of ways, for example by a bypass switch within the block (not shown) or a branch in software. To the extent that the override volume level change block's acceleration/deceleration profiles depend on the current absolute volume level, the absolute volume level can be provided.
  • the time of receiving a volume change request, either at step 175 or at a later time is denoted as t VolChange . That is, t VolChange represents the elapsed time from the start playback to the time at which the user requests a volume change.
  • t VolChange is compared to T Override at a step 180 to determine whether the time of the volume change request is still within the time interval where the override mapping is to be used rather than the default mapping. If it is, the motion signal is transformed using the override mapping at a step 185 , the volume is changed at a step 190 , and the device awaits further volume change requests at a step 195 . When a further volume change request is received, control is passed back to step 180 where t VolChange is again compared to T Override .
  • step 180 If at step 180 (whether entered from step 175 or step 195 ), it is determined that the time of the volume change request (t VolChange ) is no longer within the time interval T Override , the motion signal is transformed using the default mapping at a step 200 , the volume is changed at a step 205 , and the device awaits further volume change requests at a step 210 . When a further volume change request is received, control is passed back to step 200 , and no more tests of t VolChange are made.
  • t VolChange is compared to T Override at a step 215 . If t VolChange is less than T Override , the motion signal is transformed using the override mapping at a step 220 , the volume is changed at a step 225 , and the device awaits further volume change requests at a step 230 . If it is determined at step 215 that t VolChange is not less than T Override , the motion signal is transformed using the default mapping at a step 235 , the volume is changed at a step 225 , and the device awaits further volume change requests at a step 230 . In either case, when a further volume request change is received, control is passed back to step 215 , and the elapsed time is tested for every subsequent volume change request.
  • embodiments of the present invention provide additional functionality that can enhance user experience and convenience when using devices such as PMDs.
  • the special volume control mapping at the start of playback allows the user to ameliorate quickly the effect of an excessive volume level.

Abstract

User interface signals representing volume change requests are converted to volume control signals using a mapping. The mapping is overridden (modified) within a given time interval after starting (which includes resuming) playback. During this interval, the mapping for volume decreases is modified so that the resulting volume decreases are accelerated relative to those that would be generated by the default mapping. This allows the user to quickly reduce the volume of the device when begins playing very loud music. The mapping for volume increases can be modified during this interval.

Description

BACKGROUND OF THE INVENTION
The present invention relates generally to audio playback devices, and more particularly to controlling the output volume.
Media assets, such as audio tracks, video tracks, or images (e.g., photos) can be stored, displayed, and/or played on a portable media device (“PMD”) or on a host computer executing a media management application (“MMA”). Often, a portable media device acquires its media assets from a host computer executing an MMA, and the user may use the MMA to organize the collection of media assets. One example of a PMD may be the iPod® portable media device, currently available from Apple Inc. of Cupertino, Calif. One example of an MMA may be iTunes® media management application, produced by Apple Inc. Some PMDs provide the user a display to aid in interacting with the content on the PMD.
One reason for the popularity of PMDs and MMAs is the ability to store and manage very large collections of audio and video tracks, to arrange them into playlists, and to arrange to have tracks from a variety of sources within the collection played back in any desired order (or randomly if desired). In recognition of the fact that music CDs (and downloadable tracks) are mastered differently, with large discrepancies in volume between songs on different albums, iTunes® and the iPod™ have been provided with what is referred to as the “Sound Check” feature, which allows the user to standardize the volume of all the songs in the collection. This feature can be enabled or disabled at will.
SUMMARY OF THE INVENTION
Embodiments of the present invention operate to change playback volume in response to user input signals that request a volume change by mapping the user input signals to volume change control signals that actually control the volume. The user input requesting a volume change/increase/decrease is often referred to simply as a volume change/increase/decrease request. The user input can be provided by action on a user interface device, for example, by one or more of a gesture on a plurality of capacitive sensors, and/or an actuation of a movable element, and/or a manipulation of a displayed control element, which can be provided by a GUI engine.
Embodiments of the present invention recognize and address the possibility that there are times where the user requires the ability to change the volume more quickly (and/or more slowly) than usual. An example of such a time is an interval (of a duration referred to as TOverride) following the start of playback. Achieving a faster or slower volume change may entail, during those times, using a mapping between the user input signals and the volume change control signals that is different from the mapping that used at other times. The different mapping is referred to as the override mapping to distinguish it from the default mapping. Since the override mapping is in effect before the default mapping, it is sometimes referred to as the first mapping and the default mapping is sometimes referred to as the second mapping.
In this context, the start of playback is defined broadly to include situations in addition to the first time the user invokes playback of stored assets after power up. Thus, playback should also be considered to have started when the user pauses playback in the middle of a track, for example by pressing a “Pause” button, and then resumes playback by pressing a “Play” button. The two functions are often embodied in a single button that toggles between “Pause” and “Play.” Playback can also be considered to have started at the beginning of a track after the end of the previous track. While continuous playback of tracks can have brief periods of silence between the tracks, this is not necessary.
Another situation that is functionally similar to, and should be considered as, the start of playback is a situation during playback when the volume increases substantially after an interval of low-volume playback (i.e., where the volume has fallen below a threshold and remains there for a predetermined period).
While specific embodiments of the present invention deal with portable media devices (“PMDs”) and media management applications (“MMAs”) where the audio sources are media assets stored on, or otherwise available or retrievable to, the PMD or MMA, the invention is not limited to such environments. Other types of audio playback devices and systems represent additional environments that might benefit from the enhanced volume control provided by embodiments of the present invention.
In an aspect of the invention, a method of controlling playback volume on an audio output device where a volume change request is converted to a volume change control comprises, in response to a volume change request: if the elapsed time since playback started is less than a predetermined interval, using a first mapping to convert the volume change request to a volume change control; otherwise, for at least some elapsed times greater than the predetermined interval, using a second mapping to convert the volume change request to a volume change control, wherein the first mapping is different from the second mapping for at least some volume levels; and using the volume change control to modify the playback volume. In some embodiments, the predetermined interval comprises a plurality of subintervals, and using the first mapping comprises using one or more of a plurality of sub-mappings, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into.
In embodiments of the present invention, the method can further comprise: at the start of playback, establishing a first volume control state characterized by the first mapping; when the predetermined interval has elapsed, establishing a second volume control state characterized by the second mapping; and when a second predetermined interval has elapsed after the end of the first predetermined interval, at a time after the start of playback, but before the second volume control state is established, establishing a third volume control state characterized by a third mapping of volume change requests to volume change controls, wherein the third mapping is different from the first and second mappings for at least some volume levels.
In another aspect of the invention, a method of controlling playback volume on an audio output device where a volume change request is converted to a volume change control comprises, in response to a volume change request: at the start of playback, establishing a first volume control state characterized by a first mapping of volume change requests to volume change controls; at a time after the start of playback, establishing a second volume control state characterized by a second mapping of volume change requests to volume change controls, where the first mapping is different from the second mapping for at least some volume levels; and in response to a volume change request, changing the volume in accordance with the current volume control state. In some embodiments, the first volume control state comprises a plurality of sub-states characterized by a plurality of sub-mappings, at least some of which differ from one another, depending on which of the subintervals the volume change request falls into.
In embodiments of the present invention, the method can further comprise: at a time after the start of playback, but before the second volume control state is established, establishing an intermediate volume control state characterized by an intermediate mapping of volume change requests to volume change controls, wherein the intermediate mapping is different from the first and second mappings for at least some volume levels.
In another aspect of the invention, a method of controlling playback volume on an audio output device where a volume change request is defined by respective values of a set of one or more parameters comprises: at the start of playback, establishing a first volume control state characterized by a first set of parameter values that define a response to a volume change request; after a given elapsed time after the start of playback, establishing a second volume control state characterized by a second set of parameter values, wherein the second set of parameter values define a different response to a volume change request than the response defined by the first set of parameter values; and in response to a volume change request, changing the volume in accordance with the current volume control state. In some embodiments: the given elapsed time comprises a plurality of subintervals; the first volume control state comprises a plurality of sub-states, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into; and the first set of parameter values comprises a plurality of subsets of parameter values.
In embodiments of the present invention, the method can further comprise establishing an intermediate volume control state between the times of establishing the first and second volume control states, wherein the intermediate volume control state is characterized by an intermediate set of parameter values that define a response that is different from the responses of the first and second volume control states.
In another aspect of the invention, an audio output device comprises: a user interface element operable by a user to provide signals representing volume change requests; a level change engine, responsive to volume change requests, for converting a volume change request to a volume change control signal; and a playback engine, responsive to input media signals and to the volume change control signal, for providing audio signals representing the input media signals at a playback volume derived from the volume change control signal.
The level change engine is configured to: use a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or otherwise, use a second mapping to convert the volume change request to a volume change control signal, wherein the first mapping is different from the second mapping for at least some volume levels. The predetermined interval can comprise a plurality of subintervals, in which case the first mapping can comprise a plurality of sub-mappings, at least some of which differ from one another.
In embodiments of the present invention, the audio output device can further comprise a storage medium and a processor coupled to the storage medium, wherein: the level change engine is implemented by program code stored in the storage medium and executed by the processor; and the first and second mappings are at least in part defined by volume change data stored in the storage medium.
In embodiments of the present invention, the audio output device can further comprise override control that determines whether the level change engine uses the first mapping or the second mapping. The override control can comprise a switch that selects between first and second volume level change generators in the level change engine.
In embodiments of the present invention, the audio output device is a PMD, and further comprises a storage medium and media assets stored in the storage medium
In another aspect of the invention, a portable device comprises: a storage medium; a processor coupled to the storage medium; a user interface element operable by a user to provide signals representing volume change requests; computer code stored in the storage medium; and a playback engine. The computer code, when retrieved from the storage medium and executed by the processor: uses a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or otherwise, uses a second mapping to convert the volume change request to a volume change control signal, wherein the first mapping is different from the second mapping for at least some volume levels.
The playback engine is responsive to input media signals and to the volume change control signal, and provides audio signals representing the input media signals at a playback volume derived from the volume change control signal. The predetermined interval can comprise a plurality of subintervals, in which case the first mapping can comprise a plurality of sub-mappings, at least some of which differ from one another.
In another aspect of the invention, a device comprises: a user interface element operable by a user to provide signals representing volume change requests; a controller coupled to receive the signals representing volume change requests; and a playback engine. The controller is configured to: use a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or otherwise, use a second mapping to convert the volume change request to a volume change control signal, wherein the first mapping is different from the second mapping for at least some volume levels.
The playback engine is responsive to input media signals and to the volume change control signal, and provides audio signals representing the input media signals at a playback volume derived from the volume change control signal. The predetermined interval can comprise a plurality of subintervals, in which case the first mapping can comprise a plurality of sub-mappings, at least some of which differ from one another.
In other aspects of the invention, a computer-readable medium contains program instructions, which when executed by a computer system in a portable device cause the computer system to execute a method of controlling playback volume on an audio output device where a volume change request is converted to a volume change control. In these aspects of the invention, the method can be one of the methods described above in connection with other aspects of the invention.
In embodiments relating to any of the above methods, apparatus, or computer-readable media, the first and second mappings can differ only over a range of volume levels that is less than the full range of volume levels, or they can differ over the full range of volume levels. The first and second mappings can differ for volume decrease requests for at least some volume levels. The first mapping can provide a faster volume decrease than the second mapping for at least some volume levels. The first and second mappings can differ for volume increase requests for at least some volume levels. The first mapping can provide a slower volume increase than the second mapping for at least some volume levels, or a faster volume increase for at least some volume levels. In some embodiments, the first and second mappings differ for volume decrease requests for at least some volume levels, and also differ for volume increase requests for at least some volume levels.
Further, in embodiments relating to any of the above methods, apparatus, or computer-readable media, the nature of the override can be tailored to take the current volume into account. As one example, the acceleration of volume decreases can be reduced or disabled when the current volume is below a specified threshold. Similarly the deceleration of volume increases can be increased when the current volume is above a specified threshold. Additionally, embodiments of the present invention can disable the override entirely for volumes below a specified threshold. These possible modifications to the override can themselves be implemented as user-settable preferences.
A further understanding of the nature and advantages of the present invention may be realized by reference to the remaining portions of the specification and the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1A is a block diagram of a device according to an embodiment of the present invention;
FIGS. 1B-1E are block diagrams showing different ways that the elements of FIG. 1A can be configured in separable modules;
FIG. 2A is a front view of a portable media device (“PMD”) or similar device according to an embodiment of the present invention, and further includes a balloon view of volume control and playback components that can be implemented in the PMD;
FIG. 2B is a top view of the PMD shown in FIG. 2A;
FIG. 2C is a bottom view of the PMD shown in FIG. 2A;
FIG. 3 is a block diagram of a device according to an embodiment of the present invention;
FIG. 4A is a block diagram showing additional details of the playback engine and connected components relating to volume control in an embodiment of the present invention;
FIG. 4B is a block diagram showing the playback engine and connected components relating to volume control in an alternative embodiment of the present invention;
FIGS. 5A, 5B, and 5C are graphs showing alternative override mappings for volume decrease requests;
FIGS. 6A, 6B, and 6C are graphs showing alternative override mappings for volume increase requests; and
FIG. 7 is a block diagram showing portions of the playback engine and connected components in an alternative embodiment of the present invention; and
FIGS. 8A and 8B are flowcharts showing alternative ways of determining whether to use the override mapping or the default mapping.
DESCRIPTION OF SPECIFIC EMBODIMENTS
FIG. 1A is a block diagram of a device according to an embodiment of the present invention that provides enhancements to volume control of output audio. An audio source 2 provides audio signals to an audio output device 3. A volume control mechanism 5 is interposed between audio source 2 and audio output device 3, and determines the output volume. Volume control mechanism 5 receives user input from a user input device 7. A broad range of user input devices will be described below.
In accordance with embodiments of the present invention, the volume control mechanism has default and override modes where the manner in which signals from user input device 7 are mapped to volume control signals differs during certain intervals following the start of playback. As mentioned above, the term “start of playback” or the like is defined broadly to include situations in addition to the first time the user invokes playback of stored assets after power up. The start of playback is defined to occur when a user resumes playback after having paused it (for example by toggling a Play/Pause button), when a track begins after the end of the previous track, when the volume increases significantly after an interval of low-volume playback (i.e., where the volume has fallen below a threshold and remains there for a predetermined period). Although a wide variety of override mappings will be described below, a few scenarios and examples will be mentioned at this point.
Typical scenarios addressed by embodiments of the present invention include situations where the volume at the start of playback is higher than the volume the user was expecting or desiring. This can be addressed by accelerating a volume decrease request from the user (i.e., using a more aggressive mapping between the user input and the volume decrease). The acceleration can be continued during the entire decrease request, or can be diminished or stopped once the volume has fallen below a given level. In some embodiments of the present invention, the user can specify override parameters as part of configuring the device.
A volume that is unexpectedly low at the start of playback also presents challenges. A user may want to bring the volume up to a reasonably audible level quickly so as not to miss too much of the initial playback, but there is the danger of overshooting and ending up with an overly high volume. This can be addressed by accelerating the increase for volumes up to a certain threshold and then diminishing or stopping the volume increase once the volume reaches that threshold. In other embodiments, the default profile can specify a decelerated volume increase for a range of volumes without any accelerated volume increase.
The connections between the elements can be wired or wireless. For example, user input device 7 can be mounted on a remote control unit that communicates with volume control mechanism 5 using an infrared or an RF communications protocol. Similarly, the audio signal from audio source 2 can be wirelessly streamed to volume control 5 (e.g., via an RF protocol). Similarly, audio from volume control 5 can be wirelessly streamed to audio output device 3. Audio output device 3 can be any device that allows a user to hear, as audible sounds, audio corresponding to the audio signals generated or provided by audio source 2 and moderated by volume control mechanism 5. This includes speakers, headphones, earpieces, and the like.
FIGS. 1B-1E replicate the elements of FIG. 1A, but show different ways that the elements of FIG. 1A can be configured in separable modules. These figures thus provide examples of how embodiments of the present invention can be deployed in different environments. In different examples, different combinations of elements are referred to as being tightly associated. This can be taken to mean that the elements share a common housing, or are connected with cables or the like in a manner that they are intended to remain connected for extended periods of time. In all these examples, a statement that user input device 7 is tightly associated with volume control mechanism 5 should be taken to include the possibility that user input device 7 is on a remote control that communicates with volume control mechanism 5.
FIG. 1B shows a configuration where all the elements are tightly associated. Examples of this topology include portable and non-portable (e.g., table-top) players and computers that have built-in speakers and have provisions for storing music internally (possibly in removable media). FIG. 1C shows a configuration where audio output device 3 is less tightly associated with the remaining elements, for example where audio source 2, volume control mechanism 5, and user input device 7 are tightly associated, and audio output is provided by external speakers. Examples of this topology include portable and non-portable players that require external speakers or headphones. A particular example is an iPod® portable media device (“PMD”) that includes connectors for accessory speakers and headphones.
FIG. 1D shows a configuration where audio source 2 is less tightly associated with the remaining elements, for example where audio output device 3, volume control mechanism 5, and user input device 7 are tightly associated, and the source of audio signals is outside. One type of example of this topology is a radio that receives the audio over the airwaves and includes built-in speakers. With a clock radio, playback starts without user intervention, and the user may need or want to turn the volume down extremely quickly. Another type of example is where the audio source is a media player and the remaining elements are part of an accessory that has its own volume control.
FIG. 1E shows a configuration where audio source 2 and audio output device 3 are less tightly associated with the remaining elements, for example where volume control mechanism 5 and user input device 7 are tightly associated. Examples are discrete audio systems, computers, and other systems where the enhanced volume control is a stand-alone accessory.
The possibilities shown in FIGS. 1B-1E underscore the fact that embodiments of the present invention can be deployed in a wide variety of environments. While much of the following description refers to a portable device such as a portable media device (“PMD”), there is no need to consider the invention to be limited to portable devices, much less PMDs. Rather, embodiments of the present invention can find applicability to any device or system that is capable of outputting audio subject to user control of the output volume.
FIGS. 2A, 2B, and 2C are respective front, top, and bottom views of a PMD 10 or similar device according to an embodiment of the present invention. FIG. 2A further includes a balloon view of selected components inside the PMD. For concreteness, the description of PMD 10 will be in terms of a device that, among other things, plays music. PMDs such as Apple's iPod® devices are examples of devices in which embodiments of the present invention can be implemented. Components of PMD 10 may be hidden inside, or visible from outside, a housing 15.
Components disposed outside the housing or disposed to be visible outside the housing can include a display 20, one or more user input devices such as a scroll wheel 25 and buttons 30, one or more I/O connectors such as an accessory interface connector 35 and an audio out connector 40, and one or more switches such as a hold switch 45. The specific PMD includes four buttons denoted by respective text or graphical legends (“Menu”, Play/Pause, Forward, Backward), and a fifth button, which is not marked and can be used for selecting items. In the context of an iPod® device, scroll wheel 25 and buttons 30 are collectively referred to as a “click wheel.” These components communicate with circuitry and components (not generally shown in FIG. 2A) that are disposed inside housing 15. A number of the components disposed inside housing 15 are shown schematically as an unlabeled phantom circle.
Also shown in FIG. 2A is a balloon view of some of the components inside the housing. Included among these components is a storage subsystem 50 that can be used to store media assets 55 (possibly including metadata not shown separately). Media assets 55 can include any type of media content that can be stored in digital form and experienced by a user. Examples include music, podcasts, audiobooks, video clips, movies, recorded television or radio broadcasts, photographs, slide shows, other still images, and so on. Where the media assets include music, the individual items are sometimes referred to as “tracks” and certain pre-defined collections of tracks are sometimes referred to as “albums.” User-defined collections of tracks are sometimes referred to as “playlists.”
While a specific PMD is shown in FIGS. 2A, 2B, and 2C, the drawing could also have been drawn as a black box with an input device with which a user interacts to invoke volume changes. The details of PMD 10 beyond this are exemplary of a particular class of devices that can benefit from embodiments of the present invention.
Embodiments of the present invention deal with aspects of volume control for the playback of media assets that are of type that include audio output, and the remaining components shown in FIG. 2A are those whose function is to support the playback and to control the volume of the playback. As discussed above, volume control is achieved by mapping a user input to an output volume. In embodiments of the present invention, the mapping of volume decrease requests is overridden (modified) during a short interval (referred to as TOverride) after playback starts so that the requested volume decrease is accelerated. Some embodiments of the present invention also operate to override the mapping of volume increase requests.
The primary component responsible for audio playback is a playback engine 60 that operates on media asset data to provide a suitable output for playing the audio. In some embodiments of the present invention, the playback engine can provide USB digital audio on an output interface coupled to a suitable connector such as accessory interface connector 35 as well as analog audio on audio out connector 40 and possibly on accessory interface connector 35. Associated with, or incorporated into, playback engine 60 is a volume control register 65 that receives a volume level signal and effects the appropriate volume control.
The volume level signal that is communicated to volume control register 65 can be controlled by a user manipulating an interface element, with the user's actions converted by a user input signal generator 70 into an electrical signal representing the user's actions. This signal, which represents a volume change request, is then converted or mapped by a volume level change engine 75 having associated volume change data 75′ that supports default mapping and override mapping as determined by an override control 80. In some embodiments, the override mapping feature can be enabled and disabled as a matter of user preference.
Volume change data 75′ can include, for example, parameter values, lookup tables, and the like to support the default mapping and one or more override mappings, as will be described in greater detail below. Override control 80 determines which mapping is to be applied to the signal from user input signal generator 70, for example by switching from override mapping to default mapping after TOverride has elapsed from the start of playback.
Thus, depending on which mapping is in effect, the device can be considered to be in a selected one of first and second volume control states (referred to as default and override states). Each volume control state can be considered to be characterized by a different mapping of volume change requests. Additional embodiments of the present invention can include more than two volume control states. Further, the transition from one state to another need not be abrupt; rather override control 80 can be configured to provide a gradual transition from the override mapping to the default mapping.
In some embodiments of the present invention, override control 80 can cause volume level change engine 75 to prevent signals from passing at the start of playback, and only allow signals to pass in response to a volume change request, with the mapping depending on the elapsed time. In some embodiments of the invention, the volume level change engine can be initialized with the current volume setting and combine the current volume with the user-generated signals to provide absolute volume levels rather than specified volume level changes.
Embodiments of the present invention can be used with any electronic volume control mechanism. In traditional analog audio devices, the user turns a knob, and a potentiometer modifies an electrical signal in a manner that depends on the position of the knob. For example, if the knob is connected to a potentiometer that is connected as a voltage divider, the output signal is a voltage that is a fraction of the input signal. The potentiometer may have a logarithmic profile that represents the human aural response so that equal amounts of rotation would lead to what would be perceived as equal changes in volume.
In more modern incarnations, a user gesture, for example moving a finger along a circular path while engaged with a scroll wheel (e.g., scroll wheel 25), generates an electrical signal that is communicated to circuitry or software that controls the output volume. Other user interface controllers can be used to request a volume change. For example, a user may control volume by manipulating a displayed slider, by pressing volume Up/Down buttons (physical switches or displayed buttons), by gesturing on a touch pad, to name a few known ways. Again, the default mapping provided by volume level change engine 75 could impose a logarithmic mapping as mentioned above.
In all these techniques for requesting a volume change, the user actions requesting such a change are converted into signals, typically electrical signals, that that are then mapped to signals that will control the output volume. Volume control register 65, user input signal generator 70, volume level change engine 75, and override control 80 can be separate hardware components, software components, or a combination. To the extent that some of these are implemented in software, the code that is executed can be stored in storage subsystem 50. For convenience, the signal provided by user input signal generator 70 is referred to as the motion signal, even though some of the user actions (e.g., button presses, voice commands) do not entail movement of an actuator or a finger where the distance of the movement has significance.
Volume control register 65, user input signal generator 70, volume level change engine 75, and override control 80 are drawn as separate elements, the final output of which provides a volume level signal to playback engine 60. This is for convenience only. Depending on the implementation, some of these elements could be more tightly integrated into the playback engine. Further, volume control register 65, volume level change engine 75, and override control 80 represent one way of implementing the functionality of volume control mechanism 5 shown in FIGS. 1A-1E.
FIG. 3 is a circuit block diagram of a device according to an embodiment of the present invention. For concreteness, the example of PMD 10 will be used, it being understood that PMDs and other devices according to embodiments of the present invention do not need to contain all the components shown, and further that they may contain additional components. Again for concreteness, the description of PMD 10 will be in terms of a device that, among other things, plays music.
PMD 10 is preferably processor-based, and to that end typically includes at least one processor 85, which can be a conventional microprocessor or microcontroller. The processor can communicate with a number of peripheral devices via a bus subsystem 90. The processor is shown as implementing a graphical user interface (“GUI”) engine 95, a database engine 100, and playback engine 60. Bus subsystem 90 provides a mechanism for letting the various components and subsystems of PMD 10 communicate with each other as intended. Although bus subsystem 90 is shown schematically as a single bus, embodiments of the bus subsystem may utilize multiple buses, and various of the components may have private connections. Although the specifically described embodiments of the present invention are processor-based embodiments, other embodiments can be implemented with other types of controllers such as combinatorial logic.
In addition to storage subsystem 50, which is shown as having a memory subsystem 105 and a file storage subsystem 110, the devices on the bus can include various interface controllers for interfacing to other devices or functional elements that do not interface to other devices. In the representative configuration shown in FIG. 3, the additional devices include a user output device interface 115 (shown coupled to coupled to display 20), a user input device interface 120 (shown coupled to scroll wheel 25, buttons 30, and switch 45), an I/O interface 125 (shown coupled to accessory interface connector 35 and one or more antenna(e)) 130, and an optional dedicated playback engine 60′.
Embodiments of the present invention can be implemented with many different types of processor. Many PMDs use an embedded processor such as processors using the ARM architecture (a RISC architecture designed by ARM Limited).
GUI engine 95, database engine 100, and playback engine 60 can be implemented, for example, in program code (software or firmware) stored in PMD 10 and running on a processor such one of processors 85, in hardware, or in combinations of the two. Database engine 100, which can be of conventional design, provides various capabilities related to searching, browsing, and selecting assets 55 or groups of assets 55 from storage subsystem 50. Playback engine 60, which can also be of conventional design, provides capabilities related to presenting selected media assets 55 from storage subsystem 50 to a user. In some embodiments of the present invention, playback engine 60 may provide video portions of media assets 55 and/or audio portions of media assets 55 to the user. In some embodiments of the present invention, the playback engine can provide USB digital audio as well as analog audio.
FIG. 3 shows dedicated playback engine 60′; while the playback functionality can be implemented in software by processor(s) 85, as described above, some embodiments of the present invention may have a dedicated playback engine coupled to audio out connector 40. Dedicated playback engine 60′ provides decoding of encoded audio files (e.g., MP3, AAC) and digital-to-analog conversion for output at audio out connector 40. For a specific embodiment where the analog audio out signal is provided to accessories through accessory interface connector 35, the playback engine is also coupled to accessory interface connector 35. Conversely, for embodiments of the present invention where there is no dedicated playback engine, I/O interface 125 can be provided with digital-to-analog conversion capability to drive audio out connector 40.
As mentioned above in connection with FIG. 2A, media assets are stored in storage subsystem 50. Also shown in storage subsystem 50 is volume change data 75′ that characterizes and supports the override mapping (and possibly the default mapping) of volume level change engine 75. This was also mentioned above. The volume change data can be used by volume level change engine 75 as controlled by override control 80 to provide different desired mappings of volume change requests. For example, different sets of parameters could be read out of storage and loaded into registers before enabling any sound to be output. In other embodiments of the present invention, such parameters can be in firmware more closely bound to dedicated playback engine hardware.
Storage subsystem 50 can include various types of storage media, and stores the basic programming and data constructs that provide at least some of the functionality of PMD 10 For example, the various program modules and databases implementing the functionality of the PMD may be stored in storage subsystem 50. The software modules are generally executed by processor(s) 130. In the case of a PMD, the storage subsystem is used to store media assets 55, which may account for a significant portion of the overall storage capacity.
Memory subsystem 105 typically includes a number of memories including a main random access memory (RAM) 135 for storage of instructions and data during program execution and a non-volatile memory (NVM) 140 in which fixed instructions and fixed system parameters are stored. While the non-volatile memory may be a ROM, rewritable non-volatile memories such as flash EPROMs may be used.
File storage subsystem 160 provides persistent (non-volatile) storage for program and data files, and may include, for example, one or more hard disk drives and/or flash memory drives. Additionally the file storage subsystem may support associated removable media 145, e.g., flash memory cards such as those used in digital cameras and mobile phones. Possible types of flash memory cards include but are not limited to Secure Digital (SD), CompactFlash (CF), Memory Stick (MS), MultiMediaCard (MMC) xD-Picture Card (xD), and SmartMedia (SM).
In some embodiments of the present invention, some of the media assets, or portions thereof, that are stored in file storage subsystem 160 are transferred to a cache in memory subsystem 155, and then read out from the cache by playback engine 60. Transferring significant portions of a media stream to memory before playback can provide a measure of skip protection for hard-drive-based PMDs, and also provides the benefit of allowing the disk drive to be turned off while media are read out from the memory.
I/O interface 125 operates, for wired connections, to provide output signals and receive input signals to and from connectors outside housing 15 such as accessory interface connector 35 and audio out connector 40. It operates, for wireless connections to provide output signals and receive input signals by use of antenna(e) 130. A number of accessories 147, designated Accessory(1) . . . Accessory(Q) are shown coupled to the I/O interface. Accessories 147 can provide additional functionality, and can include such items as earphones, external speakers, microphones, car stereo adapters, wireless adapters, and the like.
I/O interface 125 may include one or more peripheral interfaces such as USB, IEEE 1394 (Firewire), and Bluetooth (a short-range wireless communication standard developed by the Bluetooth SIG and licensed under the trademark Bluetooth®). The I/O interface may also or alternatively include one or more wired networking interfaces (e.g., Ethernet) or wireless networking interfaces (e.g., Wi-Fi adhering to one of the 802.11 family standards, digital mobile phone technologies). Thus, depending on the embodiment, I/O interface 125 can provide an interface to one or more host computers, one or more networks, or accessories coupled to PMD 10. The I/O subsystem need not be configured for all these possibilities; it can be very limited in scope for some embodiments.
For example, the I/O subsystem of some embodiments of the present invention may have the ability to couple PMD 10 to a host computer (via a wired or wireless connection) that provides additional asset management capabilities as can be provided by an MMA. Such asset management capabilities include but are not limited to storing additional assets 55 in storage subsystem 50, removing assets 55 from storage subsystem 50 and/or organizing assets in manners that facilitate desired uses. For example, music assets can be arranged into playlists.
As another example, the I/O subsystem of some embodiments of the present invention (possibly the same as those above, but possibly different embodiments) will have the ability to couple PMD 10 with a source of media assets (e.g., via a wireless connection to the Internet) so that the PMD can obtain media assets without connecting to a host computer. As another example, the I/O subsystem of some embodiments of the present invention (possibly the same as those above, but possibly different embodiments) will have the ability to couple PMD 10 to accessories that expand the capabilities of the PMD (e.g., via accessory interface connector 35 or antenna(e) 130).
As another example, the I/O subsystem of some embodiments of the present invention (possibly the same as those above, but possibly different embodiments) will have the ability to couple PMD 10 to sources of wireless signals that allow the PMD to determine its location. Wireless signals from global positioning satellites can be used for those PMDs that include a GPS receiver. Alternatively, wireless signals from one or more cellular towers can be used by those PMDs that had the ability to triangulate or otherwise decode such signals.
In addition to, or instead of, scroll wheel 25 and buttons 30, the user input devices coupled to user input device interface 120 may include one or more of any or all of the following: keyboards; pointing devices such as mice, trackballs, touchpads, or graphics tablets; scanners, barcode scanners; touchscreens incorporated into displays; audio input devices such as voice recognition systems, microphones, and other types of input devices. In general, use of the term “user input device” is intended to include all possible types of devices and ways for a user to input information into PMD 10. It is noted that some of the above-mentioned user input devices can be coupled to I/O interface 125 through accessory interface connector 35.
In the context of a typical PMD, the input devices can include such devices as a touch screen, a scroll wheel such as scroll wheel 25 in FIG. 2A, buttons such as buttons 30 shown in FIG. 2A, knobs, and the like to receive user input. On a PMD such as some versions of the iPod®, the user may invoke scrolling by touching a scroll wheel and moving a finger in a circular motion. At different times, the scroll wheel has been implemented as an actual rotatable member, or as a series of fixed capacitive sensors disposed under a fixed annular region of the PMD body, which the user “moves” by touching and moving a finger in a circular motion. PMDs and computers with touch interfaces allow various gestures to cause scrolling.
Additional types of input devices could be motion detectors such as accelerometers that can respond to a user's actually moving the device. In the case of a portable device, for example, a clockwise (or counterclockwise) twist of the wrist can be interpreted in a manner analogous to a clockwise (or counterclockwise) actuation of a scroll wheel or a knob. Similarly, while the exemplary input devices were generally described as being mounted to or associated with the PMD or computer, reference to exemplary input devices should be considered to include such devices mounted to or associated with a remote control device. Remote control devices can include wired (tethered) devices (e.g., connected to user input device interface 120 or I/O interface 125, possibly using the accessory connector) and wireless devices communicating via one of antenna(e) 130.
In FIG. 3, the only user output device coupled to user output device interface 115 is a display. The present invention does not rely on any particular type of display, although suitable candidates can include liquid crystal displays (LCDs) or light emitting diode (LED) displays. Some PMDs can also provide non-visual display such as audio output. In general, use of the term “user output device” is intended to include all possible types of devices and ways to output information from PMD 10 to a user. In typical PMDs, the primary display is a visual display, which is used to display visual characteristics of the media assets (e.g., in the case of videos, images, and the like) and metadata (perhaps displayed in lists or in hierarchical menus).
GUI engine 95 can interact with display 20 and user input devices such as scroll wheel 25 and buttons 30 to provide a graphical user interface, allowing a user to control operation of PMD 10. GUI engine 95 can control display 20 to present user interface elements such as text menus, icons or the like, and user input devices can be operated by a user to interact with the displayed user interface elements (e.g., selecting or activating an element, thereby giving an instruction to PMD 10).
In some embodiments of the present invention, user input devices can include a touch-sensitive element overlaying display 20, providing a touch screen interface. In other embodiments of the present invention, user input devices can include distinct devices such as one or more of a scroll wheel 25, buttons 30, a touch pad. In any event, GUI engine 95 can reflect the operation of user input device(s) by updating display 20, e.g., to change which item on a menu is highlighted for selection. The GUI can enable the user to control any aspect of PMD 10, including locating and selecting media assets 55 to be played, controlling playback (e.g., play, pause, fast forward, rewind, etc.), adjusting playback settings (volume, equalizer, etc.), and so on.
A significant aspect of the user output are the sound characteristics of the assets, such as the music or words of audio tracks and the soundtrack of videos. As such, some of the embodiments of the present invention are concerned with facilitating the playback of music.
FIG. 4A is a block diagram showing additional details of playback engine 60 or dedicated playback engine 60′ and connected components relating to volume control in an embodiment of the present invention. The playback engine comprises a decoder 150, a multiplier 155, a digital-to-analog converter (“D/A converter” or “DAC”) 160, and a preamplifier 165. The decoder and multiplier can be implemented in hardware or software, while the DAC and preamplifier are by nature hardware elements. In embodiments of the present invention where the decoder and multiplier are implemented on a dedicated decoder chip, volume control register 65 can be one of the chip's on-chip registers.
Decoder 150 receives media asset data from storage subsystem 50, decodes it, and passes the decoded values to multiplier 155, which multiplies them by a value specified by volume control register 65. The digital values, at the specified volume, are communicated to bus subsystem 90 and also to DAC 160. The analog output of the DAC is amplified by preamplifier 165 to provide a line level output, which can be communicated to audio out connector 40 and/or accessory interface connector 35 (not shown). The digital output from multiplier 155, shown as communicated to the bus subsystem, can be provided to accessory interface connector 35 (not shown) or any other digital output.
In this embodiment of the present invention, volume level change engine 75 is represented by a default volume level change generator 75 a and an override volume level change generator 75 b. Thus, the signal that is received by volume control register 65 is a selected one of a first (default) signal provided by default volume level change generator 75 a and a second (override) signal provided by override volume level change generator 75 b, as determined by override control 80, which is represented by a switch 80′. The switch can be actuated at a time TOverride following the start of playback to switch from override volume level change generator 75 b to default volume level change generator 75 a.
Thus, depending on which signal is being selected, the device can be considered to be in a selected one of first and second volume control states (referred to as default and override states). Each volume control state can be considered to be characterized by a different mapping of user volume change requests. Additional embodiments of the present invention can include more than two volume control states. Further, the transition from one state to another need not be abrupt; rather it is possible to configure switch 80 so that it initially provides the override signal and during a transition interval mixes the two signals so that at the end of the interval the output is the default signal.
The notion of a switch selecting one of two volume level change generators is a schematic view. In one set of embodiments of the present invention, the switch can select override volume level change generator 75 b at the start of playback, and then select default volume level change generator 75 a after the predetermined time interval TOverride. In other embodiments of the present invention, the switch can remain blocking at the start of playback, and only allow signals to pass in response to a volume change request, with the selected volume level change generator depending on the elapsed time. Indeed, the notion of multiple volume level change generators, at the broadest, should be taken to cover the case where different parameter values are loaded into the same set of registers.
The figure shows user input signal generator 70, default volume level change generator 75 a (or override volume level change generator 75 b), switch 80, and volume control register 65 connected in series, as well as being coupled to bus subsystem 90. Embodiments of the present invention can utilize any combinations of these connections so long as the functionality of the signals passing from one block to the other remains. At one extreme, there are embodiments where there are no series connections, and all communications are over the bus subsystem. At the other extreme, there are embodiments where there are no bus connections and all communications are over the series paths from one block to the next. This is consistent with the statement in the Device Hardware Overview that the bus schematic is a simplification and there may be multiple buses and there might be private connections among devices. The operation of the volume control elements will now be described.
FIG. 4B is a block diagram showing the playback engine and connected components relating to volume control in an alternative embodiment of the present invention. This embodiment differs from that shown in FIG. 4A in that there is an additional override volume level change generator 75 c in parallel with default volume level change generator 75 a and override volume level change generator 75 b, and switch 80 has three inputs rather than two. This embodiment is an example of embodiments with more than two volume control states; in this specific example, the transition from an override state to the default state occurs in two steps. It is also possible to configure a single override volume level change generator to change its acceleration parameter(s) during the override volume control state.
Thus, in this embodiment of the present invention, the first and second states can be considered override states characterized by first and second predetermined intervals TOverride and TOverride′ during which first and second override mappings are used. When the second predetermined interval has elapsed after the end of the first predetermined interval, the third (default) volume control state is established, characterized by a third mapping of volume change requests to volume change controls.
Conceptually the first two override states with their respective time intervals and mappings can be viewed as a single override interval with the override mapping having a time dependence. Put another way, the first and second states can be viewed as constituting a single override state characterized by a single time interval and a single mapping. However, the override state comprises two or more sub-states with respective sub-intervals and sub-mappings.
User input signal generator 70 generates a signal, referred to as the motion signal, that represents the user's interaction with a user interface element to request a volume change. For embodiments of the present invention where the user moves a slider or wheel or moves a finger relative to a fixed structure, the motion signal encodes one or more characteristics of the user's motion (for example one or more of position, velocity, and acceleration). This is shown schematically as a graph (Motion Signal vs. User Actuation) to the right of user input signal generator 70. Depending on the implementation, the motion signal can be a defined function of the user input. For simplicity, this is shown as a linear function in the figure, but other functional relationships are possible.
In embodiments of the present invention where the user interface element is a scroll wheel that uses a plurality of capacitive sensors to detect finger position, the sensors provide electrical signals upon detecting the capacitance of the user's finger. In some implementations, the user input signal generator can then transform these signals to a time dependent position signal. Depending on the PMD context, however, this signal can represent user input specific to that context. For example, in at least some iPod® models, the scroll wheel can be used to scroll menu items as well as to control playback volume. Thus user input signal generator 70, while shown as part of the overall volume control functionality, can be a general purpose module (hardware, software, or a combination).
For purposes of example, consider that the output from user input signal generator 70 provides the position, and is updated sufficiently frequently that subsequent processing blocks can integrate and/or differentiate the signal to the extent that the total distance or the velocity is needed. For embodiments of the present invention where the user input device is a mechanical slider or wheel, the output signal can provide the distance from the initial position or can provide the absolute position.
In other embodiments of the present invention, the user presses one or more buttons to request a volume change. As noted above, the term motion signal is used in connections with these embodiments where the user is not generating a displacement whose extent matters. In button-based embodiments, the output (motion) signal can be based on the number of button presses (clicks). Some implementations can provide a pair of buttons (Up/Down or ±). The output can vary linearly or non-linearly with respect to the number of presses. Further, an extended button press can be used to invoke a signal that increases or decreases in proportion to, or as a non-linear function of, the duration of the press. The output signal can also provide information on the intervals between repeated button presses.
As mentioned above, volume level change engine 75 converts user input signal generator 70's motion signal, which provides a measure of the user's action to control the volume, to a signal relating to a desired volume level. This is shown schematically as a graph (Default Volume Level vs. Motion Signal) to the right of default and override volume level change generators 75 and 75 b. The discussion in this section is not limited to the embodiments of FIGS. 4A and 4B, but generally applies to other embodiments of the volume level change engine.
Assume for the sake of example that the output signal from user input signal generator 70 is a time dependent position signal. For further sake of example, assume that the user input device is touch sensitive. There are a still a number of ways in which the signal can be used to control volume. In some embodiments of the present invention, the location of the initial finger contact can be interpreted as requesting the intended volume, with subsequent finger motion (while maintaining contact) is ignored. Thus, a mere touch can be used to set the volume. In other embodiments, the initial finger contact is ignored until some motion is detected. At that point, the volume can be increased or decreased as a function of the direction and amount of movement. Similar considerations can apply in the case of indirect pointing devices with distinctions between the ways clicks and drags are interpreted.
The figure shows the dependence of Default Volume Level as increasing for motion to the right and decreasing for motion to the left, with upper and lower cutoffs for the maximum and minimum volume levels. What this means is that should the user continue moving the actuator or finger past the point where the volume level reaches one of the extreme values, further movement will have no further effect on the volume level. The graph is stylized in the sense that the mapping depends on the volume level when the movement begins. For example, if the volume level is at the minimum, when the user starts movement to increase the volume, the volume trajectory will begin at the bottom left kink in the graph, and continue up the graph toward the right. Similarly, if the volume level is at the maximum, when the user starts movement to decrease the volume, the volume trajectory will begin at the upper right kink in the graph, and continue down the graph toward the left.
While the figure shows volume level as a linear function of the motion signal (i.e., characterized by a single slope parameter), other functional relationships are possible. For example, some implementations can provide a measure of acceleration/deceleration depending on the speed of the user's motion (i.e., on the rate of change of the motion signal). For example, in some such implementations, short fast movements can be interpreted to result in as much volume level change as slower longer movements. The characteristics of such acceleration can be specified by an analytic function such as a polynomial or an exponential, or can be specified in a lookup table (whether or not the function has an analytic form). The possibility of providing acceleration or any other non-linear treatment to the mapping is a separate issue from the volume level override feature, which is described in greater detail below.
The opportunities for acceleration/deceleration apply to button-press embodiments of the present invention. Where the motion signal is incremented by repeated button presses, the counterpart to speed of translational or rotational movement is the speed at which the button is repeatedly pressed. Thus a small number of rapid presses can be interpreted to result in as much volume level change as a larger number of presses that occur at less frequent intervals. Acceleration can also be applied to extended button presses.
As mentioned above, volume level change engine 75 also provides an override mapping between the motion signal and the volume level that differs from the default mapping. This is shown schematically as a graph (Override Volume Level vs. Motion Signal) to the right of switch 80 and volume control register 65. For ease of explanation, the mapping for the default volume level change generator is shown in phantom. In representative embodiments of the present invention, the override mapping is selected by override control 80 when playback starts. As mentioned above, the start of playback should be understood to include, for example, the user's starting playback after power up, the user's resuming playback after having paused playback, the start of a new track, or a volume increase after an interval of very soft playback. The discussion in this section is not limited to the embodiments of FIGS. 4A and 4B, but generally applies to other embodiments of the volume level change engine.
When the user requests a decrease in volume, the override mapping provided by volume level change engine 75 accelerates the decrease. For the example of a linear function, the slope parameter has a larger absolute value than the corresponding slope parameter for the default mapping provided by volume level change engine 75. The mapping for movements requesting a decrease in volume is shown as a heavy line. As noted above, this is separate from, and in addition to, any acceleration or deceleration provided for the default mapping. Possible reasons that the user might want a very rapid response to efforts to turn down the volume is that the volume may be significantly higher than the user was expecting. This could be uncomfortable for a user wearing earphones, and could be annoying or embarrassing where the device is playing through speakers.
In some embodiments of the present invention, the override profile is deselected after a predetermined time interval TOverride (say 10-15 seconds), because by then the user is likely to have adjusted the volume or decided that the volume at the start of playback was acceptable.
In some embodiments of the present invention, volume level change engine 75, when operating with the override mapping, also modifies the default mapping for user efforts to increase the volume. The mapping for movements requesting an increase in volume is shown as a normal-weight solid line. As shown in the figure, when the user requests an increase in volume, volume level change engine 75 decelerates the increase. There are other possibilities, as will be discussed below.
FIGS. 5A, 5B, and 5C are graphs showing alternative override mappings for requested decreases in volume. In the embodiment of the present invention shown in FIG. 4A, the mapping is a uniform acceleration of the decrease (e.g., slope magnitude doubled) for all initial and subsequent volume levels. FIG. 5A shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels above a middle volume level, and then a default decrease for volume levels below the middle volume level. FIG. 5B shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels above the middle volume level, and then a decelerated decrease for volume levels below the middle volume level. FIG. 5C shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels above a medium-loud volume level, and then a default decrease for volume levels below the medium-loud volume level.
FIGS. 6A, 6B, and 6C are graphs showing additional override mappings for requested increases in volume. In the embodiment of the present invention shown in FIG. 4A, the mapping provides a uniform deceleration of the increase (e.g., slope at ⅔ the slope of default increase) for all initial and subsequent volume levels. FIG. 6A shows an embodiment where the mapping provides an acceleration of the increase for initial and subsequent volume levels below a middle volume level, and then a decelerated increase for volume levels above the middle volume level. FIG. 6B shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels below the middle volume level, and then a default increase for volume levels above the middle volume level. FIG. 6C shows an embodiment where the mapping provides an acceleration of the decrease for initial and subsequent volume levels below a medium-loud volume level, and then a decelerated increase for volume levels above the medium-loud volume level.
The choice of acceleration/deceleration profiles may depend on a number of considerations. For example, a more aggressive accelerated decrease in volume level can be used when the PMD is playing back through headphones, since user discomfort can be a greater consideration with headphones than with speakers. Since some PMD models can sense when they are connected to speakers, this can be done automatically. Although not illustrated, embodiments of the present invention can also provide near-instantaneous volume decrease or increase to a predetermined level. For example, the mapping shown in FIG. 5C can be modified so that an initial segment of the graph is vertical (i.e., any volume decrease request during the override interval results in a substantially immediate drop to a lower volume.
It is noted that in the embodiments of FIGS. 5A, 5B, 5C, 6A, 6B, and 6C, the acceleration and deceleration profiles depend on the current absolute volume level. In such cases, volume level change engine 75, possibly implemented as including override volume level change generator 75 b, can be provided with absolute volume information before playback starts. In those embodiments of the present invention where volume level change engine 75 provides an absolute volume level rather than volume level increments, this would already be taken into account. Different embodiments of the present invention can use different combinations of the override mappings shown for volume increase requests and volume decrease requests. Thus, for example, a particular embodiment can use any one of the mappings shown in FIGS. 5A, 5B, and 5C, combined with any of the mappings shown in 6A, 6B, and 6C.
FIG. 7 is a block diagram showing portions of the playback engine and connected components in an alternative embodiment of the present invention. In this embodiment, the override functionality is provided by an override volume level change block 170 in series with a default volume level change generator 75 a. As in the embodiment of FIG. 4A, the elements are also shown as being connected to bus subsystem 90, and this embodiment can utilize any combinations of these connections so long as the functionality of the signals passing from one block to the other remains.
Along the lines of the embodiment of FIG. 4A, override volume level change block 170 is disabled at some time after playback has started. This can be achieved in a number of ways, for example by a bypass switch within the block (not shown) or a branch in software. To the extent that the override volume level change block's acceleration/deceleration profiles depend on the current absolute volume level, the absolute volume level can be provided.
FIGS. 8A and 8B are flowcharts showing alternative ways of determining whether to use the override mapping or the default mapping. Both flowcharts represent the start of playback (denoted as t=0) followed by a first instance of receiving a volume change request at a step 175. The time of receiving a volume change request, either at step 175 or at a later time is denoted as tVolChange. That is, tVolChange represents the elapsed time from the start playback to the time at which the user requests a volume change.
In the embodiment of FIG. 8A, tVolChange is compared to TOverride at a step 180 to determine whether the time of the volume change request is still within the time interval where the override mapping is to be used rather than the default mapping. If it is, the motion signal is transformed using the override mapping at a step 185, the volume is changed at a step 190, and the device awaits further volume change requests at a step 195. When a further volume change request is received, control is passed back to step 180 where tVolChange is again compared to TOverride.
If at step 180 (whether entered from step 175 or step 195), it is determined that the time of the volume change request (tVolChange) is no longer within the time interval TOverride, the motion signal is transformed using the default mapping at a step 200, the volume is changed at a step 205, and the device awaits further volume change requests at a step 210. When a further volume change request is received, control is passed back to step 200, and no more tests of tVolChange are made.
In the embodiment of FIG. 8B, tVolChange is compared to TOverride at a step 215. If tVolChange is less than TOverride, the motion signal is transformed using the override mapping at a step 220, the volume is changed at a step 225, and the device awaits further volume change requests at a step 230. If it is determined at step 215 that tVolChange is not less than TOverride, the motion signal is transformed using the default mapping at a step 235, the volume is changed at a step 225, and the device awaits further volume change requests at a step 230. In either case, when a further volume request change is received, control is passed back to step 215, and the elapsed time is tested for every subsequent volume change request.
In conclusion can be seen that embodiments of the present invention provide additional functionality that can enhance user experience and convenience when using devices such as PMDs. For example, the special volume control mapping at the start of playback allows the user to ameliorate quickly the effect of an excessive volume level.
While the above is a complete description of specific embodiments of the invention, the above description should not be taken as limiting the scope of the invention as defined by the claims.

Claims (31)

1. A method of controlling playback volume on an audio output device wherein user input requesting a volume change, referred to as a volume change request, is converted to a volume change control, the method comprising, in response to a volume change request:
if the elapsed time since playback started is less than a predetermined interval, using a first mapping to convert the volume change request to a volume change control;
otherwise, for at least some elapsed times greater than the predetermined interval, using a second mapping to convert the volume change request to a volume change control, wherein the first mapping is different from the second mapping for at least some volume levels; and
using the volume change control to modify the playback volume.
2. The method of claim 1 wherein:
the predetermined interval comprises a plurality of subintervals; and
using the first mapping comprises using one or more of a plurality of sub-mappings, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into.
3. The method of claim 1 wherein:
the first and second mappings differ for volume decrease requests for at least some volume levels; and
the first and second mappings differ for volume increase requests for at least some volume levels.
4. The method of claim 1 wherein:
the first mapping provides a faster volume decrease than the second mapping for at least some volume levels; and
the first mapping provides a slower volume increase than the second mapping for at least some volume levels.
5. The method of claim 1 wherein the user input is provided by one or more of:
a gesture on a plurality of capacitive sensors;
an actuation of a movable element;
a manipulation of a displayed control element.
6. The method of claim 1, and further comprising:
at the start of playback, establishing a first volume control state characterized by the first mapping.
7. The method of claim 1, and further comprising:
when the predetermined interval has elapsed, establishing a second volume control state characterized by the second mapping.
8. The method of claim 1, and further comprising:
at the start of playback, establishing a first volume control state characterized by the first mapping;
when the predetermined interval has elapsed, establishing a second volume control state characterized by the second mapping; and
when a second predetermined interval has elapsed after the end of the first predetermined interval, at a time after the start of playback, but before the second volume control state is established, establishing a third volume control state characterized by a third mapping of volume change requests to volume change controls, wherein the third mapping is different from the first and second mappings for at least some volume levels.
9. A method of controlling playback volume on an audio output device wherein volume changes are effected in response to user input requesting a volume change, referred to as a volume change request, the method comprising:
at the start of playback, establishing a first volume control state characterized by a first mapping of volume change requests to volume change controls;
at a time after the start of playback, establishing a second volume control state characterized by a second mapping of volume change requests to volume change controls, wherein the first mapping is different from the second mapping for at least some volume levels; and
in response to a volume change request, changing the volume in accordance with the current volume control state.
10. The method of claim 9 wherein:
the first volume control state comprises a plurality of sub-states characterized by a plurality of sub-mappings, at least some of which differ from one another, depending on which of the subintervals the volume change request falls into.
11. The method of claim 9 wherein the first and second mappings differ only over a range of volume levels that is less than the full range of volume levels.
12. The method of claim 9 wherein the first and second mappings differ over the full range of volume levels.
13. A method of controlling playback volume on an audio output device wherein the response to user input requesting a volume change, referred to as a volume change request, is defined by respective values of a set of one or more parameters, the method comprising:
at the start of playback, establishing a first volume control state characterized by a first set of parameter values that define a response to a volume change request;
after a given elapsed time after the start of playback, establishing a second volume control state characterized by a second set of parameter values, wherein the second set of parameter values define a different response to a volume change request than the response defined by the first set of parameter values; and
in response to a volume change request, changing the volume in accordance with the current volume control state.
14. The method of claim 13 wherein:
the given elapsed time comprises a plurality of subintervals;
the first volume control state comprises a plurality of sub-states, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into; and
the first set of parameter values comprises a plurality of subsets of parameter values.
15. The method of claim 13, and further comprising establishing an intermediate volume control state between the times of establishing the first and second volume control states, wherein the intermediate volume control state is characterized by an intermediate set of parameter values that define a response that is different from the responses of the first and second volume control states.
16. An audio output device comprising:
a user interface element operable by a user to provide signals representing volume change requests;
a level change engine, responsive to volume change requests, for converting a volume change request to a volume change control signal, said level change engine configured to:
use a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or
otherwise, use a second mapping to convert the volume change request to a volume change control signal, wherein said first mapping is different from said second mapping for at least some volume levels; and
a playback engine, responsive to input media signals and to said volume change control signal, for providing audio signals representing the input media signals at a playback volume derived from said volume change control signal.
17. The device of claim 16 wherein:
said predetermined interval comprises a plurality of subintervals; and
said first mapping comprises a plurality of sub-mappings, at least some of which differ from one another.
18. The device of claim 16, and further comprising a storage medium and a processor coupled to said storage medium, wherein:
said level change engine is implemented by program code stored in said storage medium and executed by said processor; and
said first and second mappings are at least in part defined by volume change data stored in said storage medium.
19. The device of claim 16, and further comprising an override control that determines whether said level change engine uses said first mapping or said second mapping.
20. The device of claim 19 wherein:
said level change engine comprises first and second volume level change generators configured to use said first and second mappings, respectively; and
said override control comprises a switch that selects between said first and second volume level change generators.
21. The device of claim 16 wherein said first mapping provides a faster volume increase than said second mapping for at least some volume levels.
22. The device of claim 16 wherein:
said first and second mappings differ for volume decrease requests for at least some volume levels; and
said first and second mappings differ for volume increase requests for at least some volume levels.
23. The device of claim 16 wherein the user interface element comprises one or more of:
a plurality of capacitive sensors;
a movable element; or
a displayed control element provided by a GUI engine.
24. The device of claim 16 wherein the device is a portable media device, and further comprises a storage medium and media assets stored in said storage medium.
25. A portable device comprising:
a storage medium;
a processor coupled to said storage medium;
a user interface element operable by a user to provide signals representing volume change requests;
computer code stored in said storage medium wherein said computer code, when retrieved from said storage medium and executed by said processor:
uses a first mapping to convert a volume change request to a volume change control signal if the volume change request is received within a predetermined interval since playback started; or
otherwise, uses a second mapping to convert the volume change request to a volume change control signal, wherein said first mapping is different from said second mapping for at least some volume levels; and
a playback engine, responsive to input media signals and to said volume change control signal, for providing audio signals representing the input media signals at a playback volume derived from said volume change control signal.
26. The device of claim 25 wherein said first mapping provides a faster volume decrease than said second mapping for at least some volume levels.
27. The device of claim 25 wherein said first and second mappings differ for volume increase requests for at least some volume levels.
28. The device of claim 27 wherein said first mapping provides a slower volume increase than said second mapping for at least some volume levels.
29. A computer-readable medium containing program instructions, which when executed by a computer system in a portable device cause the computer system to execute a method of controlling playback volume on an audio output device wherein the response to user input requesting a volume change, referred to as a volume change request, is defined by respective values of a set of one or more parameters, the method comprising:
at the start of playback, establishing a first volume control state characterized by a first set of parameter values that define a response to a volume change request;
after a given elapsed time after the start of playback, establishing a second volume control state characterized by a second set of parameter values, wherein the second set of parameter values define a different response to a volume change request than the response defined by the first set of parameter values;
in response to a volume change request, changing the volume in accordance with the current volume control state.
30. The computer-readable medium of claim 29 wherein:
the given elapsed time comprises a plurality of subintervals;
the first volume control state comprises a plurality of sub-states, at least some of which differ from one another, depending on which of the plurality of subintervals the volume change request falls into; and
the first set of parameter values comprises a plurality of subsets of parameter values.
31. The computer-readable medium of claim 29 wherein the method further comprises establishing an intermediate volume control state between the times of establishing the first and second volume control states, wherein the intermediate volume control state is characterized by an intermediate set of parameter values that define a response that is different from the responses of the first and second volume control states.
US12/198,803 2008-08-26 2008-08-26 Techniques for customizing control of volume level in device playback Active 2031-05-11 US8218790B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/198,803 US8218790B2 (en) 2008-08-26 2008-08-26 Techniques for customizing control of volume level in device playback

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/198,803 US8218790B2 (en) 2008-08-26 2008-08-26 Techniques for customizing control of volume level in device playback

Publications (2)

Publication Number Publication Date
US20100054497A1 US20100054497A1 (en) 2010-03-04
US8218790B2 true US8218790B2 (en) 2012-07-10

Family

ID=41725489

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/198,803 Active 2031-05-11 US8218790B2 (en) 2008-08-26 2008-08-26 Techniques for customizing control of volume level in device playback

Country Status (1)

Country Link
US (1) US8218790B2 (en)

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8525014B1 (en) * 2009-02-18 2013-09-03 Spoonjack, Llc Electronic musical instruments
US9348354B2 (en) 2003-07-28 2016-05-24 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices without a voltage controlled crystal oscillator
US9355555B2 (en) 2013-09-27 2016-05-31 Sonos, Inc. System and method for issuing commands in a media playback system
US9374607B2 (en) 2012-06-26 2016-06-21 Sonos, Inc. Media playback system with guest access
US9379683B2 (en) 2012-08-01 2016-06-28 Sonos, Inc. Volume interactions for connected playback devices
US9438193B2 (en) 2013-06-05 2016-09-06 Sonos, Inc. Satellite volume control
US9729115B2 (en) 2012-04-27 2017-08-08 Sonos, Inc. Intelligently increasing the sound level of player
US9734242B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices that independently source digital data
US9749760B2 (en) 2006-09-12 2017-08-29 Sonos, Inc. Updating zone configuration in a multi-zone media system
US9756424B2 (en) 2006-09-12 2017-09-05 Sonos, Inc. Multi-channel pairing in a media system
US9766853B2 (en) 2006-09-12 2017-09-19 Sonos, Inc. Pair volume control
US9781513B2 (en) 2014-02-06 2017-10-03 Sonos, Inc. Audio output balancing
US9787550B2 (en) 2004-06-05 2017-10-10 Sonos, Inc. Establishing a secure wireless network with a minimum human intervention
US9794707B2 (en) 2014-02-06 2017-10-17 Sonos, Inc. Audio output balancing
CN107276551A (en) * 2013-01-21 2017-10-20 杜比实验室特许公司 Coded audio bitstream of the decoding with the metadata container in retention data space
US9977561B2 (en) 2004-04-01 2018-05-22 Sonos, Inc. Systems, methods, apparatus, and articles of manufacture to provide guest access
US10045123B2 (en) 2013-09-27 2018-08-07 Sonos, Inc. Playback device volume management
US10306364B2 (en) 2012-09-28 2019-05-28 Sonos, Inc. Audio processing adjustments for playback devices based on determined characteristics of audio content
US10359987B2 (en) 2003-07-28 2019-07-23 Sonos, Inc. Adjusting volume levels
US10599287B2 (en) 2014-03-11 2020-03-24 Sonos, Inc. Group volume control
US10613817B2 (en) 2003-07-28 2020-04-07 Sonos, Inc. Method and apparatus for displaying a list of tracks scheduled for playback by a synchrony group
US10672413B2 (en) 2013-01-21 2020-06-02 Dolby Laboratories Licensing Corporation Decoding of encoded audio bitstream with metadata container located in reserved data space
US11106425B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11106424B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US11294618B2 (en) 2003-07-28 2022-04-05 Sonos, Inc. Media player system
US11403062B2 (en) 2015-06-11 2022-08-02 Sonos, Inc. Multiple groupings in a playback system
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
US11481182B2 (en) 2016-10-17 2022-10-25 Sonos, Inc. Room association based on name
US11650784B2 (en) 2003-07-28 2023-05-16 Sonos, Inc. Adjusting volume levels
US11894975B2 (en) 2004-06-05 2024-02-06 Sonos, Inc. Playback device connection

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4797215B2 (en) * 2010-02-26 2011-10-19 オンキヨー株式会社 Volume control system
US20140173529A1 (en) * 2012-12-14 2014-06-19 Barnesandnoble.Com Llc Circular gesture for touch sensitive ui control feature
JP6323089B2 (en) * 2014-03-14 2018-05-16 ヤマハ株式会社 Level adjusting method and level adjusting device
WO2016054763A1 (en) * 2014-10-06 2016-04-14 Motorola Solutions, Inc. Methods and systems for intelligent dual-channel volume adjustment
CN106357913A (en) * 2016-09-28 2017-01-25 北京小米移动软件有限公司 Method and device for prompting information
CN111343060B (en) 2017-05-16 2022-02-11 苹果公司 Method and interface for home media control
CN108363557B (en) * 2018-02-02 2020-06-12 刘国华 Human-computer interaction method and device, computer equipment and storage medium
AU2020285524B2 (en) * 2019-05-31 2022-01-06 Apple Inc. Methods and user interfaces for sharing audio
KR20230039775A (en) 2019-05-31 2023-03-21 애플 인크. User interfaces for audio media control
DK201970533A1 (en) 2019-05-31 2021-02-15 Apple Inc Methods and user interfaces for sharing audio
US10996917B2 (en) 2019-05-31 2021-05-04 Apple Inc. User interfaces for audio media control
US11392291B2 (en) 2020-09-25 2022-07-19 Apple Inc. Methods and interfaces for media control with dynamic feedback
US11847378B2 (en) 2021-06-06 2023-12-19 Apple Inc. User interfaces for audio routing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7072477B1 (en) 2002-07-09 2006-07-04 Apple Computer, Inc. Method and apparatus for automatically normalizing a perceived volume level in a digitally encoded file
US20070085840A1 (en) * 2005-10-07 2007-04-19 Kotaro Asaka Information processing apparatus, method and program
US7399917B2 (en) * 2006-01-23 2008-07-15 Sony Corporation Music content playback apparatus, music content playback method and storage medium
US7674967B2 (en) * 2005-03-22 2010-03-09 Sony Corporation Body movement detecting apparatus and method, and content playback apparatus and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7072477B1 (en) 2002-07-09 2006-07-04 Apple Computer, Inc. Method and apparatus for automatically normalizing a perceived volume level in a digitally encoded file
US7674967B2 (en) * 2005-03-22 2010-03-09 Sony Corporation Body movement detecting apparatus and method, and content playback apparatus and method
US20070085840A1 (en) * 2005-10-07 2007-04-19 Kotaro Asaka Information processing apparatus, method and program
US7399917B2 (en) * 2006-01-23 2008-07-15 Sony Corporation Music content playback apparatus, music content playback method and storage medium

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
"iTunes' Sound Check and you", Apr. 19, 2005, Macworld, from http://www.macworld.com/article/44344/2005/04/soundcheckyou.html.
iPod classic, Features Guide, 2008, 72 pages.
iPod classic, from Wikipedia, the free encyclopedia, 7 pages; printed Apr. 7, 2008 from http://en.wikipedia.org/wiki-IPOD-classic; page states it was last modified on Apr. 5, 2008.
iPod touch, Features Guide, 2008, 98 pages.
iPod, Features Guide, 2006, 72 pages.
iPod, User's Guide, 2004, 64 pages.

Cited By (135)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10949163B2 (en) 2003-07-28 2021-03-16 Sonos, Inc. Playback device
US9734242B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices that independently source digital data
US11650784B2 (en) 2003-07-28 2023-05-16 Sonos, Inc. Adjusting volume levels
US9354656B2 (en) 2003-07-28 2016-05-31 Sonos, Inc. Method and apparatus for dynamic channelization device switching in a synchrony group
US11635935B2 (en) 2003-07-28 2023-04-25 Sonos, Inc. Adjusting volume levels
US10303432B2 (en) 2003-07-28 2019-05-28 Sonos, Inc Playback device
US11556305B2 (en) 2003-07-28 2023-01-17 Sonos, Inc. Synchronizing playback by media playback devices
US11550536B2 (en) 2003-07-28 2023-01-10 Sonos, Inc. Adjusting volume levels
US9658820B2 (en) 2003-07-28 2017-05-23 Sonos, Inc. Resuming synchronous playback of content
US11550539B2 (en) 2003-07-28 2023-01-10 Sonos, Inc. Playback device
US9727303B2 (en) 2003-07-28 2017-08-08 Sonos, Inc. Resuming synchronous playback of content
US9727302B2 (en) 2003-07-28 2017-08-08 Sonos, Inc. Obtaining content from remote source for playback
US9727304B2 (en) 2003-07-28 2017-08-08 Sonos, Inc. Obtaining content from direct source and other source
US10754613B2 (en) 2003-07-28 2020-08-25 Sonos, Inc. Audio master selection
US9733891B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Obtaining content from local and remote sources for playback
US9733892B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Obtaining content based on control by multiple controllers
US9733893B2 (en) 2003-07-28 2017-08-15 Sonos, Inc. Obtaining and transmitting audio
US9740453B2 (en) 2003-07-28 2017-08-22 Sonos, Inc. Obtaining content from multiple remote sources for playback
US11301207B1 (en) 2003-07-28 2022-04-12 Sonos, Inc. Playback device
US11294618B2 (en) 2003-07-28 2022-04-05 Sonos, Inc. Media player system
US11200025B2 (en) 2003-07-28 2021-12-14 Sonos, Inc. Playback device
US9778897B2 (en) 2003-07-28 2017-10-03 Sonos, Inc. Ceasing playback among a plurality of playback devices
US9778898B2 (en) 2003-07-28 2017-10-03 Sonos, Inc. Resynchronization of playback devices
US11132170B2 (en) 2003-07-28 2021-09-28 Sonos, Inc. Adjusting volume levels
US9778900B2 (en) 2003-07-28 2017-10-03 Sonos, Inc. Causing a device to join a synchrony group
US10754612B2 (en) 2003-07-28 2020-08-25 Sonos, Inc. Playback device volume control
US11106425B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11080001B2 (en) 2003-07-28 2021-08-03 Sonos, Inc. Concurrent transmission and playback of audio information
US10970034B2 (en) 2003-07-28 2021-04-06 Sonos, Inc. Audio distributor selection
US10963215B2 (en) 2003-07-28 2021-03-30 Sonos, Inc. Media playback device and system
US10303431B2 (en) 2003-07-28 2019-05-28 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US10956119B2 (en) 2003-07-28 2021-03-23 Sonos, Inc. Playback device
US11625221B2 (en) 2003-07-28 2023-04-11 Sonos, Inc Synchronizing playback by media playback devices
US9348354B2 (en) 2003-07-28 2016-05-24 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices without a voltage controlled crystal oscillator
US11106424B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US10296283B2 (en) 2003-07-28 2019-05-21 Sonos, Inc. Directing synchronous playback between zone players
US10289380B2 (en) 2003-07-28 2019-05-14 Sonos, Inc. Playback device
US10324684B2 (en) 2003-07-28 2019-06-18 Sonos, Inc. Playback device synchrony group states
US10747496B2 (en) 2003-07-28 2020-08-18 Sonos, Inc. Playback device
US10031715B2 (en) 2003-07-28 2018-07-24 Sonos, Inc. Method and apparatus for dynamic master device switching in a synchrony group
US10613817B2 (en) 2003-07-28 2020-04-07 Sonos, Inc. Method and apparatus for displaying a list of tracks scheduled for playback by a synchrony group
US10545723B2 (en) 2003-07-28 2020-01-28 Sonos, Inc. Playback device
US10445054B2 (en) 2003-07-28 2019-10-15 Sonos, Inc. Method and apparatus for switching between a directly connected and a networked audio source
US10387102B2 (en) 2003-07-28 2019-08-20 Sonos, Inc. Playback device grouping
US10120638B2 (en) 2003-07-28 2018-11-06 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US10133536B2 (en) 2003-07-28 2018-11-20 Sonos, Inc. Method and apparatus for adjusting volume in a synchrony group
US10365884B2 (en) 2003-07-28 2019-07-30 Sonos, Inc. Group volume control
US10140085B2 (en) 2003-07-28 2018-11-27 Sonos, Inc. Playback device operating states
US10146498B2 (en) 2003-07-28 2018-12-04 Sonos, Inc. Disengaging and engaging zone players
US10157035B2 (en) 2003-07-28 2018-12-18 Sonos, Inc. Switching between a directly connected and a networked audio source
US10157033B2 (en) 2003-07-28 2018-12-18 Sonos, Inc. Method and apparatus for switching between a directly connected and a networked audio source
US10157034B2 (en) 2003-07-28 2018-12-18 Sonos, Inc. Clock rate adjustment in a multi-zone system
US10175932B2 (en) 2003-07-28 2019-01-08 Sonos, Inc. Obtaining content from direct source and remote source
US10175930B2 (en) 2003-07-28 2019-01-08 Sonos, Inc. Method and apparatus for playback by a synchrony group
US10185541B2 (en) 2003-07-28 2019-01-22 Sonos, Inc. Playback device
US10185540B2 (en) 2003-07-28 2019-01-22 Sonos, Inc. Playback device
US10209953B2 (en) 2003-07-28 2019-02-19 Sonos, Inc. Playback device
US10216473B2 (en) 2003-07-28 2019-02-26 Sonos, Inc. Playback device synchrony group states
US10359987B2 (en) 2003-07-28 2019-07-23 Sonos, Inc. Adjusting volume levels
US10228902B2 (en) 2003-07-28 2019-03-12 Sonos, Inc. Playback device
US10282164B2 (en) 2003-07-28 2019-05-07 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US9977561B2 (en) 2004-04-01 2018-05-22 Sonos, Inc. Systems, methods, apparatus, and articles of manufacture to provide guest access
US10983750B2 (en) 2004-04-01 2021-04-20 Sonos, Inc. Guest access to a media playback system
US11467799B2 (en) 2004-04-01 2022-10-11 Sonos, Inc. Guest access to a media playback system
US11907610B2 (en) 2004-04-01 2024-02-20 Sonos, Inc. Guess access to a media playback system
US10979310B2 (en) 2004-06-05 2021-04-13 Sonos, Inc. Playback device connection
US11456928B2 (en) 2004-06-05 2022-09-27 Sonos, Inc. Playback device connection
US9866447B2 (en) 2004-06-05 2018-01-09 Sonos, Inc. Indicator on a network device
US10965545B2 (en) 2004-06-05 2021-03-30 Sonos, Inc. Playback device connection
US11025509B2 (en) 2004-06-05 2021-06-01 Sonos, Inc. Playback device connection
US9960969B2 (en) 2004-06-05 2018-05-01 Sonos, Inc. Playback device connection
US10097423B2 (en) 2004-06-05 2018-10-09 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
US10439896B2 (en) 2004-06-05 2019-10-08 Sonos, Inc. Playback device connection
US11909588B2 (en) 2004-06-05 2024-02-20 Sonos, Inc. Wireless device connection
US9787550B2 (en) 2004-06-05 2017-10-10 Sonos, Inc. Establishing a secure wireless network with a minimum human intervention
US11894975B2 (en) 2004-06-05 2024-02-06 Sonos, Inc. Playback device connection
US10541883B2 (en) 2004-06-05 2020-01-21 Sonos, Inc. Playback device connection
US10448159B2 (en) 2006-09-12 2019-10-15 Sonos, Inc. Playback device pairing
US11082770B2 (en) 2006-09-12 2021-08-03 Sonos, Inc. Multi-channel pairing in a media system
US10469966B2 (en) 2006-09-12 2019-11-05 Sonos, Inc. Zone scene management
US11388532B2 (en) 2006-09-12 2022-07-12 Sonos, Inc. Zone scene activation
US10555082B2 (en) 2006-09-12 2020-02-04 Sonos, Inc. Playback device pairing
US11385858B2 (en) 2006-09-12 2022-07-12 Sonos, Inc. Predefined multi-channel listening environment
US9749760B2 (en) 2006-09-12 2017-08-29 Sonos, Inc. Updating zone configuration in a multi-zone media system
US9756424B2 (en) 2006-09-12 2017-09-05 Sonos, Inc. Multi-channel pairing in a media system
US9766853B2 (en) 2006-09-12 2017-09-19 Sonos, Inc. Pair volume control
US9860657B2 (en) 2006-09-12 2018-01-02 Sonos, Inc. Zone configurations maintained by playback device
US10028056B2 (en) 2006-09-12 2018-07-17 Sonos, Inc. Multi-channel pairing in a media system
US11540050B2 (en) 2006-09-12 2022-12-27 Sonos, Inc. Playback device pairing
US10136218B2 (en) 2006-09-12 2018-11-20 Sonos, Inc. Playback device pairing
US10228898B2 (en) 2006-09-12 2019-03-12 Sonos, Inc. Identification of playback device and stereo pair names
US9813827B2 (en) 2006-09-12 2017-11-07 Sonos, Inc. Zone configuration based on playback selections
US10848885B2 (en) 2006-09-12 2020-11-24 Sonos, Inc. Zone scene management
US10897679B2 (en) 2006-09-12 2021-01-19 Sonos, Inc. Zone scene management
US10966025B2 (en) 2006-09-12 2021-03-30 Sonos, Inc. Playback device pairing
US9928026B2 (en) 2006-09-12 2018-03-27 Sonos, Inc. Making and indicating a stereo pair
US10306365B2 (en) 2006-09-12 2019-05-28 Sonos, Inc. Playback device pairing
US9159308B1 (en) * 2009-02-18 2015-10-13 Spoonjack, Llc Electronic musical instruments
US8525014B1 (en) * 2009-02-18 2013-09-03 Spoonjack, Llc Electronic musical instruments
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
US11758327B2 (en) 2011-01-25 2023-09-12 Sonos, Inc. Playback device pairing
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US10720896B2 (en) 2012-04-27 2020-07-21 Sonos, Inc. Intelligently modifying the gain parameter of a playback device
US10063202B2 (en) 2012-04-27 2018-08-28 Sonos, Inc. Intelligently modifying the gain parameter of a playback device
US9729115B2 (en) 2012-04-27 2017-08-08 Sonos, Inc. Intelligently increasing the sound level of player
US9374607B2 (en) 2012-06-26 2016-06-21 Sonos, Inc. Media playback system with guest access
US9379683B2 (en) 2012-08-01 2016-06-28 Sonos, Inc. Volume interactions for connected playback devices
US10284158B2 (en) 2012-08-01 2019-05-07 Sonos, Inc. Volume interactions for connected subwoofer device
US9948258B2 (en) 2012-08-01 2018-04-17 Sonos, Inc. Volume interactions for connected subwoofer device
US9455679B2 (en) 2012-08-01 2016-09-27 Sonos, Inc. Volume interactions for connected playback devices
US10536123B2 (en) 2012-08-01 2020-01-14 Sonos, Inc. Volume interactions for connected playback devices
US10306364B2 (en) 2012-09-28 2019-05-28 Sonos, Inc. Audio processing adjustments for playback devices based on determined characteristics of audio content
CN107276551A (en) * 2013-01-21 2017-10-20 杜比实验室特许公司 Coded audio bitstream of the decoding with the metadata container in retention data space
CN107276551B (en) * 2013-01-21 2020-10-02 杜比实验室特许公司 Decoding an encoded audio bitstream having a metadata container in a reserved data space
US10672413B2 (en) 2013-01-21 2020-06-02 Dolby Laboratories Licensing Corporation Decoding of encoded audio bitstream with metadata container located in reserved data space
US9438193B2 (en) 2013-06-05 2016-09-06 Sonos, Inc. Satellite volume control
US11545948B2 (en) 2013-06-05 2023-01-03 Sonos, Inc. Playback device group volume control
US10840867B2 (en) 2013-06-05 2020-11-17 Sonos, Inc. Playback device group volume control
US10050594B2 (en) 2013-06-05 2018-08-14 Sonos, Inc. Playback device group volume control
US10447221B2 (en) 2013-06-05 2019-10-15 Sonos, Inc. Playback device group volume control
US9680433B2 (en) 2013-06-05 2017-06-13 Sonos, Inc. Satellite volume control
US10045123B2 (en) 2013-09-27 2018-08-07 Sonos, Inc. Playback device volume management
US9355555B2 (en) 2013-09-27 2016-05-31 Sonos, Inc. System and method for issuing commands in a media playback system
US10536777B2 (en) 2013-09-27 2020-01-14 Sonos, Inc. Volume management in a media playback system
US9965244B2 (en) 2013-09-27 2018-05-08 Sonos, Inc. System and method for issuing commands in a media playback system
US11172296B2 (en) 2013-09-27 2021-11-09 Sonos, Inc. Volume management in a media playback system
US11797262B2 (en) 2013-09-27 2023-10-24 Sonos, Inc. Command dial in a media playback system
US11778378B2 (en) 2013-09-27 2023-10-03 Sonos, Inc. Volume management in a media playback system
US10579328B2 (en) 2013-09-27 2020-03-03 Sonos, Inc. Command device to control a synchrony group
US9794707B2 (en) 2014-02-06 2017-10-17 Sonos, Inc. Audio output balancing
US9781513B2 (en) 2014-02-06 2017-10-03 Sonos, Inc. Audio output balancing
US11640225B2 (en) 2014-03-11 2023-05-02 Sonos, Inc. Group volume control
US10599287B2 (en) 2014-03-11 2020-03-24 Sonos, Inc. Group volume control
US11403062B2 (en) 2015-06-11 2022-08-02 Sonos, Inc. Multiple groupings in a playback system
US11481182B2 (en) 2016-10-17 2022-10-25 Sonos, Inc. Room association based on name

Also Published As

Publication number Publication date
US20100054497A1 (en) 2010-03-04

Similar Documents

Publication Publication Date Title
US8218790B2 (en) Techniques for customizing control of volume level in device playback
AU2017100490A4 (en) User interfaces for navigating and playing content
KR102059882B1 (en) Method and terminal for playing media
JP6318232B2 (en) Voice management at the tab level for user notification and control
US20170068507A1 (en) User terminal apparatus, system, and method for controlling the same
US9632685B2 (en) Method of navigating through a media program displayed on a portable electronic device in a magnified time scale
KR101110539B1 (en) Audio user interface for displayless electronic device
EP2324416B1 (en) Audio user interface
KR101536044B1 (en) Pushing a user interface to a remote device
US20170195388A1 (en) Station creation
CA2819709C (en) User interface for a remote control device
US20090077491A1 (en) Method for inputting user command using user's motion and multimedia apparatus thereof
KR101905513B1 (en) Method and apparatus for reproducing moving picture in a portable terminal
KR20110038729A (en) Dynamic control of list navigation based on list item properties
TW201140424A (en) Dynamic interpretation of user input in a portable electronic device
US20140292706A1 (en) Non-visual touch input targeting
CN107608601B (en) Video playback method, mobile terminal and computer readable storage medium
US20080155467A1 (en) Content selectable reproduction system, method thereof, and portable reproduction unit control apparatus
US9497434B2 (en) Method and apparatus for multi-playing videos
WO2023029806A1 (en) Music playing method and device
KR102037199B1 (en) Method for providing contents playing application and user device using the same
CN107852529B (en) Method and apparatus for controlling media playback using a single control
KR101414313B1 (en) Computer apparatus and method for controlling audio codec setting
TWI459331B (en) Multimedia playing system having remote control with quick hopping key and navigating method thereof
KR20160147607A (en) Apparatus for Outputting Audio, Driving Method of Apparatus for Outputting Audio, and Computer Readable Recording Medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: APPLE INC.,CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BULL, WILLIAM;WOOD, POLICARPO;HICKS, KOURTNY MINH;AND OTHERS;SIGNING DATES FROM 20080811 TO 20080826;REEL/FRAME:021449/0686

Owner name: APPLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BULL, WILLIAM;WOOD, POLICARPO;HICKS, KOURTNY MINH;AND OTHERS;SIGNING DATES FROM 20080811 TO 20080826;REEL/FRAME:021449/0686

AS Assignment

Owner name: APPLE INC.,CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE DATE OF EXECUTION FOR INVENTOR KOURTNY MINH HICKS TO AUGUST 8, 2008 PREVIOUSLY RECORDED ON REEL 021449 FRAME 0686. ASSIGNOR(S) HEREBY CONFIRMS THE EXECUTION DATE OF INVENTOR KOURTNY MINH HICKS IS AUGUST 8, 2008;ASSIGNORS:BULL, WILLIAM;WOOD, POLICARPO;HICKS, KOURTNY MINH;AND OTHERS;SIGNING DATES FROM 20080808 TO 20080826;REEL/FRAME:021485/0940

Owner name: APPLE INC., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE DATE OF EXECUTION FOR INVENTOR KOURTNY MINH HICKS TO AUGUST 8, 2008 PREVIOUSLY RECORDED ON REEL 021449 FRAME 0686. ASSIGNOR(S) HEREBY CONFIRMS THE EXECUTION DATE OF INVENTOR KOURTNY MINH HICKS IS AUGUST 8, 2008;ASSIGNORS:BULL, WILLIAM;WOOD, POLICARPO;HICKS, KOURTNY MINH;AND OTHERS;SIGNING DATES FROM 20080808 TO 20080826;REEL/FRAME:021485/0940

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12