WO1994002931A1 - Three-dimensional mouse with tactile feedback - Google Patents

Three-dimensional mouse with tactile feedback Download PDF

Info

Publication number
WO1994002931A1
WO1994002931A1 PCT/US1993/006988 US9306988W WO9402931A1 WO 1994002931 A1 WO1994002931 A1 WO 1994002931A1 US 9306988 W US9306988 W US 9306988W WO 9402931 A1 WO9402931 A1 WO 9402931A1
Authority
WO
WIPO (PCT)
Prior art keywords
mouse
processing unit
central processing
housing
user
Prior art date
Application number
PCT/US1993/006988
Other languages
French (fr)
Inventor
W. Bradford Paley
Original Assignee
Paley W Bradford
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Paley W Bradford filed Critical Paley W Bradford
Publication of WO1994002931A1 publication Critical patent/WO1994002931A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033Indexing scheme relating to G06F3/033
    • G06F2203/0333Ergonomic shaped mouse for one hand
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H9/00Details of switching devices, not covered by groups H01H1/00 - H01H7/00
    • H01H9/02Bases, casings, or covers
    • H01H9/0214Hand-held casings
    • H01H9/0235Hand-held casings specially adapted for remote control, e.g. of audio or video apparatus
    • H01H2009/0257Multisided remote control, comprising control or display elements on at least two sides, e.g. front and back surface
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H9/00Details of switching devices, not covered by groups H01H1/00 - H01H7/00
    • H01H9/02Bases, casings, or covers
    • H01H9/0214Hand-held casings
    • H01H9/0235Hand-held casings specially adapted for remote control, e.g. of audio or video apparatus

Definitions

  • the present invention relates generally to mouses adapted to interface with a central processing unit, and more particularly to such a mouse which is three-dimensional and has tactile feedback.
  • a conventional mouse is well designed to work on a flat surface. When a person's hand rests on a flat surface at desk height, the hand automatically goes pronate. The mouse fits easily into the hollow of the palm when it is in that position. If there is more than one button on the mouse, it is easy to let the mouse rest on the table and reorient the hand to use the index finger on any button. A user rarely will use different fingers for different mouse buttons.
  • "wings" have been added in one design, and another design pinches a waist into the mouse to make it easier to hold.
  • U.S. Patent No. 3,919,691 One type of tactile man-machine communication system is disclosed in U.S. Patent No. 3,919,691.
  • a movable arm or control stick generates data regarding the three- dimensional position of the arm.
  • a central processing unit develops a mathematical representation of the surface of an object and compares the surface representation of the object with the actual position of the arm.
  • the CPU generates force components to alter the mobility of the arm to enable the user to probe the contents of the three-dimensional surface of the object. For example, when the probe is indicated as touching the surface of an object presented on a display, the CPU impedes further movement of the probe, thereby providing a feel of actually "touching" the surface of the displayed object.
  • this reference does not disclose an input device freely movable in three dimensions, nor does it create vibrations or clicks in the movable arm which are transmitted to the user to indicate a closing approach to the object.
  • the present invention addresses and solves all the problems enumerated above.
  • the present invention comprises a three-dimensional mouse for interfacing with a central processing unit.
  • the mouse comprises a hand ⁇ held housing adapted to be used in free space.
  • the housing has a generally vertical orientation relative to the user.
  • Means, mounted in.the housing, are provided for locating the mouse with respect to at least one of spatial dimension and orientational dimension, which locating means includes means for transmitting the location to a central processing unit.
  • Fig. 1 is a side view of the three-dimensional mouse of the present invention, showing a user's hand in phantom;
  • Fig. 2 is a front view of the present invention, showing the full front of the face portion, as the face portion would be oriented relative to a computer monitor; and Fig. 3 is a cross sectional side view taken on line 3-3 in Fig. 2, and showing the invention in its non- use, table top resting position.
  • Mouse 10 is for interfacing with a central processing unit (not shown) .
  • Mouse 10 comprises a hand ⁇ held housing 12 (the user's hand H is shown in phantom in Fig. 1) adapted to be used in free space.
  • Housing 12 may have a face portion 14 and a grip portion 16, or it may have only a grip portion naturally conformed to the hand, depending upon the manufacturing capabilities/necessities and/or the configuration desired by the consumer.
  • Housing 12 has a generally vertical orientation relative to the user, in the user's typical and resting position with the arm held out naturally in- front of the body.
  • mouse 10 From this generally vertical position, it is easier to move mouse 10 into any desired position and/or orientation with respect to the monitor. As shown in Fig. 1 by arrow A, housing 12 will face the monitor screen or the like of the central processing unit. When in that position, as shown in Fig. 2, mouse 10 will assume its generally vertical orientation with respect to the user.
  • Mouse 10 further comprises deformable means, t movably disposed within the housing, for providing a variation of a physical property to be sensed.
  • the deformable means may comprise any suitable means, but in the preferred embodiment, this means comprises a push button, and even more preferably, comprises a thumb push button 18, an index finger push button 20, and a grip push button 22.
  • the deformation of this push button may be sensed in a variety of different ways, including, but not limited to a switching means and/or a pressure sensing means (both described further below) .
  • Mouse 10 may further comprise a switching means, disposed within housing 12, for selectively moving an electrical contact 36 between two electrical states, wherein the electrical states are able to be sensed, and/or for sensing a physical displacement caused by the user.
  • the selective switching means may comprise any suitable means, including but not limited to, a microswitch, such as the microswitch commercially available from Cherry Electrical Products, Waukegan, Illinois, under the trade designation Cherry DG1C-B3LA.
  • the switching means comprises first 40, second 42 and third 44 microswitches, the first 40 being operatively connected to the thumb push button 18, the second 42 being operatively connected to the index finger push button 20, and the third 44 being operatively connected to the grip push button 22.
  • the mouse 10 may further optionally comprise means for biasing the microswitch to an open position (each of microswitches 40, 42 and 44 are shown in the open position in Fig. 3) .
  • This biasing means may comprise any suitable means, however, in the preferred embodiment, this biasing means comprises a spring 24.
  • Mouse 10 may further comprises means, responsive to any of the various sensing and/or switching means described herein, for transmitting the sensed electrical state to the central processing unit.
  • This transmitting means may comprise any suitable means including cables, electrical conductors (suitable wires, etc.), and/or air (for transmitting radio signals and the like, laser beams, infrared signals, etc.).
  • the sensed state transmitting means comprises a cable 26 having any number of individual electrical conductors therein, the cable being attached at one end to housing 12, and at the other end to the central processing unit, or to intermediate electronics meant to interpret the state of various sensors into a form useful to a computer.
  • sensing means may be used in the present invention.
  • Various properties sensable are listed in the 1992 SENSORS Buyer's Guide published by Helmers Publishing, Inc. , Peterborough, New Hampshire. Of these contemplated by the inventor as being particularly applicable in the present invention are acceleration, force, humidity, moisture, motion, position (angular and linear) , pressure, sound, speed, strain, tactile sensors, temperature, tilt, torque, velocity, vibration, and weight.
  • sensing means can be interpreted by suitable electronics generally known in the art, which can be inside the housing 12, outside the housing 12 and the central processing unit, and/or inside the central processing unit.
  • this electronics (not shown) is located outside of both the housing 12 and the CPU.
  • This electronics can turn the change in electrical properties, resulting from whatever physical property sensed, into a digital signal for subsequent transmission to the computer.
  • the physical properties such as pressure, location, etc.
  • the various sensing means are changing an electrical property which can be sensed by appropriate control electronics, after feeding a signal into and through the sensing means.
  • Mouse 10 may further optionally comprise means, operatively connected to the push button, for sensing an amount of force applied by the user to the push button.
  • This force sensing means may comprise any suitable means. Means, responsive to the force sensing means, are further provided for transmitting the force amount information to the central processing unit, and/or to the intermediate electronics discussed above. It is to be understood that this pressure amount transmitting means may comprise any suitable means.
  • the force sensing means is a pressure sensor 34 comprising a force sensitive resistor operatively connected to the electrical contact 36 of each of the microswitches 40, 42, 44. It is to be understood that pressure sensor 34 may also be distinct from electrical contact 36, as long as it is in a position to sense any force applied to the push button. Any suitable pressure sensor may be used, including any of those commercially available from
  • Pressure sensor 34 changes resistance, corresponding to the amount of pressure applied, and the suitable electronics discussed above produces a digital signal which is sent to the central processing unit by the transmitting means, preferably, a suitable electrical conductor.
  • the range of pressures able to be sensed by the pressure sensor 34 may be any suitable range as desired by the manufacturer and/or consumer, however, in the preferred embodiment, the pressure range is between about zero psi and about 255 psi.
  • the three-dimensional mouse 10 may further comprise means, mounted in the housing, for locating the mouse 10 with respect to at least one of spatial dimension and orientational dimension, which locating means includes any suitable means for transmitting the location the computer.
  • the locating means returns three spatial dimensions, x, y, z; and three orientational dimensions, pitch, yaw, roll. Any subset of these six dimensions may be useful, depending upon the desired application of the mouse 10, for example 2 spatial, 1 orientational; 3 spatial, 2 orientational; 2 spatial, 0 orientational; etc., and the present invention is not to be read as limited to the requirement of all six dimensions.
  • this locating means may comprise any suitable means, such as by light, accelerometers, gyroscopes, etc.
  • this sensing means comprises an ultrasonic sensor or magnetic sensor 28 secured within face portion 14.
  • the magnetic sensor 28 is commercially available from Ascension Technology Corp. , Burlington, Vermont, under the trade name The Bird 6D Input Device; or from Polhemus, A Kaiser Aerospace & Electronics Company, Colchester, Vermont, under the trade name 3SPACE FASTRAK or 3SPACE ISOTRAK.
  • the ultrasonic sensor is commercially available from Logitech Inc., Fremont, California, under the trade name LOGITECH 2D/6D MOUSE.
  • Sensor 28 may be secured within face portion 14 by any suitable means, such as by any suitable adhesive or the like.
  • the housing 12 may be held together by screws 30, 32.
  • microphones 38 are utilized.: It is to be understood that the magnetic sensor 28 or the ultrasonic sensor (with associated microphones 38) may be used, either alone or in combination. If both the ultrasonic sensor and the magnetic sensor are used (or any combination of two or more different types of sensors sensing the position and/or orientation of the mouse) , the mouse 10 will get much more information, thereby allowing the computer to t give a more accurate representation of the position and/or orientation of the mouse 10.
  • Means mounted in the housing and responsive to the central processing unit, are provided for imparting tactile feedback to a user based on the position of the locating means with respect to the type and position of data on a monitor or any other suitable type of central processing unit display.
  • This tactile feedback imparting means may comprise any suitable means, however, in the preferred embodiment, this means comprises a vibrator 34 either totally contained within housing 12, or partially exposed outside of housing 12. As shown in Fig. 3, vibrator 34 is secured within grip portion 16 adjacent the user's palm P or thenar eminence.
  • the mouse 10 interfaces with a central processing unit which contains data representing the three-dimensional position of an object, whether in free space, or simulated on a display.
  • a computer compares the actual position and orientation of the mouse with the object and generates tactile feedback in the form of vibrations or clicks in the mouse which can be felt by the user, with the frequency, form or amplitude of the vibrations or clicks varying. They may, for instance, increase as the mouse 10 is moved closer to a surface or point on the object.
  • the invention 10 has application in molecular docking to correctly position and orient one molecule with respect to another.
  • the computer controls the vibrations and/or clicks on the mouse 10 as the user manipulates the mouse 10 to position one molecule with respect to another in a molecular chain to locate the best binding configuration by tactile feel.
  • the vibrations will vary depending upon the position and the type of molecule, functional group and/or radical one desires to bind to another molecule.

Abstract

A three-dimensional mouse (10) is disclosed for interfacing with a central processing unit. The mouse comprises a hand-held housing (12) adapted to be used in free space. The housing (12) has a generally vertical orientation relative to the user. A mechanism, mounted in the housing, is provided for locating the mouse with respect to at least one of spatial dimension and orientational dimension, which locating mechanism includes a mechanism for transmitting the location to a central processing unit.

Description

THREE-DIMENSIONAL MOUSE WITH TACTILE FEEDBACK BACKGROUND OF THE INVENTION The present invention relates generally to mouses adapted to interface with a central processing unit, and more particularly to such a mouse which is three-dimensional and has tactile feedback.
A conventional mouse is well designed to work on a flat surface. When a person's hand rests on a flat surface at desk height, the hand automatically goes pronate. The mouse fits easily into the hollow of the palm when it is in that position. If there is more than one button on the mouse, it is easy to let the mouse rest on the table and reorient the hand to use the index finger on any button. A user rarely will use different fingers for different mouse buttons. To adapt a mouse to work in three-dimensions, "wings" have been added in one design, and another design pinches a waist into the mouse to make it easier to hold. These incremental alterations to a flat mouse do make it possible to hold in free space. However, this horizontal orientation is inappropriate and difficult to maintain. Furthermore, it is awkward to use the index, second and third fingers to activate different buttons, as this design expects. In fact, it is virtually impossible to press the third button with the third finger and maintain a constant position and orientation. Even when it is done, this takes attention, thereby breaking the user's concentration on the real task being attempted, such as analyzing a molecular docking procedure wherein the object is to minimize the binding energy of two molecules by correctly positioning and orienting one molecule with respect to another.
In addition to the physical configuration drawbacks of available devices, none of them have any type of tactile feedback, which could enhance positioning ability by providing energy level readings via vibrations in a docking task, or clicking when an object is penetrated in other tasks for which the mouse could be used.
One type of tactile man-machine communication system is disclosed in U.S. Patent No. 3,919,691. In this system, a movable arm or control stick generates data regarding the three- dimensional position of the arm. A central processing unit develops a mathematical representation of the surface of an object and compares the surface representation of the object with the actual position of the arm. The CPU generates force components to alter the mobility of the arm to enable the user to probe the contents of the three-dimensional surface of the object. For example, when the probe is indicated as touching the surface of an object presented on a display, the CPU impedes further movement of the probe, thereby providing a feel of actually "touching" the surface of the displayed object. However, this reference does not disclose an input device freely movable in three dimensions, nor does it create vibrations or clicks in the movable arm which are transmitted to the user to indicate a closing approach to the object.
Thus, it is an object of the present invention to provide an ergonomic, hand contoured, comfortable to use, three-dimensional mouse. It is a further object of the present invention to provide such a mouse specifically for use in space, having a generally vertical orientation with respect to the user, following the natural position of the hand when suspended in front of a person's body. It is a further object of the present invention to provide tactile feedback in the three-dimensional mouse in order to enhance its usefulness in various applications. Still further, it is an object of the present invention to provide pressure sensors in the three-dimensional mouse to yet further enhance its usefulness as an input device. SUMMARY OF THE INVENTION The present invention addresses and solves all the problems enumerated above. The present invention comprises a three-dimensional mouse for interfacing with a central processing unit. The mouse comprises a hand¬ held housing adapted to be used in free space. The housing has a generally vertical orientation relative to the user. Means, mounted in.the housing, are provided for locating the mouse with respect to at least one of spatial dimension and orientational dimension, which locating means includes means for transmitting the location to a central processing unit.
BRIEF DESCRIPTION OF THE DRAWINGS Other objects, features and advantages of the present invention will become apparent by reference to the following detailed description and drawings, in which:
Fig. 1 is a side view of the three-dimensional mouse of the present invention, showing a user's hand in phantom;
Fig. 2 is a front view of the present invention, showing the full front of the face portion, as the face portion would be oriented relative to a computer monitor; and Fig. 3 is a cross sectional side view taken on line 3-3 in Fig. 2, and showing the invention in its non- use, table top resting position.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Referring now to Fig. 1, the three-dimensional mouse of the present invention is designated generally as 10. Mouse 10 is for interfacing with a central processing unit (not shown) . Mouse 10 comprises a hand¬ held housing 12 (the user's hand H is shown in phantom in Fig. 1) adapted to be used in free space. Housing 12 may have a face portion 14 and a grip portion 16, or it may have only a grip portion naturally conformed to the hand, depending upon the manufacturing capabilities/necessities and/or the configuration desired by the consumer. Housing 12 has a generally vertical orientation relative to the user, in the user's typical and resting position with the arm held out naturally in- front of the body. From this generally vertical position, it is easier to move mouse 10 into any desired position and/or orientation with respect to the monitor. As shown in Fig. 1 by arrow A, housing 12 will face the monitor screen or the like of the central processing unit. When in that position, as shown in Fig. 2, mouse 10 will assume its generally vertical orientation with respect to the user.
Mouse 10 further comprises deformable means, t movably disposed within the housing, for providing a variation of a physical property to be sensed. The deformable means may comprise any suitable means, but in the preferred embodiment, this means comprises a push button, and even more preferably, comprises a thumb push button 18, an index finger push button 20, and a grip push button 22. The deformation of this push button may be sensed in a variety of different ways, including, but not limited to a switching means and/or a pressure sensing means (both described further below) .
Mouse 10 may further comprise a switching means, disposed within housing 12, for selectively moving an electrical contact 36 between two electrical states, wherein the electrical states are able to be sensed, and/or for sensing a physical displacement caused by the user. It is to be understood that the selective switching means may comprise any suitable means, including but not limited to, a microswitch, such as the microswitch commercially available from Cherry Electrical Products, Waukegan, Illinois, under the trade designation Cherry DG1C-B3LA. In the preferred embodiment, the switching means comprises first 40, second 42 and third 44 microswitches, the first 40 being operatively connected to the thumb push button 18, the second 42 being operatively connected to the index finger push button 20, and the third 44 being operatively connected to the grip push button 22. The mouse 10 may further optionally comprise means for biasing the microswitch to an open position (each of microswitches 40, 42 and 44 are shown in the open position in Fig. 3) . This biasing means may comprise any suitable means, however, in the preferred embodiment, this biasing means comprises a spring 24. Mouse 10 may further comprises means, responsive to any of the various sensing and/or switching means described herein, for transmitting the sensed electrical state to the central processing unit. This transmitting means may comprise any suitable means including cables, electrical conductors (suitable wires, etc.), and/or air (for transmitting radio signals and the like, laser beams, infrared signals, etc.). In the preferred embodiment, the sensed state transmitting means comprises a cable 26 having any number of individual electrical conductors therein, the cable being attached at one end to housing 12, and at the other end to the central processing unit, or to intermediate electronics meant to interpret the state of various sensors into a form useful to a computer. It is to be understood that many varied types of sensing means may be used in the present invention. Various properties sensable are listed in the 1992 SENSORS Buyer's Guide published by Helmers Publishing, Inc. , Peterborough, New Hampshire. Of these contemplated by the inventor as being particularly applicable in the present invention are acceleration, force, humidity, moisture, motion, position (angular and linear) , pressure, sound, speed, strain, tactile sensors, temperature, tilt, torque, velocity, vibration, and weight. Generally, all of the sensing means discussed herein need to be interpreted by suitable electronics generally known in the art, which can be inside the housing 12, outside the housing 12 and the central processing unit, and/or inside the central processing unit. In the preferred embodiment, this electronics (not shown) is located outside of both the housing 12 and the CPU. This electronics can turn the change in electrical properties, resulting from whatever physical property sensed, into a digital signal for subsequent transmission to the computer. For example, the physical properties, such as pressure, location, etc., may be turned by a transducer into an electrical signal. The electrical signal may then be measured and turned into a digital signal. Also suitable are transducers which emit a signal, as opposed to transducers which translate signals. In the preferred embodiment, the various sensing means are changing an electrical property which can be sensed by appropriate control electronics, after feeding a signal into and through the sensing means.
Mouse 10 may further optionally comprise means, operatively connected to the push button, for sensing an amount of force applied by the user to the push button.
This force sensing means may comprise any suitable means. Means, responsive to the force sensing means, are further provided for transmitting the force amount information to the central processing unit, and/or to the intermediate electronics discussed above. It is to be understood that this pressure amount transmitting means may comprise any suitable means. In the preferred embodiment, the force sensing means is a pressure sensor 34 comprising a force sensitive resistor operatively connected to the electrical contact 36 of each of the microswitches 40, 42, 44. It is to be understood that pressure sensor 34 may also be distinct from electrical contact 36, as long as it is in a position to sense any force applied to the push button. Any suitable pressure sensor may be used, including any of those commercially available from
Interlink Electronics, Carpinteria, California, under the trade name FORCE SENSING RESISTORS, Model numbers 300B through 306C. Preferably, Model Number 301B is used. Pressure sensor 34 changes resistance, corresponding to the amount of pressure applied, and the suitable electronics discussed above produces a digital signal which is sent to the central processing unit by the transmitting means, preferably, a suitable electrical conductor. The range of pressures able to be sensed by the pressure sensor 34 may be any suitable range as desired by the manufacturer and/or consumer, however, in the preferred embodiment, the pressure range is between about zero psi and about 255 psi.
The three-dimensional mouse 10 may further comprise means, mounted in the housing, for locating the mouse 10 with respect to at least one of spatial dimension and orientational dimension, which locating means includes any suitable means for transmitting the location the computer. The locating means returns three spatial dimensions, x, y, z; and three orientational dimensions, pitch, yaw, roll. Any subset of these six dimensions may be useful, depending upon the desired application of the mouse 10, for example 2 spatial, 1 orientational; 3 spatial, 2 orientational; 2 spatial, 0 orientational; etc., and the present invention is not to be read as limited to the requirement of all six dimensions. It is to be understood that this locating means may comprise any suitable means, such as by light, accelerometers, gyroscopes, etc. However, in the preferred embodiment, this sensing means comprises an ultrasonic sensor or magnetic sensor 28 secured within face portion 14. Any suitable sensors may by used, however, in the preferred embodiment, the magnetic sensor 28 is commercially available from Ascension Technology Corp. , Burlington, Vermont, under the trade name The Bird 6D Input Device; or from Polhemus, A Kaiser Aerospace & Electronics Company, Colchester, Vermont, under the trade name 3SPACE FASTRAK or 3SPACE ISOTRAK. The ultrasonic sensor is commercially available from Logitech Inc., Fremont, California, under the trade name LOGITECH 2D/6D MOUSE. Sensor 28 may be secured within face portion 14 by any suitable means, such as by any suitable adhesive or the like. The housing 12 may be held together by screws 30, 32. If the ultrasonic sensor is used, microphones 38 are utilized.: It is to be understood that the magnetic sensor 28 or the ultrasonic sensor (with associated microphones 38) may be used, either alone or in combination. If both the ultrasonic sensor and the magnetic sensor are used (or any combination of two or more different types of sensors sensing the position and/or orientation of the mouse) , the mouse 10 will get much more information, thereby allowing the computer to tgive a more accurate representation of the position and/or orientation of the mouse 10.
Means, mounted in the housing and responsive to the central processing unit, are provided for imparting tactile feedback to a user based on the position of the locating means with respect to the type and position of data on a monitor or any other suitable type of central processing unit display. This tactile feedback imparting means may comprise any suitable means, however, in the preferred embodiment, this means comprises a vibrator 34 either totally contained within housing 12, or partially exposed outside of housing 12. As shown in Fig. 3, vibrator 34 is secured within grip portion 16 adjacent the user's palm P or thenar eminence.
The mouse 10 interfaces with a central processing unit which contains data representing the three-dimensional position of an object, whether in free space, or simulated on a display. A computer compares the actual position and orientation of the mouse with the object and generates tactile feedback in the form of vibrations or clicks in the mouse which can be felt by the user, with the frequency, form or amplitude of the vibrations or clicks varying. They may, for instance, increase as the mouse 10 is moved closer to a surface or point on the object. Among many applications, the invention 10 has application in molecular docking to correctly position and orient one molecule with respect to another. In this application, the computer controls the vibrations and/or clicks on the mouse 10 as the user manipulates the mouse 10 to position one molecule with respect to another in a molecular chain to locate the best binding configuration by tactile feel. For example, the vibrations will vary depending upon the position and the type of molecule, functional group and/or radical one desires to bind to another molecule.
While preferred embodiments of the invention have been described in detail, it will be apparent to those skilled in the art that the disclosed embodiments may be modified and that, as a general purpose display of information to the user, the invention's applications are not limited to those mentioned above. Therefore, the foregoing description is to be considered exemplary rather than limiting, and the true scope of the invention is that defined in the following claims.

Claims

What is claimed is:
1. A three-dimensional mouse for interfacing with a central processing unit, the mouse comprising: a hand-held housing adapted to be used in free space, having a face portion disposed distally from a user's hand, the housing having a generally vertical orientation relative to the user; and means, mounted in the housing face portion in a position providing communication with the central processing unit, such communication being substantially unobstructed by the user's hand, for locating the mouse with respect to at least one of spatial dimension and orientational dimension, which locating means includes means for transmitting the location to a central processing unit.
2. The three-dimensional mouse as defined in claim 1, further comprising deformable means, movably disposed within the housing, for providing a variation of a physical property to be sensed.
3. The three-dimensional mouse as defined in claim 2 wherein the deformable means comprises a push button.
4. The three-dimensional mouse as defined in claim 3 wherein the push button is a thumb push button, and further comprising an index finger push button and a grip push button.
5. The three-dimensional mouse as defined in claim 3, further comprising: a microswitch, operatively connected to the push button, for sensing a physical displacement caused by the user; and means, responsive to the microswitch, for transmitting the physical displacement information to a central processing unit.
6. The three-dimensional mouse as defined in claim 3, further comprising: means, operatively connected to the push button, for sensing an amount of force applied by the user; and means, responsive to the force sensing means, for transmitting the force amount information to at least one of intermediate interpreting electronics and a central processing unit.
7. The three-dimensional mouse as defined in claim 6 wherein the amount of force able to be sensed by the force sensing means ranges between about 0 psi and about 255 psi.
8. The three-dimensional mouse as defined in claim 1, further comprising: means, mounted in the housing and responsive to a central processing unit, for imparting tactile feedback to a user based on the position of the locating means with respect to the type and position of data on a central processing unit display.
9. The three-dimensional mouse as defined in claim 1 wherein the locating means is a magnetic sensor.
10. The three-dimensional mouse as defined in claim 1 wherein the locating means is an ultrasonic sensor.
11. The three-dimensional mouse as defined in claim 1 wherein the locating means is a magnetic sensor and an ultrasonic sensor.
12. The three-dimensional mouse as defined in claim 8 wherein the tactile feedback imparting means is a vibrator secured within the housing.
13. The three-dimensional mouse as defined in claim 1, further comprising: —-
13* means, operatively connected to the deformable means, for sensing an amount.of force applied by the user; and means, responsive to the force sensing means, for transmitting the force amount information to at least one of intermediate interpreting electronics and a central processing unit.
14. The three-dimensional mouse as defined in claim 13 wherein the force sensing means is a pressure sensor comprising a force sensitive resistor.
15. A three-dimensional mouse for interfacing with a central processing unit, the mouse comprising: a hand-held housing adapted to be used in free space, having a face portion disposed distally from a user's hand, the housing having a generally vertical orientation relative to the user; deformable means, movably dispos -ed within the housing, for providing a variation of a physical property to be sensed, wherein the deformable means comprises a thumb push button, an index finger push button and a grip push button; a pressure sensor comprising a force sensitive resistor, operatively connected to each of the push buttons, for sensing an amount of force applied; means, responsive to the pressure sensor, for transmitting the force amount information to at least one of intermediate interpreting electronics and the central processing unit; at least one of an ultrasonic sensor and a magnetic sensor secured within the housing face portion in a position providing communication with the central processing unit, such communication being substantially unobstructed by the user's hand, for locating the mouse with respect to at least one of spatial dimension and orientational dimension, which locating means includes means for transmitting the location to a central processing unit; and a vibrator secured within the housing and responsive to the central processing unit, for imparting tactile feedback to a user based on the position of the locating sensor with respect to the type and position of t data on a central processing unit display.
16. The three-dimensional mouse as defined in claim 15 wherein the amount of force able to be sensed by the pressure sensor ranges between about 0 psi and about 255 psi.
PCT/US1993/006988 1992-07-27 1993-07-26 Three-dimensional mouse with tactile feedback WO1994002931A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US07/919,931 US5296871A (en) 1992-07-27 1992-07-27 Three-dimensional mouse with tactile feedback

Publications (1)

Publication Number Publication Date
WO1994002931A1 true WO1994002931A1 (en) 1994-02-03

Family

ID=25442888

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1993/006988 WO1994002931A1 (en) 1992-07-27 1993-07-26 Three-dimensional mouse with tactile feedback

Country Status (2)

Country Link
US (2) US5296871A (en)
WO (1) WO1994002931A1 (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996002878A1 (en) * 1994-07-15 1996-02-01 Virtuality (Ip) Limited Haptic computer input device
EP0718789A2 (en) * 1994-12-19 1996-06-26 AT&T Corp. Interactive pointing device
FR2736745A1 (en) * 1995-09-29 1997-01-17 France Telecom Remote control unit for interactive system
EP0940764A1 (en) * 1998-03-04 1999-09-08 Tai-Her Yang Computer mouse
EP1351119A1 (en) * 2001-01-10 2003-10-08 Sony Corporation Information processing terminal
EP1757344A1 (en) 2005-08-22 2007-02-28 Nintendo Co., Limited Game operating device
EP1764141A1 (en) * 2005-09-14 2007-03-21 Nintendo Co., Limited Video game program and video game system
EP1972363A3 (en) * 2005-08-22 2008-10-08 Nintendo Co., Limited Game operating device
US8096880B2 (en) 2006-08-15 2012-01-17 Nintendo Co., Ltd. Systems and methods for reducing jitter associated with a control device
US8834271B2 (en) 2005-08-24 2014-09-16 Nintendo Co., Ltd. Game controller and game system
US8870655B2 (en) 2005-08-24 2014-10-28 Nintendo Co., Ltd. Wireless game controllers
US8888576B2 (en) 1999-02-26 2014-11-18 Mq Gaming, Llc Multi-media interactive play system
US8907889B2 (en) 2005-01-12 2014-12-09 Thinkoptics, Inc. Handheld vision based absolute pointing system
US8913011B2 (en) 2001-02-22 2014-12-16 Creative Kingdoms, Llc Wireless entertainment device, system, and method
US8913003B2 (en) 2006-07-17 2014-12-16 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer using a projection marker system
US8961260B2 (en) 2000-10-20 2015-02-24 Mq Gaming, Llc Toy incorporating RFID tracking device
US9039533B2 (en) 2003-03-25 2015-05-26 Creative Kingdoms, Llc Wireless interactive game having both physical and virtual elements
US9149717B2 (en) 2000-02-22 2015-10-06 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9176598B2 (en) 2007-05-08 2015-11-03 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer with improved performance
USRE45905E1 (en) 2005-09-15 2016-03-01 Nintendo Co., Ltd. Video game system with wireless modular handheld controller
US9272206B2 (en) 2002-04-05 2016-03-01 Mq Gaming, Llc System and method for playing an interactive game
US9446319B2 (en) 2003-03-25 2016-09-20 Mq Gaming, Llc Interactive gaming toy
US9616334B2 (en) 2002-04-05 2017-04-11 Mq Gaming, Llc Multi-platform gaming system using RFID-tagged toys

Families Citing this family (348)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6259438B1 (en) 1998-06-04 2001-07-10 Wacom Co., Ltd. Coordinate input stylus
US5631861A (en) 1990-02-02 1997-05-20 Virtual Technologies, Inc. Force feedback and texture simulating interface device
US5889670A (en) * 1991-10-24 1999-03-30 Immersion Corporation Method and apparatus for tactilely responsive user interface
USRE40891E1 (en) * 1991-11-26 2009-09-01 Sandio Technology Corp. Methods and apparatus for providing touch-sensitive input in multiple degrees of freedom
US6597347B1 (en) 1991-11-26 2003-07-22 Itu Research Inc. Methods and apparatus for providing touch-sensitive input in multiple degrees of freedom
US6222525B1 (en) * 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5610631A (en) * 1992-07-09 1997-03-11 Thrustmaster, Inc. Reconfigurable joystick controller recalibration
US5551701A (en) * 1992-08-19 1996-09-03 Thrustmaster, Inc. Reconfigurable video game controller with graphical reconfiguration display
US5453758A (en) * 1992-07-31 1995-09-26 Sony Corporation Input apparatus
US5790108A (en) 1992-10-23 1998-08-04 University Of British Columbia Controller
US6131097A (en) * 1992-12-02 2000-10-10 Immersion Corporation Haptic authoring
US5629594A (en) 1992-12-02 1997-05-13 Cybernet Systems Corporation Force feedback system
AU6083594A (en) * 1993-01-07 1994-08-15 Thrustmaster, Inc. Reconfigurable joystick controller with multi-stage trigger
US5590062A (en) * 1993-07-02 1996-12-31 Matsushita Electric Industrial Co., Ltd. Simulator for producing various living environments mainly for visual perception
US5805140A (en) 1993-07-16 1998-09-08 Immersion Corporation High bandwidth force feedback interface using voice coils and flexures
US5734373A (en) * 1993-07-16 1998-03-31 Immersion Human Interface Corporation Method and apparatus for controlling force feedback interface systems utilizing a host computer
US5739811A (en) 1993-07-16 1998-04-14 Immersion Human Interface Corporation Method and apparatus for controlling human-computer interface systems providing force feedback
US6437771B1 (en) * 1995-01-18 2002-08-20 Immersion Corporation Force feedback device including flexure member between actuator and user object
JP3381344B2 (en) * 1993-11-15 2003-02-24 ヤマハ株式会社 Coordinate input device
JPH07302157A (en) * 1994-04-28 1995-11-14 Nintendo Co Ltd Operation device
US5576733A (en) * 1994-05-25 1996-11-19 Lo; Jack Ergonomic computer mouse
US20030040361A1 (en) * 1994-09-21 2003-02-27 Craig Thorner Method and apparatus for generating tactile feedback via relatively low-burden and/or zero burden telemetry
JPH0895539A (en) * 1994-09-28 1996-04-12 Nec Corp Presentation supporting device
US5751275A (en) * 1994-11-14 1998-05-12 Bullister; Edward T. Two-- and three--dimensional trackball with coordinate transformations
US5706031A (en) * 1994-11-14 1998-01-06 Lucent Technologies Inc. Computing and telecommunications interface system
US5659335A (en) * 1994-11-14 1997-08-19 Lucent Technologies Inc. Computing interface system
US5854623A (en) * 1994-11-14 1998-12-29 Bullister; Edward T. Two- and three-dimensional trackball with enhanced measurement optics
US5666138A (en) 1994-11-22 1997-09-09 Culver; Craig F. Interface control
US5796386A (en) * 1995-01-23 1998-08-18 International Business Machines Corporation Precise calibration procedure for sensor-based view point control system
US5894303A (en) * 1995-03-14 1999-04-13 Barr; Ann E. Computer mouse and shell therefore
US6069614A (en) * 1995-05-04 2000-05-30 Singhal; Tara C Man machine interface via display peripheral
US5691898A (en) * 1995-09-27 1997-11-25 Immersion Human Interface Corp. Safe and low cost computer peripherals with force feedback for consumer applications
US6166723A (en) * 1995-11-17 2000-12-26 Immersion Corporation Mouse interface device providing force feedback
US5668574A (en) * 1995-06-26 1997-09-16 Chung-Chin Chen Palm-top wireless trackball
US5724106A (en) * 1995-07-17 1998-03-03 Gateway 2000, Inc. Hand held remote control device with trigger button
US6359636B1 (en) 1995-07-17 2002-03-19 Gateway, Inc. Graphical user interface for control of a home entertainment system
US6005553A (en) * 1995-08-09 1999-12-21 Midas Mouse International Pty. Ltd. Ergonomic computer mouse
US5670988A (en) * 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
EP0852732A1 (en) * 1995-09-21 1998-07-15 Omniplanar, Inc. Method and apparatus for determining position and orientation
US5959613A (en) 1995-12-01 1999-09-28 Immersion Corporation Method and apparatus for shaping force signals for a force feedback device
US5754023A (en) 1995-10-26 1998-05-19 Cybernet Systems Corporation Gyro-stabilized platforms for force-feedback applications
US6081261A (en) * 1995-11-01 2000-06-27 Ricoh Corporation Manual entry interactive paper and electronic document handling and processing system
US6704001B1 (en) * 1995-11-17 2004-03-09 Immersion Corporation Force feedback device including actuator with moving magnet
US6100874A (en) 1995-11-17 2000-08-08 Immersion Corporation Force feedback mouse interface
US5825308A (en) 1996-11-26 1998-10-20 Immersion Human Interface Corporation Force feedback interface having isotonic and isometric functionality
US6639581B1 (en) 1995-11-17 2003-10-28 Immersion Corporation Flexure mechanism for interface device
US6061004A (en) * 1995-11-26 2000-05-09 Immersion Corporation Providing force feedback using an interface device including an indexing function
AU1328597A (en) 1995-11-30 1997-06-19 Virtual Technologies, Inc. Tactile feedback man-machine interface device
US6219032B1 (en) * 1995-12-01 2001-04-17 Immersion Corporation Method for providing force feedback to a user of an interface device based on interactions of a controlled cursor with graphical elements in a graphical user interface
US8508469B1 (en) 1995-12-01 2013-08-13 Immersion Corporation Networked applications including haptic feedback
US6028593A (en) * 1995-12-01 2000-02-22 Immersion Corporation Method and apparatus for providing simulated physical interactions within computer generated environments
US6161126A (en) 1995-12-13 2000-12-12 Immersion Corporation Implementing force feedback over the World Wide Web and other computer networks
US6300936B1 (en) 1997-11-14 2001-10-09 Immersion Corporation Force feedback system including multi-tasking graphical host environment and interface device
US6078308A (en) * 1995-12-13 2000-06-20 Immersion Corporation Graphical click surfaces for force feedback applications to provide user selection using cursor interaction with a trigger position within a boundary of a graphical object
GB2308641A (en) 1995-12-28 1997-07-02 Thomson Multimedia Sa Manually-operated data input device eg for computers or video games
US5692956A (en) * 1996-02-09 1997-12-02 Mattel, Inc. Combination computer mouse and game play control
US5914705A (en) * 1996-02-09 1999-06-22 Lucent Technologies Inc. Apparatus and method for providing detent-like tactile feedback
SE519661C2 (en) * 1996-02-23 2003-03-25 Immersion Corp Pointing devices and method for marking graphic details on a display with sensory feedback upon finding said detail
KR100501145B1 (en) * 1996-03-05 2005-07-18 가부시키가이샤 세가 Manipulation controller and electronic device using the same
US5999166A (en) * 1996-04-09 1999-12-07 Rangan; Karur S. Apparatus and method for optically modulating electronic signals and computer data
US5923318A (en) * 1996-04-12 1999-07-13 Zhai; Shumin Finger manipulatable 6 degree-of-freedom input device
US6374255B1 (en) * 1996-05-21 2002-04-16 Immersion Corporation Haptic authoring
US8674932B2 (en) * 1996-07-05 2014-03-18 Anascape, Ltd. Image controller
US20040160414A1 (en) * 1996-07-05 2004-08-19 Armstrong Brad A. Image controller
US5832139A (en) * 1996-07-31 1998-11-03 Omniplanar, Inc. Method and apparatus for determining degrees of freedom of a camera
US5990869A (en) * 1996-08-20 1999-11-23 Alliance Technologies Corp. Force feedback mouse
US5898424A (en) * 1996-09-30 1999-04-27 Gateway 2000, Inc. Pointing device with differing actuation forces for primary and secondary buttons
FR2754923B1 (en) * 1996-10-18 1999-01-08 Innova Son CONTROL CONSOLE
US5999167A (en) * 1996-11-08 1999-12-07 Stephen A. Marsh Cursor control device
US6411276B1 (en) 1996-11-13 2002-06-25 Immersion Corporation Hybrid control of haptic feedback for host computer and interface device
US5949401A (en) 1996-11-21 1999-09-07 Kazarian; Randal N. Two-handed input apparatus and method
US6636197B1 (en) 1996-11-26 2003-10-21 Immersion Corporation Haptic feedback effects for control, knobs and other interface devices
US6956558B1 (en) 1998-03-26 2005-10-18 Immersion Corporation Rotary force feedback wheels for remote control devices
US6686911B1 (en) * 1996-11-26 2004-02-03 Immersion Corporation Control knob with control modes and force feedback
US6128006A (en) * 1998-03-26 2000-10-03 Immersion Corporation Force feedback mouse wheel and other control wheels
US7489309B2 (en) * 1996-11-26 2009-02-10 Immersion Corporation Control knob with multiple degrees of freedom and force feedback
US6154201A (en) * 1996-11-26 2000-11-28 Immersion Corporation Control knob with multiple degrees of freedom and force feedback
JP4001411B2 (en) * 1996-12-19 2007-10-31 富士通コンポーネント株式会社 Manual input device
JP3638071B2 (en) 1997-01-31 2005-04-13 矢崎総業株式会社 System switch
US5796354A (en) * 1997-02-07 1998-08-18 Reality Quest Corp. Hand-attachable controller with direction sensing
US5764164A (en) * 1997-02-07 1998-06-09 Reality Quest Corp. Ergonomic hand-attachable controller
JPH10240433A (en) * 1997-02-25 1998-09-11 Alps Electric Co Ltd Input device
US5875257A (en) * 1997-03-07 1999-02-23 Massachusetts Institute Of Technology Apparatus for controlling continuous behavior through hand and arm gestures
US6208349B1 (en) 1997-04-14 2001-03-27 Sandia Corporation Multidimensional display controller for displaying to a user an aspect of a multidimensional space visible from a base viewing location along a desired viewing orientation
US6954899B1 (en) 1997-04-14 2005-10-11 Novint Technologies, Inc. Human-computer interface including haptically controlled interactions
US6020876A (en) 1997-04-14 2000-02-01 Immersion Corporation Force feedback interface with selective disturbance filter
US20060053371A1 (en) * 1997-04-14 2006-03-09 Anderson Thomas G Navigation and viewing in a multidimensional space
US6026376A (en) * 1997-04-15 2000-02-15 Kenney; John A. Interactive electronic shopping system and method
AU7161598A (en) 1997-04-21 1998-11-13 Virtual Technologies, Inc. Goniometer-based body-tracking device and method
US5989099A (en) * 1997-05-30 1999-11-23 Arnold, Iii; Perry C. Tactile device
USD408394S (en) * 1997-06-17 1999-04-20 Thrustmaster, Inc. Two-handed controller for video games and simulations
US6188392B1 (en) 1997-06-30 2001-02-13 Intel Corporation Electronic pen device
US6252579B1 (en) 1997-08-23 2001-06-26 Immersion Corporation Interface device and method for providing enhanced cursor control with force feedback
US6292174B1 (en) * 1997-08-23 2001-09-18 Immersion Corporation Enhanced cursor control using limited-workspace force feedback devices
US6243075B1 (en) * 1997-08-29 2001-06-05 Xerox Corporation Graspable device manipulation for controlling a computer display
US6201903B1 (en) 1997-09-30 2001-03-13 Ricoh Company, Ltd. Method and apparatus for pen-based faxing
US6281651B1 (en) 1997-11-03 2001-08-28 Immersion Corporation Haptic pointing devices
US6181322B1 (en) 1997-11-07 2001-01-30 Netscape Communications Corp. Pointing device having selection buttons operable from movement of a palm portion of a person's hands
US6211861B1 (en) * 1998-06-23 2001-04-03 Immersion Corporation Tactile mouse device
US6252583B1 (en) 1997-11-14 2001-06-26 Immersion Corporation Memory and force output management for a force feedback system
US6448977B1 (en) 1997-11-14 2002-09-10 Immersion Corporation Textures and other spatial sensations for a relative haptic interface device
US6243078B1 (en) 1998-06-23 2001-06-05 Immersion Corporation Pointing device with forced feedback button
US6088019A (en) * 1998-06-23 2000-07-11 Immersion Corporation Low cost force feedback device with actuator for non-primary axis
JP4011165B2 (en) * 1997-11-21 2007-11-21 泰和 楊 Mouse with handle
US6256011B1 (en) * 1997-12-03 2001-07-03 Immersion Corporation Multi-function control device with force feedback
US6181329B1 (en) 1997-12-23 2001-01-30 Ricoh Company, Ltd. Method and apparatus for tracking a hand-held writing instrument with multiple sensors that are calibrated by placing the writing instrument in predetermined positions with respect to the writing surface
US6878066B2 (en) * 1998-02-13 2005-04-12 Freedom Wave Llc Wireless game control units
US6219034B1 (en) 1998-02-23 2001-04-17 Kristofer E. Elbing Tactile computer interface
US20080055241A1 (en) * 1998-03-26 2008-03-06 Immersion Corporation Systems and Methods for Haptic Feedback Effects for Control Knobs
US6067077A (en) * 1998-04-10 2000-05-23 Immersion Corporation Position sensing for force feedback devices
US6300938B1 (en) 1998-04-13 2001-10-09 Immersion Corporation Multiple-cylinder control device for computers and other electronic apparatus
US6154196A (en) * 1998-06-08 2000-11-28 Wacom Co., Ltd. Coordinate input device convertible between right-handed and left-handed modes
US6160539A (en) 1998-06-08 2000-12-12 Wacom Co., Ltd. Digitizer system with cursor shape changing as a function of pointer location on menu strip
US6697043B1 (en) 1999-12-21 2004-02-24 Immersion Corporation Haptic interface device and actuator assembly providing linear haptic sensations
US6717573B1 (en) 1998-06-23 2004-04-06 Immersion Corporation Low-cost haptic mouse implementations
US6429846B2 (en) * 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6184868B1 (en) * 1998-09-17 2001-02-06 Immersion Corp. Haptic feedback control devices
US6707443B2 (en) 1998-06-23 2004-03-16 Immersion Corporation Haptic trackball device
DE19838140C1 (en) * 1998-08-21 2000-04-20 Tomtec Imaging Syst Gmbh Method and device for taking ultrasound images
DE19845566A1 (en) * 1998-09-04 2000-03-09 Volkswagen Ag Navigation interface for movement in virtual worlds including unit for control of the movement in six directions of freedom and interface is designed as cordless hand unit e.g. for presentation
US7038667B1 (en) 1998-10-26 2006-05-02 Immersion Corporation Mechanisms for control knobs and other interface devices
US6452586B1 (en) 1998-11-30 2002-09-17 Microsoft Corporation Computer input device providing tactile feedback
US6262715B1 (en) 1999-02-05 2001-07-17 Lucent Technologies, Inc. Ergonomic computer mouse
US20060061550A1 (en) * 1999-02-12 2006-03-23 Sina Fateh Display size emulation system
US20060061551A1 (en) * 1999-02-12 2006-03-23 Vega Vista, Inc. Motion detection and tracking system to control navigation and display of portable displays including on-chip gesture detection
US20060279542A1 (en) * 1999-02-12 2006-12-14 Vega Vista, Inc. Cellular phones and mobile devices with motion driven control
US6664946B1 (en) * 1999-02-22 2003-12-16 Microsoft Corporation Dual axis articulated computer input device and method of operation
US6664947B1 (en) * 1999-02-24 2003-12-16 Gueorgui K. Vinogradov Safe and handy pointing device
FR2790578A1 (en) * 1999-03-02 2000-09-08 Philippe Soulie Sign language for communicating with another person or electronic calculator has series of main keys on side not facing user and reading keys transmitting tactile sensations to fingers of user
US6424356B2 (en) 1999-05-05 2002-07-23 Immersion Corporation Command of force sensations in a forceback system using force effect suites
US6822638B2 (en) 1999-05-10 2004-11-23 International Business Machines Corporation Pointing device for navigating a 3 dimensional GUI interface
US8169402B2 (en) * 1999-07-01 2012-05-01 Immersion Corporation Vibrotactile haptic feedback devices
DE20022244U1 (en) * 1999-07-01 2001-11-08 Immersion Corp Control of vibrotactile sensations for haptic feedback devices
AU6059400A (en) * 1999-07-01 2001-01-22 Immersion Corporation Controlling vibrotactile sensations for haptic feedback devices
US7561142B2 (en) 1999-07-01 2009-07-14 Immersion Corporation Vibrotactile haptic feedback devices
US6693622B1 (en) 1999-07-01 2004-02-17 Immersion Corporation Vibrotactile haptic feedback devices
US6545667B1 (en) * 1999-08-23 2003-04-08 David M. Lilenfield Apparatus for a convenient and comfortable cursor control device
US6377245B1 (en) 1999-09-02 2002-04-23 Chin K. Park Ultimate ergonomic mouse
DE20080209U1 (en) * 1999-09-28 2001-08-09 Immersion Corp Control of haptic sensations for interface devices with vibrotactile feedback
JP3847058B2 (en) 1999-10-04 2006-11-15 任天堂株式会社 GAME SYSTEM AND GAME INFORMATION STORAGE MEDIUM USED FOR THE SAME
US6466198B1 (en) * 1999-11-05 2002-10-15 Innoventions, Inc. View navigation and magnification of a hand-held device with a display
DE19958443C2 (en) * 1999-12-03 2002-04-25 Siemens Ag operating device
US6693626B1 (en) 1999-12-07 2004-02-17 Immersion Corporation Haptic feedback using a keyboard device
USD430161S (en) * 2000-01-19 2000-08-29 Alexander Hovsepian Hand supported and controlled mouse
US6822635B2 (en) * 2000-01-19 2004-11-23 Immersion Corporation Haptic interface for laptop computers and other portable devices
US20010024192A1 (en) * 2000-01-31 2001-09-27 Lewis Stephen H. Ergonomic mouse and method of using the same
US6724400B1 (en) 2000-05-06 2004-04-20 Novint Technologies, Inc. Human-computer interface incorporating personal and application domains
US6833826B1 (en) 2000-05-06 2004-12-21 Novint Technologies, Inc. Human-computer interface
US6445284B1 (en) 2000-05-10 2002-09-03 Juan Manuel Cruz-Hernandez Electro-mechanical transducer suitable for tactile display and article conveyance
US6906697B2 (en) 2000-08-11 2005-06-14 Immersion Corporation Haptic sensations for tactile feedback interface devices
AU2001294852A1 (en) * 2000-09-28 2002-04-08 Immersion Corporation Directional tactile feedback for haptic feedback interface devices
US7182691B1 (en) 2000-09-28 2007-02-27 Immersion Corporation Directional inertial tactile feedback using rotating masses
US7084854B1 (en) * 2000-09-28 2006-08-01 Immersion Corporation Actuator for providing tactile sensations and device for directional tactile sensations
US6995744B1 (en) 2000-09-28 2006-02-07 Immersion Corporation Device and assembly for providing linear tactile sensations
US6727924B1 (en) 2000-10-17 2004-04-27 Novint Technologies, Inc. Human-computer interface including efficient three-dimensional controls
US20020109673A1 (en) * 2001-01-04 2002-08-15 Thierry Valet Method and apparatus employing angled single accelerometer sensing multi-directional motion
US9625905B2 (en) * 2001-03-30 2017-04-18 Immersion Corporation Haptic remote control for toys
US7202851B2 (en) * 2001-05-04 2007-04-10 Immersion Medical Inc. Haptic interface for palpation simulation
IL143255A (en) 2001-05-20 2015-09-24 Simbionix Ltd Endoscopic ultrasonography simulation
SE523636C2 (en) * 2001-07-22 2004-05-04 Tomer Shalit Ab Portable computerized handheld device and procedure for handling an object displayed on a screen
USRE47457E1 (en) * 2001-08-07 2019-06-25 Facebook, Inc. Control of display content by movement on a fixed spherical space
US7365734B2 (en) * 2002-08-06 2008-04-29 Rembrandt Ip Management, Llc Control of display content by movement on a fixed spherical space
US6847351B2 (en) * 2001-08-13 2005-01-25 Siemens Information And Communication Mobile, Llc Tilt-based pointing for hand-held devices
DE10146473A1 (en) * 2001-09-21 2003-04-17 3Dconnexion Gmbh Combined position / force torque sensor
US7225115B2 (en) * 2001-10-04 2007-05-29 Novint Technologies, Inc. Coordinating haptics with visual images in a human-computer interface
US6816151B2 (en) 2001-11-09 2004-11-09 Terry L. Dellinger Hand-held trackball computer pointing device
CN1450698A (en) * 2002-01-30 2003-10-22 杨泰和 Electric controller capable of being bidirectionally obliquely placed and hand-held
JP4589007B2 (en) 2002-04-12 2010-12-01 ヘンリー ケイ. オバーマイヤー, Multi-axis joystick and transducer means therefor
US7369115B2 (en) * 2002-04-25 2008-05-06 Immersion Corporation Haptic devices having multiple operational modes including at least one resonant mode
US7161580B2 (en) * 2002-04-25 2007-01-09 Immersion Corporation Haptic feedback using rotary harmonic moving mass
US7081883B2 (en) * 2002-05-14 2006-07-25 Michael Changcheng Chen Low-profile multi-channel input device
US6748604B2 (en) * 2002-05-30 2004-06-15 Finger Fitting Products, Inc. Glove massager
US7952570B2 (en) * 2002-06-08 2011-05-31 Power2B, Inc. Computer navigation
US7161579B2 (en) * 2002-07-18 2007-01-09 Sony Computer Entertainment Inc. Hand-held computer interactive device
US8797260B2 (en) * 2002-07-27 2014-08-05 Sony Computer Entertainment Inc. Inertially trackable hand-held controller
US8947347B2 (en) * 2003-08-27 2015-02-03 Sony Computer Entertainment Inc. Controlling actions in a video game unit
US8686939B2 (en) * 2002-07-27 2014-04-01 Sony Computer Entertainment Inc. System, method, and apparatus for three-dimensional input control
US8313380B2 (en) * 2002-07-27 2012-11-20 Sony Computer Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US8570378B2 (en) 2002-07-27 2013-10-29 Sony Computer Entertainment Inc. Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
US9393487B2 (en) 2002-07-27 2016-07-19 Sony Interactive Entertainment Inc. Method for mapping movements of a hand-held controller to game commands
US7803050B2 (en) * 2002-07-27 2010-09-28 Sony Computer Entertainment Inc. Tracking device with sound emitter for use in obtaining information for controlling game program execution
US8233642B2 (en) * 2003-08-27 2012-07-31 Sony Computer Entertainment Inc. Methods and apparatuses for capturing an audio signal based on a location of the signal
US8160269B2 (en) * 2003-08-27 2012-04-17 Sony Computer Entertainment Inc. Methods and apparatuses for adjusting a listening area for capturing sounds
US7918733B2 (en) * 2002-07-27 2011-04-05 Sony Computer Entertainment America Inc. Multi-input game control mixer
US10086282B2 (en) * 2002-07-27 2018-10-02 Sony Interactive Entertainment Inc. Tracking device for use in obtaining information for controlling game program execution
US9174119B2 (en) 2002-07-27 2015-11-03 Sony Computer Entertainement America, LLC Controller for providing inputs to control execution of a program when inputs are combined
US8139793B2 (en) * 2003-08-27 2012-03-20 Sony Computer Entertainment Inc. Methods and apparatus for capturing audio signals based on a visual image
US7850526B2 (en) * 2002-07-27 2010-12-14 Sony Computer Entertainment America Inc. System for tracking user manipulations within an environment
US7854655B2 (en) * 2002-07-27 2010-12-21 Sony Computer Entertainment America Inc. Obtaining input for controlling execution of a game program
US7674184B2 (en) 2002-08-01 2010-03-09 Creative Kingdoms, Llc Interactive water attraction and quest game
US7006074B2 (en) 2002-09-05 2006-02-28 Thomas Peter Chesters Multimodal pointer method
US8059088B2 (en) * 2002-12-08 2011-11-15 Immersion Corporation Methods and systems for providing haptic messaging to handheld communication devices
US8830161B2 (en) 2002-12-08 2014-09-09 Immersion Corporation Methods and systems for providing a virtual touch haptic effect to handheld communication devices
GB2413416B8 (en) * 2002-12-08 2006-09-07 Immersion Corp Haptic massaging in handheld communication devices
US20040155865A1 (en) * 2002-12-16 2004-08-12 Swiader Michael C Ergonomic data input and cursor control device
US7850456B2 (en) 2003-07-15 2010-12-14 Simbionix Ltd. Surgical simulation device, system and method
US20070223732A1 (en) * 2003-08-27 2007-09-27 Mao Xiao D Methods and apparatuses for adjusting a visual image based on an audio signal
US20050076161A1 (en) * 2003-10-03 2005-04-07 Amro Albanna Input system and method
US7489299B2 (en) * 2003-10-23 2009-02-10 Hillcrest Laboratories, Inc. User interface devices and methods employing accelerometers
SE0303370D0 (en) * 2003-12-16 2003-12-16 Anoto Ab Method, apparatus, computer program and storage medium for recording a movement of a user unit
US7283120B2 (en) 2004-01-16 2007-10-16 Immersion Corporation Method and apparatus for providing haptic feedback having a position-based component and a predetermined time-based component
US7301526B2 (en) * 2004-03-23 2007-11-27 Fujitsu Limited Dynamic adaptation of gestures for motion controlled handheld devices
US7180500B2 (en) * 2004-03-23 2007-02-20 Fujitsu Limited User definable gestures for motion controlled handheld devices
US7180502B2 (en) * 2004-03-23 2007-02-20 Fujitsu Limited Handheld device with preferred motion selection
US7301529B2 (en) * 2004-03-23 2007-11-27 Fujitsu Limited Context dependent gesture response
US7176886B2 (en) * 2004-03-23 2007-02-13 Fujitsu Limited Spatial signatures
US7301527B2 (en) * 2004-03-23 2007-11-27 Fujitsu Limited Feedback based user interface for motion controlled handheld devices
US7176887B2 (en) * 2004-03-23 2007-02-13 Fujitsu Limited Environmental modeling for motion controlled handheld devices
US7301528B2 (en) * 2004-03-23 2007-11-27 Fujitsu Limited Distinguishing tilt and translation motion components in handheld devices
US20050212760A1 (en) * 2004-03-23 2005-09-29 Marvit David L Gesture based user interface supporting preexisting symbols
US7180501B2 (en) * 2004-03-23 2007-02-20 Fujitsu Limited Gesture based navigation of a handheld user interface
US7173604B2 (en) * 2004-03-23 2007-02-06 Fujitsu Limited Gesture identification of controlled devices
US7365736B2 (en) * 2004-03-23 2008-04-29 Fujitsu Limited Customizable gesture mappings for motion controlled handheld devices
US7903084B2 (en) * 2004-03-23 2011-03-08 Fujitsu Limited Selective engagement of motion input modes
US7365735B2 (en) * 2004-03-23 2008-04-29 Fujitsu Limited Translation controlled cursor
US7365737B2 (en) * 2004-03-23 2008-04-29 Fujitsu Limited Non-uniform gesture precision
US20050212753A1 (en) * 2004-03-23 2005-09-29 Marvit David L Motion controlled remote controller
US7280096B2 (en) * 2004-03-23 2007-10-09 Fujitsu Limited Motion sensor engagement for a handheld device
US7176888B2 (en) * 2004-03-23 2007-02-13 Fujitsu Limited Selective engagement of motion detection
GB2424269A (en) * 2004-04-01 2006-09-20 Robert Michael Lipman Control apparatus
JP2007535773A (en) 2004-04-30 2007-12-06 ヒルクレスト・ラボラトリーズ・インコーポレイテッド Free space pointing device and pointing method
WO2005109847A2 (en) * 2004-04-30 2005-11-17 Hillcrest Laboratories, Inc. Methods and devices for identifying users based on tremor
WO2005109215A2 (en) * 2004-04-30 2005-11-17 Hillcrest Laboratories, Inc. Methods and devices for removing unintentional movement in free space pointing devices
US8629836B2 (en) 2004-04-30 2014-01-14 Hillcrest Laboratories, Inc. 3D pointing devices with orientation compensation and improved usability
DE202005022038U1 (en) * 2004-04-30 2012-07-12 Hillcrest Laboratories, Inc. Free space pointing devices with slope compensation and improved usability
US7746321B2 (en) 2004-05-28 2010-06-29 Erik Jan Banning Easily deployable interactive direct-pointing system and presentation control system and calibration method therefor
FR2871276B1 (en) * 2004-06-04 2009-02-06 France Telecom SYSTEM AND METHOD FOR ASSISTING LEARNING OF GEOMETRY
CA2578653A1 (en) 2004-07-29 2006-02-09 Kevin Ferguson A human movement measurement system
US20060024647A1 (en) * 2004-07-30 2006-02-02 France Telecom Method and apparatus for communicating graphical information to a visually impaired person using haptic feedback
US20060028428A1 (en) * 2004-08-05 2006-02-09 Xunhu Dai Handheld device having localized force feedback
US20060066570A1 (en) * 2004-09-27 2006-03-30 Trifilo Timothy M Pointing device and method
US9900669B2 (en) 2004-11-02 2018-02-20 Pierre Touma Wireless motion sensor system and method
US9317108B2 (en) 2004-11-02 2016-04-19 Pierre A. Touma Hand-held wireless electronic device with accelerometer for interacting with a display
US7683883B2 (en) * 2004-11-02 2010-03-23 Pierre Touma 3D mouse and game controller based on spherical coordinates system and system for use
US8137195B2 (en) 2004-11-23 2012-03-20 Hillcrest Laboratories, Inc. Semantic gaming and application transformation
US20060229058A1 (en) * 2005-10-29 2006-10-12 Outland Research Real-time person-to-person communication using geospatial addressing
US7489979B2 (en) * 2005-01-27 2009-02-10 Outland Research, Llc System, method and computer program product for rejecting or deferring the playing of a media file retrieved by an automated process
US20060161621A1 (en) * 2005-01-15 2006-07-20 Outland Research, Llc System, method and computer program product for collaboration and synchronization of media content on a plurality of media players
US20060195361A1 (en) * 2005-10-01 2006-08-31 Outland Research Location-based demographic profiling system and method of use
US20070189544A1 (en) 2005-01-15 2007-08-16 Outland Research, Llc Ambient sound responsive media player
US7542816B2 (en) * 2005-01-27 2009-06-02 Outland Research, Llc System, method and computer program product for automatically selecting, suggesting and playing music media files
US7562117B2 (en) * 2005-09-09 2009-07-14 Outland Research, Llc System, method and computer program product for collaborative broadcast media
US20070276870A1 (en) * 2005-01-27 2007-11-29 Outland Research, Llc Method and apparatus for intelligent media selection using age and/or gender
US20060173828A1 (en) * 2005-02-01 2006-08-03 Outland Research, Llc Methods and apparatus for using personal background data to improve the organization of documents retrieved in response to a search query
US20060173556A1 (en) * 2005-02-01 2006-08-03 Outland Research,. Llc Methods and apparatus for using user gender and/or age group to improve the organization of documents retrieved in response to a search query
US20060179056A1 (en) * 2005-10-12 2006-08-10 Outland Research Enhanced storage and retrieval of spatially associated information
US20060179044A1 (en) * 2005-02-04 2006-08-10 Outland Research, Llc Methods and apparatus for using life-context of a user to improve the organization of documents retrieved in response to a search query from that user
US20060253210A1 (en) * 2005-03-26 2006-11-09 Outland Research, Llc Intelligent Pace-Setting Portable Media Player
US20060223637A1 (en) * 2005-03-31 2006-10-05 Outland Research, Llc Video game system combining gaming simulation with remote robot control and remote robot feedback
US20060223635A1 (en) * 2005-04-04 2006-10-05 Outland Research method and apparatus for an on-screen/off-screen first person gaming experience
US20060256008A1 (en) * 2005-05-13 2006-11-16 Outland Research, Llc Pointing interface for person-to-person information exchange
US20060241864A1 (en) * 2005-04-22 2006-10-26 Outland Research, Llc Method and apparatus for point-and-send data transfer within an ubiquitous computing environment
US7821494B2 (en) * 2005-05-13 2010-10-26 Industrial Technology Research Institute Inertial mouse
KR100739980B1 (en) * 2005-05-13 2007-07-16 인더스트리얼 테크놀로지 리서치 인스티튜트 Inertial sensing input apparatus
US20060259574A1 (en) * 2005-05-13 2006-11-16 Outland Research, Llc Method and apparatus for accessing spatially associated information
US20060256007A1 (en) * 2005-05-13 2006-11-16 Outland Research, Llc Triangulation method and apparatus for targeting and accessing spatially associated information
US9569093B2 (en) 2005-05-18 2017-02-14 Power2B, Inc. Displays and information input devices
US10452207B2 (en) 2005-05-18 2019-10-22 Power2B, Inc. Displays and information input devices
US8610675B2 (en) * 2007-03-14 2013-12-17 Power2B, Inc. Interactive devices
WO2008111040A2 (en) 2007-03-14 2008-09-18 Power2B, Inc. Displays and information input devices
US9317170B2 (en) 2005-05-18 2016-04-19 Power2B, Inc. Interactive devices
US20070150188A1 (en) * 2005-05-27 2007-06-28 Outland Research, Llc First-person video-based travel planning system
US20060271286A1 (en) * 2005-05-27 2006-11-30 Outland Research, Llc Image-enhanced vehicle navigation systems and methods
US20060186197A1 (en) * 2005-06-16 2006-08-24 Outland Research Method and apparatus for wireless customer interaction with the attendants working in a restaurant
US20080032719A1 (en) * 2005-10-01 2008-02-07 Outland Research, Llc Centralized establishment-based tracking and messaging service
CN101213774B (en) * 2005-07-01 2012-01-04 希尔克瑞斯特实验室公司 3D positioning devices
US9285897B2 (en) 2005-07-13 2016-03-15 Ultimate Pointer, L.L.C. Easily deployable interactive direct-pointing system and calibration method therefor
US7519537B2 (en) 2005-07-19 2009-04-14 Outland Research, Llc Method and apparatus for a verbo-manual gesture interface
KR100914119B1 (en) * 2005-08-22 2009-08-27 닌텐도가부시키가이샤 Game operating device, game operating system and game system
US8313379B2 (en) * 2005-08-22 2012-11-20 Nintendo Co., Ltd. Video game system with wireless modular handheld controller
US8308563B2 (en) * 2005-08-30 2012-11-13 Nintendo Co., Ltd. Game system and storage medium having game program stored thereon
EP1938306B1 (en) 2005-09-08 2013-07-31 Power2B, Inc. Displays and information input devices
EP1932138A2 (en) * 2005-09-09 2008-06-18 CARAIAN, George Mobile pointing device
US7647175B2 (en) * 2005-09-09 2010-01-12 Rembrandt Technologies, Lp Discrete inertial display navigation
US20070057911A1 (en) * 2005-09-12 2007-03-15 Sina Fateh System and method for wireless network content conversion for intuitively controlled portable displays
US8157651B2 (en) 2005-09-12 2012-04-17 Nintendo Co., Ltd. Information processing program
US7917148B2 (en) * 2005-09-23 2011-03-29 Outland Research, Llc Social musical media rating system and method for localized establishments
US8176101B2 (en) 2006-02-07 2012-05-08 Google Inc. Collaborative rejection of media for physical establishments
US7577522B2 (en) * 2005-12-05 2009-08-18 Outland Research, Llc Spatially associated personal reminder system and method
US7586032B2 (en) * 2005-10-07 2009-09-08 Outland Research, Llc Shake responsive portable media player
US20070083323A1 (en) * 2005-10-07 2007-04-12 Outland Research Personal cuing for spatially associated information
US20070113207A1 (en) * 2005-11-16 2007-05-17 Hillcrest Laboratories, Inc. Methods and systems for gesture classification in 3D pointing devices
TWI316195B (en) * 2005-12-01 2009-10-21 Ind Tech Res Inst Input means for interactive devices
US20060227047A1 (en) * 2005-12-13 2006-10-12 Outland Research Meeting locator system and method of using the same
US20070145680A1 (en) * 2005-12-15 2007-06-28 Outland Research, Llc Shake Responsive Portable Computing Device for Simulating a Randomization Object Used In a Game Of Chance
US20070075127A1 (en) * 2005-12-21 2007-04-05 Outland Research, Llc Orientation-based power conservation for portable media devices
EP1821180A1 (en) * 2005-12-31 2007-08-22 Ball-IT Oy User operable pointing device such as mouse
JP4151982B2 (en) * 2006-03-10 2008-09-17 任天堂株式会社 Motion discrimination device and motion discrimination program
JP4684147B2 (en) * 2006-03-28 2011-05-18 任天堂株式会社 Inclination calculation device, inclination calculation program, game device, and game program
EP3287874A1 (en) * 2006-04-06 2018-02-28 Immersion Corporation Systems and methods for enhanced haptic effects
US20070265075A1 (en) * 2006-05-10 2007-11-15 Sony Computer Entertainment America Inc. Attachable structure for use with hand-held controller having tracking ability
JP4989105B2 (en) * 2006-05-09 2012-08-01 任天堂株式会社 Game controller
DE102006024872A1 (en) * 2006-05-24 2007-11-29 Bauhaus Universität Weimar Portable computer input device with tactile feedback
JP5294442B2 (en) * 2006-09-13 2013-09-18 任天堂株式会社 GAME DEVICE AND GAME PROGRAM
USRE48417E1 (en) 2006-09-28 2021-02-02 Sony Interactive Entertainment Inc. Object direction using video input combined with tilt angle information
US8310656B2 (en) * 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
US8781151B2 (en) 2006-09-28 2014-07-15 Sony Computer Entertainment Inc. Object detection using video input combined with tilt angle information
KR101533465B1 (en) * 2006-12-27 2015-07-02 임머숀 코퍼레이션 Virtual detents through vibrotactile feedback
US8543338B2 (en) 2007-01-16 2013-09-24 Simbionix Ltd. System and method for performing computerized simulations for image-guided procedures using a patient specific model
WO2008087629A2 (en) * 2007-01-16 2008-07-24 Simbionix Ltd. Preoperative surgical simulation
JP5127242B2 (en) 2007-01-19 2013-01-23 任天堂株式会社 Acceleration data processing program and game program
US20080227545A1 (en) * 2007-03-14 2008-09-18 Nam Chin Cho Apparatus and method for digitization of human motion for virtual gaming
US8167813B2 (en) * 2007-05-17 2012-05-01 Immersion Medical, Inc. Systems and methods for locating a blood vessel
US7860676B2 (en) 2007-06-28 2010-12-28 Hillcrest Laboratories, Inc. Real-time dynamic tracking of bias
US20090062943A1 (en) * 2007-08-27 2009-03-05 Sony Computer Entertainment Inc. Methods and apparatus for automatically controlling the sound level based on the content
TWI400635B (en) * 2007-09-19 2013-07-01 Kye Systems Corp Cursor Displacement Speed ​​Control Method for Aerial Mouse
WO2009051665A1 (en) * 2007-10-16 2009-04-23 Hillcrest Laboratories, Inc. Fast and smooth scrolling of user interfaces operating on thin clients
US9857872B2 (en) * 2007-12-31 2018-01-02 Apple Inc. Multi-touch display screen with localized tactile feedback
JP5224832B2 (en) * 2008-01-21 2013-07-03 任天堂株式会社 Information processing program and information processing apparatus
US8156809B2 (en) * 2008-03-27 2012-04-17 Immersion Corporation Systems and methods for resonance detection
WO2009145854A1 (en) * 2008-04-15 2009-12-03 Hillcrest Laboratories, Inc. Tracking determination based on intensity angular gradient of a wave
US20100013613A1 (en) * 2008-07-08 2010-01-21 Jonathan Samuel Weston Haptic feedback projection system
US20100031808A1 (en) * 2008-08-05 2010-02-11 Honeywell International Inc. Method, apparatus, and system of providing sensor-based tactile feedback
US8089225B2 (en) 2008-10-29 2012-01-03 Honeywell International Inc. Systems and methods for inertially controlling a hovering unmanned aerial vehicles
US20100225474A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100228493A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method including direction generation based on collection of subject advisory information
US20100225490A1 (en) * 2009-03-05 2010-09-09 Leuthardt Eric C Postural information system and method including central determining of subject advisory information based on subject status information and postural influencer status information
US20100228495A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method including determining subject advisory information based on prior determined subject advisory information
US20100228494A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method including determining subject advisory information based on prior determined subject advisory information
US20100225473A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US9024976B2 (en) * 2009-03-05 2015-05-05 The Invention Science Fund I, Llc Postural information system and method
US20100228490A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100228158A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method including device level determining of subject advisory information based on subject status information and postural influencer status information
US20100228153A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100228154A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method including determining response to subject advisory information
US20100228487A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100228159A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100271200A1 (en) * 2009-03-05 2010-10-28 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method including determining response to subject advisory information
US20100228488A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100225491A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Postural information system and method
US20100228492A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Of State Of Delaware Postural information system and method including direction generation based on collection of subject advisory information
US20100225498A1 (en) * 2009-03-05 2010-09-09 Searete Llc, A Limited Liability Corporation Postural information system and method
US7864517B2 (en) * 2009-03-30 2011-01-04 Microsoft Corporation Mobile computer device binding feedback
JP5522349B2 (en) * 2009-04-14 2014-06-18 任天堂株式会社 INPUT SYSTEM, INFORMATION PROCESSING SYSTEM, PERIPHERAL DEVICE CONTROL METHOD, AND OPERATION DEVICE CONTROL PROGRAM
WO2011061511A1 (en) * 2009-11-20 2011-05-26 Cambridge Consultants Limited Controller device for a computer
US8542105B2 (en) 2009-11-24 2013-09-24 Immersion Corporation Handheld computer interface with haptic feedback
US9310887B2 (en) 2010-05-06 2016-04-12 James W. Wieder Handheld and wearable remote-controllers
US9092073B1 (en) * 2010-05-11 2015-07-28 Contour Design, Inc. Adjustable pointing device
US9586115B1 (en) * 2011-08-18 2017-03-07 Kid Group, Llc 3D game
US9582178B2 (en) 2011-11-07 2017-02-28 Immersion Corporation Systems and methods for multi-pressure interaction on touch-sensitive surfaces
US9245428B2 (en) 2012-08-02 2016-01-26 Immersion Corporation Systems and methods for haptic remote control gaming
US9547366B2 (en) 2013-03-14 2017-01-17 Immersion Corporation Systems and methods for haptic and gesture-driven paper simulation
USD710362S1 (en) * 2013-06-19 2014-08-05 Motorola Solutions, Inc. Barcode scanning device
USD748735S1 (en) * 2014-05-16 2016-02-02 Joshua Provitt Compact game controller
USD734743S1 (en) * 2014-05-16 2015-07-21 Hillcrest Laboratories, Inc. Remote control device
US9785256B2 (en) * 2015-02-16 2017-10-10 Ming Xia Ergonomic computer mouse with handheld and ambidextrous body design
US10010788B2 (en) * 2015-12-21 2018-07-03 Sony Interactive Entertainment Inc. Game controller with lights visible inside and outside the game controller
US20180224956A1 (en) 2017-02-08 2018-08-09 All Now Corp Device for controlling a pointer

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4313113A (en) * 1980-03-24 1982-01-26 Xerox Corporation Cursor control
US4501424A (en) * 1983-06-17 1985-02-26 Cbs Inc. Manual controller for video system
US4509383A (en) * 1982-12-01 1985-04-09 Championship Electronics (Usa) Inc. Joystick controller
US4578674A (en) * 1983-04-20 1986-03-25 International Business Machines Corporation Method and apparatus for wireless cursor position control
US4739128A (en) * 1986-11-10 1988-04-19 American Telephone And Telegraph Company, At&T Bell Laboratories Thumb-controlled, hand-held joystick
US4839838A (en) * 1987-03-30 1989-06-13 Labiche Mitchell Spatial input apparatus
US4868549A (en) * 1987-05-18 1989-09-19 International Business Machines Corporation Feedback mouse
US4905001A (en) * 1987-10-08 1990-02-27 Penner Henry C Hand-held finger movement actuated communication devices and systems employing such devices
US4988981A (en) * 1987-03-17 1991-01-29 Vpl Research, Inc. Computer data entry and manipulation apparatus and method
US5006836A (en) * 1988-06-14 1991-04-09 Wang Laboratories, Inc. Squeezable computer control device
US5027115A (en) * 1989-09-04 1991-06-25 Matsushita Electric Industrial Co., Ltd. Pen-type computer input device
US5095303A (en) * 1990-03-27 1992-03-10 Apple Computer, Inc. Six degree of freedom graphic object controller

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3919691A (en) * 1971-05-26 1975-11-11 Bell Telephone Labor Inc Tactile man-machine communication system
US4489316A (en) * 1980-10-23 1984-12-18 Macquivey Donald R Method and apparatus for minority view reduction
US4560983A (en) * 1982-09-17 1985-12-24 Ampex Corporation Dynamically interactive responsive control device and system
JPS60179821A (en) * 1984-02-27 1985-09-13 Canon Inc Input device
US4795296A (en) * 1986-11-17 1989-01-03 California Institute Of Technology Hand-held robot end effector controller having movement and force control
US5038142A (en) * 1989-03-14 1991-08-06 International Business Machines Corporation Touch sensing display screen apparatus
JP2535626B2 (en) * 1989-10-27 1996-09-18 キヤノン株式会社 Coordinate input device
GB2244546A (en) * 1990-05-10 1991-12-04 Primax Electronics Ltd Computer input device
US5175534A (en) * 1990-05-30 1992-12-29 Thatcher Eric A Computer input device using the movements of a user's fingers
JPH04218824A (en) * 1990-12-19 1992-08-10 Yaskawa Electric Corp Multidimensional information input device

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4313113A (en) * 1980-03-24 1982-01-26 Xerox Corporation Cursor control
US4509383A (en) * 1982-12-01 1985-04-09 Championship Electronics (Usa) Inc. Joystick controller
US4578674A (en) * 1983-04-20 1986-03-25 International Business Machines Corporation Method and apparatus for wireless cursor position control
US4501424A (en) * 1983-06-17 1985-02-26 Cbs Inc. Manual controller for video system
US4739128A (en) * 1986-11-10 1988-04-19 American Telephone And Telegraph Company, At&T Bell Laboratories Thumb-controlled, hand-held joystick
US4988981A (en) * 1987-03-17 1991-01-29 Vpl Research, Inc. Computer data entry and manipulation apparatus and method
US4988981B1 (en) * 1987-03-17 1999-05-18 Vpl Newco Inc Computer data entry and manipulation apparatus and method
US4839838A (en) * 1987-03-30 1989-06-13 Labiche Mitchell Spatial input apparatus
US4868549A (en) * 1987-05-18 1989-09-19 International Business Machines Corporation Feedback mouse
US4905001A (en) * 1987-10-08 1990-02-27 Penner Henry C Hand-held finger movement actuated communication devices and systems employing such devices
US5006836A (en) * 1988-06-14 1991-04-09 Wang Laboratories, Inc. Squeezable computer control device
US5027115A (en) * 1989-09-04 1991-06-25 Matsushita Electric Industrial Co., Ltd. Pen-type computer input device
US5095303A (en) * 1990-03-27 1992-03-10 Apple Computer, Inc. Six degree of freedom graphic object controller

Cited By (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996002878A1 (en) * 1994-07-15 1996-02-01 Virtuality (Ip) Limited Haptic computer input device
EP0718789A2 (en) * 1994-12-19 1996-06-26 AT&T Corp. Interactive pointing device
EP0718789A3 (en) * 1994-12-19 1997-08-27 At & T Corp Interactive pointing device
FR2736745A1 (en) * 1995-09-29 1997-01-17 France Telecom Remote control unit for interactive system
EP0940764A1 (en) * 1998-03-04 1999-09-08 Tai-Her Yang Computer mouse
US10300374B2 (en) 1999-02-26 2019-05-28 Mq Gaming, Llc Multi-platform gaming systems and methods
US9186585B2 (en) 1999-02-26 2015-11-17 Mq Gaming, Llc Multi-platform gaming systems and methods
US9468854B2 (en) 1999-02-26 2016-10-18 Mq Gaming, Llc Multi-platform gaming systems and methods
US9731194B2 (en) 1999-02-26 2017-08-15 Mq Gaming, Llc Multi-platform gaming systems and methods
US9861887B1 (en) 1999-02-26 2018-01-09 Mq Gaming, Llc Multi-platform gaming systems and methods
US8888576B2 (en) 1999-02-26 2014-11-18 Mq Gaming, Llc Multi-media interactive play system
US9149717B2 (en) 2000-02-22 2015-10-06 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9814973B2 (en) 2000-02-22 2017-11-14 Mq Gaming, Llc Interactive entertainment system
US10307671B2 (en) 2000-02-22 2019-06-04 Mq Gaming, Llc Interactive entertainment system
US10188953B2 (en) 2000-02-22 2019-01-29 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9474962B2 (en) 2000-02-22 2016-10-25 Mq Gaming, Llc Interactive entertainment system
US9579568B2 (en) 2000-02-22 2017-02-28 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US8915785B2 (en) 2000-02-22 2014-12-23 Creative Kingdoms, Llc Interactive entertainment system
US9713766B2 (en) 2000-02-22 2017-07-25 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9480929B2 (en) 2000-10-20 2016-11-01 Mq Gaming, Llc Toy incorporating RFID tag
US9320976B2 (en) 2000-10-20 2016-04-26 Mq Gaming, Llc Wireless toy systems and methods for interactive entertainment
US10307683B2 (en) 2000-10-20 2019-06-04 Mq Gaming, Llc Toy incorporating RFID tag
US9931578B2 (en) 2000-10-20 2018-04-03 Mq Gaming, Llc Toy incorporating RFID tag
US8961260B2 (en) 2000-10-20 2015-02-24 Mq Gaming, Llc Toy incorporating RFID tracking device
EP1351119A4 (en) * 2001-01-10 2009-04-15 Sony Corp Information processing terminal
EP1351119A1 (en) * 2001-01-10 2003-10-08 Sony Corporation Information processing terminal
US8913011B2 (en) 2001-02-22 2014-12-16 Creative Kingdoms, Llc Wireless entertainment device, system, and method
US10758818B2 (en) 2001-02-22 2020-09-01 Mq Gaming, Llc Wireless entertainment device, system, and method
US10179283B2 (en) 2001-02-22 2019-01-15 Mq Gaming, Llc Wireless entertainment device, system, and method
US9162148B2 (en) 2001-02-22 2015-10-20 Mq Gaming, Llc Wireless entertainment device, system, and method
US9393491B2 (en) 2001-02-22 2016-07-19 Mq Gaming, Llc Wireless entertainment device, system, and method
US9737797B2 (en) 2001-02-22 2017-08-22 Mq Gaming, Llc Wireless entertainment device, system, and method
US9616334B2 (en) 2002-04-05 2017-04-11 Mq Gaming, Llc Multi-platform gaming system using RFID-tagged toys
US9272206B2 (en) 2002-04-05 2016-03-01 Mq Gaming, Llc System and method for playing an interactive game
US10478719B2 (en) 2002-04-05 2019-11-19 Mq Gaming, Llc Methods and systems for providing personalized interactive entertainment
US10507387B2 (en) 2002-04-05 2019-12-17 Mq Gaming, Llc System and method for playing an interactive game
US10010790B2 (en) 2002-04-05 2018-07-03 Mq Gaming, Llc System and method for playing an interactive game
US11278796B2 (en) 2002-04-05 2022-03-22 Mq Gaming, Llc Methods and systems for providing personalized interactive entertainment
US9463380B2 (en) 2002-04-05 2016-10-11 Mq Gaming, Llc System and method for playing an interactive game
US9993724B2 (en) 2003-03-25 2018-06-12 Mq Gaming, Llc Interactive gaming toy
US10369463B2 (en) 2003-03-25 2019-08-06 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US9393500B2 (en) 2003-03-25 2016-07-19 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US11052309B2 (en) 2003-03-25 2021-07-06 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US10583357B2 (en) 2003-03-25 2020-03-10 Mq Gaming, Llc Interactive gaming toy
US9446319B2 (en) 2003-03-25 2016-09-20 Mq Gaming, Llc Interactive gaming toy
US10022624B2 (en) 2003-03-25 2018-07-17 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US8961312B2 (en) 2003-03-25 2015-02-24 Creative Kingdoms, Llc Motion-sensitive controller and associated gaming applications
US9770652B2 (en) 2003-03-25 2017-09-26 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US9707478B2 (en) 2003-03-25 2017-07-18 Mq Gaming, Llc Motion-sensitive controller and associated gaming applications
US9039533B2 (en) 2003-03-25 2015-05-26 Creative Kingdoms, Llc Wireless interactive game having both physical and virtual elements
US9675878B2 (en) 2004-09-29 2017-06-13 Mq Gaming, Llc System and method for playing a virtual game by sensing physical movements
US8907889B2 (en) 2005-01-12 2014-12-09 Thinkoptics, Inc. Handheld vision based absolute pointing system
EP1972363B2 (en) 2005-08-22 2019-08-21 Nintendo Co., Ltd. Game operating device
US9498728B2 (en) 2005-08-22 2016-11-22 Nintendo Co., Ltd. Game operating device
EP2263765A1 (en) * 2005-08-22 2010-12-22 Nintendo Co., Ltd. Game operating device
EP1757344A1 (en) 2005-08-22 2007-02-28 Nintendo Co., Limited Game operating device
US10661183B2 (en) 2005-08-22 2020-05-26 Nintendo Co., Ltd. Game operating device
US9011248B2 (en) 2005-08-22 2015-04-21 Nintendo Co., Ltd. Game operating device
EP1972363A3 (en) * 2005-08-22 2008-10-08 Nintendo Co., Limited Game operating device
EP2058036A1 (en) 2005-08-22 2009-05-13 Nintendo Co., Limited Game operating device
US10155170B2 (en) 2005-08-22 2018-12-18 Nintendo Co., Ltd. Game operating device with holding portion detachably holding an electronic device
EP1985343A3 (en) * 2005-08-22 2009-04-22 Nintendo Co., Limited Game operating device
US9700806B2 (en) 2005-08-22 2017-07-11 Nintendo Co., Ltd. Game operating device
US10238978B2 (en) 2005-08-22 2019-03-26 Nintendo Co., Ltd. Game operating device
US8870655B2 (en) 2005-08-24 2014-10-28 Nintendo Co., Ltd. Wireless game controllers
US10137365B2 (en) 2005-08-24 2018-11-27 Nintendo Co., Ltd. Game controller and game system
US9044671B2 (en) 2005-08-24 2015-06-02 Nintendo Co., Ltd. Game controller and game system
US8834271B2 (en) 2005-08-24 2014-09-16 Nintendo Co., Ltd. Game controller and game system
US9227138B2 (en) 2005-08-24 2016-01-05 Nintendo Co., Ltd. Game controller and game system
US11027190B2 (en) 2005-08-24 2021-06-08 Nintendo Co., Ltd. Game controller and game system
US9498709B2 (en) 2005-08-24 2016-11-22 Nintendo Co., Ltd. Game controller and game system
EP1764141A1 (en) * 2005-09-14 2007-03-21 Nintendo Co., Limited Video game program and video game system
US7833100B2 (en) 2005-09-14 2010-11-16 Nintendo Co., Ltd. Video game program and video game system
USRE45905E1 (en) 2005-09-15 2016-03-01 Nintendo Co., Ltd. Video game system with wireless modular handheld controller
US8913003B2 (en) 2006-07-17 2014-12-16 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer using a projection marker system
US8096880B2 (en) 2006-08-15 2012-01-17 Nintendo Co., Ltd. Systems and methods for reducing jitter associated with a control device
US9176598B2 (en) 2007-05-08 2015-11-03 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer with improved performance

Also Published As

Publication number Publication date
US5506605A (en) 1996-04-09
US5296871A (en) 1994-03-22

Similar Documents

Publication Publication Date Title
US5296871A (en) Three-dimensional mouse with tactile feedback
US5591924A (en) Force and torque converter
US7106313B2 (en) Force feedback interface device with force functionality button
US6100874A (en) Force feedback mouse interface
EP0721615B1 (en) Force reflecting haptic interface
US5923318A (en) Finger manipulatable 6 degree-of-freedom input device
US5004871A (en) Digitizer stylus having side switch
US5095302A (en) Three dimensional mouse via finger ring or cavity
US6697044B2 (en) Haptic feedback device with button forces
US5184319A (en) Force feedback and textures simulating interface device
EP1779221B1 (en) Method and apparatus for communicating graphical information to a visually impaired person using haptic feedback
GB2247066A (en) Manual controller for computer graphic object display with six degrees of freedom
US6707445B1 (en) Input device
WO1993004348A1 (en) Force and torque converter
GB2308641A (en) Manually-operated data input device eg for computers or video games
CA2184038A1 (en) 6 degree of freedom control device for human-machine interface
IL160002A (en) Mouse interface device for providing force feedback

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WPC Withdrawal of priority claims after completion of the technical preparations for international publication

Free format text: US

122 Ep: pct application non-entry in european phase