US20090131165A1 - Physical feedback channel for entertainment or gaming environments - Google Patents
Physical feedback channel for entertainment or gaming environments Download PDFInfo
- Publication number
- US20090131165A1 US20090131165A1 US12/357,184 US35718409A US2009131165A1 US 20090131165 A1 US20090131165 A1 US 20090131165A1 US 35718409 A US35718409 A US 35718409A US 2009131165 A1 US2009131165 A1 US 2009131165A1
- Authority
- US
- United States
- Prior art keywords
- user
- signals
- application software
- feedback
- software program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/217—Input arrangements for video game devices characterised by their sensors, purposes or types using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/218—Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
- A63F13/332—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using wireless networks, e.g. cellular phone networks
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- A—HUMAN NECESSITIES
- A41—WEARING APPAREL
- A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
- A41D1/00—Garments
- A41D1/002—Garments adapted to accommodate electronic equipment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1037—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1056—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving pressure sensitive buttons
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/209—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform characterized by low level software layer, relating to hardware management, e.g. Operating System, Application Programming Interface
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
- A63F2300/302—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device specially adapted for receiving control signals not targeted to a display device or game input means, e.g. vibrating driver's seat, scent dispenser
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
- A63F2300/406—Transmission via wireless network, e.g. pager or GSM
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8082—Virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/013—Force feedback applied to a game
Definitions
- the present invention generally relates to the field of providing physical feedback to the user of an application, such as f.e. a computer game or other entertainment application software.
- Haptic interfaces represent an interesting alternative to conventional human-machine interfaces and feature a wide variety of applications. Examples include virtual-reality (VR) applications for immersive simulation, teleoperated master-slave robot systems, and robotic surgery.
- a haptic interface according to the state of the art comprises a special input/output device (e.g. a force-feedback joystick, a haptic mouse, or an exoskeleton), a real-time controller, and a real-time simulation of a virtual environment.
- the controller thereby collects information from integrated sensors of the input/output device (e.g. position, velocity, force or torque sensors), which are then used as input information to the simulation.
- the simulation estimates the forces a user should feel based on this input information and the internal state of the simulation itself.
- the simulation outputs are then used by the controller to drive the input/output device's actuators, which allows said user to touch, feel, and manipulate virtual environments.
- WO 01/41636 A1 refers to a tactile communication system enabling remotely control of tactile output devices, e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
- tactile output devices e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
- WO 98/14860 pertains to a method for transmitting the touch of a sensor array via a computer or computer network and a corresponding system for transmitting perceptible feelings, which comprises at least one computer, a sensor array for detecting touches from a person and providing sensor signals, an actuator array for generating physically perceptible pressure signals, and a control unit linking the sensor array and the actuator array to the computer.
- a communication terminal device with a tactile feedback comprises a pen-input tablet, a microphone, an acceleration sensor and a number of pressure sensors.
- a computerized system including a touch/pressure-sensitive transducer and a computer responsive thereto for producing a sentic cycle and recording touch expression is disclosed in U.S. Pat. No. 5,305,423.
- a system providing realistic physical feedback in a computer gaming environment can comprise:
- the wearable receiver can be integrated in a piece of garment.
- a display can be integrated into the piece of garment.
- the wearable receiver can comprise a controller for controlling an array of actuators according to an operational pattern depending on any feedback signal received.
- the system furthermore can comprise a channel for transmitting signals representing biological data from the user to the computing device hosting the application software program.
- the application software can be an entertainment or game-type software.
- the feedback signals can be generated depending on a background scene and/or a virtual actor of a game-type software.
- the application software can be divided into several logical parts, wherein each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator means.
- the actuator means can comprise means for generating vibrational, tactile and/or heat.
- the wearable receiver can comprise means for adjusting manually operational parameters of the actuator means.
- a method for providing physical feedback sensations to the body of a user of an application software program can comprise the following steps:
- Another aspect relates to computer program product, a computer game console and a wearable game accessory respectively supporting such a method.
- FIG. 1 shows a user wearing a piece of clothing which includes integrated actuators for generating vibrations, heat or coolness, pressure and/or electric pulses generated by actuators worn on or placed near the user's body,
- FIG. 2 block diagram showing the interaction between biometric sensors placed on or close to the body of a person wearing said piece of clothing, a game console platform and its controlling unit,
- FIG. 3 a shows a piece of clothing (e.g. a shirt) comprising a wearable display
- FIG. 3 b shows a piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red,
- a piece of clothing e.g. a shirt
- a wearable display which shows a simulated heavy violation by coloring parts of said shirt red
- FIG. 4 a illustrates a tactile communication scenario according to a first embodiment of the invention
- FIG. 4 b illustrates a tactile communication scenario according to a second embodiment of this invention
- FIGS. 1 to 4 b different embodiments of the present invention as depicted in FIGS. 1 to 4 b shall be explained in detail.
- the meaning of the symbols designated with reference numerals and signs in these figures can be taken from an annexed table.
- the present invention particularly refers to a piece of clothing or wearable accessory 101 equipped with at least one wearable computing device 100 , wherein the computing device is connected to the central controlling unit 109 ′′ e.g. of a game console application or any type of application software running on an external controlling device 109 over a wireless or wirebound link 199 . It comprises means ( 100 C) for receiving (S 202 ′) and processing (S 202 ′) e.g. digitally encoded control information representing physical feedback signals from the external controlling device 109 , actuating means 106 a - d placed on or close to the body of a person wearing said piece of clothing or wearable accessory 101 , which generate multi-sensorial feedback e.g.
- the central controlling unit can be connected operatively with a monitor device, as it is well known f.e. from game consoles, to transmit and eventually receive signals from the monitor device.
- said device 100 features a tactile interface which comprises different sensing means 105 a - c for detecting tactile input information when being touched by a user and/or a number of actuating means 106 a - d for generating (S 104 ′) tactile stimuli, which provides said user with sensoric feedback f.e. from a virtual gaming scene according to said control information.
- tactile stimulation is achieved by means of a dedicated piece of clothing equipped with one or a number of the same or different types of mechanical and/or electric actuators 106 a - d (e.g. micro motors, micro speakers, piezo elements, micro fans and electrostatic discharge modules for simulating e.g. “laser shocks”, etc.).
- Said actuators are embedded into a piece of clothing 101 or into a part of said clothing worn by the player, wearable accessories or intelligent jewelries that are preferably worn on the upper part of the person's body or on his/her arms.
- the game console application 109 ′ is usually responsible for controlling only a single actuator 106 or a number of actuators 106 a - d at a time and works according to a predefined set of rules.
- biometric 105 a - c
- environmental sensors 105 ′
- the sensors are used for measuring e.g. the skin conductivity, which indicates the degree of sweating, body temperature, blood volume pressure, respiration and/or pulse rate (and therewith the excitement level) of the player or several environmental conditions (e.g. the temperature, atmospheric pressure, relative humidity and/or wind speed) in the environment of said person, respectively.
- the controlling unit 100 C of a wearable computing device 100 integrated into the player's clothes thereby acts as a wireless or wired link between the actuators 106 a - d and the game console platform 109 .
- conventional wireless standards such as Bluetooth, ZigBee or IEEE 802.11b WLAN technology
- high-speed fixed network connections such as Ethernet, USB or 1394 can also be supported.
- a second embodiment of the present invention as depicted in FIG. 4 b is based on an active wearable device 100 driven by e.g. a game console platform 109 which targets a relaxing stimulation of a person wearing a piece of clothing 101 including such an embedded active wearable device 100 .
- This device comprises at least one haptic interface and/or a number of sensors 105 a - c and actuators 106 a - d placed on or close to a user's body (e.g. on the neck, shoulders and/or arms of said person), which are used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting the player's feelings, emotional states or states of mind) and generating different types of stimulation (e.g.
- a third embodiment of the present invention is directed to an interactive tactile communication scenario, wherein wearable computing devices of at least two players, each wearing a piece of clothing as described above and having a communication platform (i.e. a game console or PC) with the appropriate interfaces and application software, are interconnected via a wireless or wired network link.
- a number of biometric ( 110 c ) and/or environmental signals ( 110 c ′) indicating the physical condition, emotional states and/or states of mind of a first person wearing a first piece of clothing 101 equipped with a first wearable computing device 100 and/or tactile sensations perceived by said first person are continuously (or intermittently) sensed and monitored (S 100 ).
- the application software provides predefined patterns for a mutual tactile stimulation and also enables the users to create their own individual “remote touch” patterns or sequences.
- real-time entertaining is available; for non-real-time operation the provision of an email interface to drive the “remote touch” scenario is also possible.
- a user can also wear a piece of clothing 300 a/b (e-g. a shirt) that comprises optical fibers and/or any other type of wearable optical displays 102 , 102 ′ or 102 ′′.
- a piece of clothing 300 a/b e-g. a shirt
- optical fibers e.g. a display
- 102 ′ or 102 ′′ e.g. a display
- These displays can e.g.
- the haptic interface additionally comprises actuators 106 a - d which are used for generating low-frequency vibrations or acoustic signals making the player feeling tired, stressed or unconcentrated and simulating physical strain.
- a smart jacket equipped with at least one wearable computing device as described above, worn by a first person, 101′ second piece of clothing (e.g. a smart jacket) equipped with at least one further integrated wearable computing device, worn by a second person, that is specially adapted to receive digitally encoded information from said first piece of clothing or wearable accessory 101 102 liquid crystal display (LCD), incorporated into the upper right front part of the piece of clothing 101, that is used e.g. to display relaxing images, images reflecting emotional states of a person wearing said piece of clothing 101 - e.g. in the form of emoticons (“smileys”, e.g.
- LCD liquid crystal display
- a shirt which displays a simulated heavy violation by using integrated optical fibers made of quartz glass and/or plastics for illuminating and/or coloring parts of said shirt red 103 tactile interface, integrated into said piece of clothing 101, which is used for sensing tactile input information, monitoring a user's physiological, physical and/or psychological condition and generating heat, pressure, vibrational and/or electric pulses or other types of stimulation based on this tactile input information, physical or mental strain of said user and/or context information provided by applications running on a game console 109 104 smart button for buttoning up said jacket 101, which can also be used for activating or deactivating an integrated function allowing the wearer of said jacket 101 e.g.
- biometric sensors body temperature, blood volume 105a-c pressure, skin conductivity, respiration rate and/or pulse rate sensors, etc.
- biometric signals indicating the physical condition and excitement level of a user wearing the jacket 101
- meteorological sensors 105′ e.g.
- thermometer barometer, hygrometer and/or wind speed meter
- actuating means micro motors, micro speakers, piezo 106a-d elements, heating elements and micro fans or electrostatic discharge modules, etc.
- vibrations acoustic signals, heat or coolness, pressure or electric pulses stimulating the user, which are integrated e.g.
- mapping the results of this analysis to emotional patterns stored in a read access memory (RAM) and using these patterns for activating/deactivating (S104) at least one of the available actuators 106a-d that are integrated into the piece of clothing 101 for stimulating the wearer's energy level, said processing means being integrated e.g.
- Internet or SMS emoticons such as “:-)”, “:-
- biometric sensors 105 e.g. body temperature, blood volume pressure, respiration rate and/or pulse rate sensors
- meteorological sensors 105′ e.g. thermometer, barometer, hygrometer, and wind speed meter
- a shirt comprising a wearable display which shows the name or logo of an interactive network game or displays the current high-score rank of a player participating in said game and/or any other game- related information 300b piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red 400a tactile communication scenario according to a first embodiment of the present invention (“Shock U”), wherein a wearable computing device 100 comprising at least one haptic interface or a number of actuators 106a-d placed on or close to a user's body, which are used for generating different types of stimulation (e.g.
- a wearable computing device 100 - comprising at least one haptic interface or a number of sensors 105a-c and actuators 106a-d placed on or close to a user's body, that are respectively used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting said user's feelings, emotional states and/or states of mind) and generating different types of stimulation (e.g.
- step #100 sensing and monitoring different biometric signals (e.g. body temperature, blood volume pressure, respiration rate and/or pulse rate) indicating the physical condition of a person wearing said jacket 101
- step #1001 measuring meteorological parameters (e.g.
- step #101 extracting features from biometric signal taken from a user wearing said jacket 101, which indicates the physical condition of said user, and/or measured meteorological conditions in the environment of said user S102 step #102: analyzing these features S102′ step #102′: analyzing user inputs by evaluating oral and/or written user statements and signs (e.g.
Abstract
A physical feedback system for computer gaming environments including a computing device for executing an application software program, the computing device having an interface for transmitting feedback signals generated by the application software program, and a wearable receiver having means for receiving the feedback signals from the computing device and actuator means designed to enter physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
Description
- This application is a Continuation of and claims the benefit priority from U.S. Ser. No. 10/995,001, filed Nov. 22, 2004, the entire contents of each of which are incorporated herein by reference, which claims the benefit of priority from European Patent Application No. 03026896.5, filed Nov. 24, 2003.
- The present invention generally relates to the field of providing physical feedback to the user of an application, such as f.e. a computer game or other entertainment application software.
- To understand the proposed idea of the present invention, it is necessary to briefly describe the main features, advantages and problems of haptic interfaces and tactile communication systems according to the state of the art.
- Haptic interfaces represent an interesting alternative to conventional human-machine interfaces and feature a wide variety of applications. Examples include virtual-reality (VR) applications for immersive simulation, teleoperated master-slave robot systems, and robotic surgery. A haptic interface according to the state of the art comprises a special input/output device (e.g. a force-feedback joystick, a haptic mouse, or an exoskeleton), a real-time controller, and a real-time simulation of a virtual environment. The controller thereby collects information from integrated sensors of the input/output device (e.g. position, velocity, force or torque sensors), which are then used as input information to the simulation. The simulation estimates the forces a user should feel based on this input information and the internal state of the simulation itself. The simulation outputs are then used by the controller to drive the input/output device's actuators, which allows said user to touch, feel, and manipulate virtual environments.
- WO 01/41636 A1 refers to a tactile communication system enabling remotely control of tactile output devices, e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
- WO 98/14860 pertains to a method for transmitting the touch of a sensor array via a computer or computer network and a corresponding system for transmitting perceptible feelings, which comprises at least one computer, a sensor array for detecting touches from a person and providing sensor signals, an actuator array for generating physically perceptible pressure signals, and a control unit linking the sensor array and the actuator array to the computer.
- In
EP 0 875 821 A2, a communication terminal device with a tactile feedback is described. The device comprises a pen-input tablet, a microphone, an acceleration sensor and a number of pressure sensors. - A computerized system including a touch/pressure-sensitive transducer and a computer responsive thereto for producing a sentic cycle and recording touch expression is disclosed in U.S. Pat. No. 5,305,423.
- Today, entertainment and gaming software such as e.g. adventure games are getting more and more realistic due to a more and more enhanced graphical resolution and frame rate. Modern game console platforms are also used in combination with hand-held controller devices providing a haptic force-feedback function. However, these force-feedback controller devices according to the state of the art do not provide a realistic way of feeling tactile sensations in virtual game scenarios.
- In view of the explanations mentioned above, it is the object of the present invention to provide a controlling device which allows a more realistic (intuitive) feedback.
- This object is achieved by means of the features of the independent claims. Advantageous features are defined in the subordinate claims. Further objects and advantages of the invention are apparent in the detailed description which follows.
- A system providing realistic physical feedback in a computer gaming environment according can comprise:
-
- a computing device for executing an application software program,
the computing device having an interface for transmitting feedback signals generated by the application software program, and - a wearable receiver having means for receiving the feedback signals from the computing device and actuator means designed to enter physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
- a computing device for executing an application software program,
- The wearable receiver can be integrated in a piece of garment.
- A display can be integrated into the piece of garment.
- The wearable receiver can comprise a controller for controlling an array of actuators according to an operational pattern depending on any feedback signal received.
- The system furthermore can comprise a channel for transmitting signals representing biological data from the user to the computing device hosting the application software program.
- The application software can be an entertainment or game-type software.
- The feedback signals can be generated depending on a background scene and/or a virtual actor of a game-type software.
- The application software can be divided into several logical parts, wherein each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator means.
- The actuator means can comprise means for generating vibrational, tactile and/or heat.
- The wearable receiver can comprise means for adjusting manually operational parameters of the actuator means.
- According to another aspect of the present invention, a method for providing physical feedback sensations to the body of a user of an application software program can comprise the following steps:
-
- generating feedback signals in an application software program,
- transmitting the feedback signals to a wearable receiver, and
- entering, based on the received feedback signals, physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
- Another aspect relates to computer program product, a computer game console and a wearable game accessory respectively supporting such a method.
- Further advantages and conceivable applications of the present invention result from the subordinate claims as well as from the following description of one embodiment of the invention as depicted in the following drawings:
-
FIG. 1 shows a user wearing a piece of clothing which includes integrated actuators for generating vibrations, heat or coolness, pressure and/or electric pulses generated by actuators worn on or placed near the user's body, -
FIG. 2 block diagram showing the interaction between biometric sensors placed on or close to the body of a person wearing said piece of clothing, a game console platform and its controlling unit, -
FIG. 3 a shows a piece of clothing (e.g. a shirt) comprising a wearable display, -
FIG. 3 b shows a piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red, -
FIG. 4 a illustrates a tactile communication scenario according to a first embodiment of the invention, and -
FIG. 4 b illustrates a tactile communication scenario according to a second embodiment of this invention, - In the following, different embodiments of the present invention as depicted in
FIGS. 1 to 4 b shall be explained in detail. The meaning of the symbols designated with reference numerals and signs in these figures can be taken from an annexed table. - The present invention particularly refers to a piece of clothing or
wearable accessory 101 equipped with at least onewearable computing device 100, wherein the computing device is connected to the central controllingunit 109″ e.g. of a game console application or any type of application software running on an external controllingdevice 109 over a wireless orwirebound link 199. It comprises means (100C) for receiving (S202′) and processing (S202′) e.g. digitally encoded control information representing physical feedback signals from the external controllingdevice 109, actuating means 106 a-d placed on or close to the body of a person wearing said piece of clothing orwearable accessory 101, which generate multi-sensorial feedback e.g. from a virtual gaming scene by generating (S104′) visual, auditive, tactile, gustatoric and/or olfactoric stimuli, particularly stimuli using the skin of a user as an interface, as well as means for activating, controlling and deactivating (S104) these actuating means 106 a-d according to said control information. - The central controlling unit can be connected operatively with a monitor device, as it is well known f.e. from game consoles, to transmit and eventually receive signals from the monitor device.
- According to a further aspect of the invention, said
device 100 features a tactile interface which comprises different sensing means 105 a-c for detecting tactile input information when being touched by a user and/or a number of actuating means 106 a-d for generating (S104′) tactile stimuli, which provides said user with sensoric feedback f.e. from a virtual gaming scene according to said control information. - According to a first embodiment of the invention as depicted in
FIG. 4 a, tactile stimulation is achieved by means of a dedicated piece of clothing equipped with one or a number of the same or different types of mechanical and/orelectric actuators 106 a-d (e.g. micro motors, micro speakers, piezo elements, micro fans and electrostatic discharge modules for simulating e.g. “laser shocks”, etc.). Said actuators are embedded into a piece ofclothing 101 or into a part of said clothing worn by the player, wearable accessories or intelligent jewelries that are preferably worn on the upper part of the person's body or on his/her arms. To get a more realistic impression of the gaming atmosphere (displayed on the monitor device), simulated environmental conditions such as wind, rain or heat become feelable to said player. The intensity of simulated tactile sensations, which is under main control of the game console application software and also controlled by different controlling means which are directly controllable by the player, depends on the number of worn clothing layers. Thegame console application 109′ is usually responsible for controlling only asingle actuator 106 or a number ofactuators 106 a-d at a time and works according to a predefined set of rules. - As shown in
FIGS. 1 and 2 , in addition to the signals originating from the game console, furthermore feedback data from the player, detected by a number of biometric (105 a-c) and/or environmental sensors (105′) placed on or close to the user's body can also be used to influence the game console application software. The sensors are used for measuring e.g. the skin conductivity, which indicates the degree of sweating, body temperature, blood volume pressure, respiration and/or pulse rate (and therewith the excitement level) of the player or several environmental conditions (e.g. the temperature, atmospheric pressure, relative humidity and/or wind speed) in the environment of said person, respectively. - There are usually different types of visual or audio information conveyed to the user. Possible categories are:
- (1) information regarding the atmosphere, e.g. via the rhythm of music indicating danger,
(2) information about what the main character in a virtual game scenario shown on the monitor is doing (e.g. jumping or firing), and
(3) information related to other characters such as enemies and partners of the main character. These different categories of information (background, main and foreground information) can be conveyed by different types of actuators (acoustic, optical, haptic actuators or special actuators that generate signals stimulating a player's gustatoric or olfactoric sense) to represent different levels of information to the user. For each category, the intensity of a signal can be varied. - The controlling
unit 100C of awearable computing device 100 integrated into the player's clothes thereby acts as a wireless or wired link between theactuators 106 a-d and thegame console platform 109. Besides conventional wireless standards such as Bluetooth, ZigBee or IEEE 802.11b WLAN technology, high-speed fixed network connections such as Ethernet, USB or 1394 can also be supported. - A second embodiment of the present invention as depicted in
FIG. 4 b is based on an activewearable device 100 driven by e.g. agame console platform 109 which targets a relaxing stimulation of a person wearing a piece ofclothing 101 including such an embedded activewearable device 100. This device comprises at least one haptic interface and/or a number ofsensors 105 a-c andactuators 106 a-d placed on or close to a user's body (e.g. on the neck, shoulders and/or arms of said person), which are used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting the player's feelings, emotional states or states of mind) and generating different types of stimulation (e.g. heat, pressure, vibrational and/or electric pulses, etc.) based on this information, respectively. In this connection, so-called “relax software titles” are needed which are specially designed to control the actuators in a way that is being received by said person as a tactile sensation and/or relaxing stimulation. The software for running the haptic interface can also be supported by relaxing music, video or graphical scenes. Also conceivable is a combination of the first and said second embodiment. - A third embodiment of the present invention is directed to an interactive tactile communication scenario, wherein wearable computing devices of at least two players, each wearing a piece of clothing as described above and having a communication platform (i.e. a game console or PC) with the appropriate interfaces and application software, are interconnected via a wireless or wired network link. Thereby, a number of biometric (110 c) and/or environmental signals (110 c′) indicating the physical condition, emotional states and/or states of mind of a first person wearing a first piece of
clothing 101 equipped with a firstwearable computing device 100 and/or tactile sensations perceived by said first person are continuously (or intermittently) sensed and monitored (S100). - After having extracted (S101) a number of features from said biometric (110 c) and/or environmental signals (100 c′), these features are analyzed (S102) and mapped (S103) to a number of emotional patterns (meta information), that are stored in an integrated read access memory (RAM) for further processing. This meta information is then transmitted (S201) to a second person wearing a second piece of
clothing 101′ equipped with at least one furtherwearable computing device 100′ for receiving (S202) and reproducing (S104) tactile sensations perceived and/or physical affection expressed by said first person. The application software thereby allows a “remote touch” by opening an e.g. Internet-based “tactile remote control” connection between the two players. Each player can alternatively select to control the distant wearable device of his/her counterpart or his/her own wearable device. Therefore, the application software provides predefined patterns for a mutual tactile stimulation and also enables the users to create their own individual “remote touch” patterns or sequences. In case of an online connection, real-time entertaining is available; for non-real-time operation the provision of an email interface to drive the “remote touch” scenario is also possible. Finally, it should be mentioned that this embodiment can advantageously be combined with said first and/or said second embodiment described above. - In addition to the haptic interface, a user can also wear a piece of
clothing 300 a/b (e-g. a shirt) that comprises optical fibers and/or any other type of wearableoptical displays -
- show the name and/or logo of an interactive network game or display the current high-score rank of a player participating in said game and/or any other game-related information (cf.
FIG. 3 a), - show a simulated heavy violation by using integrated optical fibers for coloring parts of said shirt red (cf.
FIG. 3 b), or - display relaxing images, images reflecting emotional states of a user wearing said piece of clothing—e.g. in the form of emoticons (“smileys”, e.g. “:-)”, “:-|”, or “:-(”, etc.) or other symbols and signs—or any other type of visual information.
- show the name and/or logo of an interactive network game or display the current high-score rank of a player participating in said game and/or any other game-related information (cf.
- According to a further aspect of the invention, the haptic interface additionally comprises
actuators 106 a-d which are used for generating low-frequency vibrations or acoustic signals making the player feeling tired, stressed or unconcentrated and simulating physical strain. -
TABLE Depicted Features and their Corresponding Reference Signs No. Technical Feature (System Component or Procedure Step) 100 wearable computing device, integrated into a first piece of clothing 101 (e.g. a smart jacket) or any type of wearable accessory such as watches, wrist or arm bracelets, rings, brooches, etc. (so-called “digital jewelry”), comprising actuators transmitting feedback-information using the skin of a user as an interface for entering informational sensation to the body of the user 100′ wearable computing device, integrated into a second piece of clothing 101′ worn by a second user wearable computing device 100C central controlling unit (μC) of the wearable computing device 100 central controlling unit (μC′) of the second wearable computing device 100′ transmitting means of the wearable computing device 100 receiving means of the wearable computing device 100′ for wirelessly receiving information transmitting means of the wearable computing device, that is used for wirelessly transmitting information receiving means of the wearable computing device for wirelessly receiving information diagram showing a user wearing a piece of clothing 101 which includes a number of integrated electronic devices for monitoring tactile sensations, emotional states and/or the state of mind of the user, analyzing said feelings and combining vibrational, heat, pressure or electric pulses generated by actuators 106a-c worn on and/or placed near the user's body for stimulating said user block diagram showing the feature extraction and tactile stimulation procedure according to the present invention 101 first piece of clothing (e.g. a smart jacket) equipped with at least one wearable computing device as described above, worn by a first person, 101′ second piece of clothing (e.g. a smart jacket) equipped with at least one further integrated wearable computing device, worn by a second person, that is specially adapted to receive digitally encoded information from said first piece of clothing or wearable accessory 101 102 liquid crystal display (LCD), incorporated into the upper right front part of the piece of clothing 101, that is used e.g. to display relaxing images, images reflecting emotional states of a person wearing said piece of clothing 101 - e.g. in the form of emoticons (“smileys”, e.g. “:-)”, “:-|”, “:-(”, etc.) or other symbols and signs - or any other type of visual information 102′ wearable display, embedded into a piece of clothing 300a (e.g. a shirt), which displays the name and/or logo of an interactive network game, the current high-score rank of a player participating in said game, game-related and/or any other type of textual and/or visual information 102″ wearable display, embedded into another piece of clothing 300b (e.g. a shirt), which displays a simulated heavy violation by using integrated optical fibers made of quartz glass and/or plastics for illuminating and/or coloring parts of said shirt red 103 tactile interface, integrated into said piece of clothing 101, which is used for sensing tactile input information, monitoring a user's physiological, physical and/or psychological condition and generating heat, pressure, vibrational and/or electric pulses or other types of stimulation based on this tactile input information, physical or mental strain of said user and/or context information provided by applications running on a game console 109 104 smart button for buttoning up said jacket 101, which can also be used for activating or deactivating an integrated function allowing the wearer of said jacket 101 e.g. to listen his/her favorite music stored on an integrated microchip, tune into his/her favorite radio channel, display moving images on the liquid crystal display 102, activate or deactivate integrated heating elements, etc. 105, different biometric sensors (body temperature, blood volume 105a-c pressure, skin conductivity, respiration rate and/or pulse rate sensors, etc.) for monitoring a number of biometric signals indicating the physical condition and excitement level of a user wearing the jacket 101, 105′ different meteorological sensors 105′ (e.g. thermometer, barometer, hygrometer and/or wind speed meter) indicating different climatic and/or meteorological conditions (temperature, atmospheric pressure, relative humidity and wind speed) in the environment of said user 106, actuating means (micro motors, micro speakers, piezo 106a-d elements, heating elements and micro fans or electrostatic discharge modules, etc.) for generating vibrations, acoustic signals, heat or coolness, pressure or electric pulses stimulating the user, which are integrated e.g. into the waist belt of the user's smart jacket 101 106′ processing means for extracting (S101) features from biometric signals taken from a user wearing said jacket 101, which indicate the physical condition of said user, and/or measured meteorological parameters in the environment of the user, analyzing (S102′) user inputs by evaluating oral and/or written user statements and signs (e.g. Internet or SMS emoticons such as “:-)”, “:-|”, or “- (” typed in on an integrated keyboard 107a of a user's smart jacket 101), which reflect perceived sensations of said user, mapping (S103) the results of this analysis to emotional patterns stored in a read access memory (RAM) and using these patterns for activating/deactivating (S104) at least one of the available actuators 106a-d that are integrated into the piece of clothing 101 for stimulating the wearer's energy level, said processing means being integrated e.g. into the waist belt of the user's smart jacket 101 106″ battery pack, integrated into the waist belt of the user's smart jacket 101 107 control display, integrated into the left sleeve of the user's smart jacket 101 107a keyboard for inputting user and control information needed for controlling said control display 107, integrated into the left sleeve of said jacket 101 107b “JogDial” button, integrated into the left sleeve of said jacket 101, which gives a rundown on the user's physical performances after a sporting activity 108 fake pocket, integrated into the upper left front part of said user's jacket 101, which includes a digital pocket storage 109 game console platform, driving the haptic interface 103 of a wearable computing device 100 integrated into a piece of clothing 101 or any other type of wearable accessory 109′ game console application, running on said game console 109 U129 109″ controlling unit of the game console application, used for controlling the haptic interface 103 of the wearable computing device 100 or a number of different sensors 105, 105′ and actuators 106a-d placed on or close to said user's body signs (e.g. Internet or SMS emoticons such as “:-)”, “:-|”, or “:-(” typed in on an integrated keyboard 107a of the user's smart jacket 101), that reflect perceived sensations and/or emotional states of a user wearing said jacket written statements and/or spoken utterances reflecting tactile sensations and/or emotional states perceived by a user wearing said jacket biometric signals indicating the physical condition of a user's body, detected by different biometric sensors 105 (e.g. body temperature, blood volume pressure, respiration rate and/or pulse rate sensors) integrated into the piece of clothing 101 worn by said user environmental signals indicating climatic and/or meteorological conditions (e.g. temperature, atmospheric pressure, relative humidity, and/or wind speed) in the environment of said user, detected by different meteorological sensors 105′ (e.g. thermometer, barometer, hygrometer, and wind speed meter) literally, lexically and syntactically analyzed and semantically interpreted written statement typed in on an integrated keyboard 107a of the piece of clothing 101 or phonetically, lexically and syntactically analyzed and semantically interpreted spoken utterance of a user wearing said jacket 101 (“feeling language statement”), which reflects expressed feelings of said user vibrations, heat or coolness, pressure and/or electric pulses generated by actuators worn on and/or placed near the user's body for stimulating the user depending on the perceived and analyzed sensations of said user 300a piece of clothing (e.g. a shirt) comprising a wearable display which shows the name or logo of an interactive network game or displays the current high-score rank of a player participating in said game and/or any other game- related information 300b piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red 400a tactile communication scenario according to a first embodiment of the present invention (“Shock U”), wherein a wearable computing device 100 comprising at least one haptic interface or a number of actuators 106a-d placed on or close to a user's body, which are used for generating different types of stimulation (e.g. heat, pressure, vibrational and/or electric pulses), is controlled by the controlling unit 109″ of a game console platform 109 400b tactile communication scenario according to a second embodiment of this invention (“Relax U”), wherein a wearable computing device 100 - comprising at least one haptic interface or a number of sensors 105a-c and actuators 106a-d placed on or close to a user's body, that are respectively used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting said user's feelings, emotional states and/or states of mind) and generating different types of stimulation (e.g. heat, pressure, vibrational and/or electric pulses, etc.) based on this input information, physical or mental strain of the user - is controlled by the controlling unit 109′ of the game console platform 109 S100 step #100: sensing and monitoring different biometric signals (e.g. body temperature, blood volume pressure, respiration rate and/or pulse rate) indicating the physical condition of a person wearing said jacket 101 S100′ step #1001: measuring meteorological parameters (e.g. temperature, atmospheric pressure, relative humidity and/or wind speed) indicating climatic and meteorological conditions in the environment of said user S101 step #101: extracting features from biometric signal taken from a user wearing said jacket 101, which indicates the physical condition of said user, and/or measured meteorological conditions in the environment of said user S102 step #102: analyzing these features S102′ step #102′: analyzing user inputs by evaluating oral and/or written user statements and signs (e.g. Internet or SMS emoticons such as “:-)”, “:-|”, or “:-(” typed in on an integrated keyboard 107a of a user's smart jacket 101), which reflect perceived sensations of the user S103 step #103: translating these signals into a “feeling language statement”, that reflects perceived sensations and/or emotional states of said user, by mapping results of this analysis to a number of emotional patterns (meta information) stored in a read access memory (RAM) S104 step #104: using these patterns for activating or deactivating at least one of the available actuators 106a-d integrated into the piece of clothing 101 for stimulating a user's energy level S104′ step #104′: continuously or intermittently generating visual, auditive, tactile, gustatoric and/or olfactoric stimuli based on digitally encoded control information received from an external controlling unit 109″ via a wireless or wired link S201 step #201: transmitting meta information from a first person wearing a first piece of clothing 101 equipped with at least one integrated wearable computing device to a second person wearing a second piece of clothing 101′ equipped with at least one further integrated wearable computing device for receiving said meta information, evaluating and reproducing feelable signals, tactile sensations perceived and/or physical affection expressed by said first person S202 step #202: receiving meta information representing feelable signals, tactile sensations perceived and/or physical affection expressed by a first person wearing a first piece of clothing 101 equipped with at least one integrated wearable computing device S202′ step #202′: receiving digitally encoded control information received from an external controlling unit 109″ via a wireless or wired link S202″ step #202″: processing this control information S301 step #301: character scan procedure for automatically recognizing characters, numbers and/or symbols typed in on the integrated keyboard 107a of said smart jacket 101 S301′ step #301′: phonetic scan procedure for automatically recognizing the phonemes in a spoken utterance of a person wearing this piece of clothing 101 S302 step #302: lexical scan procedure for automatically recognizing feeling language tokens belonging to a “feeling language vocabulary” reflecting perceived sensations and/or emotional states of a user wearing said jacket S303 step #303: syntax scan procedure for analyzing the grammatical structure of a recognized “feeling language statement” S304 step #304: semantic scan procedure for interpreting expressed feelings by performing a semantic analysis of this recognized and syntactically analyzed feeling language statement S401 step #401: searching the read access memory (RAM) integrated into the wearable computing device of the first piece of clothing 101 worn by said first person, which serves as a repository for meta information representing feelings, tactile sensations perceived and/or physical affection expressed by said first person S401′ step #401′: selecting a pattern dependent on an interpretation of a tactile sensation perceived or a feeling expressed by said first person gained by a literal and/or phonetic, lexical, syntactical and semantic analysis of a statement typed in on an integrated keyboard 107a of said first piece of clothing 101 and/or a spoken utterance of said first person wearing this particular piece of clothing 101, respectively S402 step #402: enriching or updating the UPF pattern descriptors 600 of said patterns with additional information derived from available context information provided by a number of different biometric (105) and/or environmental sensors (105′) integrated into the first piece of clothing 101 worn by said first person
Claims (19)
1. A system comprising:
a first wearable device including sensors configured to receive biological data from a first user and a channel configured to transmit signals representing the biological data;
a computing device configured to receive the signals and to execute an application software program, the computing device having an interface configured to transmit feedback signals generated by the application software program based on the received signals; and
a second wearable device including a receiver configured to receive the feedback signals from the computing device and an actuator configured to produce physical feedback sensations to a body and/or head of a second user using skin of the second user as an interface.
2. The system according to claim 1 , wherein at least one of the first wearable device and the second wearable device is integrated in a piece of garment.
3. The system according to claim 2 , wherein a display is integrated into the piece of garment, and the display is configured to react to the feedback signals from the computing device.
4. The system according to claim 1 , wherein the second wearable device includes a controller configured to control an array of actuators according to an operational pattern depending on any feedback signal received.
5. The system according to claim 1 , wherein the application software is an entertainment or game-type software.
6. The system according to claim 5 , wherein the feedback signals are generated depending on a user or application context.
7. The system according to claim 6 , wherein the feedback signals are generated depending on at least one of a background scene, defined virtual objects, sounds, colors and a virtual actor generated by a game-type software.
8. The system according to claim 1 , wherein the application software is designed to display scenes on the monitor, and different elements of the scenes displayed are respectively associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator.
9. The system according to claim 1 , wherein the actuator is configured to produce at least one of vibrational stimuli, tactile stimuli and heat stimuli.
10. The system according to claim 1 , wherein the first wearable device and the second wearable device each include means for manually adjusting operational parameters of the actuator.
11. A method for providing physical feedback sensations to a body of a second user of an application software program, the method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
12. The method according to claim 11 , wherein an array of actuators is controlled according to an operational pattern depending on any feedback signal.
13. The method according to claim 11 , wherein signals representing biological data from the first user are transmitted to the computing device hosting the application software program for further processing.
14. The method according to claim 11 , wherein the feedback signals are generated depending on at least one of a background scene, defined virtual objects, sounds, colors and a virtual actor generated by a game-type software.
15. The method according to claim 11 , wherein the application software is divided into several logical parts, and each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of an actuator.
16. The method according to claim 11 , wherein the at least one of producing vibrational stimuli, tactile stimuli and heat stimuli to a user.
17. A computer readable storage medium in which a program is recorded, said program executing a method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
18. A computer game console in which a program is executed, said program executing a method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
19. A wearable game accessory including a controller in which a method is executed, said method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/357,184 US20090131165A1 (en) | 2003-11-24 | 2009-01-21 | Physical feedback channel for entertainment or gaming environments |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP03026896.5 | 2003-11-24 | ||
EP03026896A EP1533678A1 (en) | 2003-11-24 | 2003-11-24 | Physical feedback channel for entertaining or gaming environments |
US10/995,001 US20050113167A1 (en) | 2003-11-24 | 2004-11-22 | Physical feedback channel for entertainement or gaming environments |
US12/357,184 US20090131165A1 (en) | 2003-11-24 | 2009-01-21 | Physical feedback channel for entertainment or gaming environments |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/995,001 Continuation US20050113167A1 (en) | 2003-11-24 | 2004-11-22 | Physical feedback channel for entertainement or gaming environments |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090131165A1 true US20090131165A1 (en) | 2009-05-21 |
Family
ID=34429424
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/995,001 Abandoned US20050113167A1 (en) | 2003-11-24 | 2004-11-22 | Physical feedback channel for entertainement or gaming environments |
US12/357,184 Abandoned US20090131165A1 (en) | 2003-11-24 | 2009-01-21 | Physical feedback channel for entertainment or gaming environments |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/995,001 Abandoned US20050113167A1 (en) | 2003-11-24 | 2004-11-22 | Physical feedback channel for entertainement or gaming environments |
Country Status (2)
Country | Link |
---|---|
US (2) | US20050113167A1 (en) |
EP (1) | EP1533678A1 (en) |
Cited By (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070063849A1 (en) * | 2005-09-02 | 2007-03-22 | Francesca Rosella | Wearable haptic telecommunication device and system |
US20100152620A1 (en) * | 2008-12-12 | 2010-06-17 | Immersion Corporation | Method and Apparatus for Providing A Haptic Monitoring System Using Multiple Sensors |
US20100315228A1 (en) * | 2009-06-16 | 2010-12-16 | Honeywell International Inc. | Wearable data hub for first responders |
US20110134063A1 (en) * | 2008-08-29 | 2011-06-09 | Shin Norieda | Information input device, information input method, and information input program |
US20110193703A1 (en) * | 2010-02-08 | 2011-08-11 | Adriana Payton | Wearable fluid-sensitive hygiene compliance device |
US20110212756A1 (en) * | 2010-02-27 | 2011-09-01 | Thuuz, LLC | Method and system for an online performance service with recommendation module |
US20120078393A1 (en) * | 2009-09-30 | 2012-03-29 | Miral Kotb | Self-contained, wearable light controller with wireless communication interface |
US20120086550A1 (en) * | 2009-02-24 | 2012-04-12 | Leblanc Donald Joseph | Pedobarographic biometric system |
US20120242478A1 (en) * | 2009-12-16 | 2012-09-27 | Weng Onn Chen | Digital electronic second identity for vehicle |
US20120258800A1 (en) * | 2011-04-11 | 2012-10-11 | Sony Computer Entertainment Inc. | Temperature feedback motion controller |
US20130073305A1 (en) * | 2001-09-15 | 2013-03-21 | Stmicroelectronics S.R.L. | Multimedia tagging system and method, related computer program product |
US20130226580A1 (en) * | 2012-02-29 | 2013-08-29 | Fluential, Llc | Spoken control for user construction of complex behaviors |
US20130222139A1 (en) * | 2011-08-24 | 2013-08-29 | Safetyminded Holdings, Inc. | Human safety indicator |
US20130331157A1 (en) * | 2009-01-06 | 2013-12-12 | Immersion Corporation | Programmable game-based haptic enabled gun controller |
US20130328783A1 (en) * | 2011-06-30 | 2013-12-12 | Sheridan Martin | Transmission of information to smart fabric ouput device |
US8624836B1 (en) * | 2008-10-24 | 2014-01-07 | Google Inc. | Gesture-based small device input |
US20140043228A1 (en) * | 2010-03-31 | 2014-02-13 | Immersion Corporation | System and method for providing haptic stimulus based on position |
US20140114445A1 (en) * | 2011-06-16 | 2014-04-24 | Fondazione Istituto Italiano Di Tecnologia | Interface system for man-machine interaction |
US20150164322A1 (en) * | 2009-09-01 | 2015-06-18 | Adidas Ag | Multi modal method and system for transmitting information about a subject |
US20150206322A1 (en) * | 2014-01-23 | 2015-07-23 | Kiomars Anvari | Fast image sensor for body protection gear or equipment |
US20150277563A1 (en) * | 2014-03-28 | 2015-10-01 | Wen-Ling M. Huang | Dynamic tactile user interface |
US20150289034A1 (en) * | 2014-04-08 | 2015-10-08 | Matthew A.F. Engman | Event entertainment system |
US20150324181A1 (en) * | 2013-05-08 | 2015-11-12 | Natalya Segal | Smart wearable devices and system therefor |
US20150332659A1 (en) * | 2014-05-16 | 2015-11-19 | Not Impossible LLC | Sound vest |
US20160027338A1 (en) * | 2014-05-16 | 2016-01-28 | Not Impossible LLC | Wearable sound |
WO2016033512A1 (en) * | 2014-08-28 | 2016-03-03 | Georgia Tech Research Corporation | Physical interactions through information infrastructures integrated in fabrics and garments |
US20160278444A1 (en) * | 2015-03-24 | 2016-09-29 | Intel Corporation | Smart clothing |
TWI562811B (en) * | 2015-11-09 | 2016-12-21 | Univ Nan Kai Technology | Intelligent starting system of interactive game and method thereof |
WO2017010697A1 (en) * | 2015-07-11 | 2017-01-19 | 홍선기 | Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same |
WO2017091141A1 (en) * | 2015-11-24 | 2017-06-01 | Razer (Asia-Pacific) Pte. Ltd. | Wearable devices, methods for controlling a wearable device, and computer-readable media |
US9727139B2 (en) | 2008-12-12 | 2017-08-08 | Immersion Corporation | Method and apparatus for providing a haptic monitoring system using multiple sensors |
US10052029B2 (en) * | 2014-09-11 | 2018-08-21 | General Electric Company | Infant patient transfer device with temperature sensor |
US10105594B2 (en) * | 2016-06-17 | 2018-10-23 | Disney Enterprises, Inc. | Wearable garments recognition and integration with an interactive gaming system |
US10157487B2 (en) | 2015-07-30 | 2018-12-18 | International Business Machines Corporation | VR biometric integration |
US20180364807A1 (en) * | 2014-06-05 | 2018-12-20 | Immersion Corporation | Systems and Methods for Induced Electrostatic Haptic Effects |
CN109710058A (en) * | 2018-11-27 | 2019-05-03 | 南京恩诺网络科技有限公司 | Tactile data recording method and device, system |
US20190201779A1 (en) * | 2017-12-28 | 2019-07-04 | Keith Vargo | App integrated wearable gaming board design |
CN110199243A (en) * | 2016-10-31 | 2019-09-03 | 泰格韦有限公司 | For providing feedback device, the content playback unit, system and method for heat experience |
US20190317605A1 (en) * | 2016-11-23 | 2019-10-17 | Google Llc | Providing Mediated Social Interactions |
US10467926B2 (en) * | 2013-10-07 | 2019-11-05 | Mc10, Inc. | Conformal sensor systems for sensing and analysis |
US10564730B2 (en) * | 2014-05-19 | 2020-02-18 | Immersion Corporation | Non-collocated haptic cues in immersive environments |
US10569167B1 (en) | 2018-08-22 | 2020-02-25 | Abdul Hotaki | System and methods for providing wireless feedback to a video game |
US10616534B2 (en) * | 2014-10-16 | 2020-04-07 | Lat Enterprises, Inc. | Personal tactical system and network |
US10761608B2 (en) | 2013-07-15 | 2020-09-01 | Vr Electronics Limited | Method and wearable apparatus for synchronizing a user with a virtual environment |
CN112156448A (en) * | 2020-11-05 | 2021-01-01 | 王照斌 | Mutual wearing equipment is felt to artificial intelligence body |
US10937284B2 (en) | 2017-01-23 | 2021-03-02 | Hewlett-Packard Development Company, L.P. | Somatosensory feedback system |
US10944140B2 (en) | 2014-01-15 | 2021-03-09 | Lat Enterprises, Inc. | Wearable and replaceable pouch or skin for holding a portable battery pack |
US10964179B2 (en) | 2014-05-16 | 2021-03-30 | Not Impossible, Llc | Vibrotactile control systems and methods |
US11049380B2 (en) * | 2015-01-13 | 2021-06-29 | Robert Kaindl | Personal safety device, method and article |
US11118819B2 (en) | 2016-10-31 | 2021-09-14 | Tegway Co., Ltd. | Feedback device and thermal feedback providing method using same |
US11191491B2 (en) * | 2016-10-31 | 2021-12-07 | Tegway Co., Ltd. | Feedback device and method for providing thermal feedback using the same |
US11207032B2 (en) | 2016-10-31 | 2021-12-28 | Tegway Co., Ltd. | Feedback device and method for providing thermal feedback using the same |
US11315396B2 (en) | 2018-01-08 | 2022-04-26 | Robert Kaindl | Threat identification device and system with optional active countermeasures |
US11403264B2 (en) * | 2014-09-12 | 2022-08-02 | Verily Life Sciences Llc | Long-term data storage service for wearable device data |
US11416120B2 (en) * | 2009-07-08 | 2022-08-16 | Steelseries Aps | Apparatus and method for managing operations of accessories |
US11450429B2 (en) | 2015-07-11 | 2022-09-20 | Sun Ki Hong | Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same |
US20220343740A1 (en) * | 2019-09-26 | 2022-10-27 | Nippon Telegraph And Telephone Corporation | Vibration presentation apparatus |
US11701585B2 (en) | 2013-03-15 | 2023-07-18 | Steelseries Aps | Gaming device with independent gesture-sensitive areas |
US11759389B2 (en) * | 2013-12-31 | 2023-09-19 | Iftech Inventing Future Technology, Inc. | Wearable devices, systems, methods and architectures for sensory stimulation and manipulation and physiological data acquisition |
US11876354B2 (en) | 2014-01-15 | 2024-01-16 | Lat Enterprises, Inc. | Wearable and replaceable pouch or skin for holding a portable battery pack |
US11876161B2 (en) | 2014-10-16 | 2024-01-16 | Lat Enterprises, Inc. | Material for dissipating heat from and/or reducing heat signature of electronic devices and clothing |
US11876241B2 (en) | 2014-01-15 | 2024-01-16 | Lat Enterprises, Inc. | System for supplying power to a portable battery using at least one solar panel |
US11955825B2 (en) | 2014-10-16 | 2024-04-09 | Lat Enterprises, Inc. | Portable power case with lithium iron phosphate battery |
Families Citing this family (90)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7046151B2 (en) * | 2003-07-14 | 2006-05-16 | Michael J. Dundon | Interactive body suit and interactive limb covers |
BRPI0516847A (en) | 2004-10-11 | 2008-09-23 | Smm Medical Ab | electroactive compression bandage |
US8123624B2 (en) * | 2005-03-03 | 2012-02-28 | Theodore Weissenburger Caldwell | Shot Monitoring Watch |
US8139803B2 (en) | 2005-08-15 | 2012-03-20 | Immerz, Inc. | Systems and methods for haptic sound |
US20070050880A1 (en) * | 2005-08-17 | 2007-03-08 | Edoc Apparel Llc | System and method for interpretive garments |
ES2303744B1 (en) * | 2005-08-31 | 2009-07-23 | David Nieto Hernandez | PHYSICAL SENSATIONS TRANSMISSION SYSTEM. |
US20100201512A1 (en) * | 2006-01-09 | 2010-08-12 | Harold Dan Stirling | Apparatus, systems, and methods for evaluating body movements |
WO2007079777A1 (en) | 2006-01-13 | 2007-07-19 | Smm Medical Ab | Device, system and method for compression treatment of a body part |
EP1993437A4 (en) * | 2006-02-24 | 2014-05-14 | Hmicro Inc | A medical signal processing system with distributed wireless sensors |
TWI434718B (en) * | 2006-12-07 | 2014-04-21 | Cel Kom Llc | Tactile wearable gaming device |
US8652040B2 (en) | 2006-12-19 | 2014-02-18 | Valencell, Inc. | Telemetric apparatus for health and environmental monitoring |
US8157730B2 (en) | 2006-12-19 | 2012-04-17 | Valencell, Inc. | Physiological and environmental monitoring systems and methods |
CA2618942A1 (en) * | 2007-01-24 | 2008-07-24 | Splitfish Gameware Inc. | Game controller with tactile feedback |
WO2008089787A1 (en) | 2007-01-24 | 2008-07-31 | Smm Medical Ab | An elastomeric particle having an electrically conducting surface, a pressure sensor comprising said particles, a method for producing said sensor and a sensor system comprising sais sensors |
US20090233710A1 (en) * | 2007-03-12 | 2009-09-17 | Roberts Thomas J | Feedback gaming peripheral |
US8033916B2 (en) * | 2007-05-04 | 2011-10-11 | Theodore Caldwell | Grip pressure sensor |
WO2009026289A2 (en) * | 2007-08-20 | 2009-02-26 | Hmicro, Inc. | Wearable user interface device, system, and method of use |
US8926509B2 (en) * | 2007-08-24 | 2015-01-06 | Hmicro, Inc. | Wireless physiological sensor patches and systems |
US8611319B2 (en) | 2007-10-24 | 2013-12-17 | Hmicro, Inc. | Methods and apparatus to retrofit wired healthcare and fitness systems for wireless operation |
US20110019824A1 (en) * | 2007-10-24 | 2011-01-27 | Hmicro, Inc. | Low power radiofrequency (rf) communication systems for secure wireless patch initialization and methods of use |
US8251903B2 (en) | 2007-10-25 | 2012-08-28 | Valencell, Inc. | Noninvasive physiological analysis using excitation-sensor modules and related devices and methods |
US20090150158A1 (en) * | 2007-12-06 | 2009-06-11 | Becker Craig H | Portable Networked Picting Device |
US20090156308A1 (en) * | 2007-12-17 | 2009-06-18 | Hsu Kent T J | Foot-actuated mat with flashing indicators for video game console |
US20090251407A1 (en) * | 2008-04-03 | 2009-10-08 | Microsoft Corporation | Device interaction with combination of rings |
US8250454B2 (en) * | 2008-04-03 | 2012-08-21 | Microsoft Corporation | Client-side composing/weighting of ads |
US20090289937A1 (en) * | 2008-05-22 | 2009-11-26 | Microsoft Corporation | Multi-scale navigational visualtization |
US8682736B2 (en) | 2008-06-24 | 2014-03-25 | Microsoft Corporation | Collection represents combined intent |
US8380561B1 (en) * | 2008-07-30 | 2013-02-19 | Immersion Corporation | Method and apparatus for scoring haptic devices |
IT1394880B1 (en) * | 2009-01-05 | 2012-07-20 | Fond Istituto Italiano Di Tecnologia | WEARABLE DEVICE AND ITS RELATED SYSTEM FOR DETECTION AND GUIDANCE OF THE MOVEMENTS OF A USER. |
US8376858B2 (en) * | 2009-02-20 | 2013-02-19 | Sony Computer Entertainment America Llc | System and method for communicating game information between a portable gaming device and a game controller |
US9750462B2 (en) | 2009-02-25 | 2017-09-05 | Valencell, Inc. | Monitoring apparatus and methods for measuring physiological and/or environmental conditions |
US8788002B2 (en) | 2009-02-25 | 2014-07-22 | Valencell, Inc. | Light-guiding devices and monitoring devices incorporating same |
US8700111B2 (en) | 2009-02-25 | 2014-04-15 | Valencell, Inc. | Light-guiding devices and monitoring devices incorporating same |
WO2010106435A1 (en) * | 2009-03-20 | 2010-09-23 | Pub Company S.R.L. | Video game hardware systems and software methods using electroencephalography |
JP5639151B2 (en) | 2009-04-15 | 2014-12-10 | コーニンクレッカ フィリップス エヌ ヴェ | Foldable tactile display |
WO2012007860A1 (en) * | 2010-07-16 | 2012-01-19 | Koninklijke Philips Electronics N.V. | Device including a multi-actuator haptic surface for providing haptic effects on said surface. |
PT105469A (en) * | 2011-01-04 | 2012-11-19 | Marta Isabel Santos Paiva Ferraz Da Conceicao | INTERACTIVE FACT FOR VIDEO GAMES IN WHICH ELECTRONIC SENSORS AND PHYSICAL OBJECTS ARE USED |
US8888701B2 (en) | 2011-01-27 | 2014-11-18 | Valencell, Inc. | Apparatus and methods for monitoring physiological data during environmental interference |
ES1074734Y (en) * | 2011-04-13 | 2011-09-27 | Casado Miguel Angel Roncero | DRESS WITH SENSORY AND / OR MECHANICAL EFFECTS |
WO2013016007A2 (en) | 2011-07-25 | 2013-01-31 | Valencell, Inc. | Apparatus and methods for estimating time-state physiological parameters |
US9801552B2 (en) | 2011-08-02 | 2017-10-31 | Valencell, Inc. | Systems and methods for variable filter adjustment by heart rate metric feedback |
US20140049487A1 (en) * | 2012-08-17 | 2014-02-20 | Qualcomm Incorporated | Interactive user interface for clothing displays |
CN110013239A (en) | 2013-01-28 | 2019-07-16 | 瓦伦赛尔公司 | Physiological monitoring device with the sensing element disengaged with body kinematics |
CN104994919B (en) * | 2013-02-07 | 2017-11-21 | 马卡里 | Special-shaped attachment and system in a kind of game for laser gunfight |
US9486272B2 (en) * | 2013-03-12 | 2016-11-08 | Biosense Webster (Israel) Ltd. | Force feedback device and method for catheters |
US9443401B2 (en) * | 2013-09-06 | 2016-09-13 | Immersion Corporation | Automatic remote sensing and haptic conversion system |
US20150105129A1 (en) * | 2013-10-15 | 2015-04-16 | Kevin Chapman | Video Game Body Suit |
FR3013443B1 (en) | 2013-11-15 | 2016-04-29 | Michelin Travel Partner | METHOD AND SYSTEM FOR SENSITIVE NAVIGATION |
AU2014100006A4 (en) | 2014-01-03 | 2014-02-13 | Wearable Experiments Pty Ltd | Fan Garment |
CN106687885B (en) * | 2014-05-15 | 2020-03-03 | 联邦快递公司 | Wearable device for messenger processing and method of use thereof |
US20160029898A1 (en) | 2014-07-30 | 2016-02-04 | Valencell, Inc. | Physiological Monitoring Devices and Methods Using Optical Sensors |
WO2016022295A1 (en) | 2014-08-06 | 2016-02-11 | Valencell, Inc. | Optical physiological sensor modules with reduced signal noise |
US9799177B2 (en) * | 2014-09-23 | 2017-10-24 | Intel Corporation | Apparatus and methods for haptic covert communication |
US9794653B2 (en) | 2014-09-27 | 2017-10-17 | Valencell, Inc. | Methods and apparatus for improving signal quality in wearable biometric monitoring devices |
DE102014015103A1 (en) * | 2014-10-10 | 2016-04-14 | Marc Ebel | Device for head mounted displays |
US9627804B2 (en) | 2014-12-19 | 2017-04-18 | Intel Corporation | Snap button fastener providing electrical connection |
US9958903B2 (en) * | 2015-04-29 | 2018-05-01 | Sony Mobile Communications Inc. | Providing a representation of orientation and movement of an item being moved in space |
US20170055596A1 (en) * | 2015-08-28 | 2017-03-02 | Raquel Smith Colby | Smart Clothing for Simulated Touch and Concussive Force |
EP3356003A4 (en) * | 2015-10-01 | 2019-04-03 | Mc10, Inc. | Method and system for interacting with a virtual environment |
US10945618B2 (en) | 2015-10-23 | 2021-03-16 | Valencell, Inc. | Physiological monitoring devices and methods for noise reduction in physiological signals based on subject activity type |
US10610158B2 (en) | 2015-10-23 | 2020-04-07 | Valencell, Inc. | Physiological monitoring devices and methods that identify subject activity type |
WO2017095951A1 (en) | 2015-11-30 | 2017-06-08 | Nike Innovate C.V. | Apparel with ultrasonic position sensing and haptic feedback for activities |
CN105536249B (en) * | 2016-02-18 | 2023-09-01 | 高创(苏州)电子有限公司 | game system |
JP2017182495A (en) * | 2016-03-30 | 2017-10-05 | ソニー株式会社 | Information processing device, information processing method and program |
DE202016003692U1 (en) * | 2016-06-10 | 2017-09-12 | Kuka Roboter Gmbh | Haptic feedback devices for a manipulator system |
WO2018009736A1 (en) | 2016-07-08 | 2018-01-11 | Valencell, Inc. | Motion-dependent averaging for physiological metric estimating systems and methods |
US10699538B2 (en) * | 2016-07-27 | 2020-06-30 | Neosensory, Inc. | Method and system for determining and providing sensory experiences |
EP3509549A4 (en) | 2016-09-06 | 2020-04-01 | Neosensory, Inc. | Method and system for providing adjunct sensory information to a user |
WO2018047102A1 (en) * | 2016-09-09 | 2018-03-15 | Ecole Polytechnique Federale De Lausanne (Epfl) | Jacket for embodied interaction with virtual or distal robotic device |
CN110520040B (en) * | 2017-01-27 | 2022-05-31 | 西北大学 | Epidermis virtual reality device |
US10181331B2 (en) | 2017-02-16 | 2019-01-15 | Neosensory, Inc. | Method and system for transforming language inputs into haptic outputs |
US10744058B2 (en) * | 2017-04-20 | 2020-08-18 | Neosensory, Inc. | Method and system for providing information to a user |
CN107219919A (en) * | 2017-05-10 | 2017-09-29 | 北京小鸟看看科技有限公司 | A kind of virtual reality body-sensing method and system, wear display device and wearable device |
CN109985379A (en) * | 2017-12-30 | 2019-07-09 | 广州大正新材料科技有限公司 | A kind of game effect expression system and its application method based on body-sensing clothes |
US10627896B1 (en) * | 2018-10-04 | 2020-04-21 | International Business Machines Coporation | Virtual reality device |
US10437340B1 (en) | 2019-01-29 | 2019-10-08 | Sean Sullivan | Device for providing thermoreceptive haptic feedback |
WO2021062276A1 (en) | 2019-09-25 | 2021-04-01 | Neosensory, Inc. | System and method for haptic stimulation |
AT17923U1 (en) * | 2019-10-15 | 2023-08-15 | Katerina Sedlackova Ma | garment |
US11467668B2 (en) | 2019-10-21 | 2022-10-11 | Neosensory, Inc. | System and method for representing virtual object information with haptic stimulation |
LT3960260T (en) | 2019-11-04 | 2023-08-10 | Boreal Technology & Investment S.L | Wearable device and method thereof |
WO2021142162A1 (en) | 2020-01-07 | 2021-07-15 | Neosensory, Inc. | Method and system for haptic stimulation |
CN111383313B (en) * | 2020-03-31 | 2023-05-12 | 歌尔股份有限公司 | Virtual model rendering method, device, equipment and readable storage medium |
US11925433B2 (en) * | 2020-07-17 | 2024-03-12 | Daniel Hertz S.A. | System and method for improving and adjusting PMC digital signals to provide health benefits to listeners |
US11497675B2 (en) | 2020-10-23 | 2022-11-15 | Neosensory, Inc. | Method and system for multimodal stimulation |
US11862147B2 (en) | 2021-08-13 | 2024-01-02 | Neosensory, Inc. | Method and system for enhancing the intelligibility of information for a user |
US20230062315A1 (en) * | 2021-08-30 | 2023-03-02 | Msg Entertainment Group, Llc | Live venue performance sensor capture and visualization over game network |
CN114176534A (en) * | 2021-11-25 | 2022-03-15 | 爱其服(杭州)科技有限公司 | Intelligent wearing system for metacarpal space |
KR20230123219A (en) * | 2022-02-16 | 2023-08-23 | 한국전자통신연구원 | System and method for reproducing tactile content using spatial information |
CN116909392B (en) * | 2023-06-30 | 2024-01-26 | 青岛登云智上科技有限公司 | Wearable and perceivable interaction system and interaction method |
CN117180720B (en) * | 2023-11-07 | 2024-01-05 | 成都孚谦科技有限公司 | Virtual action game interaction system and method based on somatosensory tracker technology |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5565840A (en) * | 1994-09-21 | 1996-10-15 | Thorner; Craig | Tactile sensation generator |
US5588139A (en) * | 1990-06-07 | 1996-12-24 | Vpl Research, Inc. | Method and system for generating objects for a multi-person virtual world using data flow networks |
US6135450A (en) * | 1998-02-09 | 2000-10-24 | Huang; Cheng-Pin | Wearable vibration device for video games |
US20010040590A1 (en) * | 1998-12-18 | 2001-11-15 | Abbott Kenneth H. | Thematic response to a computer user's context, such as by a wearable personal computer |
US6422941B1 (en) * | 1994-09-21 | 2002-07-23 | Craig Thorner | Universal tactile feedback system for computer video games and simulations |
US6563487B2 (en) * | 1998-06-23 | 2003-05-13 | Immersion Corporation | Haptic feedback for directional control pads |
US20030125110A1 (en) * | 2001-12-27 | 2003-07-03 | Lalley Timothy J. | Games utilizing electronic display strips and methods of making display strips |
US6695770B1 (en) * | 1999-04-01 | 2004-02-24 | Dominic Kin Leung Choy | Simulated human interaction systems |
US6786863B2 (en) * | 2001-06-07 | 2004-09-07 | Dadt Holdings, Llc | Method and apparatus for remote physical contact |
US20040229702A1 (en) * | 1999-05-21 | 2004-11-18 | Cooke Michael Charles | Feedback assembly for computer games |
US7046151B2 (en) * | 2003-07-14 | 2006-05-16 | Michael J. Dundon | Interactive body suit and interactive limb covers |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0468340A3 (en) * | 1990-07-24 | 1992-12-16 | Biocontrol Systems, Inc. | Eye directed controller |
NL1004195C1 (en) * | 1996-10-04 | 1998-04-07 | Christine Karman | System for transmitting touch sensation via a computer network. |
US6522417B1 (en) * | 1997-04-28 | 2003-02-18 | Matsushita Electric Industrial Co., Ltd. | Communication terminal device that processes received images and transmits physical quantities that affect the receiving communication terminal device |
FR2786899B1 (en) * | 1998-12-03 | 2006-09-29 | Jean Bonnard | MOVEMENT INDICATOR FOR SOFTWARE |
EP1314102B1 (en) * | 2000-04-02 | 2009-06-03 | Tangis Corporation | Thematic response to a computer user's context, such as by a wearable personal computer |
FR2819371B1 (en) * | 2001-01-10 | 2004-04-02 | Medialux | COMPUTER OR TELEPHONE INTEGRATED IN A GARMENT |
-
2003
- 2003-11-24 EP EP03026896A patent/EP1533678A1/en not_active Withdrawn
-
2004
- 2004-11-22 US US10/995,001 patent/US20050113167A1/en not_active Abandoned
-
2009
- 2009-01-21 US US12/357,184 patent/US20090131165A1/en not_active Abandoned
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5588139A (en) * | 1990-06-07 | 1996-12-24 | Vpl Research, Inc. | Method and system for generating objects for a multi-person virtual world using data flow networks |
US5565840A (en) * | 1994-09-21 | 1996-10-15 | Thorner; Craig | Tactile sensation generator |
US6422941B1 (en) * | 1994-09-21 | 2002-07-23 | Craig Thorner | Universal tactile feedback system for computer video games and simulations |
US6135450A (en) * | 1998-02-09 | 2000-10-24 | Huang; Cheng-Pin | Wearable vibration device for video games |
US6563487B2 (en) * | 1998-06-23 | 2003-05-13 | Immersion Corporation | Haptic feedback for directional control pads |
US20010040590A1 (en) * | 1998-12-18 | 2001-11-15 | Abbott Kenneth H. | Thematic response to a computer user's context, such as by a wearable personal computer |
US6695770B1 (en) * | 1999-04-01 | 2004-02-24 | Dominic Kin Leung Choy | Simulated human interaction systems |
US20040229702A1 (en) * | 1999-05-21 | 2004-11-18 | Cooke Michael Charles | Feedback assembly for computer games |
US6786863B2 (en) * | 2001-06-07 | 2004-09-07 | Dadt Holdings, Llc | Method and apparatus for remote physical contact |
US20030125110A1 (en) * | 2001-12-27 | 2003-07-03 | Lalley Timothy J. | Games utilizing electronic display strips and methods of making display strips |
US7046151B2 (en) * | 2003-07-14 | 2006-05-16 | Michael J. Dundon | Interactive body suit and interactive limb covers |
Cited By (100)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130073305A1 (en) * | 2001-09-15 | 2013-03-21 | Stmicroelectronics S.R.L. | Multimedia tagging system and method, related computer program product |
US20070063849A1 (en) * | 2005-09-02 | 2007-03-22 | Francesca Rosella | Wearable haptic telecommunication device and system |
US10185356B2 (en) * | 2008-08-29 | 2019-01-22 | Nec Corporation | Information input device, information input method, and information input program |
US20110134063A1 (en) * | 2008-08-29 | 2011-06-09 | Shin Norieda | Information input device, information input method, and information input program |
US8624836B1 (en) * | 2008-10-24 | 2014-01-07 | Google Inc. | Gesture-based small device input |
US9292097B1 (en) | 2008-10-24 | 2016-03-22 | Google Inc. | Gesture-based small device input |
US11307718B2 (en) | 2008-10-24 | 2022-04-19 | Google Llc | Gesture-based small device input |
US10139915B1 (en) | 2008-10-24 | 2018-11-27 | Google Llc | Gesture-based small device input |
US10852837B2 (en) | 2008-10-24 | 2020-12-01 | Google Llc | Gesture-based small device input |
US20180233226A1 (en) * | 2008-12-12 | 2018-08-16 | Immersion Corporation | Method and apparatus for providing a haptic monitoring system using multiple sensors |
US9727139B2 (en) | 2008-12-12 | 2017-08-08 | Immersion Corporation | Method and apparatus for providing a haptic monitoring system using multiple sensors |
US20100152620A1 (en) * | 2008-12-12 | 2010-06-17 | Immersion Corporation | Method and Apparatus for Providing A Haptic Monitoring System Using Multiple Sensors |
US9504914B2 (en) * | 2009-01-06 | 2016-11-29 | Immersion Corporation | Programmable game-based haptic enabled gun controller |
US20130331157A1 (en) * | 2009-01-06 | 2013-12-12 | Immersion Corporation | Programmable game-based haptic enabled gun controller |
US20120086550A1 (en) * | 2009-02-24 | 2012-04-12 | Leblanc Donald Joseph | Pedobarographic biometric system |
US20100315228A1 (en) * | 2009-06-16 | 2010-12-16 | Honeywell International Inc. | Wearable data hub for first responders |
US11416120B2 (en) * | 2009-07-08 | 2022-08-16 | Steelseries Aps | Apparatus and method for managing operations of accessories |
US11709582B2 (en) | 2009-07-08 | 2023-07-25 | Steelseries Aps | Apparatus and method for managing operations of accessories |
US20150164322A1 (en) * | 2009-09-01 | 2015-06-18 | Adidas Ag | Multi modal method and system for transmitting information about a subject |
US9826903B2 (en) * | 2009-09-01 | 2017-11-28 | Adidas Ag | Multi modal method and system for transmitting information about a subject |
US8892220B2 (en) * | 2009-09-30 | 2014-11-18 | Iluminate Llc | Self-contained, wearable light controller with wireless communication interface |
US20120078393A1 (en) * | 2009-09-30 | 2012-03-29 | Miral Kotb | Self-contained, wearable light controller with wireless communication interface |
US20120242478A1 (en) * | 2009-12-16 | 2012-09-27 | Weng Onn Chen | Digital electronic second identity for vehicle |
US20110193703A1 (en) * | 2010-02-08 | 2011-08-11 | Adriana Payton | Wearable fluid-sensitive hygiene compliance device |
US20130337920A1 (en) * | 2010-02-27 | 2013-12-19 | Thuuz, LLC | Method and system for an online performance service with recommendation module |
US20110212756A1 (en) * | 2010-02-27 | 2011-09-01 | Thuuz, LLC | Method and system for an online performance service with recommendation module |
US8535131B2 (en) * | 2010-02-27 | 2013-09-17 | Thuuz, LLC | Method and system for an online performance service with recommendation module |
US9050537B2 (en) * | 2010-02-27 | 2015-06-09 | Thuuz, Inc. | Method and system for an online performance service with recommendation module |
US20140043228A1 (en) * | 2010-03-31 | 2014-02-13 | Immersion Corporation | System and method for providing haptic stimulus based on position |
US9987555B2 (en) * | 2010-03-31 | 2018-06-05 | Immersion Corporation | System and method for providing haptic stimulus based on position |
US8550905B2 (en) * | 2011-04-11 | 2013-10-08 | Sony Computer Entertainment Inc. | Temperature feedback motion controller |
US20120258800A1 (en) * | 2011-04-11 | 2012-10-11 | Sony Computer Entertainment Inc. | Temperature feedback motion controller |
US20140114445A1 (en) * | 2011-06-16 | 2014-04-24 | Fondazione Istituto Italiano Di Tecnologia | Interface system for man-machine interaction |
US20130328783A1 (en) * | 2011-06-30 | 2013-12-12 | Sheridan Martin | Transmission of information to smart fabric ouput device |
US9501918B2 (en) | 2011-08-24 | 2016-11-22 | Safetyminded Holdings, Inc. | Human safety indicator |
US20130222139A1 (en) * | 2011-08-24 | 2013-08-29 | Safetyminded Holdings, Inc. | Human safety indicator |
US9183719B2 (en) * | 2011-08-24 | 2015-11-10 | Safetyminded Holdings, Inc. | Human safety indicator |
US9324327B2 (en) | 2012-02-29 | 2016-04-26 | Nant Holdings Ip, Llc | Spoken control for user construction of complex behaviors |
US9026441B2 (en) * | 2012-02-29 | 2015-05-05 | Nant Holdings Ip, Llc | Spoken control for user construction of complex behaviors |
US20130226580A1 (en) * | 2012-02-29 | 2013-08-29 | Fluential, Llc | Spoken control for user construction of complex behaviors |
US11701585B2 (en) | 2013-03-15 | 2023-07-18 | Steelseries Aps | Gaming device with independent gesture-sensitive areas |
US10225721B2 (en) * | 2013-05-08 | 2019-03-05 | Natalya Segal | Smart wearable devices and system therefor |
US9955286B2 (en) * | 2013-05-08 | 2018-04-24 | Natalya Segal | Smart wearable devices and system therefor |
US20150324181A1 (en) * | 2013-05-08 | 2015-11-12 | Natalya Segal | Smart wearable devices and system therefor |
US11209906B2 (en) | 2013-07-15 | 2021-12-28 | Vr Electronics Limited | Method and wearable apparatus for synchronizing a user with a virtual environment |
US10761608B2 (en) | 2013-07-15 | 2020-09-01 | Vr Electronics Limited | Method and wearable apparatus for synchronizing a user with a virtual environment |
US10467926B2 (en) * | 2013-10-07 | 2019-11-05 | Mc10, Inc. | Conformal sensor systems for sensing and analysis |
US11759389B2 (en) * | 2013-12-31 | 2023-09-19 | Iftech Inventing Future Technology, Inc. | Wearable devices, systems, methods and architectures for sensory stimulation and manipulation and physiological data acquisition |
US11876241B2 (en) | 2014-01-15 | 2024-01-16 | Lat Enterprises, Inc. | System for supplying power to a portable battery using at least one solar panel |
US11955779B2 (en) | 2014-01-15 | 2024-04-09 | Lat Enterprises, Inc. | Portable battery pack |
US10944140B2 (en) | 2014-01-15 | 2021-03-09 | Lat Enterprises, Inc. | Wearable and replaceable pouch or skin for holding a portable battery pack |
US11876354B2 (en) | 2014-01-15 | 2024-01-16 | Lat Enterprises, Inc. | Wearable and replaceable pouch or skin for holding a portable battery pack |
US20150206322A1 (en) * | 2014-01-23 | 2015-07-23 | Kiomars Anvari | Fast image sensor for body protection gear or equipment |
US9444988B2 (en) * | 2014-01-23 | 2016-09-13 | Kiomars Anvari | Fast image sensor for body protection gear or equipment |
US20150277563A1 (en) * | 2014-03-28 | 2015-10-01 | Wen-Ling M. Huang | Dynamic tactile user interface |
US20150289034A1 (en) * | 2014-04-08 | 2015-10-08 | Matthew A.F. Engman | Event entertainment system |
US10412470B2 (en) * | 2014-04-08 | 2019-09-10 | Matthew A. F. Engman | Event entertainment system |
US9679546B2 (en) * | 2014-05-16 | 2017-06-13 | Not Impossible LLC | Sound vest |
US20150332659A1 (en) * | 2014-05-16 | 2015-11-19 | Not Impossible LLC | Sound vest |
US9786201B2 (en) * | 2014-05-16 | 2017-10-10 | Not Impossible LLC | Wearable sound |
US11625994B2 (en) | 2014-05-16 | 2023-04-11 | Not Impossible, Llc | Vibrotactile control systems and methods |
US10964179B2 (en) | 2014-05-16 | 2021-03-30 | Not Impossible, Llc | Vibrotactile control systems and methods |
US20160027338A1 (en) * | 2014-05-16 | 2016-01-28 | Not Impossible LLC | Wearable sound |
US10564730B2 (en) * | 2014-05-19 | 2020-02-18 | Immersion Corporation | Non-collocated haptic cues in immersive environments |
US20180364807A1 (en) * | 2014-06-05 | 2018-12-20 | Immersion Corporation | Systems and Methods for Induced Electrostatic Haptic Effects |
WO2016033512A1 (en) * | 2014-08-28 | 2016-03-03 | Georgia Tech Research Corporation | Physical interactions through information infrastructures integrated in fabrics and garments |
US10052029B2 (en) * | 2014-09-11 | 2018-08-21 | General Electric Company | Infant patient transfer device with temperature sensor |
US11403264B2 (en) * | 2014-09-12 | 2022-08-02 | Verily Life Sciences Llc | Long-term data storage service for wearable device data |
US11955825B2 (en) | 2014-10-16 | 2024-04-09 | Lat Enterprises, Inc. | Portable power case with lithium iron phosphate battery |
US11800067B2 (en) | 2014-10-16 | 2023-10-24 | Lat Enterprises, Inc. | Personal tactical system including a power distribution and data hub and network of personal tactical systems |
US10616534B2 (en) * | 2014-10-16 | 2020-04-07 | Lat Enterprises, Inc. | Personal tactical system and network |
US10951865B2 (en) | 2014-10-16 | 2021-03-16 | Lat Enterprises, Inc. | Personal tactical system including a power distribution and data hub and network of personal tactical systems |
US11876161B2 (en) | 2014-10-16 | 2024-01-16 | Lat Enterprises, Inc. | Material for dissipating heat from and/or reducing heat signature of electronic devices and clothing |
US11049380B2 (en) * | 2015-01-13 | 2021-06-29 | Robert Kaindl | Personal safety device, method and article |
US20160278444A1 (en) * | 2015-03-24 | 2016-09-29 | Intel Corporation | Smart clothing |
WO2017010697A1 (en) * | 2015-07-11 | 2017-01-19 | 홍선기 | Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same |
US11450429B2 (en) | 2015-07-11 | 2022-09-20 | Sun Ki Hong | Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same |
US10157487B2 (en) | 2015-07-30 | 2018-12-18 | International Business Machines Corporation | VR biometric integration |
TWI562811B (en) * | 2015-11-09 | 2016-12-21 | Univ Nan Kai Technology | Intelligent starting system of interactive game and method thereof |
US10786731B2 (en) * | 2015-11-24 | 2020-09-29 | Razer (Asia-Pacific) Pte. Ltd. | Wearable devices, methods for controlling a wearable device, and computer-readable media |
WO2017091141A1 (en) * | 2015-11-24 | 2017-06-01 | Razer (Asia-Pacific) Pte. Ltd. | Wearable devices, methods for controlling a wearable device, and computer-readable media |
US10105594B2 (en) * | 2016-06-17 | 2018-10-23 | Disney Enterprises, Inc. | Wearable garments recognition and integration with an interactive gaming system |
US11118819B2 (en) | 2016-10-31 | 2021-09-14 | Tegway Co., Ltd. | Feedback device and thermal feedback providing method using same |
US11747056B2 (en) | 2016-10-31 | 2023-09-05 | Tegway Co., Ltd. | Feedback device and thermal feedback providing method using same |
US11191491B2 (en) * | 2016-10-31 | 2021-12-07 | Tegway Co., Ltd. | Feedback device and method for providing thermal feedback using the same |
US11813089B2 (en) | 2016-10-31 | 2023-11-14 | Tegway Co., Ltd. | Feedback device and method for providing thermal feedback using the same |
US11207032B2 (en) | 2016-10-31 | 2021-12-28 | Tegway Co., Ltd. | Feedback device and method for providing thermal feedback using the same |
US11612358B2 (en) | 2016-10-31 | 2023-03-28 | Tegway Co., Ltd. | Feedback device and method for providing thermal feedback using the same |
CN110199243A (en) * | 2016-10-31 | 2019-09-03 | 泰格韦有限公司 | For providing feedback device, the content playback unit, system and method for heat experience |
US11402915B2 (en) * | 2016-11-23 | 2022-08-02 | Google Llc | Providing mediated social interactions |
US20190317605A1 (en) * | 2016-11-23 | 2019-10-17 | Google Llc | Providing Mediated Social Interactions |
US10884502B2 (en) * | 2016-11-23 | 2021-01-05 | Google Llc | Providing mediated social interactions |
US10937284B2 (en) | 2017-01-23 | 2021-03-02 | Hewlett-Packard Development Company, L.P. | Somatosensory feedback system |
US20190201779A1 (en) * | 2017-12-28 | 2019-07-04 | Keith Vargo | App integrated wearable gaming board design |
US11315396B2 (en) | 2018-01-08 | 2022-04-26 | Robert Kaindl | Threat identification device and system with optional active countermeasures |
US11351451B2 (en) | 2018-08-22 | 2022-06-07 | Abdul Hotaki | System and methods for providing wireless feedback to a video game |
US10569167B1 (en) | 2018-08-22 | 2020-02-25 | Abdul Hotaki | System and methods for providing wireless feedback to a video game |
CN109710058A (en) * | 2018-11-27 | 2019-05-03 | 南京恩诺网络科技有限公司 | Tactile data recording method and device, system |
US20220343740A1 (en) * | 2019-09-26 | 2022-10-27 | Nippon Telegraph And Telephone Corporation | Vibration presentation apparatus |
CN112156448A (en) * | 2020-11-05 | 2021-01-01 | 王照斌 | Mutual wearing equipment is felt to artificial intelligence body |
Also Published As
Publication number | Publication date |
---|---|
EP1533678A1 (en) | 2005-05-25 |
US20050113167A1 (en) | 2005-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20090131165A1 (en) | Physical feedback channel for entertainment or gaming environments | |
US11157080B2 (en) | Detection device, detection method, control device, and control method | |
US10216474B2 (en) | Variable computing engine for interactive media based upon user biometrics | |
CN102473320B (en) | Bringing a visual representation to life via learned input from the user | |
CN100583007C (en) | Movable device with surface display information and interaction function | |
US20070149282A1 (en) | Interactive gaming method and apparatus with emotion perception ability | |
CN107077229B (en) | Human-machine interface device and system | |
US20170216675A1 (en) | Fitness-based game mechanics | |
US20130311132A1 (en) | Wearable computing device | |
CN104049746A (en) | Systems and methods for parameter modification of haptic effects | |
CN106878390B (en) | Electronic pet interaction control method and device and wearable equipment | |
WO2001012285A1 (en) | Networked toys | |
WO2018108174A1 (en) | Interface interactive assembly control method and apparatus, and wearable device | |
Salter | Sensing machines: How sensors shape our everyday life | |
Taheri et al. | Exploratory design of a hands-free video game controller for a quadriplegic individual | |
US20130014055A1 (en) | Device and method for inducing use | |
Taheri et al. | Designing a first person shooter game for quadriplegics | |
TWM600411U (en) | Behavior data processing system | |
Ossmann et al. | AsTeRICS, a flexible AT construction set | |
CN111610857A (en) | Gloves with interactive installation is felt to VR body | |
Pagliarini et al. | Wearable playware | |
US20240036619A1 (en) | Systems and methods to select an action using a handheld device by perceptual association | |
KR102431050B1 (en) | An Artificial Intelligence Type of a Game System for Improving a Brain Cognitive Skill | |
Cheok et al. | Huggy pajama: A remote interactive touch and hugging system | |
Shultz et al. | Designing for haptics |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |