WO2003023702A2 - Computer input device using an orientation sensor - Google Patents

Computer input device using an orientation sensor Download PDF

Info

Publication number
WO2003023702A2
WO2003023702A2 PCT/GB2002/004063 GB0204063W WO03023702A2 WO 2003023702 A2 WO2003023702 A2 WO 2003023702A2 GB 0204063 W GB0204063 W GB 0204063W WO 03023702 A2 WO03023702 A2 WO 03023702A2
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
control member
controlling
camera
analysing
Prior art date
Application number
PCT/GB2002/004063
Other languages
French (fr)
Other versions
WO2003023702A3 (en
Inventor
Eugenio Bustamante
Original Assignee
4D Technology Systems Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 4D Technology Systems Limited filed Critical 4D Technology Systems Limited
Priority to AU2002321622A priority Critical patent/AU2002321622A1/en
Publication of WO2003023702A2 publication Critical patent/WO2003023702A2/en
Publication of WO2003023702A3 publication Critical patent/WO2003023702A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1006—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals having additional degrees of freedom
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1043—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being characterized by constructional details
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light

Definitions

  • This invention relates to means for controlling electronic devices such as games consoles or the like.
  • a joystick or keypad usually integrated into the device.
  • the device may have an integrated display screen, or be connected to a separate display monitor, which displays the game being played. Movement of the joystick or depression of buttons on the keypad sends control signals to the device.
  • One disadvantage of the joystick and the keypad is that they may not be easy to use, especially for users with disabilities affecting the fine motor control of the hands .
  • a means for controlling an electronic device comprises a control member adapted to be held and moved in space by a user, and having at least one characteristic enabling its orientation in space to be determined, a camera means for detecting the position of the control member with respect to time, means for analysing the positional information to ascertain movement of the control member, and means for generating control signals for the electronic device in response to the movement of the control member.
  • the position of the control member at any point in time is detected by the camera means.
  • the orienting characteristic on the control member means that movement can be deduced from the positional information and translated into control signals for the device.
  • the control member has a greater freedom of movement than the normal joystick or keypad. For example, it can be moved bodily in space up or down, side to side, and towards or away from the camera means. It can also be rotated. Each of these movements can be detected and used to generate control signals for the device. Where the device is a games console, different movements can be used to move a character and perform other functions such as selecting a mode of firing a weapon.
  • the control member is easy to use, as it does not rely significantly on fine motor control.
  • the control member may comprise at least two spokes radiating from a central axis, with at least one spoke having an orienting characteristic. Preferably four spokes are provided, although there could be as many as eight.
  • the orienting characteristic is preferably provided on the outer end of at least one spoke.
  • the orienting characteristic comprises at least one distinguishing shape or mark.
  • Each orienting characteristic may comprise a mark such as a cross, circle, triangle or square.
  • the orienting characteristic may be the shape of the spoke. For example, one spoke could be longer than the rest, or of a different outline. Different colours may also be used as well as other distinctions.
  • the outer ends of the spokes may be joined by a ring.
  • the control member may also include a handle on its rear side.
  • the preferred control member with four spokes enables rotation of the control member about the central axis (i.e. in the plane of the spokes) to be detected, as well as inclination of the spokes to the plane.
  • the analysing means use algorithms to deduce the movement of the control member from the positional information acquired by the camera means.
  • the analysing means may be executed as software, or hardware such as microprocessors.
  • the signal generating means uses the movements analysed by the analysing means to generate appropriate control signals for operating the device.
  • the generating means is preferably executed as software. It may generate signals which emulate those of existing game consoles, enabling the control member to be used with existing game consoles.
  • the camera means preferably comprises a stereoscopic camera array, having a pair of pinhole cameras whose optical properties are known. The images from the two cameras are combined to provide an accurate representation of the position of the control member in space, so that its movement can also be accurately analysed.
  • one camera may be used. Again, its optical properties are known. With one camera, movement towards and away from the camera is more difficult to analyse than with two. However, large movements towards or away from the camera can be detected, by looking at the change in surface area, and comparing the current dimensions of the control member with those for a given distance from the camera, which will be known. The other movements (up or down, side to side, rotation and inclination) can be determined accurately by comparing the camera image with an ideal image of the control member at a fixed position.
  • the analysing means stores the size and shape of the control member. This enables more accurate analysis of the movement of the control member to be made.
  • the camera image can be compared with the stored ideal image to determine the location and orientation of the control member.
  • the camera means and the analysing and generating means are preferably combined into a single unit. This may be integrated into a games console.
  • the camera means and the analysing and generating means may be separate and adapted to be joined to a console by appropriate leads.
  • Figure 1 is a schematic illustration of a control means for an electronic device
  • FIG. 1 shows the control member in detail
  • Figure 3 is similar to Figure 1 , but shows a modification
  • Figure 4 shows a modified control member
  • Figure 1 shows a schematic view of a means for controlling an electronic device such as a games console 1.
  • the games console 1 is connected by appropriate leads 2 to a monitor 3 on which the game being played is displayed.
  • the control means has a control member 4 which is held and moved in space by a user (not shown) and has characteristics enabling its orientation in space to be determined.
  • a camera means 5 detects the position of the control member 4 over time, analysing means 6 analyses the positional information to ascertain the movement of the control member 4, and generating means 7 generates control signals for the device 1 in response to movement of the control member 4.
  • the control member 4 is shown in more detail in Figure 2. It comprises a plastics member having four spokes 8, 9, 10, 11 radiating in a cross- shape from a central axis A. Each spoke has on its respective outer end of its front face an orienting characteristic 12, 13, 14, 15. The orienting characteristics are a different colour from the spokes, and each has a different shape. In this case they are a cross, a square, a triangle, and a circle, but it will be appreciated that any suitable shapes could be used.
  • the control member 4 also has on its rear face a handle (not shown) by which it can be held by the user.
  • the control member 4 can be moved bodily in space, and relative to the camera means 5, in the following ways: up or down, side to side, and towards or away from the camera means 5. In addition, it can be rotated about its central axis A (in the plane of the spokes 8, 9, 10, 11) or inclined to that plane.
  • the camera means 5 detects the position of the control member 4 as it is moved.
  • the camera means 5 is mounted on the console 1, and comprises a stereoscopic camera array of two pinhole cameras 16, 17 whose optical properties are known.
  • the images from the cameras 16, 17 are analysed by the analysing means 6, to ascertain the movements of the control member 4.
  • the analysing means 6 is integrated into the console 1 and is executed as hardware, such as a microprocessor, although it may be provided as software.
  • the analysing means 6 receives the images from the cameras 16, 17, and processes these to determine the position and orientation of the control member 4 at any given time.
  • the use of the stereoscope camera array means that the location of the control member 4 in space can be determined absolutely.
  • the analysing means 6 uses suitable algorithms to process the images, and holds an ideal image of the control member 4 at a given distance from the camera means 5 and with a given orientation, to assist in the processing. Comparison of one set of images with the previous one is used to determine movement.
  • changes in the position of the orienting characteristics in the plane of the spokes are used to determine the up or down and side to side movement of the control member 4, while changes in their size are used to determine the towards and away movement.
  • Angular movement of at least two of the orienting characteristics is used to determine rotation, and changes in their shape determine inclination.
  • the movement ascertained by the analysing means 6 is used by the generated means 7 to provide control signals for the console 1.
  • the generating means 7 is integrated into the console 1, and is executed as software.
  • the generating means 7 assigns each movement (as described above) a particular command to the games console 1 - for example movement of a character in the game, selection of a mode or the firing of a weapon.
  • the ability to rotate the control member 4 is particularly useful when the game simulates the driving of a vehicle.
  • FIG 3 shows a modification, where the games console 1 is separate from the control unit 20.
  • the camera means 5, analysing means 6 and generating means 7 are all housed in the control unit 20, which is connectable to the games console 1 by appropriate controller leads 21.
  • the generating means 7 are arranged to generate control signals which emulate those of an existing game controller (not shown), such as a joystick or keypad.
  • the camera means 5 comprises a single camera 22.
  • Figure 4 shows another embodiment of the control member 4, in which a ring 23 connects the outer ends of the spokes 8, 9, 10, 11. Otherwise the member 4 of Figure 4 is the same as that of Figure 2, and corresponding reference numerals have been applied to corresponding parts.
  • the ring 23 has advantages as it provides a further comparison item for processing of the image.
  • control member 4 could be modified in other ways (not shown) .
  • only one spoke need have the orienting characteristic, but more orienting characteristics increases accuracy.
  • the spokes could be of different shapes, so that the shape provides the orienting characteristic.
  • the control members 4 shown have four spokes, any number from two to eight would be possible. Whatever the size and shape of the control member 4, its dimensions must be held in the analysing means 6 to enable the analysis of its movements to be made.

Abstract

A means for controlling an electronic device (1) comprises a control member (4) adapted to be held and moved in space by a user. The control member (4) has at least one characteristic (12, 13, 14, 15) enabling its orientation in space to be determined. A camera means (5) detects the position of the control member (4) with respect to time and analysing means (6) analyses the positional information to ascertain the movement of the control member (4). Control signal generating means (7) generates control signals for the electronic device (1) in response to the analysed movement of the control member (4). The means can replace a conventional joystick or keypad, and is particularly useful for controlling games consoles and the like.

Description

CONTROLLING ELECTRONIC DEVICES
This invention relates to means for controlling electronic devices such as games consoles or the like.
Conventionally such electronic devices are controlled by a joystick or keypad, usually integrated into the device. The device may have an integrated display screen, or be connected to a separate display monitor, which displays the game being played. Movement of the joystick or depression of buttons on the keypad sends control signals to the device. One disadvantage of the joystick and the keypad is that they may not be easy to use, especially for users with disabilities affecting the fine motor control of the hands .
According to the present invention, a means for controlling an electronic device comprises a control member adapted to be held and moved in space by a user, and having at least one characteristic enabling its orientation in space to be determined, a camera means for detecting the position of the control member with respect to time, means for analysing the positional information to ascertain movement of the control member, and means for generating control signals for the electronic device in response to the movement of the control member.
The position of the control member at any point in time is detected by the camera means. The orienting characteristic on the control member means that movement can be deduced from the positional information and translated into control signals for the device. The control member has a greater freedom of movement than the normal joystick or keypad. For example, it can be moved bodily in space up or down, side to side, and towards or away from the camera means. It can also be rotated. Each of these movements can be detected and used to generate control signals for the device. Where the device is a games console, different movements can be used to move a character and perform other functions such as selecting a mode of firing a weapon. The control member is easy to use, as it does not rely significantly on fine motor control.
The control member may comprise at least two spokes radiating from a central axis, with at least one spoke having an orienting characteristic. Preferably four spokes are provided, although there could be as many as eight.
The orienting characteristic is preferably provided on the outer end of at least one spoke. Preferably, the orienting characteristic comprises at least one distinguishing shape or mark. Each orienting characteristic may comprise a mark such as a cross, circle, triangle or square. The orienting characteristic may be the shape of the spoke. For example, one spoke could be longer than the rest, or of a different outline. Different colours may also be used as well as other distinctions.
The outer ends of the spokes may be joined by a ring. The control member may also include a handle on its rear side.
The preferred control member with four spokes enables rotation of the control member about the central axis (i.e. in the plane of the spokes) to be detected, as well as inclination of the spokes to the plane.
Conveniently, the analysing means use algorithms to deduce the movement of the control member from the positional information acquired by the camera means. The analysing means may be executed as software, or hardware such as microprocessors. The signal generating means uses the movements analysed by the analysing means to generate appropriate control signals for operating the device. The generating means is preferably executed as software. It may generate signals which emulate those of existing game consoles, enabling the control member to be used with existing game consoles.
The camera means preferably comprises a stereoscopic camera array, having a pair of pinhole cameras whose optical properties are known. The images from the two cameras are combined to provide an accurate representation of the position of the control member in space, so that its movement can also be accurately analysed.
Alternatively, one camera may be used. Again, its optical properties are known. With one camera, movement towards and away from the camera is more difficult to analyse than with two. However, large movements towards or away from the camera can be detected, by looking at the change in surface area, and comparing the current dimensions of the control member with those for a given distance from the camera, which will be known. The other movements (up or down, side to side, rotation and inclination) can be determined accurately by comparing the camera image with an ideal image of the control member at a fixed position.
Preferably, the analysing means stores the size and shape of the control member. This enables more accurate analysis of the movement of the control member to be made. The camera image can be compared with the stored ideal image to determine the location and orientation of the control member.
The camera means and the analysing and generating means are preferably combined into a single unit. This may be integrated into a games console. The camera means and the analysing and generating means may be separate and adapted to be joined to a console by appropriate leads.
Various embodiments of the invention are illustrated, by way of example only, in the accompanying drawings in which:
Figure 1 is a schematic illustration of a control means for an electronic device;
Figure 2 shows the control member in detail;
Figure 3 is similar to Figure 1 , but shows a modification; and
Figure 4 shows a modified control member.
Figure 1 shows a schematic view of a means for controlling an electronic device such as a games console 1. The games console 1 is connected by appropriate leads 2 to a monitor 3 on which the game being played is displayed.
The control means has a control member 4 which is held and moved in space by a user (not shown) and has characteristics enabling its orientation in space to be determined. A camera means 5 detects the position of the control member 4 over time, analysing means 6 analyses the positional information to ascertain the movement of the control member 4, and generating means 7 generates control signals for the device 1 in response to movement of the control member 4.
The control member 4 is shown in more detail in Figure 2. It comprises a plastics member having four spokes 8, 9, 10, 11 radiating in a cross- shape from a central axis A. Each spoke has on its respective outer end of its front face an orienting characteristic 12, 13, 14, 15. The orienting characteristics are a different colour from the spokes, and each has a different shape. In this case they are a cross, a square, a triangle, and a circle, but it will be appreciated that any suitable shapes could be used. The control member 4 also has on its rear face a handle (not shown) by which it can be held by the user.
The control member 4 can be moved bodily in space, and relative to the camera means 5, in the following ways: up or down, side to side, and towards or away from the camera means 5. In addition, it can be rotated about its central axis A (in the plane of the spokes 8, 9, 10, 11) or inclined to that plane.
The camera means 5 detects the position of the control member 4 as it is moved. The camera means 5 is mounted on the console 1, and comprises a stereoscopic camera array of two pinhole cameras 16, 17 whose optical properties are known. The images from the cameras 16, 17 are analysed by the analysing means 6, to ascertain the movements of the control member 4.
The analysing means 6 is integrated into the console 1 and is executed as hardware, such as a microprocessor, although it may be provided as software. The analysing means 6 receives the images from the cameras 16, 17, and processes these to determine the position and orientation of the control member 4 at any given time. The use of the stereoscope camera array means that the location of the control member 4 in space can be determined absolutely. The analysing means 6 uses suitable algorithms to process the images, and holds an ideal image of the control member 4 at a given distance from the camera means 5 and with a given orientation, to assist in the processing. Comparison of one set of images with the previous one is used to determine movement. Thus, changes in the position of the orienting characteristics in the plane of the spokes are used to determine the up or down and side to side movement of the control member 4, while changes in their size are used to determine the towards and away movement. Angular movement of at least two of the orienting characteristics is used to determine rotation, and changes in their shape determine inclination.
The movement ascertained by the analysing means 6 is used by the generated means 7 to provide control signals for the console 1. The generating means 7 is integrated into the console 1, and is executed as software. The generating means 7 assigns each movement (as described above) a particular command to the games console 1 - for example movement of a character in the game, selection of a mode or the firing of a weapon. The ability to rotate the control member 4 is particularly useful when the game simulates the driving of a vehicle.
Thus, simple movements of the control member 4 can be used to send control signals to the games console 1, ensuring ease of use.
Figure 3 shows a modification, where the games console 1 is separate from the control unit 20. In Figure 3 the camera means 5, analysing means 6 and generating means 7 are all housed in the control unit 20, which is connectable to the games console 1 by appropriate controller leads 21. The generating means 7 are arranged to generate control signals which emulate those of an existing game controller (not shown), such as a joystick or keypad.
Further, in Figure 3 the camera means 5 comprises a single camera 22.
This, naturally, does not provide as much information as the pair of cameras 16, 17 of Figure 1 , as the position in the towards and away from camera direction is more difficult to detect. However, the camera image can be compared with the ideal image, and the difference in the surface area and size will give a good approximation of towards/away from distance. The other movements can be determined accurately by comparison with the ideal image, and comparison of one camera image with a previous one. Otherwise, the embodiment of Figure 3 is the same as that of Figure 1.
Figure 4 shows another embodiment of the control member 4, in which a ring 23 connects the outer ends of the spokes 8, 9, 10, 11. Otherwise the member 4 of Figure 4 is the same as that of Figure 2, and corresponding reference numerals have been applied to corresponding parts. The ring 23 has advantages as it provides a further comparison item for processing of the image.
It will be appreciated that the control member 4 could be modified in other ways (not shown) . For example, only one spoke need have the orienting characteristic, but more orienting characteristics increases accuracy. Alternatively, the spokes could be of different shapes, so that the shape provides the orienting characteristic. While the control members 4 shown have four spokes, any number from two to eight would be possible. Whatever the size and shape of the control member 4, its dimensions must be held in the analysing means 6 to enable the analysis of its movements to be made.

Claims

1. A means for controlling an electronic device (1) comprises a control member (4) adapted to be held by a user, characterised in that the control member (4) is adapted to be moved in space, and having at least one characteristic (12,13, 14,15) enabling its orientation in space to be determined, a camera means (5) for detecting the position of the control member (4) with respect to time, means for analysing (6) the positional information to ascertain movement of the control member (4) , and means for generating control signals (7) for the electronic device (1) in response to the movement of the control member (4) .
2. A means for controlling an electronic device as claimed in claim 1 , characterised in that the control member (4) comprises at least two spokes (8, 9, 10, 11) radiating from a central axis (A) with at least one spoke (8, 9, 10, 11) having an orienting characteristic (12, 13, 14, 15) .
3. A means for controlling an electronic device as claimed in claim 2, characterised in that the control member (4) comprises four spokes (8, 9, 10, 11) radiating from a central axis (A) with at least one spoke (8, 9, 10, 11) having an orienting characteristic (12, 13, 14, 15) .
4. A means for controlling an electronic device as claimed in claim 2 or claim 3, characterised in that the orienting characteristic (12, 13, 14, 15) of the control member (4) is located at an outer end of at least one spoke (8, 9, 10, 11) .
5. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the orienting characteristic (12, 13, 14, 15) of the control member (4) is at least one distinguishing shape or mark (12, 13, 14, 15) .
6. A means for controlling an electronic device as claimed in claim 2 or claim 3, characterised in that the orienting characteristic (12, 13, 14, 15) of the control member (4) is the shape or size of at least one spoke (8, 9, 10, 11) .
7. A means for controlling an electronic device as claimed in any of claims 1 to 3, characterised in that the orienting characteristic (12, 13, 14, 15) is the colouring of the control member (4) .
8. A means for controlling an electronic device as claimed in any of claims 2 to 7, characterised in that the spokes (8, 9, 10, 11) of the control member (4) are joined by a ring (23).
9. A means for controlling an electronic device as claimed in any preceding claim, characterised in that a handle is provided on the rear side of the control member (4) .
10. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the analysing means (6) uses algorithms to deduce the movement of the control member (4) from the positional information acquired by the camera means (5) .
11. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the analysing means (6) is executed as software.
12. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the analysing means (6) is executed as hardware.
13. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the signal generating means (7) uses the movements analysed by the analysing means (6) to generate appropriate control signals for operating the electronic device (1) .
14. A means for controlling an electronic device as claimed in claim 13, characterised in that the control signal generating means (7) is executed as software.
15. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the camera means (5) comprises a stereoscopic camera array, having a pair of pinhole cameras (16, 17) whose optical properties are known.
16. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the camera means (5) comprises a single camera (22) whose optical properties are known.
17. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the analysing means (6) stores the size and shape of the control member (4) .
18. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the camera means (5) and the analysing (6) and generating means (7) are combined into a single unit and integrated into a games console (1) .
19. A means for controlling an electronic device as claimed in any preceding claim, characterised in that the camera means (5) and the analysing (6) and generating means (7) are separate and adapted to be joined to a games console (1) by appropriate leads (21) .
PCT/GB2002/004063 2001-09-06 2002-09-06 Computer input device using an orientation sensor WO2003023702A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002321622A AU2002321622A1 (en) 2001-09-06 2002-09-06 Computer input device using an orientation sensor

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0121536.7 2001-09-06
GBGB0121536.7A GB0121536D0 (en) 2001-09-06 2001-09-06 Controlling electronic device

Publications (2)

Publication Number Publication Date
WO2003023702A2 true WO2003023702A2 (en) 2003-03-20
WO2003023702A3 WO2003023702A3 (en) 2004-01-08

Family

ID=9921595

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2002/004063 WO2003023702A2 (en) 2001-09-06 2002-09-06 Computer input device using an orientation sensor

Country Status (3)

Country Link
AU (1) AU2002321622A1 (en)
GB (2) GB0121536D0 (en)
WO (1) WO2003023702A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005085983A1 (en) * 2004-03-08 2005-09-15 Third Eye Interfaces Pty Limited An orientation data collection system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SG115546A1 (en) * 2003-06-23 2005-10-28 Affineon Technologies Pte Ltd Computer input device tracking six degrees of freedom
GB2467951A (en) * 2009-02-20 2010-08-25 Sony Comp Entertainment Europe Detecting orientation of a controller from an image of the controller captured with a camera

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5297061A (en) * 1993-05-19 1994-03-22 University Of Maryland Three dimensional pointing device monitored by computer vision
US5818424A (en) * 1995-10-19 1998-10-06 International Business Machines Corporation Rod shaped device and data acquisition apparatus for determining the position and orientation of an object in space
US5889505A (en) * 1996-04-04 1999-03-30 Yale University Vision-based six-degree-of-freedom computer input device
WO2000007148A1 (en) * 1998-07-29 2000-02-10 Intel Corporation Method and apparatus for three-dimensional input entry
WO2000021023A1 (en) * 1998-10-07 2000-04-13 Intel Corporation Controlling a pointer using digital video
EP1033882A1 (en) * 1998-06-01 2000-09-06 Sony Computer Entertainment Inc. Input position measuring instrument and entertainment system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5227985A (en) * 1991-08-19 1993-07-13 University Of Maryland Computer vision system for position monitoring in three dimensions using non-coplanar light sources attached to a monitored object
EP0716389A1 (en) * 1994-12-09 1996-06-12 International Business Machines Corporation Rod-shaped device for spatial data acquisition and method of determining the position and orientation of an object in space
US6243491B1 (en) * 1996-12-31 2001-06-05 Lucent Technologies Inc. Methods and apparatus for controlling a video system with visually recognized props
US20020036617A1 (en) * 1998-08-21 2002-03-28 Timothy R. Pryor Novel man machine interfaces and applications
US6417836B1 (en) * 1999-08-02 2002-07-09 Lucent Technologies Inc. Computer input device having six degrees of freedom for controlling movement of a three-dimensional object
US20020126090A1 (en) * 2001-01-18 2002-09-12 International Business Machines Corporation Navigating and selecting a portion of a screen by utilizing a state of an object as viewed by a camera

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5297061A (en) * 1993-05-19 1994-03-22 University Of Maryland Three dimensional pointing device monitored by computer vision
US5818424A (en) * 1995-10-19 1998-10-06 International Business Machines Corporation Rod shaped device and data acquisition apparatus for determining the position and orientation of an object in space
US5889505A (en) * 1996-04-04 1999-03-30 Yale University Vision-based six-degree-of-freedom computer input device
EP1033882A1 (en) * 1998-06-01 2000-09-06 Sony Computer Entertainment Inc. Input position measuring instrument and entertainment system
WO2000007148A1 (en) * 1998-07-29 2000-02-10 Intel Corporation Method and apparatus for three-dimensional input entry
WO2000021023A1 (en) * 1998-10-07 2000-04-13 Intel Corporation Controlling a pointer using digital video

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005085983A1 (en) * 2004-03-08 2005-09-15 Third Eye Interfaces Pty Limited An orientation data collection system

Also Published As

Publication number Publication date
GB0121536D0 (en) 2001-10-24
GB0219108D0 (en) 2002-09-25
AU2002321622A1 (en) 2003-03-24
GB2379493A (en) 2003-03-12
WO2003023702A3 (en) 2004-01-08

Similar Documents

Publication Publication Date Title
KR100503847B1 (en) Operation input device and electronic device using it
US6033309A (en) Peripheral input device with six-axis capability
US6544124B2 (en) Handheld steering wheel game controller
US6243491B1 (en) Methods and apparatus for controlling a video system with visually recognized props
US7736230B2 (en) Control apparatus for use with a computer or video game system
US5739813A (en) Three-dimensional image special effect apparatus
US5684512A (en) Ergonomic apparatus for controlling video or computer equipment
JPH1021000A (en) Signal input device
WO2008025973A2 (en) Game controllers
KR20070012214A (en) Game machine controller
CN113825548A (en) Using the presence of a finger to activate a motion control function of a hand-held controller
WO2001043473A1 (en) Hand held data processor unit
US20090322888A1 (en) Integrated circuit for detecting movements of persons
WO2003023702A2 (en) Computer input device using an orientation sensor
US6707445B1 (en) Input device
JP2002000945A (en) Controller
JPH08161103A (en) Three-dimensional information input device
CN106323251A (en) Method for operating a construction laser
JP3619573B2 (en) Input devices such as computers
JPH0926830A (en) Joy stick operating device
JPH1031552A (en) Input device
WO2022113721A1 (en) Game controller
JPH11156050A (en) Controller for game machine
JPH09140936A (en) Game machine
JP2002248268A (en) Controller and expansion unit for controller

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ OM PH PL PT RU SD SE SG SI SK SL TJ TM TN TR TZ UA UG US UZ VC VN YU ZA ZM

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZM ZW AM AZ BY KG KZ RU TJ TM AT BE BG CH CY CZ DK EE ES FI FR GB GR IE IT LU MC PT SE SK TR BF BJ CF CG CI GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 69(1) EPC (EPO-FORM 1205A DATED 13.05.2004)

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP