WO2001069930A1 - Method and apparatus for object surveillance with a movable camera - Google Patents
Method and apparatus for object surveillance with a movable camera Download PDFInfo
- Publication number
- WO2001069930A1 WO2001069930A1 PCT/US2001/007228 US0107228W WO0169930A1 WO 2001069930 A1 WO2001069930 A1 WO 2001069930A1 US 0107228 W US0107228 W US 0107228W WO 0169930 A1 WO0169930 A1 WO 0169930A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interest
- camera
- time point
- difference
- future position
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S11/00—Systems for determining distance or velocity not using reflection or reradiation
- G01S11/12—Systems for determining distance or velocity not using reflection or reradiation using electromagnetic waves other than radio waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
- G01S3/78—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using electromagnetic waves other than radio waves
- G01S3/782—Systems for determining direction or deviation from predetermined direction
- G01S3/785—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system
- G01S3/786—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system the desired condition being maintained automatically
- G01S3/7864—T.V. type tracking systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19678—User interface
- G08B13/19686—Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
Definitions
- the present invention relates to a method and system for object tracking with a video camera.
- a method for holding an object of interest in a field of view of a movable video camera comprising the steps of: receiving an indication of the object of interest; predicting a future position of the object of interest based on a current position and movement parameters of the object of interest; determining a future position of the movable camera based on said future position of the object of interest, said future position of the movable camera having the object of interest in the field of view; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
- a method for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view comprising the steps of: detecting moving objects in the video signal; transmitting an indication of said detected moving objects and the video signal at a first time point; receiving an indication of the selected object of interest at a current time point; translating said indication of the selected object of interest from the video signal transmitted at said first time point to an object in the video signal at said current time point; predicting a future position of said selected object of interest based on a current position and movement parameters of said selected object of interest; determining a future position of the movable camera based on said future position of said selected object of interest; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
- a system for holding an object of interest in a field of view of a movable video camera, the object of interest being selected form a plurality of moving objects detected in the field of view comprising: a selector for selecting the object of interest; means for predicting a future position of the object of interest and a coordinating future position of the movable video camera; a movement coordinator for creating movement signals to move the movable video camera to said future position from a current position.
- a system for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view comprising: an object detector for detecting moving objects in the field of view of the video camera; means for transmitting and receiving video information for transmitting the video signal and said detected moving objects and receiving an indication of the selected object of interest; a translator for determining an object of interest at a current time point based on a video signal transmitted at a first time point and said indication of the selected object of interest received at said current time point; means for predicting a future position of the object of interest and a coordinating future position of the movable video camera; a movement coordinator for creating movement signals to move the movable video camera to said future position from a current position.
- a computer readable medium having stored thereon computer-executable instructions for holding an object of interest in a field of view of a movable video camera, the object of interest being selected from a plurality of moving objects detected in the field of view performing the steps comprising: receiving an indication of the object of interest; predicting a future position of the object of interest based on a current position and movement parameters of the object of interest; determining a future position of the movable camera based on said future position of the object of interest, said future position of the movable camera having the object of interest in the field of view; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
- a computer readable medium having stored thereon computer-executable instructions for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view performing the steps comprising: detecting moving objects in the video signal; transmitting an indication of said detected moving objects and the video signal at a first time point; receiving an indication of the selected object of interest at a current time point; translating said indication of the selected object of interest from the video signal transmitted at said first time point to an object in the video signal at said current time point; predicting a future position of said selected object of interest based on a current position and movement parameters of said selected object of interest; determining a future position of the movable camera based on said future position of said selected object of interest; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
- Fig. 1 is a functional diagram of a monitoring system with a selection means provided remote from a motion video camera according to a first embodiment of the present invention
- Fig. 2 is a system diagram of a monitoring system with a selection means and motion video camera provided in close proximity according to a second embodiment of the present invention
- Fig. 3 is a flow chart illustrating an object monitoring method with a movable camera according to the first embodiment of the present invention
- Fig. 4 is a flow chart illustrating an object monitoring method with a movable camera according to the second embodiment of the present invention
- Fig. 5 is a flow chart illustrating movement of the camera according to an embodiment of the present invention.
- DETAILED DESCRIPTION The present invention relates to tracking moving objects using a single movable video camera and processing the video camera signal such that multiple objects can be tracked and maintained within the camera's field of view. It is therefore possible to automatically detect moving objects, automatically or manually select a moving object and direct the camera's line-of-sight to maintain the selected object within the camera's field of view. This enables objects to be monitored in a larger field of view with a single movable camera than would otherwise be possible.
- Fig. 1 shows a system 10 for monitoring moving objects using a single movable camera 12 attached to a camera controller 14.
- the video camera 12 collects motion video data and sends a motion video signal to a camera processing system 22 located on site with the camera 12.
- the motion video signal is composed of a number of frames each having a unique frame number associated therewith.
- the camera processing system 22 is connected to a remotely located selection processing system 16 over a network 40, such as a wide area network (i.e. the Internet).
- a network 40 such as a wide area network (i.e. the Internet).
- the camera processing system 22 creates camera control signals that keep object(s) being tracked by the system 10 centered in the field of view of the camera 12.
- the processing system 16 creates these control signals from a prediction of future movement based on past and current movement of the object(s) being tracked.
- the camera processing system 22 has an object detector 24 that automatically detects moving objects in the field of view of the camera 12.
- the object detector applies a technique to the received video signal to isolate moving objects, which are considered to be detected objects once they have been isolated.
- Object detection may be accomplished using any number of methods for image segmentation known in the art. For example, motion detection may be performed by frame differencing sequential pairs of video frames and applying thresholding techniques thereby yielding pixels within the processed image that reflect motion of objects within the field of view of the camera 12.
- Detected objects area associated with video frames in which they are found. These objects are represented by a unique object identification number, the position of the object and the video frame number. Each video frame may be represented by its identifying video frame number and a list of all objects (by identification number) that are present in the frame.
- the video signal in received from the camera 12 and an indication of all moving objects detected by the object detector 24 are received by a remote processor interface of the camera processing system 22 where they are sent over the network 40 to the remotely located selection processing system 16.
- a predetermined number of video frames are stored in a video in database 30. These data frames will be used to coordinate information between a current signal in and the signal on which the response was based due to the latency between sending the video and receiving a response.
- the selection processing system 16 is connected to a display 18 and a user input device 20 by which user input can be accepted and used for control of the camera 12.
- the video signal in and indication of the detected moving objects is received by a video processor interface 48 of the selection processing system 16.
- the video signal in and the detected moving objects indicators are passed to a display manager interface 42 where the two types of information are combined to produce a video signal displaying an indication of the selected moving objects. This combined signal is displayed by the display 18.
- the display manager interface 42 also provides an indicator for assisting a user in selecting displayed objects.
- the user selects one or more of the displayed objects using the input device 20.
- An input device interface 44 of the selection processing system 16 receives input from the user indicating selected objects. This indication is passed to an object correlator 46 where the video signal in, the indication of the detected objects and the indication of the selected objects are coordinated to determine the coordinates of the selected object. The coordinates may be combined with a frame number of the frame from which the object was selected. These coordinates are sent by the video processor interface 48 back to the camera processing system 22 via the network 40.
- the selection processor interface 36 receives the coordinates of the selected object and forwards this information to a remote selection to current frame translator 38.
- the translator 38 consults a latency determinator 50 to receive the delay, in number of frames, between the frame on which the selection was based and the current frame of the video signal in.
- the latency calculation may be performed in a number of ways.
- a time stamp or frame number may be sent to the selection processing system 16 and then returned with the selected objects indication.
- the video signal frames stored in the video in database 30 may then be queried to determine the frame on which the selection was based.
- a ping may be sent to the selection processing system 16.
- the round trip latency may be calculated according to the time between the sending and receiving of the ping. Based on this time the video in database 30 may be queried to determine the frame that was current when the signal was first sent to the selection processing system 16.
- the latency determinator 50 provides the translator 38 with an indication of the frame in the video in database 30 on which the selection received was based.
- the translator 38 provides an object tracker 34 with an indication of the frame and selected object.
- the object tracker 34 determines the position of the selected object and uses subsequent frames to determine the position of the object in the current video frame.
- the position of the object in the current frame is provided to the translator 38.
- the current position of the object may be based on the object identification number such that if an object is currently being tracked but was previously selected, its current position may be determined based on the object identification number and the corresponding object in the current frame.
- the translator 38 passes the current position information of the selected object to the path predictor 32 where the future path of the object is detected in order to proactively move the camera 12 to maintain the object in the field of view.
- the path predictor 32 predicts possible future movement paths using a state prediction algorithm, such as the Kalman filter.
- Kalman filtering is a time-based method of predicting variables, such as position, velocity and acceleration, based on current samples of these variables.
- the predicted path is based on a digital time based system.
- the sample rate of the predicting variables is based on a data rate of the system, which is determined by regional video standards (i.e. North American standard is 30 frames/second whereas the European standard is 25 frames/second). Coordinates of a display, representative of the camera's 12 field of view, are use by the Kalman filter to determine a future position.
- the predicted position of the selected object is used by a movement coordinator 26 to keep the object in the field of view of the camera 12.
- the current position of the object within the field of view of the camera 12 and the position of the field of view of the camera 12 are determined in display coordinates or pixels associated with the field of view of the camera 12. Based on the predicted position of the object, the amount of movement of the camera 12 necessary to maintain the object in the center of the field of view is determined. Horizontal and vertical movement are determined according to a display coordinate change of the object. The difference between the current and future positions is used to determine how much the camera 12 will need to move in order to maintain the object in its field of view.
- the difference between the current and future camera positions is transformed into a change in camera coordinates according to information in a coordinate translation database 28.
- Movement of the camera controller 14 is in discrete movement units in three directions: zoom, along a z-axis; pan, along a horizontal x-axis; and tilt, along a vertical y-axis. Movement along one of these three perpendicular axes affects the degree of movement necessary along the other axes. For example, pan o tilt movement at greater positive zoom translates into a larger movement in display coordinates than with a smaller zoom. A similar pan movement at a large tilt and a small tilt produces a smaller movement in display coordinates with the large tilt.
- a change in the zoom is determined by the size of the object being tracked and its predicted position.
- the object must be sized in the field of view such that it is completely contained and there is sufficient area for the object to move without necessitating immediate movement of the camera 12 to maintain the object in the field of view.
- tilt change values and then pan change values are determined based on vertical and horizontal display coordinate changes, respectively. If display coordinate changes are only in the vertical direction then a direct mapping of display coordinate change values to tilt change values can be performed. However, if there are horizontal and vertical changes then the horizontal changes must be compensated for when determining the vertical movement as objects that are horizontally distant require smaller tilt movement than appears to be necessary. After the tilt change has been calculated, the mapping for pan change necessary for movement of a single horizontal display coordinate changes accordingly.
- the pan movement by the camera controller 14 according to the horizontal display coordinate change is determined after the zoom and tilt changes have been calculated. If there was no change in the vertical display coordinates then the horizontal display coordinate change can be mapped directly to a pan movement value based on the current zoom value. However, if there is both a horizontal and vertical display coordinate change then the tilt change value of the camera 12 must be compensated for.
- the movement calculator 26 Based on the PTZ (pan, tilt, zoom) movement coordinates, the movement calculator 26 creates control signals for the camera controller 14.
- a message containing an address for the camera controller 14, a command and an error check byte is sent to the camera controller 14 from the processing system 22 responsible for creating the camera movement commands.
- the camera controller address is a unique identifier that allows the processing system 22 to control and monitor multiple cameras.
- the error check byte is used to ensure that all command information was received by the camera controller 14.
- the command information may be a new position in PTZ coordinates that centers on the object. Alternatively, the command information may be a change in the current PTZ coordinate position such that, the change and not the final position is sent to the camera controller 14.
- tracking continues for a predetermined number of frames based on the originally predicted path.
- the predetermined number of frames for which an original prediction is followed after an object is lost may be based on average speed of objects that are tracked by the system. If an object is not rediscovered after the predetermined number of frames then it is considered to have been lost. If the object is subsequently rediscovered it is considered to be a new object.
- Fig. 2 shows a monitoring system 72 with a selection means 74 and motion video camera 12 provided in close proximity.
- the system in Figure 2 performs the same functions as the system 10 of Figure 1; however, the camera 12 and the selection processing system 74 are not separated by a network 40.
- the functions of the camera processing system 22 from Figure 1 may now be performed by the selection processing system 74. That is, the selection processing system 74 now includes the functions of object detection 60, movement coordination 62, path prediction 66, object tracking 68 and includes a coordinate translation database 64.
- These components all perform the same functions as their counter-parts by the same name in the camera processing system 22 of Fig. 1. As there is minimal delay between the selection processing system 74 and the camera
- the system 72 of Fig. 2 does not require video in database 30, latency determinator 50, translator 38 or network interfaces 36, 48.
- Movement command signals generated by the movement coordinator 62 in the selection processing system 74 are received by a command interface 70 to the camera controller 14.
- the command controller 70 receives the signals and passes them to the camera controller 14 were the camera 12 is moved to maintain line of sight with an object.
- the processing functions of object detection, movement coordination, path prediction and object tracking may be performed at the camera processing system with the selection processing system in close proximity (not shown). That is, for the selection processing system in close proximity to the camera 12 the camera processing system is in much the same form as the camera processing system 22 in Fig. 1 except without the components necessary for overcoming transmission latency (i.e. video in database 30, selection processing system interface 36, translator 38 and latency determinator 50).
- Figures 1 and 2 illustrate an exemplary embodiment where an object of interest is selected by a user.
- objects of interest may be selected from the detected moving objects.
- a prescreening qualifier indicative of a characteristic of an object of interest is received and used to determine if a detected moving object is of interest based on whether or not these objects have a value for the characteristic represented by the prescreening qualifier. Based on a comparison technique, such as percentage error, the difference between the desired characteristic value (object of interest) and that for each detected moving object is determined. If the difference is within a predefined tolerance then the detected moving object is considered to be of interest.
- Fig. 3 is a flow chart illustrating an object monitoring method 100 with a movable camera according to the first embodiment of the present invention, as shown in Fig. 1.
- the camera processing system 22 receives a video signal from the camera 12 in step 102. Using the video signal received, the camera processing system 22 detects moving objects in the field of view according to techniques known in the art in step 104.
- the video signal and the detected moving objects are stored in step 106 in camera processing system 22 for use in later processing.
- the video signal and the detected moving objects are transmitted in step 108 to the selection processing system 16 where a user selects an object of interest.
- An indication of this selected object of interest is sent back to the camera processing system 22 and received in step 110.
- a latency between the transmission and receipt time is determined in step 112. Determining the latency allows the system to use the object selected in a previous frame in tracking of an object in the current frame.
- the previously saved video signal is used to provide a position of the selected object at the time of selection.
- the position of the selected object can then be traced to a position in the current frame as determined in step 114. If the selected object is still in the camera's 12 field of view, as determined in step 116, then the future position of the selected object can be predicted using the current position and movement parameters of the selected object such as velocity and acceleration in step 118.
- the future position of the selected object may be determined by a prediction algorithm such as a Kalman filter.
- the camera processing system 22 determines a future position of the camera based on the future position of the selected object in step 120.
- the future position of the camera 12 keeps the selected object in the field of view.
- the future position of the selected object is expressed in coordinates of the display and its future corresponding camera coordinates.
- the camera processing system 22 must determine a difference in step 122 current position of the camera and the future position of the camera to determine the amount of movement necessary to place the camera in the future position. This comparison may also be made in display coordinates.
- the difference calculated in step 122 must be translated into a coordinate system that will be imderstood by the camera controller 14 and can be used to move the camera 12 into the future position.
- the difference between the display coordinates of the current and future camera positions is translated into PTZ coordinates in step 124. These PTZ coordinates are used to generate camera control signals in step 126 that are sent to the camera controller in step 128.
- the camera processing system 22 continues to monitor the current position of the selected object and move the camera 12 as necessary to maintain the object in the field of view.
- the camera processing system 22 continues to monitor the field of view and detect moving objects, step 104.
- Fig. 4 is a flow chart illustrating an object monitoring method 150 with a movable camera according to the second embodiment of the present invention, as shown in Fig. 2.
- the selection processing system 74 receives a video signal from the camera 12 in step 152. Using the video signal received, the selection processing system 74 detects moving objects in the field of view according to techniques known in the art in step 154.
- a moving object of interest is selected from the detected moving objects in step 156.
- the selection may be the result of user selected or may be the result of automatic selection of objects based on a comparison with prescreening qualifiers.
- the position of the selected object is determined in step 158. If the selected object is still in the camera's 12 field of view, as determined in step 160, then the future position of the selected object can be predicted using the current position and movement parameters of the selected object such as velocity and acceleration in step 162.
- the future position of the selected object may be determined by a prediction algorithm such as a Kalman filter.
- the selection processing system 74 determines a future position of the camera 12 based on the future position of the selected object in step 164.
- the future position of the camera 12 keeps the selected object in the field of view.
- the future position of the selected object is expressed in coordinates of the display as is the future position of the camera.
- the selection processing system 74 must determine a difference in step 168 current position of the camera and the future position of the camera to determine the amount of movement necessary to place the camera in the future position. This comparison may also be made in display coordinates.
- step 166 the difference calculated in step 166 must be translated into a coordinate system that will be understood by the camera controller 14 and can be used to move the camera 12 into the future position.
- the difference between the display coordinates of the current and future camera positions is translated into PTZ coordinates in step 168. These PTZ coordinates are used to generate camera control signals in step 170 that are sent to the command interface 70 of the camera controller 14 in step 172.
- the selection processing system 74 continues to monitor the current position of the selected object and move the camera 12 as necessary to maintain the object in the field of view.
- the selection processing system 74 continues to monitor the field of view and detect moving objects, step 154.
- Fig. 5 is a flow chart illustrating movement of the camera according to an embodiment of the present invention.
- An indication of selected objects and their movement information is received in step 202.
- the current position and movement parameters (i.e. velocity and acceleration) of the camera 12 are determined in step 204.
- the future position of the object being tracked is determined in step 206.
- the future position of the camera is determined in step 208 such that the object will remain within the field of view of the camera 12.
- the future movement parameters necessary to achieve the future position of the camera 12 are determined in step 210. These movement parameters are based on the horizontal and vertical changes in the object and thus are a rough estimate of the pan and tilt changes of the camera 12.
- the size of the object is examined to determine in step 214 if the object is sufficiently in the field of view such that the entire object is visible and will remain visible with the predicted future position. If the object size is sufficient then the zoom value is maintained in step 216 and a command is formatted with the pan and tilt changes. If the object size is not sufficient then a new zoom value is determined in step 218 such that the object will be sufficiently within the field of view. A command incorporating the pan, tilt and zoom changes is formatted in step 220 and sent to the camera controller 14 in step 222.
Abstract
A method for holding an object of interest in a field of view of a movable video camera, the object of interest being selected from a plurality of moving objects detected in the field of view, is taught. An indication of the object of interest is received and is used to predict a future position thereof. Movement commands for the camera are created based on the future position of the object of interest such that the object of interest remains in the field of view of the camera.
Description
METHOD AND APPARATUS FOR OBJECT SURVEILLANCE WITH A MOVABLE CAMERA
CROSS REFERENCE TO RELATED APPLICATIONS This application claims the benefit of United States provisional patent application serial number 60/188,171 filed on March 10, 2000. United States Patent applications, also claiming the benefit of U.S. Provisional application 60/188,171, and entitled "Method and Apparatus for Video Surveillance With Defined Zones" and "Method an Apparatus for Object Tracking and Detection" were filed concurrently herewith.
FIELD OF THE INVENTION The present invention relates to a method and system for object tracking with a video camera.
BACKGROUND OF THE INVENTION
There are several shortcomings in current video surveillance systems that need to be overcome for widespread use of automatic detection and collection of relevant video data in response to scene stimulus without the need of a human operator present. When viewing a scene from a video camera a large amount of data is generated. The vast amount of data created produces a data reduction problem. Automatically detecting and accurately and reliably collecting image information of a moving object using a motion video camera is a difficult task. This task is made even more difficult when trying to detect, track and maintain camera line-of-sight using a single motion video camera without requiring human intervention. U.S. Patent 5,473,369 (Abe) describes the use of a camera to detect and track a moving object without using conventional block matching. In the system described in Abe single object tracking is performed only after an object is placed within a frame on a screen; however, there is no user input device for manual target selection. Moreover, Abe does not provide for camera movement to maintain line-of-site. Other prior art solutions provide for image stabilization for a camera in arbitrary motion without object tracking functionality. U.S. Patent 5,629,988 (Burt) teaches electronic stabilization of a sequence of images with respect to one another but provides no tracking facility.
Still other prior art solutions control camera movement to maintain line-of-sight between camera and object but lack arbitrary motion compensation or do not provide for automatic and user selected object tracking. U.S. Patent 5,434,621 (Nu) teaches a method for automatic zooming and automatic tracking of an object using a zoom lens but does not provide for reorienting the camera's line-of-sight.
Many prior art system in the field lack optical zoom for maintaining object size within field-of-view. Efforts have been made to simultaneously support near field and far field tracking using two cameras.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a method and apparatus for monitoring objects of interest with a movable camera.
It is an object of the present invention to provide a method and apparatus for monitoring objects of interest with a single movable camera in an improved size field of view.
It is an object of the present invention to provide a method and apparatus for motion video tracking with optical zoom for collecting and improving information content.
In accordance with one aspect of the present invention there is provided a method for holding an object of interest in a field of view of a movable video camera, the object of interest being selected from a plurality of moving objects detected in the field of view, said method comprising the steps of: receiving an indication of the object of interest; predicting a future position of the object of interest based on a current position and movement parameters of the object of interest; determining a future position of the movable camera based on said future position of the object of interest, said future position of the movable camera having the object of interest in the field of view; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
In accordance with another aspect of the present invention there is provided a method for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view, said method comprising the steps of: detecting moving objects in the video signal; transmitting an indication of said detected moving objects and the video signal at a first time point; receiving an indication of the selected object of interest at a current time point; translating said
indication of the selected object of interest from the video signal transmitted at said first time point to an object in the video signal at said current time point; predicting a future position of said selected object of interest based on a current position and movement parameters of said selected object of interest; determining a future position of the movable camera based on said future position of said selected object of interest; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
In accordance with a further aspect of the present invention there is provided a system for holding an object of interest in a field of view of a movable video camera, the object of interest being selected form a plurality of moving objects detected in the field of view, said system comprising: a selector for selecting the object of interest; means for predicting a future position of the object of interest and a coordinating future position of the movable video camera; a movement coordinator for creating movement signals to move the movable video camera to said future position from a current position. In accordance with yet another aspect of the present invention there is provided a system for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view, said system comprising: an object detector for detecting moving objects in the field of view of the video camera; means for transmitting and receiving video information for transmitting the video signal and said detected moving objects and receiving an indication of the selected object of interest; a translator for determining an object of interest at a current time point based on a video signal transmitted at a first time point and said indication of the selected object of interest received at said current time point; means for predicting a future position of the object of interest and a coordinating future position of the movable video camera; a movement coordinator for creating movement signals to move the movable video camera to said future position from a current position.
In accordance with a further aspect of the present invention there is provided a computer readable medium having stored thereon computer-executable instructions for holding an object of interest in a field of view of a movable video camera, the object of interest being selected from a plurality of moving objects detected in the field of view performing the steps comprising: receiving an indication of the object of interest; predicting a future position of the object of interest based on a current position and movement parameters of the object of interest; determining a future position of the movable camera based on said
future position of the object of interest, said future position of the movable camera having the object of interest in the field of view; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera. In accordance with an aspect of the present invention there is provided a computer readable medium having stored thereon computer-executable instructions for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view performing the steps comprising: detecting moving objects in the video signal; transmitting an indication of said detected moving objects and the video signal at a first time point; receiving an indication of the selected object of interest at a current time point; translating said indication of the selected object of interest from the video signal transmitted at said first time point to an object in the video signal at said current time point; predicting a future position of said selected object of interest based on a current position and movement parameters of said selected object of interest; determining a future position of the movable camera based on said future position of said selected object of interest; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a functional diagram of a monitoring system with a selection means provided remote from a motion video camera according to a first embodiment of the present invention; Fig. 2 is a system diagram of a monitoring system with a selection means and motion video camera provided in close proximity according to a second embodiment of the present invention;
Fig. 3 is a flow chart illustrating an object monitoring method with a movable camera according to the first embodiment of the present invention;
Fig. 4 is a flow chart illustrating an object monitoring method with a movable camera according to the second embodiment of the present invention; and Fig. 5 is a flow chart illustrating movement of the camera according to an embodiment of the present invention.
DETAILED DESCRIPTION The present invention relates to tracking moving objects using a single movable video camera and processing the video camera signal such that multiple objects can be tracked and maintained within the camera's field of view. It is therefore possible to automatically detect moving objects, automatically or manually select a moving object and direct the camera's line-of-sight to maintain the selected object within the camera's field of view. This enables objects to be monitored in a larger field of view with a single movable camera than would otherwise be possible.
Fig. 1 shows a system 10 for monitoring moving objects using a single movable camera 12 attached to a camera controller 14. The video camera 12 collects motion video data and sends a motion video signal to a camera processing system 22 located on site with the camera 12. The motion video signal is composed of a number of frames each having a unique frame number associated therewith. The camera processing system 22 is connected to a remotely located selection processing system 16 over a network 40, such as a wide area network (i.e. the Internet).
The camera processing system 22 creates camera control signals that keep object(s) being tracked by the system 10 centered in the field of view of the camera 12. The processing system 16 creates these control signals from a prediction of future movement based on past and current movement of the object(s) being tracked. The camera processing system 22 has an object detector 24 that automatically detects moving objects in the field of view of the camera 12. The object detector applies a technique to the received video signal to isolate moving objects, which are considered to be detected objects once they have been isolated. Object detection may be accomplished using any number of methods for image segmentation known in the art. For example, motion detection may be performed by frame differencing sequential pairs of video frames and applying thresholding techniques thereby yielding pixels within the processed image that reflect motion of objects within the field of view of the camera 12. Additional image processing techniques such as centroid analysis may then be applied to remove spurious motion. Object tracking and detection is discussed in greater detail in applicant's co-pending related application entitled "Method and Apparatus for Object Tracking and Detection," filed concurrently herewith and incorporated herein by reference.
Detected objects area associated with video frames in which they are found. These objects are represented by a unique object identification number, the position of the object
and the video frame number. Each video frame may be represented by its identifying video frame number and a list of all objects (by identification number) that are present in the frame.
The video signal in received from the camera 12 and an indication of all moving objects detected by the object detector 24 are received by a remote processor interface of the camera processing system 22 where they are sent over the network 40 to the remotely located selection processing system 16. During the delay between when a signal is sent to the selection processing system 16 and a response is received, a predetermined number of video frames are stored in a video in database 30. These data frames will be used to coordinate information between a current signal in and the signal on which the response was based due to the latency between sending the video and receiving a response.
The selection processing system 16 is connected to a display 18 and a user input device 20 by which user input can be accepted and used for control of the camera 12. The video signal in and indication of the detected moving objects is received by a video processor interface 48 of the selection processing system 16. The video signal in and the detected moving objects indicators are passed to a display manager interface 42 where the two types of information are combined to produce a video signal displaying an indication of the selected moving objects. This combined signal is displayed by the display 18.
The display manager interface 42 also provides an indicator for assisting a user in selecting displayed objects. The user selects one or more of the displayed objects using the input device 20. An input device interface 44 of the selection processing system 16 receives input from the user indicating selected objects. This indication is passed to an object correlator 46 where the video signal in, the indication of the detected objects and the indication of the selected objects are coordinated to determine the coordinates of the selected object. The coordinates may be combined with a frame number of the frame from which the object was selected. These coordinates are sent by the video processor interface 48 back to the camera processing system 22 via the network 40.
The selection processor interface 36 receives the coordinates of the selected object and forwards this information to a remote selection to current frame translator 38. The translator 38 consults a latency determinator 50 to receive the delay, in number of frames, between the frame on which the selection was based and the current frame of the video signal in.
The latency calculation may be performed in a number of ways. A time stamp or frame number may be sent to the selection processing system 16 and then returned with the
selected objects indication. The video signal frames stored in the video in database 30 may then be queried to determine the frame on which the selection was based. Alternatively, a ping may be sent to the selection processing system 16. When the ping is detected as being received by the latency determinator 50 the round trip latency may be calculated according to the time between the sending and receiving of the ping. Based on this time the video in database 30 may be queried to determine the frame that was current when the signal was first sent to the selection processing system 16.
The latency determinator 50 provides the translator 38 with an indication of the frame in the video in database 30 on which the selection received was based. The translator 38 provides an object tracker 34 with an indication of the frame and selected object. The object tracker 34 determines the position of the selected object and uses subsequent frames to determine the position of the object in the current video frame. The position of the object in the current frame is provided to the translator 38. Alternatively, the current position of the object may be based on the object identification number such that if an object is currently being tracked but was previously selected, its current position may be determined based on the object identification number and the corresponding object in the current frame.
The translator 38 passes the current position information of the selected object to the path predictor 32 where the future path of the object is detected in order to proactively move the camera 12 to maintain the object in the field of view. The path predictor 32 predicts possible future movement paths using a state prediction algorithm, such as the Kalman filter. Kalman filtering is a time-based method of predicting variables, such as position, velocity and acceleration, based on current samples of these variables. The predicted path is based on a digital time based system. The sample rate of the predicting variables is based on a data rate of the system, which is determined by regional video standards (i.e. North American standard is 30 frames/second whereas the European standard is 25 frames/second). Coordinates of a display, representative of the camera's 12 field of view, are use by the Kalman filter to determine a future position.
The predicted position of the selected object is used by a movement coordinator 26 to keep the object in the field of view of the camera 12. The current position of the object within the field of view of the camera 12 and the position of the field of view of the camera 12 are determined in display coordinates or pixels associated with the field of view of the camera 12. Based on the predicted position of the object, the amount of movement of the camera 12 necessary to maintain the object in the center of the field of view is determined.
Horizontal and vertical movement are determined according to a display coordinate change of the object. The difference between the current and future positions is used to determine how much the camera 12 will need to move in order to maintain the object in its field of view.
The difference between the current and future camera positions is transformed into a change in camera coordinates according to information in a coordinate translation database 28. Movement of the camera controller 14 is in discrete movement units in three directions: zoom, along a z-axis; pan, along a horizontal x-axis; and tilt, along a vertical y-axis. Movement along one of these three perpendicular axes affects the degree of movement necessary along the other axes. For example, pan o tilt movement at greater positive zoom translates into a larger movement in display coordinates than with a smaller zoom. A similar pan movement at a large tilt and a small tilt produces a smaller movement in display coordinates with the large tilt.
A change in the zoom is determined by the size of the object being tracked and its predicted position. The object must be sized in the field of view such that it is completely contained and there is sufficient area for the object to move without necessitating immediate movement of the camera 12 to maintain the object in the field of view.
Once zoom change has been calculated, tilt change values and then pan change values are determined based on vertical and horizontal display coordinate changes, respectively. If display coordinate changes are only in the vertical direction then a direct mapping of display coordinate change values to tilt change values can be performed. However, if there are horizontal and vertical changes then the horizontal changes must be compensated for when determining the vertical movement as objects that are horizontally distant require smaller tilt movement than appears to be necessary. After the tilt change has been calculated, the mapping for pan change necessary for movement of a single horizontal display coordinate changes accordingly.
The pan movement by the camera controller 14 according to the horizontal display coordinate change is determined after the zoom and tilt changes have been calculated. If there was no change in the vertical display coordinates then the horizontal display coordinate change can be mapped directly to a pan movement value based on the current zoom value. However, if there is both a horizontal and vertical display coordinate change then the tilt change value of the camera 12 must be compensated for.
Based on the PTZ (pan, tilt, zoom) movement coordinates, the movement calculator 26 creates control signals for the camera controller 14. A message containing an address for
the camera controller 14, a command and an error check byte is sent to the camera controller 14 from the processing system 22 responsible for creating the camera movement commands. The camera controller address is a unique identifier that allows the processing system 22 to control and monitor multiple cameras. The error check byte is used to ensure that all command information was received by the camera controller 14. The command information may be a new position in PTZ coordinates that centers on the object. Alternatively, the command information may be a change in the current PTZ coordinate position such that, the change and not the final position is sent to the camera controller 14.
If an object that is being tracked rapidly moves out of the field of view of the camera 12 or veers off of the predicted path of movement, tracking continues for a predetermined number of frames based on the originally predicted path. The predetermined number of frames for which an original prediction is followed after an object is lost may be based on average speed of objects that are tracked by the system. If an object is not rediscovered after the predetermined number of frames then it is considered to have been lost. If the object is subsequently rediscovered it is considered to be a new object.
Fig. 2 shows a monitoring system 72 with a selection means 74 and motion video camera 12 provided in close proximity. The system in Figure 2 performs the same functions as the system 10 of Figure 1; however, the camera 12 and the selection processing system 74 are not separated by a network 40. As a result, the functions of the camera processing system 22 from Figure 1 may now be performed by the selection processing system 74. That is, the selection processing system 74 now includes the functions of object detection 60, movement coordination 62, path prediction 66, object tracking 68 and includes a coordinate translation database 64. These components all perform the same functions as their counter-parts by the same name in the camera processing system 22 of Fig. 1. As there is minimal delay between the selection processing system 74 and the camera
12, the system 72 of Fig. 2 does not require video in database 30, latency determinator 50, translator 38 or network interfaces 36, 48.
Movement command signals generated by the movement coordinator 62 in the selection processing system 74 are received by a command interface 70 to the camera controller 14. The command controller 70 receives the signals and passes them to the camera controller 14 were the camera 12 is moved to maintain line of sight with an object.
Alternatively, the processing functions of object detection, movement coordination, path prediction and object tracking may be performed at the camera processing system with
the selection processing system in close proximity (not shown). That is, for the selection processing system in close proximity to the camera 12 the camera processing system is in much the same form as the camera processing system 22 in Fig. 1 except without the components necessary for overcoming transmission latency (i.e. video in database 30, selection processing system interface 36, translator 38 and latency determinator 50).
Figures 1 and 2 illustrate an exemplary embodiment where an object of interest is selected by a user. Alternatively, objects of interest may be selected from the detected moving objects. A prescreening qualifier indicative of a characteristic of an object of interest is received and used to determine if a detected moving object is of interest based on whether or not these objects have a value for the characteristic represented by the prescreening qualifier. Based on a comparison technique, such as percentage error, the difference between the desired characteristic value (object of interest) and that for each detected moving object is determined. If the difference is within a predefined tolerance then the detected moving object is considered to be of interest. The process for selecting objects based on prescreening qualifiers representative of an object of interest is described in more detail in Applicant's co- pending application titled "Method and Apparatus for Object Tracking and Detection," filed concurrently herewith and incorporated herein by reference.
Fig. 3 is a flow chart illustrating an object monitoring method 100 with a movable camera according to the first embodiment of the present invention, as shown in Fig. 1. The camera processing system 22 receives a video signal from the camera 12 in step 102. Using the video signal received, the camera processing system 22 detects moving objects in the field of view according to techniques known in the art in step 104.
Once moving objects have been detected the video signal and the detected moving objects are stored in step 106 in camera processing system 22 for use in later processing. The video signal and the detected moving objects are transmitted in step 108 to the selection processing system 16 where a user selects an object of interest. An indication of this selected object of interest is sent back to the camera processing system 22 and received in step 110.
When the indication of the selected object has been received by the camera processing system 22 a latency between the transmission and receipt time is determined in step 112. Determining the latency allows the system to use the object selected in a previous frame in tracking of an object in the current frame. The previously saved video signal is used to provide a position of the selected object at the time of selection. The position of the selected object can then be traced to a position in the current frame as determined in step 114.
If the selected object is still in the camera's 12 field of view, as determined in step 116, then the future position of the selected object can be predicted using the current position and movement parameters of the selected object such as velocity and acceleration in step 118. The future position of the selected object may be determined by a prediction algorithm such as a Kalman filter.
The camera processing system 22 determines a future position of the camera based on the future position of the selected object in step 120. The future position of the camera 12 keeps the selected object in the field of view. The future position of the selected object is expressed in coordinates of the display and its future corresponding camera coordinates. The camera processing system 22 must determine a difference in step 122 current position of the camera and the future position of the camera to determine the amount of movement necessary to place the camera in the future position. This comparison may also be made in display coordinates.
As the camera controller 14 does not understand display coordinates, the difference calculated in step 122 must be translated into a coordinate system that will be imderstood by the camera controller 14 and can be used to move the camera 12 into the future position. The difference between the display coordinates of the current and future camera positions is translated into PTZ coordinates in step 124. These PTZ coordinates are used to generate camera control signals in step 126 that are sent to the camera controller in step 128. After the camera 12 is moved to maintain the selected object in the field of view, the camera processing system 22 continues to monitor the current position of the selected object and move the camera 12 as necessary to maintain the object in the field of view.
If the selected object is no longer in the camera's 12 field of view then the camera processing system 22 continues to monitor the field of view and detect moving objects, step 104.
Fig. 4 is a flow chart illustrating an object monitoring method 150 with a movable camera according to the second embodiment of the present invention, as shown in Fig. 2. The selection processing system 74 receives a video signal from the camera 12 in step 152. Using the video signal received, the selection processing system 74 detects moving objects in the field of view according to techniques known in the art in step 154.
A moving object of interest is selected from the detected moving objects in step 156. The selection may be the result of user selected or may be the result of automatic selection of objects based on a comparison with prescreening qualifiers.
The position of the selected object is determined in step 158. If the selected object is still in the camera's 12 field of view, as determined in step 160, then the future position of the selected object can be predicted using the current position and movement parameters of the selected object such as velocity and acceleration in step 162. The future position of the selected object may be determined by a prediction algorithm such as a Kalman filter.
The selection processing system 74 determines a future position of the camera 12 based on the future position of the selected object in step 164. The future position of the camera 12 keeps the selected object in the field of view. The future position of the selected object is expressed in coordinates of the display as is the future position of the camera. The selection processing system 74 must determine a difference in step 168 current position of the camera and the future position of the camera to determine the amount of movement necessary to place the camera in the future position. This comparison may also be made in display coordinates.
As the camera controller 14 does not understand display coordinates, the difference calculated in step 166 must be translated into a coordinate system that will be understood by the camera controller 14 and can be used to move the camera 12 into the future position. The difference between the display coordinates of the current and future camera positions is translated into PTZ coordinates in step 168. These PTZ coordinates are used to generate camera control signals in step 170 that are sent to the command interface 70 of the camera controller 14 in step 172.
After the camera 12 is moved to maintain the selected object in the field of view, the selection processing system 74 continues to monitor the current position of the selected object and move the camera 12 as necessary to maintain the object in the field of view.
If the selected object is no longer in the camera's 12 field of view then the selection processing system 74 continues to monitor the field of view and detect moving objects, step 154.
Fig. 5 is a flow chart illustrating movement of the camera according to an embodiment of the present invention. An indication of selected objects and their movement information is received in step 202. The current position and movement parameters (i.e. velocity and acceleration) of the camera 12 are determined in step 204. The future position of the object being tracked is determined in step 206. Based on the future position of the object, the future position of the camera is determined in step 208 such that the object will remain within the field of view of the camera 12. The future movement parameters necessary
to achieve the future position of the camera 12 are determined in step 210. These movement parameters are based on the horizontal and vertical changes in the object and thus are a rough estimate of the pan and tilt changes of the camera 12. The size of the object, determined in step 212, is examined to determine in step 214 if the object is sufficiently in the field of view such that the entire object is visible and will remain visible with the predicted future position. If the object size is sufficient then the zoom value is maintained in step 216 and a command is formatted with the pan and tilt changes. If the object size is not sufficient then a new zoom value is determined in step 218 such that the object will be sufficiently within the field of view. A command incorporating the pan, tilt and zoom changes is formatted in step 220 and sent to the camera controller 14 in step 222.
It is apparent to one skilled in the art that numerous modifications and departures from the specific embodiments described herein may be made without departing from the spirit and scope of the invention.
Claims
1. A method for holding an obj ect of interest in a field of view of a movable video camera, the object of interest being selected from a plurality of moving objects detected in the field of view, said method comprising the steps of: receiving an indication of the object of interest; predicting a future position of the obj ect of interest based on a current position and movement parameters of the object of interest; determining a future position of the movable camera based on said future position of the object of interest, said future position of the movable camera having the object of interest in the field of view; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
2. The method of claim 1 wherein said movement parameters includes the parameters of velocity and acceleration of the object of interest.
3. The method of claim 1 wherein said step of generating includes the steps of: determining a difference between said current position of the movable camera and said future position of the movable camera; and creating control signals to move the movable camera said difference.
4. The method of claim 3 wherein said difference is determined in a display coordinate system used for representing objects in the field of view, and the method further comprises the step of: translating said difference in said display coordinate system to a difference in a camera controller coordinate system; and wherein said step of creating control signals includes the step of creating control signals based on said difference in said camera controller coordinate system.
5. A method for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view, said method comprising the steps of: detecting moving objects in the video signal; transmitting an indication of said detected moving objects and the video signal at a first time point; receiving an indication of the selected object of interest at a current time point; translating said indication of the selected object of interest from the video signal transmitted at said first time point to an object in the video signal at said current time point; predicting a future position of said selected object of interest based on a current position and movement parameters of said selected object of interest; determining a future position of the movable camera based on said future position of said selected object of interest; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
6. The method of 5 wherein said step of translating further includes the steps of: determining a difference between said first time point and said current time point; and determining a current location of said selected object of interest at said current time point based on said received indication taken at said first time point and said difference between said first time point and said current time point.
7. The method of claim 5 wherein said movement parameters includes the parameters of velocity and acceleration of the object of interest.
8. The method of claim 5 wherein said step of generating includes the steps of: determining a difference between said current position of the movable camera and said future position of the movable camera; and creating control signals to move the movable camera said difference.
9. The method of claim 8 wherein said difference is determined in a display coordinate system used for representing objects in the field of view, and the method further comprises the step of: translating said difference in said display coordinate system to a difference in a camera controller coordinate system; and wherein said step of creating control signals includes the step of creating control signals based on said difference in said camera controller coordinate system.
10. The method of claim 6 further including the step of storing the video signal received between said first time point and said current time point.
11. The method of claim 10 wherein said step of determining a said current location of said selected object of interest includes the step of determining a position of said selected object of interest at said first time point from said stored video signal; mapping said position of said selected object of interest at said first time point to said current position.
12. A system for holding an object of interest in a field of view of a movable video camera, the object of interest being selected form a plurality of moving objects detected in the field of view, said system comprising: a selector for selecting the object of interest; means for predicting a future position of the object of interest and a coordinating future position of the movable video camera; a movement coordinator for creating movement signals to move the movable video camera to said future position from a current position.
13. The system of claim 12 wherein said future position of the movable camera is in a display coordinate system used for representing objects in the field of view, and said movement coordinator includes a coordinate translation database storing a mapping of display coordinates to camera controller coordinates for translating said future position said movable camera in said display coordinate system to a future position in a camera controller coordinate system; and wherein said movement signals are created in said camera controller coordinate system.
14. A system for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view, said system comprising: an object detector for detecting moving objects in the field of view of the video camera; means for transmitting and receiving video information for transmitting the video signal and said detected moving objects and receiving an indication of the selected object of interest; a translator for determining an object of interest at a current time point based on a video signal transmitted at a first time point and said indication of the selected object of interest received at said current time point; means for predicting a future position of the object of interest and a coordinating future position of the movable video camera; a movement coordinator for creating movement signals to move the movable video camera to said future position from a current position.
15. The system of claim 14 wherein said future position of the movable camera is in a display coordinate system used for representing objects in the field of view, and said movement coordinator includes a coordinate translation database storing a mapping of display coordinates to camera controller coordinates for translating said future position said movable camera in said display coordinate system to a future position in a camera controller coordinate system; and wherein said movement signals are created in said camera controller coordinate system.
16. The system of claim 14 wherein said translator further includes a video database for storing the video signal received between said first time point and said current time point .
17. A computer readable medium having stored thereon computer-executable instructions for holding an object of interest in a field of view of a movable video camera, the object of interest being selected from a plurality of moving objects detected in the field of view performing the steps comprising: receiving an indication of the object of interest; predicting a future position of the object of interest based on a current position and movement parameters of the object of interest; determining a future position of the movable camera based on said future position of the object of interest, said future position of the movable camera having the object of interest in the field of view; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
18. The computer readable medium of claim 17 wherein said movement parameters includes the parameters of velocity and acceleration of the object of interest.
19. The computer readable medium of claim 17 wherein said step of generating includes the steps of: determining a difference between said current position of the movable camera and said future position of the movable camera; and creating control signals to move the movable camera said difference.
20. The computer readable medium of claim 19 wherein said difference is determined in a display coordinate system used for representing objects in the field of view, and the method further comprises the step of: translating said difference in said display coordinate system to a difference in a camera controller coordinate system; and wherein said step of creating control signals includes the step of creating control signals based on said difference in said camera controller coordinate system.
21. A computer readable medium having stored thereon computer-executable instructions for holding an object of interest selected by a user in a field of view of a movable camera, the movable camera producing a video signal representative of the field of view performing the steps comprising: detecting moving objects in the video signal; transmitting an indication of said detected moving objects and the video signal at a first time point; receiving an indication of the selected object of interest at a current time point; translating said indication of the selected object of interest from the video signal transmitted at said first time point to an object in the video signal at said current time point; predicting a future position of said selected object of interest based on a current position and movement parameters of said selected object of interest; determining a future position of the movable camera based on said future position of said selected object of interest; and generating movement signals for the movable camera based on a difference between a current position of the movable camera and said future position of the movable camera.
22. The method of 21 wherein said step of translating further includes the steps of: determining a difference between said first time point and said current time point; and determining a current location of said selected object of interest at said current time point based on said received indication taken at said first time point and said difference between said first time point and said current time point.
23. The computer readable medium of claim 21 wherein said movement parameters includes the parameters of velocity and acceleration of the object of interest.
24. The computer readable medium of claim 21 wherein said step of generating includes the steps of: determining a difference between said current position of the movable camera and said future position of the movable camera; and creating control signals to move the movable camera said difference.
25. The computer readable medium of claim 24 wherein said difference is determined in a display coordinate system used for representing objects in the field of view, and the method further comprises the step of: translating said difference in said display coordinate system to a difference in a camera controller coordinate system; and wherein said step of creating control signals includes the step of creating control signals based on said difference in said camera controller coordinate system.
26. The computer readable medium of claim 22 further including the step of storing the video signal received between said first time point and said current time point.
27. The computer readable medium of claim 26 wherein said step of determining a said current location of said selected object of interest includes the step of determining a position of said selected object of interest at said first time point from said stored video signal; mapping said position of said selected object of interest at said first time point to said current position.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2001247302A AU2001247302A1 (en) | 2000-03-10 | 2001-03-07 | Method and apparatus for object surveillance with a movable camera |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18817100P | 2000-03-10 | 2000-03-10 | |
US60/188,171 | 2000-03-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2001069930A1 true WO2001069930A1 (en) | 2001-09-20 |
Family
ID=22692026
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2001/007361 WO2001069932A1 (en) | 2000-03-10 | 2001-03-07 | Method and apparatus for object tracking and detection |
PCT/US2001/007330 WO2001069931A1 (en) | 2000-03-10 | 2001-03-07 | Method and apparatus for video surveillance with defined zones |
PCT/US2001/007228 WO2001069930A1 (en) | 2000-03-10 | 2001-03-07 | Method and apparatus for object surveillance with a movable camera |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2001/007361 WO2001069932A1 (en) | 2000-03-10 | 2001-03-07 | Method and apparatus for object tracking and detection |
PCT/US2001/007330 WO2001069931A1 (en) | 2000-03-10 | 2001-03-07 | Method and apparatus for video surveillance with defined zones |
Country Status (3)
Country | Link |
---|---|
US (3) | US20020008758A1 (en) |
AU (3) | AU2001247302A1 (en) |
WO (3) | WO2001069932A1 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2404247A (en) * | 2003-07-22 | 2005-01-26 | Hitachi Int Electric Inc | Object tracking when visual field range is related to an imaging prohibited region |
US7382400B2 (en) | 2004-02-19 | 2008-06-03 | Robert Bosch Gmbh | Image stabilization system and method for a video camera |
US7742077B2 (en) | 2004-02-19 | 2010-06-22 | Robert Bosch Gmbh | Image stabilization system and method for a video camera |
US8212872B2 (en) | 2004-06-02 | 2012-07-03 | Robert Bosch Gmbh | Transformable privacy mask for video camera images |
US9210312B2 (en) | 2004-06-02 | 2015-12-08 | Bosch Security Systems, Inc. | Virtual mask for use in autotracking video camera images |
CN106297162A (en) * | 2015-06-23 | 2017-01-04 | 霍尼韦尔国际公司 | The system and method for the intelligent event analysis in the control system of use floor maps |
GB2540129A (en) * | 2015-06-29 | 2017-01-11 | Sony Corp | Apparatus, method and computer program |
US9876993B2 (en) | 2002-11-27 | 2018-01-23 | Bosch Security Systems, Inc. | Video tracking system and method |
US10049542B2 (en) | 2012-11-04 | 2018-08-14 | Magal Security Systems Ltd. | Self-propelled security system on an adjacent to a fence track |
US20220301354A1 (en) * | 2012-11-14 | 2022-09-22 | Golan Weiss | Methods and systems for enrollment and authentication |
Families Citing this family (166)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002001754A1 (en) * | 2000-06-23 | 2002-01-03 | Sportvision, Inc. | Gps based tracking system |
US7082209B2 (en) * | 2000-08-31 | 2006-07-25 | Hitachi Kokusai Electric, Inc. | Object detecting method and object detecting apparatus and intruding object monitoring apparatus employing the object detecting method |
US9892606B2 (en) | 2001-11-15 | 2018-02-13 | Avigilon Fortress Corporation | Video surveillance system employing video primitives |
US20050146605A1 (en) | 2000-10-24 | 2005-07-07 | Lipton Alan J. | Video surveillance system employing video primitives |
US8711217B2 (en) | 2000-10-24 | 2014-04-29 | Objectvideo, Inc. | Video surveillance system employing video primitives |
US8564661B2 (en) * | 2000-10-24 | 2013-10-22 | Objectvideo, Inc. | Video analytic rule detection system and method |
US20050162515A1 (en) * | 2000-10-24 | 2005-07-28 | Objectvideo, Inc. | Video surveillance system |
US7868912B2 (en) * | 2000-10-24 | 2011-01-11 | Objectvideo, Inc. | Video surveillance system employing video primitives |
US7256817B2 (en) * | 2000-10-26 | 2007-08-14 | Fujinon Corporation | Following device |
WO2002037856A1 (en) * | 2000-11-06 | 2002-05-10 | Dynapel Systems, Inc. | Surveillance video camera enhancement system |
WO2002065763A2 (en) * | 2001-02-12 | 2002-08-22 | Carnegie Mellon University | System and method for manipulating the point of interest in a sequence of images |
US7027083B2 (en) * | 2001-02-12 | 2006-04-11 | Carnegie Mellon University | System and method for servoing on a moving fixation point within a dynamic scene |
US7424175B2 (en) | 2001-03-23 | 2008-09-09 | Objectvideo, Inc. | Video segmentation using statistical pixel modeling |
US20020171742A1 (en) * | 2001-03-30 | 2002-11-21 | Wataru Ito | Method and apparatus for controlling a view field of an image picking-up apparatus and computer program therefor |
US7728870B2 (en) * | 2001-09-06 | 2010-06-01 | Nice Systems Ltd | Advanced quality management and recording solutions for walk-in environments |
JP2003083712A (en) * | 2001-09-10 | 2003-03-19 | Denso Corp | Position recognition method for honeycomb structure |
US6970083B2 (en) * | 2001-10-09 | 2005-11-29 | Objectvideo, Inc. | Video tripwire |
US20030076413A1 (en) * | 2001-10-23 | 2003-04-24 | Takeo Kanade | System and method for obtaining video of multiple moving fixation points within a dynamic scene |
US7650058B1 (en) | 2001-11-08 | 2010-01-19 | Cernium Corporation | Object selective video recording |
KR100470931B1 (en) * | 2001-12-05 | 2005-02-22 | 가부시키가이샤 히다치 고쿠사이 덴키 | Object tracking method and apparatus using template matching |
US7583416B2 (en) * | 2001-12-20 | 2009-09-01 | Eastman Kodak Company | Document scanning system with tethered platen element providing sheet-fed and platen scanning functions |
US7062511B1 (en) | 2001-12-31 | 2006-06-13 | Oracle International Corporation | Method and system for portal web site generation |
JP4383891B2 (en) * | 2002-02-22 | 2009-12-16 | ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツング | Measurement data transmission device |
US7548957B1 (en) | 2002-05-07 | 2009-06-16 | Oracle International Corporation | Method and mechanism for a portal website architecture |
US7277924B1 (en) | 2002-05-07 | 2007-10-02 | Oracle International Corporation | Method and mechanism for a portal website architecture |
DE10222203B4 (en) * | 2002-05-18 | 2004-03-25 | Robert Bosch Gmbh | Image monitoring system |
EP1376502A1 (en) * | 2002-06-10 | 2004-01-02 | Siemens Building Technologies AG | Surveillance system |
US7385626B2 (en) * | 2002-10-21 | 2008-06-10 | Sarnoff Corporation | Method and system for performing surveillance |
DE602004015173D1 (en) * | 2003-01-21 | 2008-09-04 | Canon Kk | Imaging device and image acquisition system |
US7421727B2 (en) * | 2003-02-14 | 2008-09-02 | Canon Kabushiki Kaisha | Motion detecting system, motion detecting method, motion detecting apparatus, and program for implementing the method |
US20050134685A1 (en) * | 2003-12-22 | 2005-06-23 | Objectvideo, Inc. | Master-slave automated video-based surveillance system |
US20040196369A1 (en) * | 2003-03-07 | 2004-10-07 | Canon Kabushiki Kaisha | Monitoring system |
US8004565B2 (en) * | 2003-06-19 | 2011-08-23 | Nvidia Corporation | System and method for using motion vectors for object tracking |
US7310442B2 (en) | 2003-07-02 | 2007-12-18 | Lockheed Martin Corporation | Scene analysis surveillance system |
US20100013917A1 (en) * | 2003-08-12 | 2010-01-21 | Keith Hanna | Method and system for performing surveillance |
US20050052533A1 (en) * | 2003-09-05 | 2005-03-10 | Hitachi Kokusai Electric Inc. | Object tracking method and object tracking apparatus |
JP3791848B2 (en) * | 2003-10-28 | 2006-06-28 | 松下電器産業株式会社 | Image display apparatus, image display system, photographing apparatus, image display method, and program |
US20050104958A1 (en) * | 2003-11-13 | 2005-05-19 | Geoffrey Egnal | Active camera video-based surveillance systems and methods |
KR100601933B1 (en) * | 2003-11-18 | 2006-07-14 | 삼성전자주식회사 | Method and apparatus of human detection and privacy protection method and system employing the same |
US7428314B2 (en) * | 2003-12-03 | 2008-09-23 | Safehouse International Inc. | Monitoring an environment |
GB2408879A (en) | 2003-12-03 | 2005-06-08 | Safehouse Internat Inc | Storing data recorded over a period of time |
US8558892B2 (en) * | 2004-01-20 | 2013-10-15 | Honeywell International Inc. | Object blocking zones to reduce false alarms in video surveillance systems |
US7643066B2 (en) * | 2004-02-19 | 2010-01-05 | Robert Bosch Gmbh | Method and apparatus for producing frame accurate position data in a PTZ dome camera with open loop control |
US7447331B2 (en) * | 2004-02-24 | 2008-11-04 | International Business Machines Corporation | System and method for generating a viewable video index for low bandwidth applications |
JP2005295004A (en) * | 2004-03-31 | 2005-10-20 | Sanyo Electric Co Ltd | Stereoscopic image processing method and apparatus thereof |
EP1584944B1 (en) * | 2004-04-08 | 2008-07-16 | Festo AG & Co. KG | Imaging device and process for detecting moving objects |
US7542588B2 (en) * | 2004-04-30 | 2009-06-02 | International Business Machines Corporation | System and method for assuring high resolution imaging of distinctive characteristics of a moving object |
US20050270372A1 (en) * | 2004-06-02 | 2005-12-08 | Henninger Paul E Iii | On-screen display and privacy masking apparatus and method |
JP4140567B2 (en) * | 2004-07-14 | 2008-08-27 | 松下電器産業株式会社 | Object tracking device and object tracking method |
US7391907B1 (en) * | 2004-10-01 | 2008-06-24 | Objectvideo, Inc. | Spurious object detection in a video surveillance system |
US20060126737A1 (en) * | 2004-12-15 | 2006-06-15 | International Business Machines Corporation | Method, system and program product for a camera to track an object using motion vector data |
US20060126738A1 (en) * | 2004-12-15 | 2006-06-15 | International Business Machines Corporation | Method, system and program product for a plurality of cameras to track an object using motion vector data |
US8493443B2 (en) * | 2005-01-04 | 2013-07-23 | Hewlett-Packard Development Company, L.P. | Methods and apparatus for location determination and asserting and maintaining privacy |
TW200634674A (en) * | 2005-03-28 | 2006-10-01 | Avermedia Tech Inc | Surveillance system having multi-area motion-detection function |
US11232768B2 (en) | 2005-04-12 | 2022-01-25 | Douglas G. Richardson | Embedding animation in electronic mail, text messages and websites |
IL168210A (en) * | 2005-04-21 | 2012-03-29 | Rafael Advanced Defense Sys | Method for assisting a user to designate a target |
US8964029B2 (en) * | 2005-04-29 | 2015-02-24 | Chubb Protection Corporation | Method and device for consistent region of interest |
WO2007014216A2 (en) | 2005-07-22 | 2007-02-01 | Cernium Corporation | Directed attention digital video recordation |
US20070058717A1 (en) * | 2005-09-09 | 2007-03-15 | Objectvideo, Inc. | Enhanced processing for scanning video |
US20070152157A1 (en) * | 2005-11-04 | 2007-07-05 | Raydon Corporation | Simulation arena entity tracking system |
US8942426B2 (en) * | 2006-03-02 | 2015-01-27 | Michael Bar-Am | On-train rail track monitoring system |
JP2007249722A (en) * | 2006-03-17 | 2007-09-27 | Hitachi Ltd | Object detector |
JP2009533778A (en) * | 2006-04-17 | 2009-09-17 | オブジェクトビデオ インコーポレイテッド | Video segmentation using statistical pixel modeling |
US7907750B2 (en) * | 2006-06-12 | 2011-03-15 | Honeywell International Inc. | System and method for autonomous object tracking |
TW200801933A (en) * | 2006-06-22 | 2008-01-01 | Univ Nat Central | Positioning apparatus and method for a remote control camera combined with electronic map |
JP4940820B2 (en) * | 2006-08-09 | 2012-05-30 | パナソニック株式会社 | Network camera |
NZ551762A (en) * | 2006-11-30 | 2008-03-28 | Lincoln Ventures Ltd | Player position validation interface |
US9008354B2 (en) * | 2007-02-07 | 2015-04-14 | The Directv Group, Inc. | Video camera tracking system based on geoposition data feedback |
US8451331B2 (en) * | 2007-02-26 | 2013-05-28 | Christopher L. Hughes | Automotive surveillance system |
WO2008109608A1 (en) * | 2007-03-05 | 2008-09-12 | Sportvision, Inc. | Automatic measurement of advertising effectiveness |
TWI355615B (en) * | 2007-05-11 | 2012-01-01 | Ind Tech Res Inst | Moving object detection apparatus and method by us |
US20100157056A1 (en) * | 2007-05-20 | 2010-06-24 | Rafael Advanced Defense Systems Ltd. | Tracking and imaging data fusion |
US8159519B2 (en) * | 2007-05-31 | 2012-04-17 | Eastman Kodak Company | Personal controls for personal video communications |
US8154578B2 (en) * | 2007-05-31 | 2012-04-10 | Eastman Kodak Company | Multi-camera residential communication system |
US8253770B2 (en) * | 2007-05-31 | 2012-08-28 | Eastman Kodak Company | Residential video communication system |
US8154583B2 (en) * | 2007-05-31 | 2012-04-10 | Eastman Kodak Company | Eye gazing imaging for video communications |
US20080306708A1 (en) * | 2007-06-05 | 2008-12-11 | Raydon Corporation | System and method for orientation and location calibration for image sensors |
WO2009006605A2 (en) * | 2007-07-03 | 2009-01-08 | Pivotal Vision, Llc | Motion-validating remote monitoring system |
JP4872834B2 (en) * | 2007-07-04 | 2012-02-08 | 株式会社ニコン | Image recognition device, focus adjustment device, and imaging device |
US8587667B2 (en) | 2007-07-09 | 2013-11-19 | International Business Machines Corporation | Beyond field-of-view tracked object positional indicators for television event directors and camera operators |
JP4998156B2 (en) * | 2007-08-30 | 2012-08-15 | ソニー株式会社 | Information presenting system, information presenting apparatus, information presenting method, program, and recording medium recording the program |
US20100114704A1 (en) * | 2007-09-07 | 2010-05-06 | Ryan Steelberg | System and method for brand affinity content distribution and optimization |
KR101187909B1 (en) * | 2007-10-04 | 2012-10-05 | 삼성테크윈 주식회사 | Surveillance camera system |
DE102007052307A1 (en) * | 2007-10-31 | 2009-05-07 | Deutsche Industrie Video System Gmbh | Object's e.g. package, position determining and tracking system, has memory unit storing image information linked with numerical values or vector information of computer unit that analyses camera information |
US8315430B2 (en) * | 2007-11-07 | 2012-11-20 | Viewdle Inc. | Object recognition and database population for video indexing |
US8064641B2 (en) * | 2007-11-07 | 2011-11-22 | Viewdle Inc. | System and method for identifying objects in video |
CN101448142A (en) * | 2007-11-27 | 2009-06-03 | 鸿富锦精密工业(深圳)有限公司 | Image tracking device and image tracking method thereof |
DE102007058959A1 (en) * | 2007-12-07 | 2009-06-10 | Robert Bosch Gmbh | Configuration module for a monitoring system, monitoring system, method for configuring the monitoring system and computer program |
TWI353778B (en) * | 2007-12-21 | 2011-12-01 | Ind Tech Res Inst | Moving object detection apparatus and method |
TWI381719B (en) * | 2008-02-18 | 2013-01-01 | Univ Nat Taiwan | Full-frame video stabilization with a polyline-fitted camcorder path |
US8330810B2 (en) * | 2008-02-27 | 2012-12-11 | Honeywell International Inc. | Systems and method for dynamic stabilization of target data detected from a moving platform |
US8320615B2 (en) * | 2008-02-27 | 2012-11-27 | Honeywell International Inc. | Systems and methods for recognizing a target from a moving platform |
US9741129B2 (en) * | 2008-04-14 | 2017-08-22 | Gvbb Holdings S.A.R.L. | Technique for automatically tracking an object by a camera based on identification of an object |
US8169481B2 (en) * | 2008-05-05 | 2012-05-01 | Panasonic Corporation | System architecture and process for assessing multi-perspective multi-context abnormal behavior |
US8311275B1 (en) | 2008-06-10 | 2012-11-13 | Mindmancer AB | Selective viewing of a scene |
US9288449B2 (en) * | 2008-08-05 | 2016-03-15 | University Of Florida Research Foundation, Inc. | Systems and methods for maintaining multiple objects within a camera field-of-view |
FR2935214B1 (en) * | 2008-08-20 | 2010-10-08 | Eads Europ Aeronautic Defence | METHOD AND DEVICE FOR REMOTELY CONTROLLING AN INBOARD CAMERA IN A MOBILE STATION |
US8150169B2 (en) * | 2008-09-16 | 2012-04-03 | Viewdle Inc. | System and method for object clustering and identification in video |
US9215467B2 (en) | 2008-11-17 | 2015-12-15 | Checkvideo Llc | Analytics-modulated coding of surveillance video |
KR101627185B1 (en) * | 2009-04-24 | 2016-06-03 | 삼성전자 주식회사 | Control method of image photographing apparatus |
TW201040581A (en) * | 2009-05-06 | 2010-11-16 | J Touch Corp | Digital image capturing device with stereo image display and touch functions |
TWI423146B (en) * | 2009-06-05 | 2014-01-11 | Univ Nat Taiwan Science Tech | Method and system for actively detecting and recognizing placards |
US9697746B2 (en) * | 2009-09-30 | 2017-07-04 | National Ict Australia Limited | Object tracking for artificial vision |
JP5570176B2 (en) * | 2009-10-19 | 2014-08-13 | キヤノン株式会社 | Image processing system and information processing method |
US10375287B2 (en) * | 2009-10-21 | 2019-08-06 | Disney Enterprises, Inc. | Object trail-based analysis and control of video |
US20110150272A1 (en) * | 2009-12-21 | 2011-06-23 | Honeywell International Inc. | Systems and methods of tracking object paths |
US20110187895A1 (en) * | 2010-02-03 | 2011-08-04 | Fred Cheng | Intelligent video compacting agent |
JP2013533469A (en) | 2010-05-25 | 2013-08-22 | アリックス インク | Methods and apparatus for detection of particle positional freedom in biological and chemical analysis and applications in immunodiagnostics |
JP5791256B2 (en) * | 2010-10-21 | 2015-10-07 | キヤノン株式会社 | Display control apparatus and display control method |
US9794518B2 (en) | 2010-10-21 | 2017-10-17 | Sensormatic Electronics, LLC | Method and system for converting privacy zone planar images to their corresponding pan/tilt coordinates |
GB2489675A (en) * | 2011-03-29 | 2012-10-10 | Sony Corp | Generating and viewing video highlights with field of view (FOV) information |
US9565403B1 (en) * | 2011-05-05 | 2017-02-07 | The Boeing Company | Video processing system |
US8790269B2 (en) * | 2011-05-09 | 2014-07-29 | Xerox Corporation | Monitoring respiration with a thermal imaging system |
US8548848B1 (en) * | 2011-06-21 | 2013-10-01 | Google Inc. | Mobile interstitial ads |
US8996234B1 (en) * | 2011-10-11 | 2015-03-31 | Lytx, Inc. | Driver performance determination based on geolocation |
US9298575B2 (en) | 2011-10-12 | 2016-03-29 | Lytx, Inc. | Drive event capturing based on geolocation |
JP6004371B2 (en) * | 2011-11-16 | 2016-10-05 | パナソニックIpマネジメント株式会社 | Imaging device |
US9210300B2 (en) * | 2011-12-19 | 2015-12-08 | Nec Corporation | Time synchronization information computation device for synchronizing a plurality of videos, time synchronization information computation method for synchronizing a plurality of videos and time synchronization information computation program for synchronizing a plurality of videos |
US8704904B2 (en) | 2011-12-23 | 2014-04-22 | H4 Engineering, Inc. | Portable system for high quality video recording |
WO2013116810A1 (en) | 2012-02-03 | 2013-08-08 | H4 Engineering, Inc. | Apparatus and method for securing a portable electronic device |
US8749634B2 (en) | 2012-03-01 | 2014-06-10 | H4 Engineering, Inc. | Apparatus and method for automatic video recording |
US9723192B1 (en) | 2012-03-02 | 2017-08-01 | H4 Engineering, Inc. | Application dependent video recording device architecture |
AU2013225635B2 (en) | 2012-03-02 | 2017-10-26 | H4 Engineering, Inc. | Waterproof Electronic Device |
IL219639A (en) | 2012-05-08 | 2016-04-21 | Israel Aerospace Ind Ltd | Remote tracking of objects |
JP6057562B2 (en) | 2012-06-28 | 2017-01-11 | キヤノン株式会社 | Information processing apparatus and control method thereof |
WO2014008504A1 (en) | 2012-07-06 | 2014-01-09 | H4 Engineering, Inc. | A remotely controlled automatic camera tracking system |
US9344683B1 (en) | 2012-11-28 | 2016-05-17 | Lytx, Inc. | Capturing driving risk based on vehicle state and automatic detection of a state of a location |
WO2014111923A1 (en) * | 2013-01-15 | 2014-07-24 | Israel Aerospace Industries Ltd | Remote tracking of objects |
IL224273B (en) | 2013-01-17 | 2018-05-31 | Cohen Yossi | Delay compensation while controlling a remote sensor |
US9905009B2 (en) | 2013-01-29 | 2018-02-27 | Ramrock Video Technology Laboratory Co., Ltd. | Monitor system |
US9374532B2 (en) * | 2013-03-15 | 2016-06-21 | Google Inc. | Cascaded camera motion estimation, rolling shutter detection, and camera shake detection for video stabilization |
US8929603B1 (en) * | 2013-03-15 | 2015-01-06 | Puretech Systems, Inc. | Autonomous lock-on target tracking with geospatial-aware PTZ cameras |
US10298846B2 (en) | 2013-03-15 | 2019-05-21 | Freefly Systems, Inc. | Method and system for enabling pointing control of an actively stabilized camera |
RU2543527C1 (en) * | 2013-08-08 | 2015-03-10 | Открытое акционерное общество "Ракетно-космическая корпорация "Энергия" имени С.П. Королева" | Method of measuring speed of objects from television images thereof |
WO2015102731A2 (en) * | 2013-10-18 | 2015-07-09 | Aerovironment, Inc. | Privacy shield for unmanned aerial systems |
US9684435B2 (en) * | 2014-01-13 | 2017-06-20 | Disney Enterprises, Inc. | Camera selection interface for producing a media presentation |
WO2015142919A1 (en) * | 2014-03-17 | 2015-09-24 | BARNES, Megan, D. | Airplane collision avoidance |
CN104036490B (en) * | 2014-05-13 | 2017-03-29 | 重庆大学 | Foreground segmentation method suitable for mobile communications network transmission |
US10334150B2 (en) * | 2014-05-14 | 2019-06-25 | Hanwha Aerospace Co., Ltd. | Camera system and method of tracking object using the same |
US10070077B2 (en) | 2014-09-26 | 2018-09-04 | Sensormatic Electronics, LLC | System and method for automated camera guard tour operation |
US9900511B2 (en) | 2015-04-10 | 2018-02-20 | Freefly Systems, Inc. | Method, system, and device for controlling a stabilized camera remotely |
US10872241B2 (en) | 2015-04-17 | 2020-12-22 | Ubicquia Iq Llc | Determining overlap of a parking space by a vehicle |
US10043307B2 (en) | 2015-04-17 | 2018-08-07 | General Electric Company | Monitoring parking rule violations |
US10445885B1 (en) | 2015-10-01 | 2019-10-15 | Intellivision Technologies Corp | Methods and systems for tracking objects in videos and images using a cost matrix |
US10139281B2 (en) | 2015-12-04 | 2018-11-27 | Amazon Technologies, Inc. | Motion detection for A/V recording and communication devices |
US10325625B2 (en) | 2015-12-04 | 2019-06-18 | Amazon Technologies, Inc. | Motion detection for A/V recording and communication devices |
EP3405889A4 (en) * | 2016-01-21 | 2019-08-28 | Wizr LLC | Cloud platform with multi camera synchronization |
CN107105193B (en) * | 2016-02-23 | 2020-03-20 | 芋头科技(杭州)有限公司 | Robot monitoring system based on human body information |
US10055652B2 (en) * | 2016-03-21 | 2018-08-21 | Ford Global Technologies, Llc | Pedestrian detection and motion prediction with rear-facing camera |
US10650650B2 (en) * | 2016-08-12 | 2020-05-12 | A9.Com, Inc. | Parcel theft deterrence for A/V recording and communication devices |
US11545013B2 (en) * | 2016-10-26 | 2023-01-03 | A9.Com, Inc. | Customizable intrusion zones for audio/video recording and communication devices |
US11106274B2 (en) * | 2017-04-10 | 2021-08-31 | Intel Corporation | Adjusting graphics rendering based on facial expression |
EP3419283B1 (en) * | 2017-06-21 | 2022-02-16 | Axis AB | System and method for tracking moving objects in a scene |
US10062414B1 (en) * | 2017-08-22 | 2018-08-28 | Futurewei Technologies, Inc. | Determining a future field of view (FOV) for a particular user viewing a 360 degree video stream in a network |
US10819645B2 (en) | 2017-09-20 | 2020-10-27 | Futurewei Technologies, Inc. | Combined method for data rate and field of view size adaptation for virtual reality and 360 degree video streaming |
US10878578B2 (en) * | 2017-10-30 | 2020-12-29 | Qualcomm Incorporated | Exclusion zone in video analytics |
US10759051B2 (en) * | 2018-04-23 | 2020-09-01 | General Electric Company | Architecture and methods for robotic mobile manipulation system |
US11399137B2 (en) * | 2018-08-10 | 2022-07-26 | Aurora Flight Sciences Corporation | Object-tracking system |
EP3640903B1 (en) * | 2018-10-18 | 2023-12-27 | IDEMIA Identity & Security Germany AG | Signal dependent video surveillance |
TWI673653B (en) | 2018-11-16 | 2019-10-01 | 財團法人國家實驗研究院 | Moving object detection system and method |
CN111291585B (en) * | 2018-12-06 | 2023-12-08 | 杭州海康威视数字技术股份有限公司 | GPS-based target tracking system, method and device and ball machine |
US20230044707A1 (en) * | 2020-01-14 | 2023-02-09 | Sony Group Corporation | Information processor, information processing method, and program |
US11373511B2 (en) | 2020-09-14 | 2022-06-28 | PureTech Systems Inc. | Alarm processing and classification system and method |
US11610224B2 (en) * | 2021-03-16 | 2023-03-21 | International Business Machines Corporation | Electronic display systems |
DE102021207642A1 (en) | 2021-07-16 | 2023-01-19 | Robert Bosch Gesellschaft mit beschränkter Haftung | Surveillance device with at least two cameras, surveillance method, computer program and storage medium |
DE102022202620A1 (en) | 2022-03-17 | 2023-09-21 | Robert Bosch Gesellschaft mit beschränkter Haftung | Monitoring arrangement for displaying moving objects monitoring area, method for displaying a moving object in a monitoring area, computer program and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5754225A (en) * | 1995-10-05 | 1998-05-19 | Sony Corporation | Video camera system and automatic tracking method therefor |
US5798787A (en) * | 1995-08-11 | 1998-08-25 | Kabushiki Kaisha Toshiba | Method and apparatus for detecting an approaching object within a monitoring zone |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2644844B2 (en) * | 1988-09-20 | 1997-08-25 | 株式会社日立製作所 | Distributed image recognition system |
GB2279198B (en) * | 1990-08-02 | 1995-05-10 | Hughes Aircraft Co | Image tracking system and technique |
JP2873338B2 (en) * | 1991-09-17 | 1999-03-24 | 富士通株式会社 | Moving object recognition device |
EP0557007A2 (en) * | 1992-02-15 | 1993-08-25 | Sony Corporation | Picture processing apparatus |
KR0147572B1 (en) * | 1992-10-09 | 1998-09-15 | 김광호 | Method & apparatus for object tracing |
US5387768A (en) * | 1993-09-27 | 1995-02-07 | Otis Elevator Company | Elevator passenger detector and door control system which masks portions of a hall image to determine motion and court passengers |
CA2148231C (en) * | 1993-01-29 | 1999-01-12 | Michael Haysom Bianchi | Automatic tracking camera control system |
US5473369A (en) * | 1993-02-25 | 1995-12-05 | Sony Corporation | Object tracking apparatus |
ES2151550T3 (en) | 1993-06-04 | 2001-01-01 | Sarnoff Corp | SYSTEM AND PROCEDURE FOR ELECTRONIC STABILIZATION OF IMAGES. |
US5739856A (en) * | 1993-10-07 | 1998-04-14 | Nikon Corporation | Photographic subject position predicting apparatus |
EP0660131A1 (en) * | 1993-12-23 | 1995-06-28 | Karl Osen | Camera guidance system |
US5694625A (en) * | 1994-09-07 | 1997-12-02 | Nikon Corporation | Camera provided with an automatic focus adjusting apparatus |
JP3693130B2 (en) * | 1996-06-28 | 2005-09-07 | ソニー株式会社 | Control device |
JP3895431B2 (en) * | 1996-07-08 | 2007-03-22 | 株式会社ハイニックスセミコンダクター | Video information encoding method using object boundary block merge / division |
US5677224A (en) * | 1996-09-03 | 1997-10-14 | Advanced Micro Devices, Inc. | Method of making asymmetrical N-channel and P-channel devices |
JPH1091795A (en) * | 1996-09-12 | 1998-04-10 | Toshiba Corp | Device for detecting mobile object and method therefor |
US5878151A (en) * | 1996-10-31 | 1999-03-02 | Combustion Engineering, Inc. | Moving object tracking |
US6061055A (en) * | 1997-03-21 | 2000-05-09 | Autodesk, Inc. | Method of tracking objects with an imaging device |
US6760061B1 (en) * | 1997-04-14 | 2004-07-06 | Nestor Traffic Systems, Inc. | Traffic sensor |
US6727938B1 (en) * | 1997-04-14 | 2004-04-27 | Robert Bosch Gmbh | Security system with maskable motion detection and camera with an adjustable field of view |
US6445409B1 (en) * | 1997-05-14 | 2002-09-03 | Hitachi Denshi Kabushiki Kaisha | Method of distinguishing a moving object and apparatus of tracking and monitoring a moving object |
US6263088B1 (en) * | 1997-06-19 | 2001-07-17 | Ncr Corporation | System and method for tracking movement of objects in a scene |
US6335985B1 (en) * | 1998-01-07 | 2002-01-01 | Kabushiki Kaisha Toshiba | Object extraction apparatus |
KR100281463B1 (en) * | 1998-03-14 | 2001-02-01 | 전주범 | Sub-data encoding apparatus in object based encoding system |
US6545705B1 (en) * | 1998-04-10 | 2003-04-08 | Lynx System Developers, Inc. | Camera with object recognition/data output |
JP2001169281A (en) * | 1999-12-13 | 2001-06-22 | Matsushita Electric Ind Co Ltd | Device and method for encoding moving image |
US6509926B1 (en) * | 2000-02-17 | 2003-01-21 | Sensormatic Electronics Corporation | Surveillance apparatus for camera surveillance system |
WO2002045434A1 (en) * | 2000-12-01 | 2002-06-06 | Vigilos, Inc. | System and method for processing video data utilizing motion detection and subdivided video fields |
-
2001
- 2001-03-07 AU AU2001247302A patent/AU2001247302A1/en not_active Abandoned
- 2001-03-07 AU AU2001240100A patent/AU2001240100A1/en not_active Abandoned
- 2001-03-07 AU AU2001247315A patent/AU2001247315A1/en not_active Abandoned
- 2001-03-07 US US09/801,441 patent/US20020008758A1/en not_active Abandoned
- 2001-03-07 WO PCT/US2001/007361 patent/WO2001069932A1/en active Application Filing
- 2001-03-07 WO PCT/US2001/007330 patent/WO2001069931A1/en active Application Filing
- 2001-03-07 WO PCT/US2001/007228 patent/WO2001069930A1/en active Application Filing
- 2001-03-07 US US09/801,484 patent/US7307652B2/en not_active Expired - Lifetime
- 2001-03-07 US US09/801,483 patent/US6867799B2/en not_active Expired - Lifetime
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5798787A (en) * | 1995-08-11 | 1998-08-25 | Kabushiki Kaisha Toshiba | Method and apparatus for detecting an approaching object within a monitoring zone |
US5754225A (en) * | 1995-10-05 | 1998-05-19 | Sony Corporation | Video camera system and automatic tracking method therefor |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9876993B2 (en) | 2002-11-27 | 2018-01-23 | Bosch Security Systems, Inc. | Video tracking system and method |
US7596240B2 (en) | 2003-07-22 | 2009-09-29 | Hitachi Kokusai Electric, Inc. | Object tracking method and object tracking apparatus |
GB2404247A (en) * | 2003-07-22 | 2005-01-26 | Hitachi Int Electric Inc | Object tracking when visual field range is related to an imaging prohibited region |
GB2404247B (en) * | 2003-07-22 | 2005-07-20 | Hitachi Int Electric Inc | Object tracing method and object tracking apparatus |
US7382400B2 (en) | 2004-02-19 | 2008-06-03 | Robert Bosch Gmbh | Image stabilization system and method for a video camera |
US7742077B2 (en) | 2004-02-19 | 2010-06-22 | Robert Bosch Gmbh | Image stabilization system and method for a video camera |
US8212872B2 (en) | 2004-06-02 | 2012-07-03 | Robert Bosch Gmbh | Transformable privacy mask for video camera images |
US9210312B2 (en) | 2004-06-02 | 2015-12-08 | Bosch Security Systems, Inc. | Virtual mask for use in autotracking video camera images |
US11153534B2 (en) | 2004-06-02 | 2021-10-19 | Robert Bosch Gmbh | Virtual mask for use in autotracking video camera images |
US10049542B2 (en) | 2012-11-04 | 2018-08-14 | Magal Security Systems Ltd. | Self-propelled security system on an adjacent to a fence track |
US20220301354A1 (en) * | 2012-11-14 | 2022-09-22 | Golan Weiss | Methods and systems for enrollment and authentication |
US11823499B2 (en) * | 2012-11-14 | 2023-11-21 | Golan Weiss | Methods and systems for enrollment and authentication |
CN106297162A (en) * | 2015-06-23 | 2017-01-04 | 霍尼韦尔国际公司 | The system and method for the intelligent event analysis in the control system of use floor maps |
GB2540129A (en) * | 2015-06-29 | 2017-01-11 | Sony Corp | Apparatus, method and computer program |
Also Published As
Publication number | Publication date |
---|---|
AU2001247315A1 (en) | 2001-09-24 |
WO2001069931A1 (en) | 2001-09-20 |
AU2001240100A1 (en) | 2001-09-24 |
US6867799B2 (en) | 2005-03-15 |
AU2001247302A1 (en) | 2001-09-24 |
US20020008758A1 (en) | 2002-01-24 |
US20010035907A1 (en) | 2001-11-01 |
US7307652B2 (en) | 2007-12-11 |
WO2001069932A1 (en) | 2001-09-20 |
US20020030741A1 (en) | 2002-03-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6867799B2 (en) | Method and apparatus for object surveillance with a movable camera | |
KR102189262B1 (en) | Apparatus and method for collecting traffic information using edge computing | |
EP2196967B1 (en) | Methods and apparatus for adaptively streaming video data based on a triggering event | |
US8180107B2 (en) | Active coordinated tracking for multi-camera systems | |
US6989745B1 (en) | Sensor device for use in surveillance system | |
US7242295B1 (en) | Security data management system | |
US7342489B1 (en) | Surveillance system control unit | |
US7385626B2 (en) | Method and system for performing surveillance | |
KR101727162B1 (en) | Apparatus and method for providing vessel traffic service | |
US20110279697A1 (en) | Ar navigation for repeat photography and difference extraction | |
EP0878965A2 (en) | Method for tracking entering object and apparatus for tracking and monitoring entering object | |
CA2466085A1 (en) | Method and apparatus for providing immersive surveillance | |
KR101125233B1 (en) | Fusion technology-based security method and security system thereof | |
JP6413530B2 (en) | Surveillance system, video analysis apparatus, video analysis method and program | |
CN111091584B (en) | Target tracking method, device, equipment and storage medium | |
Baldwin et al. | Panoramic video with predictive windows for telepresence applications | |
JP3852745B2 (en) | Object detection method and object detection apparatus | |
JP3122002B2 (en) | Interactive information provision device | |
CN111462189A (en) | Image locking and tracking system and method | |
JP2006211696A (en) | Object detecting method and object detecting system | |
JPH06289927A (en) | Multimedia process monitor/control device | |
Chien et al. | Acquisition Of Moving Objects And Hand-Eye Coordination. | |
JP2004336569A (en) | Mobile object monitor system and mobile object monitor method | |
JP2001012946A (en) | Dynamic image processor and processing method | |
JP2003163929A (en) | Image monitor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AU BR CA JP |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: JP |