US20100208070A2 - Computerized information collection and training method and apparatus - Google Patents
Computerized information collection and training method and apparatus Download PDFInfo
- Publication number
- US20100208070A2 US20100208070A2 US11/989,954 US98995406A US2010208070A2 US 20100208070 A2 US20100208070 A2 US 20100208070A2 US 98995406 A US98995406 A US 98995406A US 2010208070 A2 US2010208070 A2 US 2010208070A2
- Authority
- US
- United States
- Prior art keywords
- data
- vehicle
- relating
- route
- location
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000012549 training Methods 0.000 title claims abstract description 60
- 230000001360 synchronised effect Effects 0.000 claims description 16
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 claims description 7
- 238000001454 recorded image Methods 0.000 claims description 7
- 239000000446 fuel Substances 0.000 claims description 3
- 230000001133 acceleration Effects 0.000 claims description 2
- 230000004424 eye movement Effects 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 claims description 2
- 238000003909 pattern recognition Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 18
- 238000012360 testing method Methods 0.000 description 8
- 230000008859 change Effects 0.000 description 6
- 238000012550 audit Methods 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 238000012384 transportation and delivery Methods 0.000 description 4
- 230000006378 damage Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000005065 mining Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 241001516311 Watermelon virus A Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000000881 depressing effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013383 initial experiment Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 239000010421 standard material Substances 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
-
- B60K35/80—
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/16—Control of vehicles or other craft
- G09B19/167—Control of land vehicles
-
- B60K2360/566—
-
- B60K2360/573—
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0858—Registering performance data using electronic data carriers wherein the data carrier is removable
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/0875—Registering performance data using magnetic data carriers
- G07C5/0891—Video recorder in combination with video camera
Definitions
- This invention relates to a computerised information collection method and apparatus and a method of, and apparatus for, training based on the information collected.
- the present invention is particularly but not exclusively suited to use in collecting information on drivers operating vehicles for assessment of drivers undertaking a driver training or testing program.
- the present invention is also particularly but not exclusively suited to the training of or informing drivers or users of motor vehicles.
- the method and apparatus of the invention however may be used for the purposes of information collection and/or training in a wide range of applications.
- ABS Antilock Braking Systems
- ESP Electronic Stability Programs
- CAS Collision avoidance systems
- Lane Departure Warning systems and Adaptive Cruise Control systems are all advanced ‘last-minute’ intervention technologies that have the ability to reduce the incidence of injury during the vital seconds before a crash.
- These technologies are predominantly found in passenger cars, as opposed to large commercial vehicles, such as buses.
- These intervention technologies do not allow the managers of professional transit drivers to intervene as the likelihood of crash or other incident increases nor do they provide information relating to correct operation of a motor vehicle.
- Larger vehicles such as buses may have “black box” technologies installed to record data however these provide date only after an event has occurred.
- assessments may include assessments of driving skill, conduct or business to organizational standards, passenger interaction, driving to road rules and other driving aspects. Ensuring the safety of passengers and other road users is a primary objective for transport operators.
- an onboard instructor or tester it would be desirable for an onboard instructor or tester to be able to collect information whilst observing a vehicle driver during operation of a vehicle and provide advanced input upon which a subsequent driver assessment report can be based so as to provide an enhanced training facility for vehicle drivers.
- Potential training applications include bus driver routes and other application where training must be delivered related to an accurate geographical location or route such as homeland security applications, rail and light rail applications, dangerous goods transport applications, oil and gas transport applications, mining vehicle applications, airport flightside applications, marine and military applications.
- the present invention thus aims to provide in one aspect a computerised information collection method and apparatus which are particularly but not exclusively suited to use in collecting information on operators of machinery or equipment or individuals undertaking other observable tasks for the purposes of assessing the operation of the machinery or equipment.
- the present invention aims to provide a method and apparatus for collecting information on operation of vehicles by drivers of vehicles to enable assessment of drivers undertaking a driver training or testing program.
- the present invention aims to provide a method and apparatus for collecting information of other observable scenes such as for collecting information on certain processes or establishments for auditing or inspection purposes.
- the present invention aims to provide a training method and apparatus for vehicle operators and in particular to a route training method and apparatus.
- the present invention further aims to provide a method and apparatus for preparing a computer-based route training program using the above referred to information collection method and apparatus.
- the present invention thus provides in a first preferred aspect, a method of collecting information relating to an observable scene comprising the steps of capturing and recording in computing apparatus, image data relating to said scene, recording in said computer apparatus, location data corresponding to said image data, said location data being synchronised with said recorded image data, and providing in said computing apparatus, means for recording information relating to said recorded image and/or location data.
- the present invention in further aspect provides apparatus for collecting information relating to an observable scene, said apparatus including computing apparatus, image capturing means for capturing an image or images of said scene, means for recording in said computing apparatus, image data capturing by said image capturing means, location sensing means, means for recording in said computing apparatus, location data sensed by said location sensing means, said location data being synchronized with said recorded image data, and input means for recording in said computing apparatus, information relating to said image data and/or said location data.
- the computing apparatus may comprise a portable computer such as a tablet PC, a pocket or palm PC or laptop computer.
- the computing apparatus may, depending upon the application, comprise a fixed computer or an onboard computer on a vehicle from which images are captured and recorded.
- the imaging capturing means, location sensing means and computing means are located in a vehicle from which the image and location data are captured and recorded.
- the apparatus may additionally include one or more sensors for sensing further data and means are suitably provided for recording the further data in the computing apparatus at the same time as recording of the image and/or location data.
- the computing apparatus may comprise a single computer for the recording of all data including the image and location data.
- the computing apparatus may include first computer means for recording the image and location data or any other data and a second computer means comprising the input means for recording the information relating to the image and/or location data.
- the first computer means may comprise a tablet PC, a PDA (pocket or palm PC), a laptop computer, an in-vehicle PC, a desktop PC, a cell phone, a customized embedded computer or any other computing device.
- the second computer means may comprise a tablet PC, a PDA (pocket or palm PC), a cell phone, smart paper, a laptop computer or other computing platform.
- the interface to the input means may comprise one or more of a stylus, touch screen, mouse, trackball, smart pen for use with smart paper, keyboard, keypad, microphone associated with voice recognition software, a game pad or a joystick.
- the computer means or apparatus for recording information relating to the image data and/or location data may display a table or form into which information may be inserted using an interface as referred to above and stored.
- the image data may be video or still image data captured using any form of camera, a web cam, a separately recorded camcorder video, a PDA camera, time and/or location stamped still camera, or cell phone camera.
- the location data may be data derived from any positioning system such as GPS, European Satellite Navigation System (GALILEO), Russian Global Navigation Satellite System (GLONASS), radio beacon based location technologies (802.11, Bluetooth, GSM), micro-location sensors or from an RF ID tag.
- GALILEO European Satellite Navigation System
- GLONASS Russian Global Navigation Satellite System
- radio beacon based location technologies 802.11, Bluetooth, GSM
- micro-location sensors or from an RF ID tag.
- the information recorded and derived as above may be stored in single or multiple files from which particular information can be extracted to permit assessment of the stored information.
- the stored information can be extracted to determine whether that person is undertaking the task correctly or efficiently which enables corrective or counseling actions to be formulated if required.
- the information can be extracted by any standard database and reporting tools. Custom algorithms may be used to extract further information from the data not available using standard databases or reporting tools. Algorithms can be used to detect certain patterns which may require correction.
- the recorded data may also be subject to statistical analysis for any purposes.
- the present invention provides a method of assessing a driver of a motor vehicle during operation of said vehicle by said driver, said method comprising the steps of monitoring and recording in computing apparatus, image data and location data relating to operation of said vehicle by said driver, said location data being synchronized with said image data, recording in said computing apparatus, input data from an observer during and relating to operation of said vehicle by said driver.
- the computing apparatus is capable of analyzing the recorded data and providing a report or reports of operation of the vehicle by the driver based on the recorded data.
- the present invention in another aspect provides apparatus for assessing a driver of a motor vehicle during operation of said vehicle by said driver, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to operation of said vehicle by said driver, location sensing means for obtaining location data of said vehicle, said computing apparatus being adapted to store said image data and location data synchronized with said image data, and input means associated with said computing apparatus for input of data from an observer during and relating to operation of said vehicle by said driver.
- the computing apparatus includes means for analyzing the data and for providing one or more reports relating to operation of the vehicle by said driver based on the data.
- the image data most preferably includes captured image data as recorded for example by one or more video cameras showing a particular vehicle route traveled by a vehicle and/or the vehicle operator.
- the location data typically may be derived from a GPS sensor used to sense geographical location of the vehicle.
- the apparatus may also include means for monitoring and recorded in the computing apparatus further data relating to operational parameters of a vehicle.
- the monitored vehicle parameters may comprise one or more of the following:
- the input data provided by the observer is input under predetermined categories into the computing apparatus, the predetermined categories relating to the vehicle operation and/or the vehicle driver.
- the predetermined categories can be selectively displayed on the computing apparatus to enable input by the observer under a predetermined category or categories.
- the categories are displayed on a form or table, which can receive input from the observer under one or more of the categories.
- the observer is a driver trainer or tester or other person skilled or expert in driving.
- the input means may comprise any known input device associated with the computing platform being used.
- the input may be input provided by a stylus in the case of a tablet or pocket PC or a mouse in the case of a laptop PC.
- the input may be a simple logic type answer such as a YES/NO answer.
- the form or table may include a default answer which may be accepted by or changed by the trainer or tester.
- the input data provided by the trainer or tester is recorded with the image and location data suitably in a database and analysis of that data by the computing apparatus provides information on operation of the vehicle operation which may produce a report or reports relating to vehicle operation.
- the present invention thus provides in a further preferred aspect, a method of assessing an operator of machinery or equipment during operation of said machinery or equipment by said operator, said method comprising the steps of monitoring and recording in computing apparatus, image data and location data synchronized with said image data relating to operation of said machinery or equipment by said operator, recording in said computing apparatus, input data from an observer during and relating to operation of said machinery or equipment by said operator, and analyzing said data and providing a report or reports of operation of said machinery or equipment by said operator based on said analysed data.
- the present invention in yet another aspect provides apparatus for assessing an operator of a machinery or equipment, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to operation of said machinery or equipment by said operator, location sensing means for obtaining location data relating to operation of said machinery or equipment by said operator, said computing apparatus being adapted to record said image data and location data synchronized with said image data and input means associated with said computing apparatus for receiving input data from an observer during and relating to operation of said machinery or equipment by said operator.
- the computing apparatus includes means for analyzing the data and for providing one or more reports relating to operation of said machinery or equipment by the operator based on the data. Analyzing of the data and providing of the reports is suitably undertaken by using suitable software.
- the reference to an observer above includes an instructor or expert in the operation of a vehicle or machinery or other equipment.
- the present invention in another preferred aspect provides a method of collecting information on a procedure, process or establishment, said method comprising the steps of recording in computing apparatus image data and location data synchronized with said image data relating to said procedure, process or establishment and recording in said computing apparatus, input data from an observer relating to said procedure, process or establishment
- the present invention in yet a further aspect provides apparatus for collecting information on a procedure, process or establishment, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to said procedure, process or establishment, locating sensing means for obtaining location data relating to said procedure, process or establishment, said computing apparatus being adapted to store said image data and location data synchronized with said image data relating to said procedure, process or establishment and input means for receiving input of data from an observer relating to said procedure, process or establishment.
- the present invention provides in another preferred aspect, a method of preparing a computer-base route training program for vehicle operators comprising the steps of selecting a route in relation to which training is to be undertaken, recording and storing in computing apparatus video image data and location information data about said selected route, and compiling a computer-based training program based on said recorded and stored data.
- the image data and location data are recorded on image capturing means and location sensing means on a vehicle traveling along said route.
- the method also includes the step of recording further input data from an observer or trainer relating to the selected route, the further data being used in the training program.
- the present invention provides in another preferred aspect, apparatus for preparing a computer-base route training or identification program in relation to a route to be undertaken by a vehicle operator, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to said route, location sensing means for obtaining location data relating to said route, said computing apparatus being adapted to store said image data and location data, and input means associated with said computing apparatus for receiving input of data from an observer relating to said route to enable compiling of a computer-based training program based on said data.
- the computer-based training or identification program is prepared at a fixed location and using appropriate authoring tools after recording of the above referred to data.
- the image data and location data may be recorded using any vehicle, a laptop computer, and recording hardware.
- the recording hardware can be attached to any vehicle of any type (including bicycles and motorcycles).
- the location recording hardware fits in a briefcase and will function anywhere location information data can be ascertained for example from a satellite, a global positioning system (GPS), from radio location, a track sector or speed transponder or from any other deployed location mechanism or system.
- GPS global positioning system
- the image capturing means suitably comprises one or more cameras but preferably a plurality of video cameras. Most preferably four video cameras mounted to the vehicle for capturing video image data providing different images or perspectives of the route. Recording software associated with the hardware allows the operator to focus on capturing the highest quality information concerning the route.
- the computer based training or identification program may also be prepared using other data relating to the vehicle such as data derived from vehicle sensors such as engine interfaces, following distance sensors and inertial sensors. This data may also be recorded and stored for use in preparation of the training or identification program.
- the video image data from the video cameras is synchronized with location, speed and other sensed and recorded data.
- the aforesaid data may be synchronized and multiplexed into the audio stream of Windows media files using real time multiplexing and compression algorithms. This information can then be de-multiplexed into vehicle information data, and audio, video and location information to be displayed to a trainee.
- multiple files for video and other data may be employed using time-based synchronization.
- the training program of the invention can be used for training tasks focused on routes to be traversed as well as locations to be visited, for example transit bus routes and pick-up/delivery locations, mining haul roads, parcel delivery routes and pick-up/delivery locations, fuel delivery routes and drop off locations and military patrols routes and locations.
- Trainers or authors of the program can integrate their own existing training materials into the training program including slideshows, animations, video, narrations and written documents.
- the training or identification program may have the capability of presenting multiple windows including video images, mapping, other computer-based training content (macromedia flash animations, video etc) and text.
- Points of interest along a particular route can be inserted by a trainer or author using the input means and may be classified for example as “Customer Service Issues”, “Operator Issues” or “Safety Issues”, and the trainer/author can define these issues in the context of the route.
- These points of interest may be linked to a timeline and a geographical location along the route and linked to specific frames or sections of video.
- route database allows trainers/authors to define many routes typically hundreds of routes, and update them as routes change or as other issues with the routes become evident. Route changes can then be tracked using route modification history.
- HTML quizzes can be embedded in the training program. Links can also be provided to other program materials. Sub-titles and voice-over support can additionally be added to the program to allow the trainer/author to provide a running commentary to the route.
- the resultant program can be published into a single deployable file.
- a trainee or other person using the program is able to navigate vehicle information data, audio, video and information location in synchronization by navigating in time, space (maps) or by specific events.
- Information “kiosk-style” navigation means that trainees or other persons with no previous computer experience can view the route information
- Navigation buttons may be provided to allow trainees or other persons to work through the route at their own pace, absorbing as much information as possible.
- Each point of interest along the route is linked to the training materials inserted and authored by the trainer/author.
- Trainees can be tested at any time during use of the program before being allowed to progress to the next phase of training.
- Points of interest highlighted by driver trainers ensure that trainees concentrate on significant parts of the route, and do not waste time on learning about irrelevant parts of a journey.
- the program of the invention is particularly suited to use by persons undergoing a driver training program in relation to a particular route to be undertaken, it may also be used by other persons wishing to obtain information about a particular route to be undertaken. Whilst the program is usually undertaken at a fixed location remote from a vehicle, the program may also be used within a vehicle by a driver seeking information about a route.
- each recorded route may be broken up into individual route segments with each segment comprising part of the route in relation to which training is to be undertaken and containing relevant video images and location information relating to that route segment.
- Each route segment also may contain “hotspot” and/or “hotzone” information.
- Each route segment is stored in a database as a separate file. Thus should a change occur in a portion of a route, the route segment of that route portion can be updated and re-recorded rather than requiring re-recording of the entire route. To view a required route, the appropriate route segments which constitute that route can be played back in the correct order. Furthermore where different routes have some overlap, overlapping route segments are only required to be recorded once. Thus video image information, location data information and “hotspot” and “hotzone” information could be captured and recorded in database in separate route segment files of all roads in a country.
- a user may then in seeking driving directions for a particular route search the database and receive information and directions relating to the particular route assembled from a plurality of route segment files which make up that route, the route being presented as video images, location data (as indicated on a map) and where relevant “hotspot” or “hotzone” information.
- route training program Whilst the route training program is capable of being played back through a software programmed computing platform, it may be streamed through a web-based viewing/learning tool so as to be accessible to persons requiring information on a particular route as well as to trainee drivers.
- the present invention provides in another preferred aspect, a method of training or informing a vehicle operator or user in relation to a route to be undertaken, said method comprising the steps of providing to said vehicle operator or user, a computer-base route training program, said program being adapted to display information concerning said route including location information relating to said route to be undertaken and video images of said route corresponding to said location information.
- the location information comprises information presented on a map.
- the present invention provides in yet another preferred aspect, a computer based route training or information program for training or informing a vehicle operator or user in relation to a route to be undertaken, said program being adapted to display on a computer display screen information concerning said route including location information relating to said route to be undertaken and video images of said route corresponding to said location information.
- the location information is displayed on a map of said route or part of said route.
- the displayed route includes a number of points of interest designated as “hotspots” or “hotzones” along the route.
- the points of interest may be designated in any manner for example as a number or cross on a particular route.
- information corresponding to respective points of interest along the route is accessible and displayable to the vehicle operator or user. That information may be displayed for example by positioning a cursor on the point of interest. The cursor may be positioned with a computer mouse or other positioning device and the information may be displayed by depressing a button on the mouse. That information may be a particular property relating to that point of interest for example road conditions at that marked location or any other information to be noted by the vehicle operator/trainee.
- means may be provided for tracking and recording routes or route segments viewed by a particular trainee.
- Such means which may comprise a software/web based tool may also advise of changes to a route or route segment and notify trainees or other persons of the changes or track trainees or other persons who know about the changes.
- a record may also be maintained of which trainees or other persons may need to be advised of the changed route.
- the present invention thus provides in a further preferred aspect, means for monitoring the above route training program, said monitoring means including means for recording information on each said operator or user, and means for recording in relation to each said operator or user, route segments in relation to which training has been undertaken by said operator or user.
- the monitoring means includes means for notifying operators or users of changes in route segments.
- the monitoring means suitably includes a database for recording the relevant information.
- the stored information concerning route information, changes in route or route segment and drivers who have undertaken training in relation to a route or an updated route may be linked to an organization learning management system, human resource database and an advance transportation management system.
- FIG. 1 illustrates typical components of information collection apparatus as used in the present invention for collecting information relating to assessment of a vehicle driver when operating a vehicle;
- FIG. 2 illustrates a typical driver assessment form as displayed on a display screen of the apparatus of the invention
- FIG. 3 illustrates schematically the manner in which the apparatus of the invention is used in relation to vehicle driver training or testing
- FIG. 4 illustrates typical driver assessment report generated by the apparatus of the invention
- FIG. 5 illustrates apparatus for preparing a route training program according to another aspect of the invention
- FIG. 6 illustrates a typical preview screen display on a computer for use in preparing the route training program
- FIGS. 7 and 8 illustrate typical authoring screen displays for use in preparing the route program with the of a route marked with “hotspots” and “hotzones”;
- FIGS. 9 and 10 illustrate alternative screen displays for defining “hotspots” and “hotzones” along the route
- FIG. 11 illustrates a presentation window as used during route training
- FIG. 12 illustrates a typical screen display for selection of a route for route training.
- apparatus 10 for collecting information relating to a driver of a vehicle for subsequent assessment of a driver
- the apparatus 10 including a tablet computer 11 having a display screen 12 , one or more video cameras 13 , a GPS sensor 14 for sensing speed and location, a comfort sensor 15 , and a junction box 16 which has inputs 17 to receive up to four outputs from up to four cameras 13 , and the outputs from a GPS sensor 14 and comfort sensor 15 and an output 18 which is connectable to the tablet computer 11 .
- the computer 11 has any known input device such as a stylus or mouse.
- the junction box 16 may have only three inputs for connection to two cameras 13 and a GPS sensor 14 . In some applications however, the junction box 16 is not required as the sensors 14 and 15 and camera/s 13 may be connected directly to the computer 11 .
- the comfort sensor 15 typically comprises an inertial sensor or other sensors to sense movements of the vehicle. Data from this or these sensors can be processed to determine the comfort level of the driver undertaking the drive.
- the apparatus 10 is used within a suitable training vehicle for example a bus and the video cameras 13 are mounted on the vehicle to record different views from the vehicle such as views to the front and rear of the vehicle and/or a view or views of a vehicle driver.
- the location of a vehicle in addition is monitored by the GPS sensor 14 also mounted on or within the vehicle.
- the computer 11 is programmed with driver recording software to enable the computer display screen 12 to show in a video window, the view or views 19 from the one or more video cameras 13 .
- the display screen 12 also can display as shown in FIG. 3 route and location on a map display 20 and vehicle speed 21 derived from the GPS sensor 14 corresponding to the route being traveled by the vehicle and to the images captured by the video camera/s 13 .
- the computer 11 is also programmed to display a customizable input form 22 in this case a driver assessment form which enables input by a driver trainer or tester.
- a customizable input form 22 in this case a driver assessment form which enables input by a driver trainer or tester.
- the input form can be generated by a low-level wizard application supplied as part of the software, or by using a third-party form authoring application to create more in-depth forms.
- a typical driver assessment form 22 is shown in FIG. 2 and includes in this case six assessment headings 23 or categories relating to operation of a vehicle in this case “Following Distance”, “Turns”, “Traffic lights and Signs”, “Intersections”, “Braking” and “Speed”.
- Each heading or category is assessed in accordance with sub-headings which are indicative of the correct (or incorrect) operation of a vehicle.
- the sub-headings 24 under the “Following Distance” heading are “Uses proper stopping distance behind other vehicles”, “Maintains safe following distance at city driving speeds”, and “Proper following distance at freeway driving speeds”.
- Input selection boxes 25 enable the driver trainer using the computer stylus or mouse to indicate whether the event defined by the sub-headings 24 has or has not occurred.
- the assessment form 20 has a text box 26 enabling freehand text and/or freehand diagrams to be entered by the driver trainer.
- the apparatus 10 is set up in a vehicle where a driver is to be assessed such as in a bus with the GPS sensor 14 positioned to provide sensed location and movement data to the computer 11 through the junction box 16 .
- the cameras 13 are set up on the vehicle to capture required video signals which are supplied to the computer 11 which is typically held by a trainer or tester in the vehicle observing the operation of the vehicle by the driver.
- the video window on the computer display screen 12 can show the views 19 from two or more cameras 13 (see FIG. 3 ).
- a video preview window allows accurate setup of cameras view prior to driver training testing session. This window also includes a display of current speed 21 derived from the GPS.
- the route and location of the vehicle is recorded for subsequent display on a map using a circuit overview menu whilst the entire journey is recorded by the cameras 13 .
- the driver tester or trainer then can enter information into the assessment form 22 in accordance with operation of the vehicle by the driver.
- the trainer or tester uses the mouse or stylus 27 to select the relevant event box which will display the numeral “1” or any other indicator in the box.
- GPS, video and other data is collected by the computer 11 while the driver tester/trainer is inputting the customised information.
- the location, video and speed at that time are recorded so that the event is linked to or synchronized with location information (as for example shown on a map 26 ) as well as video images 19 of or adjacent to that location.
- miscellaneous events may be recorded by using a free-form field such as in the box 26 .
- This field allows the input of diagrams, text and symbols.
- Handwriting recognition software may be used to turn the notes into text.
- the customised information entered into the form 20 is integrated with a database and may be viewed by time, location or by other customisable categories or standard or customized reporting tools.
- the large video data files may then be sliced into smaller pieces, with irrelevant information being deleted. This decreases storage requirements. These smaller slices of the video/data files may then be integrated into the database.
- Automated tools/neural network style algorithms can be used to interrogate the database to facilitate the automated detection of driving events.
- a typical driver assessment report 28 derived from a driver training or assessment session is illustrated in FIG. 4 .
- the generated report shows the number of times certain instructor detected events have occurred, how this links to the sub-headings in the report and advice that should be adhered to reduce the risk of this behavior occurring again.
- each type of event can be highlighted on a map of the drive undertaken on the report.
- This report is customizable from a database that stores this information and preferably can only be modified by a user with administrator privileges.
- the results of individual test drives and synchronized information regarding the completion of the training may be stored in corporate databases.
- the computer 11 used comprises a tablet PC however any other computing platform may be used such as a Laptop or Pocket PC or an in-car PC or customized PC either permanently or temporarily mounted.
- a portable computer however is preferred to allow portability of the apparatus.
- the apparatus may also include other sensors to sense vehicle operation such as the inertial sensors 15 or following distance sensors, and ECU interfaces.
- the present invention by automating reporting functionality, improves the productivity of driver instructors as paperwork is eliminated. Initial experiments have shown up to 2 hours per day productivity improvement potential.
- automated links to corporate databases robustness of risk management and training processes is assured. Effectiveness of training is assured as interactive debriefing can provide a strong link between classroom training and on-road performance
- the link between skills required, observed performance and video images provides evidence for personal change.
- Personalized action plans are directly related to observed problems. Improved interaction between trainers and trainees also results.
- the apparatus is easy to transport, setup and install.
- a GPS sensor for sensing location and a computer such as a tablet PC.
- the cameras may be vehicle mounted and the vehicle driven around the establishment being audited with photographic and video images being recorded linked to GPS location information.
- the location information may be derived from a RF ID tag. Information is then input by the person undertaking the audit (in the same manner that information is inserted into the form 22 ) with that information being linked to the images and location. Assessments can then be undertaken of all the data for audit or any other purposes.
- FIGS. 5 to 12 there is illustrated an application of the information collection function of the above described apparatus for the purpose of creating a computer based training program for training vehicle drivers in relation to particular routes which a driver may be required to undertake for example a route to be traversed by a bus driven by the driver so that the driver can be trained in relation to the route.
- the computer based route training system of this embodiment may be applied to a wide range of applications where a person is to be trained or informed in relation to a particular route. For example persons may be required to be trained in relation to the transportation of dangerous goods along a particular route. Similarly military personnel may be required to be trained in relation to the transportation of military equipment along a route. The general public however may also require information in relation to a particular route to be undertaken.
- the description below is primarily related to the training of bus drivers however it will be appreciate that the system may be equally applied to other applications as referred to above.
- the computer based training system 30 shown schematically in FIG. 5 uses a computer 31 such as a laptop computer or a tablet computer which is software programmed to have a first recording administration/trainer mode and a second student/trainee mode.
- the administrator/trainer initially records video and locating information whilst traveling in a vehicle traveling along the route for which the training program is to be created.
- one or more image capturing means or cameras 32 are mounted to the vehicle, the image capturing means or cameras 32 being provided with quick-release vehicle mounting hardware to enable them to be readily mounted to the vehicle.
- the image capturing means in this embodiment comprise two to four CCD cameras which capture images at 10 frames per second at 1 ⁇ 4 VGA resolution.
- the cameras 32 also have day and night capability and may have wide-angle and telephoto options. Images captured by the cameras 32 are stored in the memory of the computer 30 as the vehicle travels along the route.
- location data is captured in the computer 30 from a GPS sensor 33 which in the illustrated embodiment may comprise Wide Area Augmentation System (WAAS) or a differential GPS system.
- WAAS Wide Area Augmentation System
- the GPS sensor 33 used provides location information once per second at a 2-5 m accuracy.
- Data obtained from the GPS sensor 33 can be displayed on a map so that the position of the vehicle along a particular route can be viewed on a map display.
- a mapping interface is used to allow the importation of any data in standard GIS format and display it on the display screen.
- a user-customisable map display can include road styles, parkland, water and other features. Maps of this type are known and can be accessed free or from commercial mapping suppliers
- FIG. 6 illustrates a typical screen display 35 of the computer 31 as generated by the recording software using four cameras with images 37 from each camera being displayed during recording of the route. As shown, the images are different view from the vehicle comprising clockwise from the top image 37 , a view of the adjacent vehicle lane views to the front and rear of the vehicle and a view of the driver.
- the screen display 35 also includes a display 38 of speed. This display is similar to the display used in the embodiment of FIG. 3 .
- the typical file size of the file storing this information is 400 MBytes per hour.
- the administrator/trainer 34 can insert information relating to the route by operation of an event button.
- the administrator/trainer 34 can record with a microphone verbal notes which can be used as reminders for later preparation of the training program.
- the administrator/trainer 34 by using an authoring tool or screen, examples of which are illustrated in FIGS. 7 and 8 can mark the route 39 in relation to which training is to be undertaking and can also mark different points of interest or zone of interest on the route which have important information attached to them. These points referred to herein as “hotspots” and “hotzones” respectively are defined to focus trainees only on sections of the route or important points along the route 39 that are required learning. Hotspots can be classified into one or more pre-defined categories for quick browsing.
- hotspot types may be locations of traffic issues, accident black spots, significant customer service issues, bathroom locations, and rest stop locations during layovers between runs.
- categories which relate to a bus route are defined by icons 40 , 41 and 42 which are customer issues, conductor issues and safety issues respectively.
- the administrator/trainer can open the file and manage the hotspots and hotzones by inserting information relating to each hotspot.
- various hotspots 43 along the route have been identified by icons. Different types of hotspots can be made by the trainer/trainer to appear as different icons or colours on the map. Thus the icons 43 may be one or more of the icons 40 , 41 and 42 referred to above. Hotzones 44 along the route 39 can be marked in different colours.
- a pop-up window is triggered and appears as in FIG. 9 which allows the administrator/trainer to enter any text information as required.
- the pop-up window alternatively can be overlaid on the route creating authoring screen as in FIG. 10 .
- the administrators/trainers can adjust the map zoom to displayed of the hotspot or hotzone.
- the administrator/trainer can also determine within the trigger window whether to include a video as recorded by the cameras 32 for playback by marking the appropriate box 47 within the pop-up window.
- the administrator/trainer can determine the duration, start and finish of the video.
- the administrator/trainer can also determine whether to include playback of audio by marking the box 48 .
- the box 49 allows the administrator/trainer to add a text message relating to the hotspot or a warning such as the speed limit warning in the trigger window shown in FIG. 10 .
- the trigger widows thus trigger the display of certain information at specific times determined by the properties defined in the trigger. Triggers allow trainer control of map zoom, video angle (1-4 cameras), audio play in any Windows audio format display of information in a rich text box including symbols and images.
- the administrator/trainer in preparing the program can add a new event or hotspot or hotzone or remove an unnecessary event or hotspot or hotzone.
- a training program can include one or many hotspots or hotzone on a route without limit. Hotspots or hotzones can be from one second to the entire route length.
- the administrator/trainer can also show a single camera view and determine the size of the camera view window.
- the windows shown in FIGS. 9 and 10 allows the display of a map together with a video display.
- hotspots are visualized on the map as a different icons and hotzones as different color regions and on a timeline as block of time.
- a zoom ability can give finer visualisation of the sequence of events in a hotspot or hotzone. The author however has full dynamic control of map viewing for different parts of the route—zoom, pan, etc.
- a presentation window for presentation to the trainee as illustrated in FIG. 11 can replace a mapping window at pre-defined points in hotspots.
- the computer based training program prepared as above can contain any content within HTML specification. It may include video, sound, Flash animation, text, Powerpoint® slides. It may include HTML-based quizzes. It may support Lectora® and other multimedia authoring software packages with Web publishing capability. It further may refer to external documents of any type, including Microsoft Word® documents, Microsoft Excel® spreadsheets, and Adobe® PDFs. It further may play audio files, such as WAVs, MP3s or WMAs and additionally may display image files, such as JPEGs, GIFs, and BMPs.
- the program may describe in detail a route of up to two hours in length and may draw a map of the route with the ability to zoom and pan automatically.
- the program is saved in a suitable file format and is published for student or trainee access such as over a network.
- a trainee For use of the computer based training program, a trainee is presented with a list of available routes to learn and the trainee selects which route they need to learn as presented on the screen display illustrated in FIG. 12 .
- a multimedia introduction to the route can be played which may include standard materials for all routes, or the particular issues that make the selected route different from others.
- an overview of the entire route complete with all hotspots is displayed. The trainee can be taken to the first hotspot skipping parts of the route that are irrelevant. The first hotspot will often be the “deadhead”, the journey from the depot to the start of the route as in FIG. 8 . The trainee by clicking on a hotspot will be shown a display as determined by an administrator.
- a defined video may be played, text notes will be displayed and any link to an external program will be activated by clicking the relevant button.
- map zooms change to show more detail
- camera angles change to show the best view of points of interest or caution
- cautionary and advisory text and graphics appear (for example changes in speed zones) in the text box as hotspots are processed by the system.
- Each hotspot visited by the student will change colour or otherwise be marked so that a track can be kept of the visited hotspots. The trainee can thus be focused on the important aspects of the route to be learned.
- the trainee may be presented with quiz materials during the presentation, if these have been authored using SCORM compliant tools, then results can be communicated back to learning management systems
- Routes may be structured to allow “branching” from the main route to minor route for example similar to a branch line on a railway. Certain conditions may require this branching functionality.
- Routes may be assembled from existing sub-components or segments of routes.
- a new bus route may be composed 50% of an existing bus route and 50% of a new route.
- a route may be broken up into individual route segments which may be prepared in the above described manner using cameras 32 , a GPS sensor 33 and input from an administrator/author 34 .
- the segments may be prepared after recording the full route and broken up into different files or separate files for each segment may be prepared during the recording process.
- Each route segment thus contains video images and location information and may additionally contain “hotspot” and/or “hotzone” information input by the administrator/author.
- the appropriate route segments which constitute that route can be played back in the correct order with the route segments being combined similar to the task of editing a movie made up of scenes to define the whole route.
- overlapping route segments are thus only required to be recorded once.
- a user may then, in seeking driving directions or information for a particular route, search the database and receive information and directions relating to the particular route assembled from a plurality of route segment files which make up that route.
- the driver is thus presented with video images, location data (as indicated on a map) and where relevant “hotspot” or “hotzone” information along the route.
Abstract
Description
- This invention relates to a computerised information collection method and apparatus and a method of, and apparatus for, training based on the information collected. The present invention is particularly but not exclusively suited to use in collecting information on drivers operating vehicles for assessment of drivers undertaking a driver training or testing program. The present invention is also particularly but not exclusively suited to the training of or informing drivers or users of motor vehicles. The method and apparatus of the invention however may be used for the purposes of information collection and/or training in a wide range of applications.
- Driver error accounts for more than 90% of all road traffic collisions. Most accidents are not caused by unsafe cars or dangerous roads but by drivers making mistakes. Identifying, managing and correcting unsafe driving behavior is crucial to reducing the costs and risks associated with accidents. Passenger transport organizations worldwide are facing similar challenges in managing the risk profile of their drivers. There are significant costs associated with accidents and incidents, including insurance, liability claims, vehicle and property damage, injuries and fatalities.
- In our U.S. Pat. No. 6,470,240, we disclose a driver training system to improve the safety and competency of drivers. In that system, a portable sensing unit is temporarily mounted into a vehicle to measure and record driver behaviour during an on-road training session. Measurement and recording of the driver's behaviour however is simply by means of the sensing unit with no input from a third party such as a driver instructor or tester.
- Currently, several in-vehicle technologies are available to intervene when hazardous driving is detected. Antilock Braking Systems (ABS), Electronic Stability Programs (ESP), Collision avoidance systems (CAS), Lane Departure Warning systems and Adaptive Cruise Control systems are all advanced ‘last-minute’ intervention technologies that have the ability to reduce the incidence of injury during the vital seconds before a crash. These technologies are predominantly found in passenger cars, as opposed to large commercial vehicles, such as buses. These intervention technologies do not allow the managers of professional transit drivers to intervene as the likelihood of crash or other incident increases nor do they provide information relating to correct operation of a motor vehicle. Larger vehicles such as buses may have “black box” technologies installed to record data however these provide date only after an event has occurred.
- In order to ensure safety and service standards are maintained at all times, transport operators seek an effective approach to monitor and assess drivers during service hours as well as during training and licensing processes. These assessments may include assessments of driving skill, conduct or business to organizational standards, passenger interaction, driving to road rules and other driving aspects. Ensuring the safety of passengers and other road users is a primary objective for transport operators.
- It would be desirable for an onboard instructor or tester to be able to collect information whilst observing a vehicle driver during operation of a vehicle and provide advanced input upon which a subsequent driver assessment report can be based so as to provide an enhanced training facility for vehicle drivers.
- Inspection of other non-driving procedures or processes to ensure for example correct and efficient operation of those procedures or processes is usually undertaken manually by trained personnel using basic recording equipment which may be as simple as a form or pad upon which information is written. Similarly, manual inspections of factories, warehouses or other establishments are generally undertaken as part of an auditing program using basic recording equipment as above. It would be desirable to provide a means whereby information relating to such procedures, processes or establishments could be more efficiently recorded to provide an enhanced means for assessment of such procedures, processes or establishments or persons involved in such procedures, processes or establishments.
- It would also desirable to be able to train vehicle operators as to particular geographical routes that the vehicle controlled by the operator is required to travel and to train the operator to recognize certain locations along that route. Potential training applications include bus driver routes and other application where training must be delivered related to an accurate geographical location or route such as homeland security applications, rail and light rail applications, dangerous goods transport applications, oil and gas transport applications, mining vehicle applications, airport flightside applications, marine and military applications.
- It would also be desirable to enable information to be collected on operation of other machinery or equipment to enables assessment thereof to ensure machinery or other equipment is operated by operators in an efficient, correct or safe manner or to ensure trainee operators are trained correctly in the operation of such machinery and equipment.
- The present invention thus aims to provide in one aspect a computerised information collection method and apparatus which are particularly but not exclusively suited to use in collecting information on operators of machinery or equipment or individuals undertaking other observable tasks for the purposes of assessing the operation of the machinery or equipment. In a particular aspect, the present invention aims to provide a method and apparatus for collecting information on operation of vehicles by drivers of vehicles to enable assessment of drivers undertaking a driver training or testing program. In a further aspect, the present invention aims to provide a method and apparatus for collecting information of other observable scenes such as for collecting information on certain processes or establishments for auditing or inspection purposes. In yet another aspect, the present invention aims to provide a training method and apparatus for vehicle operators and in particular to a route training method and apparatus. The present invention further aims to provide a method and apparatus for preparing a computer-based route training program using the above referred to information collection method and apparatus. Other objects and advantages of the invention will become apparent from the following description.
- The present invention thus provides in a first preferred aspect, a method of collecting information relating to an observable scene comprising the steps of capturing and recording in computing apparatus, image data relating to said scene, recording in said computer apparatus, location data corresponding to said image data, said location data being synchronised with said recorded image data, and providing in said computing apparatus, means for recording information relating to said recorded image and/or location data.
- The present invention in further aspect provides apparatus for collecting information relating to an observable scene, said apparatus including computing apparatus, image capturing means for capturing an image or images of said scene, means for recording in said computing apparatus, image data capturing by said image capturing means, location sensing means, means for recording in said computing apparatus, location data sensed by said location sensing means, said location data being synchronized with said recorded image data, and input means for recording in said computing apparatus, information relating to said image data and/or said location data.
- The computing apparatus may comprise a portable computer such as a tablet PC, a pocket or palm PC or laptop computer. Alternatively the computing apparatus may, depending upon the application, comprise a fixed computer or an onboard computer on a vehicle from which images are captured and recorded. Preferably the imaging capturing means, location sensing means and computing means are located in a vehicle from which the image and location data are captured and recorded.
- The apparatus may additionally include one or more sensors for sensing further data and means are suitably provided for recording the further data in the computing apparatus at the same time as recording of the image and/or location data.
- The computing apparatus may comprise a single computer for the recording of all data including the image and location data. Alternatively the computing apparatus may include first computer means for recording the image and location data or any other data and a second computer means comprising the input means for recording the information relating to the image and/or location data.
- The first computer means may comprise a tablet PC, a PDA (pocket or palm PC), a laptop computer, an in-vehicle PC, a desktop PC, a cell phone, a customized embedded computer or any other computing device.
- The second computer means may comprise a tablet PC, a PDA (pocket or palm PC), a cell phone, smart paper, a laptop computer or other computing platform. The interface to the input means may comprise one or more of a stylus, touch screen, mouse, trackball, smart pen for use with smart paper, keyboard, keypad, microphone associated with voice recognition software, a game pad or a joystick.
- The computer means or apparatus for recording information relating to the image data and/or location data may display a table or form into which information may be inserted using an interface as referred to above and stored.
- The image data may be video or still image data captured using any form of camera, a web cam, a separately recorded camcorder video, a PDA camera, time and/or location stamped still camera, or cell phone camera.
- The location data may be data derived from any positioning system such as GPS, European Satellite Navigation System (GALILEO), Russian Global Navigation Satellite System (GLONASS), radio beacon based location technologies (802.11, Bluetooth, GSM), micro-location sensors or from an RF ID tag.
- The information recorded and derived as above may be stored in single or multiple files from which particular information can be extracted to permit assessment of the stored information. In the case where a person undertaking a particular task is being monitored using the apparatus and method of the invention, the stored information can be extracted to determine whether that person is undertaking the task correctly or efficiently which enables corrective or counselling actions to be formulated if required. The information can be extracted by any standard database and reporting tools. Custom algorithms may be used to extract further information from the data not available using standard databases or reporting tools. Algorithms can be used to detect certain patterns which may require correction. The recorded data may also be subject to statistical analysis for any purposes.
- In a particular aspect of the invention relating to motor vehicle drivers, the present invention provides a method of assessing a driver of a motor vehicle during operation of said vehicle by said driver, said method comprising the steps of monitoring and recording in computing apparatus, image data and location data relating to operation of said vehicle by said driver, said location data being synchronized with said image data, recording in said computing apparatus, input data from an observer during and relating to operation of said vehicle by said driver.
- Preferably the computing apparatus is capable of analyzing the recorded data and providing a report or reports of operation of the vehicle by the driver based on the recorded data.
- The present invention in another aspect provides apparatus for assessing a driver of a motor vehicle during operation of said vehicle by said driver, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to operation of said vehicle by said driver, location sensing means for obtaining location data of said vehicle, said computing apparatus being adapted to store said image data and location data synchronized with said image data, and input means associated with said computing apparatus for input of data from an observer during and relating to operation of said vehicle by said driver.
- Preferably the computing apparatus includes means for analyzing the data and for providing one or more reports relating to operation of the vehicle by said driver based on the data.
- The image data most preferably includes captured image data as recorded for example by one or more video cameras showing a particular vehicle route traveled by a vehicle and/or the vehicle operator. The location data typically may be derived from a GPS sensor used to sense geographical location of the vehicle.
- The apparatus may also include means for monitoring and recorded in the computing apparatus further data relating to operational parameters of a vehicle. The monitored vehicle parameters may comprise one or more of the following:
-
- Pattern Recognition (position of the vehicle on a road or within a lane on a road).
- Object Tracking (distance to other vehicles).
- Vehicle inertia (to measure vehicle acceleration, deceleration and vehicle body movement such as in cornering and stopping).
- Accelerator use.
- Brake use.
- Indicator use.
- Engine RPM.
- Fuel use.
- Driver face/eye movement.
- Preferably the input data provided by the observer is input under predetermined categories into the computing apparatus, the predetermined categories relating to the vehicle operation and/or the vehicle driver. Preferably the predetermined categories can be selectively displayed on the computing apparatus to enable input by the observer under a predetermined category or categories. Preferably the categories are displayed on a form or table, which can receive input from the observer under one or more of the categories. Typically the observer is a driver trainer or tester or other person skilled or expert in driving. The input means may comprise any known input device associated with the computing platform being used. For example the input may be input provided by a stylus in the case of a tablet or pocket PC or a mouse in the case of a laptop PC. The input may be a simple logic type answer such as a YES/NO answer. The form or table may include a default answer which may be accepted by or changed by the trainer or tester.
- The input data provided by the trainer or tester is recorded with the image and location data suitably in a database and analysis of that data by the computing apparatus provides information on operation of the vehicle operation which may produce a report or reports relating to vehicle operation.
- Whilst the method and apparatus of the invention as described above are typically applicable to driver training and testing, they may be applied to the operation of other machinery or equipment and thus reference to monitored parameters include where relevant reference to monitored parameters of machinery or equipment.
- The present invention thus provides in a further preferred aspect, a method of assessing an operator of machinery or equipment during operation of said machinery or equipment by said operator, said method comprising the steps of monitoring and recording in computing apparatus, image data and location data synchronized with said image data relating to operation of said machinery or equipment by said operator, recording in said computing apparatus, input data from an observer during and relating to operation of said machinery or equipment by said operator, and analyzing said data and providing a report or reports of operation of said machinery or equipment by said operator based on said analysed data.
- The present invention in yet another aspect provides apparatus for assessing an operator of a machinery or equipment, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to operation of said machinery or equipment by said operator, location sensing means for obtaining location data relating to operation of said machinery or equipment by said operator, said computing apparatus being adapted to record said image data and location data synchronized with said image data and input means associated with said computing apparatus for receiving input data from an observer during and relating to operation of said machinery or equipment by said operator.
- Preferably the computing apparatus includes means for analyzing the data and for providing one or more reports relating to operation of said machinery or equipment by the operator based on the data. Analyzing of the data and providing of the reports is suitably undertaken by using suitable software.
- The reference to an observer above includes an instructor or expert in the operation of a vehicle or machinery or other equipment.
- The present invention in another preferred aspect provides a method of collecting information on a procedure, process or establishment, said method comprising the steps of recording in computing apparatus image data and location data synchronized with said image data relating to said procedure, process or establishment and recording in said computing apparatus, input data from an observer relating to said procedure, process or establishment
- The present invention in yet a further aspect provides apparatus for collecting information on a procedure, process or establishment, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to said procedure, process or establishment, locating sensing means for obtaining location data relating to said procedure, process or establishment, said computing apparatus being adapted to store said image data and location data synchronized with said image data relating to said procedure, process or establishment and input means for receiving input of data from an observer relating to said procedure, process or establishment.
- The present invention provides in another preferred aspect, a method of preparing a computer-base route training program for vehicle operators comprising the steps of selecting a route in relation to which training is to be undertaken, recording and storing in computing apparatus video image data and location information data about said selected route, and compiling a computer-based training program based on said recorded and stored data.
- Typically the image data and location data are recorded on image capturing means and location sensing means on a vehicle traveling along said route. Preferably the method also includes the step of recording further input data from an observer or trainer relating to the selected route, the further data being used in the training program.
- The present invention provides in another preferred aspect, apparatus for preparing a computer-base route training or identification program in relation to a route to be undertaken by a vehicle operator, said apparatus comprising computing apparatus, image capturing means for capturing image data relating to said route, location sensing means for obtaining location data relating to said route, said computing apparatus being adapted to store said image data and location data, and input means associated with said computing apparatus for receiving input of data from an observer relating to said route to enable compiling of a computer-based training program based on said data.
- Preferably the computer-based training or identification program is prepared at a fixed location and using appropriate authoring tools after recording of the above referred to data.
- The image data and location data may be recorded using any vehicle, a laptop computer, and recording hardware. The recording hardware can be attached to any vehicle of any type (including bicycles and motorcycles). Typically the location recording hardware fits in a briefcase and will function anywhere location information data can be ascertained for example from a satellite, a global positioning system (GPS), from radio location, a track sector or speed transponder or from any other deployed location mechanism or system.
- The image capturing means suitably comprises one or more cameras but preferably a plurality of video cameras. Most preferably four video cameras mounted to the vehicle for capturing video image data providing different images or perspectives of the route. Recording software associated with the hardware allows the operator to focus on capturing the highest quality information concerning the route. The computer based training or identification program may also be prepared using other data relating to the vehicle such as data derived from vehicle sensors such as engine interfaces, following distance sensors and inertial sensors. This data may also be recorded and stored for use in preparation of the training or identification program.
- Preferably the video image data from the video cameras is synchronized with location, speed and other sensed and recorded data. The aforesaid data may be synchronized and multiplexed into the audio stream of Windows media files using real time multiplexing and compression algorithms. This information can then be de-multiplexed into vehicle information data, and audio, video and location information to be displayed to a trainee. Alternatively, multiple files for video and other data may be employed using time-based synchronization.
- The training program of the invention can be used for training tasks focused on routes to be traversed as well as locations to be visited, for example transit bus routes and pick-up/delivery locations, mining haul roads, parcel delivery routes and pick-up/delivery locations, fuel delivery routes and drop off locations and military patrols routes and locations.
- Trainers or authors of the program can integrate their own existing training materials into the training program including slideshows, animations, video, narrations and written documents.
- The training or identification program may have the capability of presenting multiple windows including video images, mapping, other computer-based training content (macromedia flash animations, video etc) and text.
- Points of interest along a particular route can be inserted by a trainer or author using the input means and may be classified for example as “Customer Service Issues”, “Operator Issues” or “Safety Issues”, and the trainer/author can define these issues in the context of the route. These points of interest may be linked to a timeline and a geographical location along the route and linked to specific frames or sections of video.
- The use of a route database allows trainers/authors to define many routes typically hundreds of routes, and update them as routes change or as other issues with the routes become evident. Route changes can then be tracked using route modification history.
- Using standard computer based training authoring tools; HTML quizzes can be embedded in the training program. Links can also be provided to other program materials. Sub-titles and voice-over support can additionally be added to the program to allow the trainer/author to provide a running commentary to the route. The resultant program can be published into a single deployable file. A trainee or other person using the program is able to navigate vehicle information data, audio, video and information location in synchronization by navigating in time, space (maps) or by specific events. Information “kiosk-style” navigation means that trainees or other persons with no previous computer experience can view the route information
- Navigation buttons may be provided to allow trainees or other persons to work through the route at their own pace, absorbing as much information as possible. Each point of interest along the route is linked to the training materials inserted and authored by the trainer/author.
- Trainees can be tested at any time during use of the program before being allowed to progress to the next phase of training.
- Detailed aerial photography or satellite imagery and the video camera views help to orientate trainees in the route environment.
- Points of interest highlighted by driver trainers ensure that trainees concentrate on significant parts of the route, and do not waste time on learning about irrelevant parts of a journey.
- Whilst the program of the invention is particularly suited to use by persons undergoing a driver training program in relation to a particular route to be undertaken, it may also be used by other persons wishing to obtain information about a particular route to be undertaken. Whilst the program is usually undertaken at a fixed location remote from a vehicle, the program may also be used within a vehicle by a driver seeking information about a route.
- In another aspect of the invention, each recorded route may be broken up into individual route segments with each segment comprising part of the route in relation to which training is to be undertaken and containing relevant video images and location information relating to that route segment. Each route segment also may contain “hotspot” and/or “hotzone” information. Each route segment is stored in a database as a separate file. Thus should a change occur in a portion of a route, the route segment of that route portion can be updated and re-recorded rather than requiring re-recording of the entire route. To view a required route, the appropriate route segments which constitute that route can be played back in the correct order. Furthermore where different routes have some overlap, overlapping route segments are only required to be recorded once. Thus video image information, location data information and “hotspot” and “hotzone” information could be captured and recorded in database in separate route segment files of all roads in a country.
- A user may then in seeking driving directions for a particular route search the database and receive information and directions relating to the particular route assembled from a plurality of route segment files which make up that route, the route being presented as video images, location data (as indicated on a map) and where relevant “hotspot” or “hotzone” information.
- Whilst the route training program is capable of being played back through a software programmed computing platform, it may be streamed through a web-based viewing/learning tool so as to be accessible to persons requiring information on a particular route as well as to trainee drivers.
- The present invention provides in another preferred aspect, a method of training or informing a vehicle operator or user in relation to a route to be undertaken, said method comprising the steps of providing to said vehicle operator or user, a computer-base route training program, said program being adapted to display information concerning said route including location information relating to said route to be undertaken and video images of said route corresponding to said location information.
- Preferably the location information comprises information presented on a map.
- The present invention provides in yet another preferred aspect, a computer based route training or information program for training or informing a vehicle operator or user in relation to a route to be undertaken, said program being adapted to display on a computer display screen information concerning said route including location information relating to said route to be undertaken and video images of said route corresponding to said location information. Preferably the location information is displayed on a map of said route or part of said route.
- Preferably the displayed route includes a number of points of interest designated as “hotspots” or “hotzones” along the route. The points of interest may be designated in any manner for example as a number or cross on a particular route. Preferably information corresponding to respective points of interest along the route is accessible and displayable to the vehicle operator or user. That information may be displayed for example by positioning a cursor on the point of interest. The cursor may be positioned with a computer mouse or other positioning device and the information may be displayed by depressing a button on the mouse. That information may be a particular property relating to that point of interest for example road conditions at that marked location or any other information to be noted by the vehicle operator/trainee.
- Where used in a training application, for example for training trainee drivers in relation to a route to be undertaken, means may be provided for tracking and recording routes or route segments viewed by a particular trainee. Such means which may comprise a software/web based tool may also advise of changes to a route or route segment and notify trainees or other persons of the changes or track trainees or other persons who know about the changes. A record may also be maintained of which trainees or other persons may need to be advised of the changed route. Thus if a route or route segment is updated or changed, drivers are notified to re-learn changed routes or route segments. Drivers additionally may be prevented from traveling along a route unless they have viewed the updated route information.
- The present invention thus provides in a further preferred aspect, means for monitoring the above route training program, said monitoring means including means for recording information on each said operator or user, and means for recording in relation to each said operator or user, route segments in relation to which training has been undertaken by said operator or user.
- Preferably the monitoring means includes means for notifying operators or users of changes in route segments. The monitoring means suitably includes a database for recording the relevant information.
- The stored information concerning route information, changes in route or route segment and drivers who have undertaken training in relation to a route or an updated route may be linked to an organization learning management system, human resource database and an advance transportation management system.
- In order that the invention may be more readily understood and put into practical effect, reference will now be made to the accompanying drawings which illustrate preferred embodiments of the invention described in relation to vehicle driver training or testing. The method and apparatus of the invention however may be used in many applications as referred to above other than that described in the embodiment set out below. In the drawings:—
-
FIG. 1 illustrates typical components of information collection apparatus as used in the present invention for collecting information relating to assessment of a vehicle driver when operating a vehicle; -
FIG. 2 illustrates a typical driver assessment form as displayed on a display screen of the apparatus of the invention; -
FIG. 3 illustrates schematically the manner in which the apparatus of the invention is used in relation to vehicle driver training or testing; -
FIG. 4 illustrates typical driver assessment report generated by the apparatus of the invention; -
FIG. 5 illustrates apparatus for preparing a route training program according to another aspect of the invention; -
FIG. 6 illustrates a typical preview screen display on a computer for use in preparing the route training program; -
FIGS. 7 and 8 illustrate typical authoring screen displays for use in preparing the route program with the of a route marked with “hotspots” and “hotzones”; -
FIGS. 9 and 10 illustrate alternative screen displays for defining “hotspots” and “hotzones” along the route; -
FIG. 11 illustrates a presentation window as used during route training; and -
FIG. 12 illustrates a typical screen display for selection of a route for route training. - Referring to the drawings and firstly to
FIG. 1 , there is illustratedapparatus 10 according to an embodiment of the present invention for collecting information relating to a driver of a vehicle for subsequent assessment of a driver, theapparatus 10 including atablet computer 11 having adisplay screen 12, one ormore video cameras 13, aGPS sensor 14 for sensing speed and location, acomfort sensor 15, and ajunction box 16 which hasinputs 17 to receive up to four outputs from up to fourcameras 13, and the outputs from aGPS sensor 14 andcomfort sensor 15 and an output 18 which is connectable to thetablet computer 11. Thecomputer 11 has any known input device such as a stylus or mouse. In a simplified version, thejunction box 16 may have only three inputs for connection to twocameras 13 and aGPS sensor 14. In some applications however, thejunction box 16 is not required as thesensors computer 11. Thecomfort sensor 15 typically comprises an inertial sensor or other sensors to sense movements of the vehicle. Data from this or these sensors can be processed to determine the comfort level of the driver undertaking the drive. - The
apparatus 10 is used within a suitable training vehicle for example a bus and thevideo cameras 13 are mounted on the vehicle to record different views from the vehicle such as views to the front and rear of the vehicle and/or a view or views of a vehicle driver. The location of a vehicle in addition is monitored by theGPS sensor 14 also mounted on or within the vehicle. Thecomputer 11 is programmed with driver recording software to enable thecomputer display screen 12 to show in a video window, the view or views 19 from the one ormore video cameras 13. Thedisplay screen 12 also can display as shown inFIG. 3 route and location on a map display 20 andvehicle speed 21 derived from theGPS sensor 14 corresponding to the route being traveled by the vehicle and to the images captured by the video camera/s 13. - The
computer 11 is also programmed to display acustomizable input form 22 in this case a driver assessment form which enables input by a driver trainer or tester. The input form can be generated by a low-level wizard application supplied as part of the software, or by using a third-party form authoring application to create more in-depth forms. - A typical
driver assessment form 22 is shown inFIG. 2 and includes in this case sixassessment headings 23 or categories relating to operation of a vehicle in this case “Following Distance”, “Turns”, “Traffic lights and Signs”, “Intersections”, “Braking” and “Speed”. Each heading or category is assessed in accordance with sub-headings which are indicative of the correct (or incorrect) operation of a vehicle. For example thesub-headings 24 under the “Following Distance” heading are “Uses proper stopping distance behind other vehicles”, “Maintains safe following distance at city driving speeds”, and “Proper following distance at freeway driving speeds”.Input selection boxes 25 enable the driver trainer using the computer stylus or mouse to indicate whether the event defined by thesub-headings 24 has or has not occurred. In addition, the assessment form 20 has atext box 26 enabling freehand text and/or freehand diagrams to be entered by the driver trainer. - In use, the
apparatus 10 is set up in a vehicle where a driver is to be assessed such as in a bus with theGPS sensor 14 positioned to provide sensed location and movement data to thecomputer 11 through thejunction box 16. Thecameras 13 are set up on the vehicle to capture required video signals which are supplied to thecomputer 11 which is typically held by a trainer or tester in the vehicle observing the operation of the vehicle by the driver. The video window on thecomputer display screen 12 can show theviews 19 from two or more cameras 13 (seeFIG. 3 ). A video preview window allows accurate setup of cameras view prior to driver training testing session. This window also includes a display ofcurrent speed 21 derived from the GPS. - During the driver training or testing session, the route and location of the vehicle is recorded for subsequent display on a map using a circuit overview menu whilst the entire journey is recorded by the
cameras 13. The driver tester or trainer then can enter information into theassessment form 22 in accordance with operation of the vehicle by the driver. Thus if an event indicated in a sub heading for example a sub heading 24 has occurred, the trainer or tester uses the mouse orstylus 27 to select the relevant event box which will display the numeral “1” or any other indicator in the box. - GPS, video and other data is collected by the
computer 11 while the driver tester/trainer is inputting the customised information. Each time an event is selected or input by the driver trainer, the location, video and speed at that time are recorded so that the event is linked to or synchronized with location information (as for example shown on a map 26) as well asvideo images 19 of or adjacent to that location. - In addition to entering data into a
customised form 22, miscellaneous events may be recorded by using a free-form field such as in thebox 26. This field allows the input of diagrams, text and symbols. Handwriting recognition software may be used to turn the notes into text. - After the data collection has been completed, the customised information entered into the form 20 is integrated with a database and may be viewed by time, location or by other customisable categories or standard or customized reporting tools. Using the information entered by the instructor/operator, the large video data files may then be sliced into smaller pieces, with irrelevant information being deleted. This decreases storage requirements. These smaller slices of the video/data files may then be integrated into the database. Automated tools/neural network style algorithms can be used to interrogate the database to facilitate the automated detection of driving events.
- A typical
driver assessment report 28 derived from a driver training or assessment session is illustrated inFIG. 4 . The generated report shows the number of times certain instructor detected events have occurred, how this links to the sub-headings in the report and advice that should be adhered to reduce the risk of this behavior occurring again. - Optionally each type of event can be highlighted on a map of the drive undertaken on the report. This report is customizable from a database that stores this information and preferably can only be modified by a user with administrator privileges. The results of individual test drives and synchronized information regarding the completion of the training may be stored in corporate databases.
- During debrief, the “jump to event” function will jump up to 30 seconds before a marked event. Events of interest can be selected for display by selecting that item on the pull down menu
- In the embodiment of the apparatus of the invention, the
computer 11 used comprises a tablet PC however any other computing platform may be used such as a Laptop or Pocket PC or an in-car PC or customized PC either permanently or temporarily mounted. A portable computer however is preferred to allow portability of the apparatus. - Whilst the described embodiment uses inputs from up to four
cameras 13, and aGPS sensor 14, the apparatus may also include other sensors to sense vehicle operation such as theinertial sensors 15 or following distance sensors, and ECU interfaces. - The present invention, by automating reporting functionality, improves the productivity of driver instructors as paperwork is eliminated. Initial experiments have shown up to 2 hours per day productivity improvement potential. By automated links to corporate databases, robustness of risk management and training processes is assured. Effectiveness of training is assured as interactive debriefing can provide a strong link between classroom training and on-road performance
- The link between skills required, observed performance and video images provides evidence for personal change. Personalized action plans are directly related to observed problems. Improved interaction between trainers and trainees also results. The apparatus is easy to transport, setup and install.
- Whilst the invention has been described with reference to vehicle driver training and testing, it may be applied to many different applications where training or testing in the use of machinery or equipment is required, for pipeline and powerline auditing, road maintenance checking, minesite, refinery and powerplant safety documentation, homeland security documentation and audits, military base audits and pilot, marine captain training as well as efficiency audits for establishments such as factories, hotels or warehouses.
- For auditing purposes, only two cameras may be necessary combined with a GPS sensor for sensing location and a computer such as a tablet PC. The cameras may be vehicle mounted and the vehicle driven around the establishment being audited with photographic and video images being recorded linked to GPS location information. Alternatively, the location information may be derived from a RF ID tag. Information is then input by the person undertaking the audit (in the same manner that information is inserted into the form 22) with that information being linked to the images and location. Assessments can then be undertaken of all the data for audit or any other purposes.
- Referring now to FIGS. 5 to 12, there is illustrated an application of the information collection function of the above described apparatus for the purpose of creating a computer based training program for training vehicle drivers in relation to particular routes which a driver may be required to undertake for example a route to be traversed by a bus driven by the driver so that the driver can be trained in relation to the route. The computer based route training system of this embodiment however may be applied to a wide range of applications where a person is to be trained or informed in relation to a particular route. For example persons may be required to be trained in relation to the transportation of dangerous goods along a particular route. Similarly military personnel may be required to be trained in relation to the transportation of military equipment along a route. The general public however may also require information in relation to a particular route to be undertaken. The description below is primarily related to the training of bus drivers however it will be appreciate that the system may be equally applied to other applications as referred to above.
- The computer based
training system 30 shown schematically inFIG. 5 uses acomputer 31 such as a laptop computer or a tablet computer which is software programmed to have a first recording administration/trainer mode and a second student/trainee mode. In the first mode, the administrator/trainer initially records video and locating information whilst traveling in a vehicle traveling along the route for which the training program is to be created. For the purpose of recording the route, one or more image capturing means orcameras 32 are mounted to the vehicle, the image capturing means orcameras 32 being provided with quick-release vehicle mounting hardware to enable them to be readily mounted to the vehicle. The image capturing means in this embodiment comprise two to four CCD cameras which capture images at 10 frames per second at ¼ VGA resolution. Thecameras 32 also have day and night capability and may have wide-angle and telephoto options. Images captured by thecameras 32 are stored in the memory of thecomputer 30 as the vehicle travels along the route. - Additionally, as the vehicle is traveling along the route, location data is captured in the
computer 30 from aGPS sensor 33 which in the illustrated embodiment may comprise Wide Area Augmentation System (WAAS) or a differential GPS system. TheGPS sensor 33 used provides location information once per second at a 2-5 m accuracy. Data obtained from theGPS sensor 33 can be displayed on a map so that the position of the vehicle along a particular route can be viewed on a map display. A mapping interface is used to allow the importation of any data in standard GIS format and display it on the display screen. A user-customisable map display can include road styles, parkland, water and other features. Maps of this type are known and can be accessed free or from commercial mapping suppliers -
FIG. 6 illustrates atypical screen display 35 of thecomputer 31 as generated by the recording software using four cameras withimages 37 from each camera being displayed during recording of the route. As shown, the images are different view from the vehicle comprising clockwise from thetop image 37, a view of the adjacent vehicle lane views to the front and rear of the vehicle and a view of the driver. Thescreen display 35 also includes adisplay 38 of speed. This display is similar to the display used in the embodiment ofFIG. 3 . The typical file size of the file storing this information is 400 MBytes per hour. - During the recording mode, the administrator/
trainer 34 can insert information relating to the route by operation of an event button. In addition, the administrator/trainer 34 can record with a microphone verbal notes which can be used as reminders for later preparation of the training program. The administrator/trainer 34 by using an authoring tool or screen, examples of which are illustrated inFIGS. 7 and 8 can mark theroute 39 in relation to which training is to be undertaking and can also mark different points of interest or zone of interest on the route which have important information attached to them. These points referred to herein as “hotspots” and “hotzones” respectively are defined to focus trainees only on sections of the route or important points along theroute 39 that are required learning. Hotspots can be classified into one or more pre-defined categories for quick browsing. For example, hotspot types may be locations of traffic issues, accident black spots, significant customer service issues, bathroom locations, and rest stop locations during layovers between runs. In the authoring tools or screens illustrated inFIGS. 7 and 8 , the categories which relate to a bus route are defined byicons - After recording of all of the above information whilst traveling the route, the administrator/trainer can open the file and manage the hotspots and hotzones by inserting information relating to each hotspot. In the authorizing screen of
FIGS. 7 and 8 ,various hotspots 43 along the route have been identified by icons. Different types of hotspots can be made by the trainer/trainer to appear as different icons or colours on the map. Thus theicons 43 may be one or more of theicons Hotzones 44 along theroute 39 can be marked in different colours. - By positioning the cursor on a hotspot or hotzone and clicking, a pop-up window is triggered and appears as in
FIG. 9 which allows the administrator/trainer to enter any text information as required. The pop-up window alternatively can be overlaid on the route creating authoring screen as inFIG. 10 . - Within the trigger window, the administrators/trainers can adjust the map zoom to displayed of the hotspot or hotzone. The administrator/trainer can also determine within the trigger window whether to include a video as recorded by the
cameras 32 for playback by marking theappropriate box 47 within the pop-up window. The administrator/trainer can determine the duration, start and finish of the video. The administrator/trainer can also determine whether to include playback of audio by marking thebox 48. Thebox 49 allows the administrator/trainer to add a text message relating to the hotspot or a warning such as the speed limit warning in the trigger window shown inFIG. 10 . - The trigger widows thus trigger the display of certain information at specific times determined by the properties defined in the trigger. Triggers allow trainer control of map zoom, video angle (1-4 cameras), audio play in any Windows audio format display of information in a rich text box including symbols and images.
- The administrator/trainer in preparing the program can add a new event or hotspot or hotzone or remove an unnecessary event or hotspot or hotzone. A training program can include one or many hotspots or hotzone on a route without limit. Hotspots or hotzones can be from one second to the entire route length. The administrator/trainer can also show a single camera view and determine the size of the camera view window.
- The windows shown in
FIGS. 9 and 10 allows the display of a map together with a video display. In this case hotspots are visualized on the map as a different icons and hotzones as different color regions and on a timeline as block of time. A zoom ability can give finer visualisation of the sequence of events in a hotspot or hotzone. The author however has full dynamic control of map viewing for different parts of the route—zoom, pan, etc. - For video and audio purposes, scripted control of camera angle from one to four cameras at trigger points in the route is provided. Video is synchronized to map location and timeline for easy navigation to points of interest. Other video can be embedded in computer based training window in place of the map. Audio can be played at trigger points or embedded in the training program.
- Instead of the map display as illustrated in
FIGS. 9 and 10 , a presentation window for presentation to the trainee as illustrated inFIG. 11 can replace a mapping window at pre-defined points in hotspots. - The computer based training program prepared as above can contain any content within HTML specification. It may include video, sound, Flash animation, text, Powerpoint® slides. It may include HTML-based quizzes. It may support Lectora® and other multimedia authoring software packages with Web publishing capability. It further may refer to external documents of any type, including Microsoft Word® documents, Microsoft Excel® spreadsheets, and Adobe® PDFs. It further may play audio files, such as WAVs, MP3s or WMAs and additionally may display image files, such as JPEGs, GIFs, and BMPs. The program may describe in detail a route of up to two hours in length and may draw a map of the route with the ability to zoom and pan automatically.
- At the completion of authoring process as described above, the program is saved in a suitable file format and is published for student or trainee access such as over a network.
- For use of the computer based training program, a trainee is presented with a list of available routes to learn and the trainee selects which route they need to learn as presented on the screen display illustrated in
FIG. 12 . A multimedia introduction to the route can be played which may include standard materials for all routes, or the particular issues that make the selected route different from others. Alternatively, an overview of the entire route complete with all hotspots is displayed. The trainee can be taken to the first hotspot skipping parts of the route that are irrelevant. The first hotspot will often be the “deadhead”, the journey from the depot to the start of the route as inFIG. 8 . The trainee by clicking on a hotspot will be shown a display as determined by an administrator. Thus a defined video may be played, text notes will be displayed and any link to an external program will be activated by clicking the relevant button. As the hotspot is processed, map zooms change to show more detail, camera angles change to show the best view of points of interest or caution, and cautionary and advisory text and graphics appear (for example changes in speed zones) in the text box as hotspots are processed by the system. Each hotspot visited by the student will change colour or otherwise be marked so that a track can be kept of the visited hotspots. The trainee can thus be focused on the important aspects of the route to be learned. - As presentations are reached, the program hands total control to the content that appears to replace the map. Familiar presentations reinforce in a practical manner the classroom training received on topics such as turns, railroad crossings, schools, entering and leaving premises, loading docks, etc.
- The trainee may be presented with quiz materials during the presentation, if these have been authored using SCORM compliant tools, then results can be communicated back to learning management systems
- When the trainee has completed learning the route, they are returned to the route menu. Routes may be structured to allow “branching” from the main route to minor route for example similar to a branch line on a railway. Certain conditions may require this branching functionality.
- Routes may be assembled from existing sub-components or segments of routes. For example a new bus route may be composed 50% of an existing bus route and 50% of a new route.
- Thus a route may be broken up into individual route segments which may be prepared in the above described
manner using cameras 32, aGPS sensor 33 and input from an administrator/author 34. The segments may be prepared after recording the full route and broken up into different files or separate files for each segment may be prepared during the recording process. Each route segment thus contains video images and location information and may additionally contain “hotspot” and/or “hotzone” information input by the administrator/author. - If there are amendments to a route segment such as a new roundabout, only that a particular route segment will be required to be changed or amended.
- To view a required route, the appropriate route segments which constitute that route can be played back in the correct order with the route segments being combined similar to the task of editing a movie made up of scenes to define the whole route.
- Where different routes have some overlap, overlapping route segments are thus only required to be recorded once. A user may then, in seeking driving directions or information for a particular route, search the database and receive information and directions relating to the particular route assembled from a plurality of route segment files which make up that route. The driver is thus presented with video images, location data (as indicated on a map) and where relevant “hotspot” or “hotzone” information along the route.
- The terms “comprising” or “comprises” as used throughout the specification and claims are taken to specify the presence of the stated features, integers and components referred to but not preclude the presence or addition of one or more other feature/s, integer/s, component/s or group thereof.
- Whilst the above has been given by way of illustrative embodiment of the invention, all such variations and modifications thereto as would be apparent to persons skilled in the art are deemed to fall within the broad scope and ambit of the invention as herein described.
Claims (21)
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2005904216A AU2005904216A0 (en) | 2005-08-05 | Training method and apparatus for vehicle operators | |
AU2005904216 | 2005-08-05 | ||
AU2005905766A AU2005905766A0 (en) | 2005-10-19 | Computerised information collection method an apparatus | |
AU2005905766 | 2005-10-19 | ||
PCT/AU2006/001118 WO2007016731A1 (en) | 2005-08-05 | 2006-08-07 | Computerised information collection and training method and apparatus |
Publications (3)
Publication Number | Publication Date |
---|---|
US20090262191A1 US20090262191A1 (en) | 2009-10-22 |
US20100208070A2 true US20100208070A2 (en) | 2010-08-19 |
US8633985B2 US8633985B2 (en) | 2014-01-21 |
Family
ID=37727017
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/989,954 Expired - Fee Related US8633985B2 (en) | 2005-08-05 | 2006-08-07 | Computerized information collection and training method and apparatus |
Country Status (2)
Country | Link |
---|---|
US (1) | US8633985B2 (en) |
WO (1) | WO2007016731A1 (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080300731A1 (en) * | 2007-05-31 | 2008-12-04 | Fujitsu Ten Limited | Vehicle-running-state display method |
US20110013836A1 (en) * | 2008-07-09 | 2011-01-20 | Smadar Gefen | Multiple-object tracking and team identification for game strategy analysis |
US20110106334A1 (en) * | 2009-10-30 | 2011-05-05 | Ford Global Technologies, Llc | Vehicle and method for advising driver of same |
US20110187522A1 (en) * | 2008-10-30 | 2011-08-04 | Ford Global Technologies, Llc | Vehicle and method of advising a driver therein |
DE102012105043A1 (en) * | 2012-06-12 | 2013-12-12 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Method for preview of rail tracks to be traveled by rail vehicles, involves creating video from stored video image data based on tracks selected for preview by video unit, and playing created video for preview of selected tracks |
US20140047347A1 (en) * | 2012-08-10 | 2014-02-13 | Xrs Corporation | Communication techniques for transportation route modifications |
US8738228B2 (en) | 2009-10-30 | 2014-05-27 | Ford Global Technologies, Llc | Vehicle and method of tuning performance of same |
DE102013001747A1 (en) | 2013-01-31 | 2014-07-31 | Volkswagen Aktiengesellschaft | Method for providing a rating of drive along traffic route traveled by learner-driver of motor car, involves detecting route data and evaluation data along busy route so as to assign the data to current geographical position of car |
US8798598B2 (en) * | 2012-09-13 | 2014-08-05 | Alain Rossmann | Method and system for screencasting Smartphone video game software to online social networks |
US20150088334A1 (en) * | 2013-09-20 | 2015-03-26 | Elwha. LLC | Systems and methods for insurance based upon status of vehicle software |
US9106816B1 (en) * | 2012-01-12 | 2015-08-11 | Sprint Communications Company L.P. | Handheld apparatus for demonstrating a screen display |
US20150307107A1 (en) * | 2011-10-11 | 2015-10-29 | Lytx, Inc. | Driver performance determination based on geolocation |
US9344683B1 (en) | 2012-11-28 | 2016-05-17 | Lytx, Inc. | Capturing driving risk based on vehicle state and automatic detection of a state of a location |
US20160321699A1 (en) * | 2008-07-22 | 2016-11-03 | At&T Intellectual Property I, L.P. | System and Method for Adaptive Media Playback Based on Destination |
US20170111587A1 (en) * | 2015-10-14 | 2017-04-20 | Garmin Switzerland Gmbh | Navigation device wirelessly coupled with auxiliary camera unit |
US9646433B1 (en) * | 2015-09-23 | 2017-05-09 | State Farm Mutual Automobile Insurance Company | Systems and methods for using image data to generate vehicle operation logs |
US20170221150A1 (en) * | 2014-07-08 | 2017-08-03 | Matan BICHACHO | Behavior dependent insurance |
US9922567B2 (en) | 2011-07-21 | 2018-03-20 | Bendix Commercial Vehicle Systems Llc | Vehicular fleet management system and methods of monitoring and improving driver performance in a fleet of vehicles |
US20180232045A1 (en) * | 2017-02-15 | 2018-08-16 | Cae Inc. | Contextual monitoring perspective selection during training session |
US10169821B2 (en) | 2013-09-20 | 2019-01-01 | Elwha Llc | Systems and methods for insurance based upon status of vehicle software |
US10397665B2 (en) | 2008-07-22 | 2019-08-27 | At&T Intellectual Property I, L.P. | System and method for temporally adaptive media playback |
US10445954B2 (en) | 2011-10-12 | 2019-10-15 | Lytx, Inc. | Drive event capturing based on geolocation |
US10471964B2 (en) | 2014-10-10 | 2019-11-12 | Wpj Holdings, Inc. | System and method for collecting vehicle use and driving behavior data using a mobile communication device and bluetooth low energy (BLE) device |
US20200265013A1 (en) * | 2019-02-18 | 2020-08-20 | Microsoft Technology Licensing, Llc | Inline document conversation system |
US11315207B1 (en) * | 2017-06-02 | 2022-04-26 | Des Moines Area Metropolitan Planning Organization | Cargo optimization systems, devices and related methods |
US11321951B1 (en) | 2017-01-19 | 2022-05-03 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for integrating vehicle operator gesture detection within geographic maps |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007016731A1 (en) * | 2005-08-05 | 2007-02-15 | Vigil Systems Pty Ltd | Computerised information collection and training method and apparatus |
US9150275B2 (en) * | 2009-12-17 | 2015-10-06 | Shimano Inc. | Hydraulic connector arrangement |
CN102646294A (en) * | 2012-05-11 | 2012-08-22 | 海华电子企业(中国)有限公司 | Vehicle-using record counting method based on satellite positioning and radio identification technology |
US10963966B1 (en) | 2013-09-27 | 2021-03-30 | Allstate Insurance Company | Electronic exchange of insurance information |
US9019092B1 (en) | 2013-03-08 | 2015-04-28 | Allstate Insurance Company | Determining whether a vehicle is parked for automated accident detection, fault attribution, and claims processing |
US8799034B1 (en) | 2013-03-08 | 2014-08-05 | Allstate University Company | Automated accident detection, fault attribution, and claims processing |
US10032226B1 (en) | 2013-03-08 | 2018-07-24 | Allstate Insurance Company | Automatic exchange of information in response to a collision event |
US10445758B1 (en) | 2013-03-15 | 2019-10-15 | Allstate Insurance Company | Providing rewards based on driving behaviors detected by a mobile computing device |
USD745425S1 (en) * | 2013-08-23 | 2015-12-15 | Eaton Corporation | Hose sensor signal receiver |
US10572943B1 (en) | 2013-09-10 | 2020-02-25 | Allstate Insurance Company | Maintaining current insurance information at a mobile device |
US9443270B1 (en) | 2013-09-17 | 2016-09-13 | Allstate Insurance Company | Obtaining insurance information in response to optical input |
SE537605C2 (en) | 2013-09-19 | 2015-07-21 | Scania Cv Ab | Procedure and system for determining the performance characteristics of a vehicle |
CN103942851B (en) * | 2014-04-02 | 2016-08-31 | 北京中交慧联信息科技有限公司 | A kind of method and device that target vehicle state and driving behavior are monitored |
JP6415851B2 (en) * | 2014-05-21 | 2018-10-31 | 株式会社中勢自動車学校 | Car training system |
US9623875B2 (en) * | 2014-06-13 | 2017-04-18 | University of Pittsburgh—of the Commonwealth System of Higher Education | Systems and method for driving evaluation and training |
US10713717B1 (en) | 2015-01-22 | 2020-07-14 | Allstate Insurance Company | Total loss evaluation and handling system and method |
US9767625B1 (en) | 2015-04-13 | 2017-09-19 | Allstate Insurance Company | Automatic crash detection |
US10083551B1 (en) | 2015-04-13 | 2018-09-25 | Allstate Insurance Company | Automatic crash detection |
CN105046764A (en) * | 2015-07-14 | 2015-11-11 | 成都中微电微波技术有限公司 | Double-line simultaneously-recording driving recorder |
CN105023316A (en) * | 2015-07-14 | 2015-11-04 | 成都中微电微波技术有限公司 | Automobile data recorder with bluetooth function |
CN105006036A (en) * | 2015-07-14 | 2015-10-28 | 成都中微电微波技术有限公司 | Automobile data recorder with anti-theft alarm function |
CN105023312A (en) * | 2015-07-14 | 2015-11-04 | 成都中微电微波技术有限公司 | Cloud e-dog type automobile data recorder |
CN105023315A (en) * | 2015-07-14 | 2015-11-04 | 成都中微电微波技术有限公司 | Panoramic camera type automobile data recorder |
US11361380B2 (en) | 2016-09-21 | 2022-06-14 | Allstate Insurance Company | Enhanced image capture and analysis of damaged tangible objects |
US10902525B2 (en) | 2016-09-21 | 2021-01-26 | Allstate Insurance Company | Enhanced image capture and analysis of damaged tangible objects |
US10937103B1 (en) | 2017-04-21 | 2021-03-02 | Allstate Insurance Company | Machine learning based accident assessment |
CN108776481B (en) * | 2018-06-20 | 2021-09-10 | 北京智行者科技有限公司 | Parallel driving control method |
WO2023129781A1 (en) * | 2021-12-29 | 2023-07-06 | Gentex Corporation | Vehicle trip review system |
Citations (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2667962A1 (en) * | 1990-10-11 | 1992-04-17 | Opti Pilote | Method of recording and processing data for managing the driving of vehicles |
US5353023A (en) * | 1991-06-27 | 1994-10-04 | Mitsubishi Denki Kabushiki Kaisha | Navigation system for cars |
US5534759A (en) * | 1995-05-19 | 1996-07-09 | The United States Of America As Represented By The Secretary Of The Navy | Electric vehicle monitoring system |
US5539645A (en) * | 1993-11-19 | 1996-07-23 | Philips Electronics North America Corporation | Traffic monitoring system with reduced communications requirements |
US5928291A (en) * | 1997-03-27 | 1999-07-27 | Rockwell International Corporation | Mileage and fuel consumption determination for geo-cell based vehicle information management |
US6272457B1 (en) * | 1996-09-16 | 2001-08-07 | Datria Systems, Inc. | Spatial asset management system that time-tags and combines captured speech data and captured location data using a predifed reference grammar with a semantic relationship structure |
US6298290B1 (en) * | 1999-12-30 | 2001-10-02 | Niles Parts Co., Ltd. | Memory apparatus for vehicle information data |
US20020091473A1 (en) * | 2000-10-14 | 2002-07-11 | Gardner Judith Lee | Method and apparatus for improving vehicle operator performance |
US20020116156A1 (en) * | 2000-10-14 | 2002-08-22 | Donald Remboski | Method and apparatus for vehicle operator performance assessment and improvement |
US20030028296A1 (en) * | 2001-08-01 | 2003-02-06 | Miller Steven P. | Automated vehicle inspection system |
US20030069716A1 (en) * | 2001-10-09 | 2003-04-10 | Martinez David Frederick | System & method for performing field inspection |
US20030120522A1 (en) * | 2001-12-20 | 2003-06-26 | Robert Uyeki | Vehicle monitoring and reservation system |
US6593848B1 (en) * | 2000-02-23 | 2003-07-15 | Atkins, Iii William T. | Motor vehicle recorder system |
US20030132968A1 (en) * | 2002-01-11 | 2003-07-17 | Stewart Paul Joseph | System and method for virtual interactive design and evaluation and manipulation of vehicle mechanisms |
US20030153329A1 (en) * | 2002-02-13 | 2003-08-14 | General Motors Corporation | Method for broadcast filtering using convex hulls |
US6684027B1 (en) * | 1999-08-19 | 2004-01-27 | Joan I. Rosenberg | Method and system for recording data for the purposes of performance related skill development |
US20040054452A1 (en) * | 2000-08-01 | 2004-03-18 | Mats Bjorkman | Methods and means for monitoring driver alertness and display means for displaying information related thereto |
US6735506B2 (en) * | 1992-05-05 | 2004-05-11 | Automotive Technologies International, Inc. | Telematics system |
US6784973B1 (en) * | 2000-08-31 | 2004-08-31 | Eastman Kodak Company | Quality assurance system for retail photofinishing |
US20050171663A1 (en) * | 2000-08-31 | 2005-08-04 | Lisa Mittelsteadt | Automobile monitoring for operation analysis |
US20060018642A1 (en) * | 2004-07-20 | 2006-01-26 | Chaplin David V | Mobile laser designated infrared multimedia mapping system |
US20060044401A1 (en) * | 2004-08-31 | 2006-03-02 | Samsung Electronics Co., Ltd. | Mobile communication terminal for storing a picture and picture-taking location information and method for providing services using the same |
US20060055564A1 (en) * | 2004-01-09 | 2006-03-16 | United Parcel Service Of America, Inc. | System, method, and apparatus for capturing telematics data with an active RFID tag |
US20060077095A1 (en) * | 2004-07-20 | 2006-04-13 | Tucker Layne D | Precision GPS driven utility asset management and utility damage prevention system and method |
US20060106504A1 (en) * | 2002-08-27 | 2006-05-18 | Carpenter Timothy G | Apparatus and a system for determining compliance with parking rules by vehicle |
US20060165160A1 (en) * | 2005-01-24 | 2006-07-27 | Winningstad C N | Wireless event authentication system |
US20060171539A1 (en) * | 2005-01-24 | 2006-08-03 | Winningstad C N | Wireless event authentication system |
US20060185019A1 (en) * | 2005-02-11 | 2006-08-17 | Wong Chun P | Method and system for observational data collection |
US20060212195A1 (en) * | 2005-03-15 | 2006-09-21 | Veith Gregory W | Vehicle data recorder and telematic device |
US7129848B2 (en) * | 2003-03-11 | 2006-10-31 | Alcatel | Remote monitoring method and system |
WO2007016731A1 (en) * | 2005-08-05 | 2007-02-15 | Vigil Systems Pty Ltd | Computerised information collection and training method and apparatus |
US20080103651A1 (en) * | 1999-07-30 | 2008-05-01 | Oshkosh Truck Corporation | User interface and method for vehicle control system |
US7548961B1 (en) * | 1998-09-01 | 2009-06-16 | Fernandez Dennis S | Integrated vehicular sensor and messaging system and method |
US20090157619A1 (en) * | 2007-12-18 | 2009-06-18 | Triad Group Plc | System and method for creating a database |
US7756640B2 (en) * | 2006-09-26 | 2010-07-13 | Hitachi, Ltd. | Vehicle control system, vehicle control method, and vehicle control program |
US8139878B2 (en) * | 2002-04-15 | 2012-03-20 | Panasonic Corporation | Picture coding method and picture decoding method |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3672973B2 (en) | 1995-06-12 | 2005-07-20 | 三菱プレシジョン株式会社 | Data recording / reproducing method for training evaluation, data recording method for training evaluation, and data recording / reproducing apparatus for training evaluation |
JP4235465B2 (en) | 2003-02-14 | 2009-03-11 | 本田技研工業株式会社 | Riding simulation equipment |
JP2004258900A (en) | 2003-02-25 | 2004-09-16 | Aisin Seiki Co Ltd | Surrounding vehicle information providing system |
DE10343942B4 (en) | 2003-09-23 | 2012-08-09 | Robert Bosch Gmbh | Assistance device for motor vehicles and method for visualizing additional information |
JP4262133B2 (en) | 2004-04-27 | 2009-05-13 | 独立行政法人科学技術振興機構 | Driving simulator |
WO2006016295A1 (en) | 2004-08-04 | 2006-02-16 | Koninklijke Philips Electronics N.V. | Transport device simulator |
CA2482240A1 (en) | 2004-09-27 | 2006-03-27 | Claude Choquet | Body motion training and qualification system and method |
DE102004047865A1 (en) | 2004-10-01 | 2006-04-06 | Beeck, geb. Schröder, Heinz-Dieter | Driver training system especially for road vehicles has a driving simulator with dual controls for trainee and instructor and with simulation of road situations |
-
2006
- 2006-08-07 WO PCT/AU2006/001118 patent/WO2007016731A1/en active Application Filing
- 2006-08-07 US US11/989,954 patent/US8633985B2/en not_active Expired - Fee Related
Patent Citations (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2667962A1 (en) * | 1990-10-11 | 1992-04-17 | Opti Pilote | Method of recording and processing data for managing the driving of vehicles |
US5353023A (en) * | 1991-06-27 | 1994-10-04 | Mitsubishi Denki Kabushiki Kaisha | Navigation system for cars |
US6735506B2 (en) * | 1992-05-05 | 2004-05-11 | Automotive Technologies International, Inc. | Telematics system |
US5539645A (en) * | 1993-11-19 | 1996-07-23 | Philips Electronics North America Corporation | Traffic monitoring system with reduced communications requirements |
US5534759A (en) * | 1995-05-19 | 1996-07-09 | The United States Of America As Represented By The Secretary Of The Navy | Electric vehicle monitoring system |
US6272457B1 (en) * | 1996-09-16 | 2001-08-07 | Datria Systems, Inc. | Spatial asset management system that time-tags and combines captured speech data and captured location data using a predifed reference grammar with a semantic relationship structure |
US20010039489A1 (en) * | 1996-09-16 | 2001-11-08 | Ford Terry Edward | Spatial asset management system and method |
US20010053970A1 (en) * | 1996-09-16 | 2001-12-20 | Ford Terry Edward | Spatial asset management system and method |
US7003443B2 (en) * | 1996-09-16 | 2006-02-21 | Datria Systems, Inc. | Spatial asset management system and method |
US6711535B2 (en) * | 1996-09-16 | 2004-03-23 | Datria Systems, Inc. | Method and apparatus for performing field data collection |
US5928291A (en) * | 1997-03-27 | 1999-07-27 | Rockwell International Corporation | Mileage and fuel consumption determination for geo-cell based vehicle information management |
US7548961B1 (en) * | 1998-09-01 | 2009-06-16 | Fernandez Dennis S | Integrated vehicular sensor and messaging system and method |
US20080103651A1 (en) * | 1999-07-30 | 2008-05-01 | Oshkosh Truck Corporation | User interface and method for vehicle control system |
US6684027B1 (en) * | 1999-08-19 | 2004-01-27 | Joan I. Rosenberg | Method and system for recording data for the purposes of performance related skill development |
US6298290B1 (en) * | 1999-12-30 | 2001-10-02 | Niles Parts Co., Ltd. | Memory apparatus for vehicle information data |
US6593848B1 (en) * | 2000-02-23 | 2003-07-15 | Atkins, Iii William T. | Motor vehicle recorder system |
US20040054452A1 (en) * | 2000-08-01 | 2004-03-18 | Mats Bjorkman | Methods and means for monitoring driver alertness and display means for displaying information related thereto |
US6784973B1 (en) * | 2000-08-31 | 2004-08-31 | Eastman Kodak Company | Quality assurance system for retail photofinishing |
US20050171663A1 (en) * | 2000-08-31 | 2005-08-04 | Lisa Mittelsteadt | Automobile monitoring for operation analysis |
US6925425B2 (en) * | 2000-10-14 | 2005-08-02 | Motorola, Inc. | Method and apparatus for vehicle operator performance assessment and improvement |
US7565230B2 (en) * | 2000-10-14 | 2009-07-21 | Temic Automotive Of North America, Inc. | Method and apparatus for improving vehicle operator performance |
US20020116156A1 (en) * | 2000-10-14 | 2002-08-22 | Donald Remboski | Method and apparatus for vehicle operator performance assessment and improvement |
US20020091473A1 (en) * | 2000-10-14 | 2002-07-11 | Gardner Judith Lee | Method and apparatus for improving vehicle operator performance |
US20030028296A1 (en) * | 2001-08-01 | 2003-02-06 | Miller Steven P. | Automated vehicle inspection system |
US6650977B2 (en) * | 2001-08-01 | 2003-11-18 | International Truck Intellectual Property Company, Llc | Automated vehicle inspection system |
US20030105566A1 (en) * | 2001-08-01 | 2003-06-05 | Miller Steven P. | Automated vehicle inspection system |
US20030069716A1 (en) * | 2001-10-09 | 2003-04-10 | Martinez David Frederick | System & method for performing field inspection |
US20030120522A1 (en) * | 2001-12-20 | 2003-06-26 | Robert Uyeki | Vehicle monitoring and reservation system |
US20030132968A1 (en) * | 2002-01-11 | 2003-07-17 | Stewart Paul Joseph | System and method for virtual interactive design and evaluation and manipulation of vehicle mechanisms |
US20030153329A1 (en) * | 2002-02-13 | 2003-08-14 | General Motors Corporation | Method for broadcast filtering using convex hulls |
US8139878B2 (en) * | 2002-04-15 | 2012-03-20 | Panasonic Corporation | Picture coding method and picture decoding method |
US20060106504A1 (en) * | 2002-08-27 | 2006-05-18 | Carpenter Timothy G | Apparatus and a system for determining compliance with parking rules by vehicle |
US7129848B2 (en) * | 2003-03-11 | 2006-10-31 | Alcatel | Remote monitoring method and system |
US20060055564A1 (en) * | 2004-01-09 | 2006-03-16 | United Parcel Service Of America, Inc. | System, method, and apparatus for capturing telematics data with an active RFID tag |
US20060077095A1 (en) * | 2004-07-20 | 2006-04-13 | Tucker Layne D | Precision GPS driven utility asset management and utility damage prevention system and method |
US20060018642A1 (en) * | 2004-07-20 | 2006-01-26 | Chaplin David V | Mobile laser designated infrared multimedia mapping system |
US20060044401A1 (en) * | 2004-08-31 | 2006-03-02 | Samsung Electronics Co., Ltd. | Mobile communication terminal for storing a picture and picture-taking location information and method for providing services using the same |
US7483485B2 (en) * | 2005-01-24 | 2009-01-27 | Moderator Systems, Inc. | Wireless event authentication system |
US7496140B2 (en) * | 2005-01-24 | 2009-02-24 | Winningstad C Norman | Wireless event authentication system |
US20060171539A1 (en) * | 2005-01-24 | 2006-08-03 | Winningstad C N | Wireless event authentication system |
US20060165160A1 (en) * | 2005-01-24 | 2006-07-27 | Winningstad C N | Wireless event authentication system |
US20060185019A1 (en) * | 2005-02-11 | 2006-08-17 | Wong Chun P | Method and system for observational data collection |
US20060212195A1 (en) * | 2005-03-15 | 2006-09-21 | Veith Gregory W | Vehicle data recorder and telematic device |
WO2007016731A1 (en) * | 2005-08-05 | 2007-02-15 | Vigil Systems Pty Ltd | Computerised information collection and training method and apparatus |
US7756640B2 (en) * | 2006-09-26 | 2010-07-13 | Hitachi, Ltd. | Vehicle control system, vehicle control method, and vehicle control program |
US20090157619A1 (en) * | 2007-12-18 | 2009-06-18 | Triad Group Plc | System and method for creating a database |
Cited By (47)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8285424B2 (en) * | 2007-05-31 | 2012-10-09 | Fujitsu Ten Limited | Vehicle-running-state display method |
US20080300731A1 (en) * | 2007-05-31 | 2008-12-04 | Fujitsu Ten Limited | Vehicle-running-state display method |
US9437012B2 (en) * | 2008-07-09 | 2016-09-06 | Disney Enterprises, Inc. | Multiple-object tracking and team identification for game strategy analysis |
US20110013836A1 (en) * | 2008-07-09 | 2011-01-20 | Smadar Gefen | Multiple-object tracking and team identification for game strategy analysis |
US9031279B2 (en) * | 2008-07-09 | 2015-05-12 | Disney Enterprises, Inc. | Multiple-object tracking and team identification for game strategy analysis |
US20150221096A1 (en) * | 2008-07-09 | 2015-08-06 | Disney Enterprises, Inc. | Multiple-Object Tracking And Team Identification For Game Strategy Analysis |
US10198748B2 (en) * | 2008-07-22 | 2019-02-05 | At&T Intellectual Property I, L.P. | System and method for adaptive media playback based on destination |
US10812874B2 (en) | 2008-07-22 | 2020-10-20 | At&T Intellectual Property I, L.P. | System and method for temporally adaptive media playback |
US20160321699A1 (en) * | 2008-07-22 | 2016-11-03 | At&T Intellectual Property I, L.P. | System and Method for Adaptive Media Playback Based on Destination |
US10397665B2 (en) | 2008-07-22 | 2019-08-27 | At&T Intellectual Property I, L.P. | System and method for temporally adaptive media playback |
US11272264B2 (en) | 2008-07-22 | 2022-03-08 | At&T Intellectual Property I, L.P. | System and method for temporally adaptive media playback |
US9586599B2 (en) | 2008-10-30 | 2017-03-07 | Ford Global Technologies, Llc | Vehicle and method for advising driver of same |
US20110187522A1 (en) * | 2008-10-30 | 2011-08-04 | Ford Global Technologies, Llc | Vehicle and method of advising a driver therein |
US9493171B2 (en) | 2008-10-30 | 2016-11-15 | Ford Global Technologies, Llc | Vehicle and method of advising a driver therein |
US20110187520A1 (en) * | 2008-10-30 | 2011-08-04 | Ford Global Technologies, Llc | Vehicle and method for advising driver of same |
US9707975B2 (en) | 2008-10-30 | 2017-07-18 | Ford Global Technologies, Llc | Vehicle and method for advising driver of same |
US8738228B2 (en) | 2009-10-30 | 2014-05-27 | Ford Global Technologies, Llc | Vehicle and method of tuning performance of same |
US8886365B2 (en) * | 2009-10-30 | 2014-11-11 | Ford Global Technologies, Llc | Vehicle and method for advising driver of same |
US20110106334A1 (en) * | 2009-10-30 | 2011-05-05 | Ford Global Technologies, Llc | Vehicle and method for advising driver of same |
US9045145B2 (en) | 2009-10-30 | 2015-06-02 | Ford Global Technologies, Llc | Vehicle and method of tuning performance of same |
US9922567B2 (en) | 2011-07-21 | 2018-03-20 | Bendix Commercial Vehicle Systems Llc | Vehicular fleet management system and methods of monitoring and improving driver performance in a fleet of vehicles |
US20150307107A1 (en) * | 2011-10-11 | 2015-10-29 | Lytx, Inc. | Driver performance determination based on geolocation |
US9604648B2 (en) * | 2011-10-11 | 2017-03-28 | Lytx, Inc. | Driver performance determination based on geolocation |
US10445954B2 (en) | 2011-10-12 | 2019-10-15 | Lytx, Inc. | Drive event capturing based on geolocation |
US9106816B1 (en) * | 2012-01-12 | 2015-08-11 | Sprint Communications Company L.P. | Handheld apparatus for demonstrating a screen display |
DE102012105043B4 (en) * | 2012-06-12 | 2014-03-27 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Turn preview |
DE102012105043A1 (en) * | 2012-06-12 | 2013-12-12 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Method for preview of rail tracks to be traveled by rail vehicles, involves creating video from stored video image data based on tracks selected for preview by video unit, and playing created video for preview of selected tracks |
US9754499B2 (en) * | 2012-08-10 | 2017-09-05 | Xrs Corporation | Communication techniques for transportation route modifications |
US20140047347A1 (en) * | 2012-08-10 | 2014-02-13 | Xrs Corporation | Communication techniques for transportation route modifications |
US8798598B2 (en) * | 2012-09-13 | 2014-08-05 | Alain Rossmann | Method and system for screencasting Smartphone video game software to online social networks |
US9344683B1 (en) | 2012-11-28 | 2016-05-17 | Lytx, Inc. | Capturing driving risk based on vehicle state and automatic detection of a state of a location |
US10166934B2 (en) | 2012-11-28 | 2019-01-01 | Lytx, Inc. | Capturing driving risk based on vehicle state and automatic detection of a state of a location |
DE102013001747A1 (en) | 2013-01-31 | 2014-07-31 | Volkswagen Aktiengesellschaft | Method for providing a rating of drive along traffic route traveled by learner-driver of motor car, involves detecting route data and evaluation data along busy route so as to assign the data to current geographical position of car |
US10169821B2 (en) | 2013-09-20 | 2019-01-01 | Elwha Llc | Systems and methods for insurance based upon status of vehicle software |
US20150088334A1 (en) * | 2013-09-20 | 2015-03-26 | Elwha. LLC | Systems and methods for insurance based upon status of vehicle software |
US9424607B2 (en) * | 2013-09-20 | 2016-08-23 | Elwha Llc | Systems and methods for insurance based upon status of vehicle software |
US20170221150A1 (en) * | 2014-07-08 | 2017-08-03 | Matan BICHACHO | Behavior dependent insurance |
US10471964B2 (en) | 2014-10-10 | 2019-11-12 | Wpj Holdings, Inc. | System and method for collecting vehicle use and driving behavior data using a mobile communication device and bluetooth low energy (BLE) device |
US10325425B1 (en) * | 2015-09-23 | 2019-06-18 | State Farm Mutual Automobile Insurance Company | Systems and methods for using image data to generate vehicle operation logs |
US9646433B1 (en) * | 2015-09-23 | 2017-05-09 | State Farm Mutual Automobile Insurance Company | Systems and methods for using image data to generate vehicle operation logs |
US20170111587A1 (en) * | 2015-10-14 | 2017-04-20 | Garmin Switzerland Gmbh | Navigation device wirelessly coupled with auxiliary camera unit |
US11321951B1 (en) | 2017-01-19 | 2022-05-03 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for integrating vehicle operator gesture detection within geographic maps |
US20180232045A1 (en) * | 2017-02-15 | 2018-08-16 | Cae Inc. | Contextual monitoring perspective selection during training session |
US11398162B2 (en) * | 2017-02-15 | 2022-07-26 | Cae Inc. | Contextual monitoring perspective selection during training session |
US11315207B1 (en) * | 2017-06-02 | 2022-04-26 | Des Moines Area Metropolitan Planning Organization | Cargo optimization systems, devices and related methods |
US20200265013A1 (en) * | 2019-02-18 | 2020-08-20 | Microsoft Technology Licensing, Llc | Inline document conversation system |
US11086824B2 (en) * | 2019-02-18 | 2021-08-10 | Microsoft Technology Licensing, Llc | Inline document conversation system |
Also Published As
Publication number | Publication date |
---|---|
US8633985B2 (en) | 2014-01-21 |
US20090262191A1 (en) | 2009-10-22 |
WO2007016731A1 (en) | 2007-02-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8633985B2 (en) | Computerized information collection and training method and apparatus | |
Fisher et al. | Handbook of driving simulation for engineering, medicine and psychology: an overview | |
US20120135382A1 (en) | Individualized mastery-based driver training | |
Dingus et al. | TravTek evaluation task C3-Camera car study | |
JP2005538393A (en) | Computer-based driving lesson system | |
US8506302B2 (en) | System, method and apparatus for automatic generation of remedial training | |
CN107430815A (en) | Method and system for automatic identification parking area | |
Pollatsek et al. | Driving simulators as training and evaluation tools: Novice drivers | |
De Ceunynck et al. | Proactive evaluation of traffic signs using a traffic sign simulator | |
Cao et al. | Hazard perception in driving: a systematic literature review | |
Grahn et al. | Expert drivers’ prospective thinking-aloud to enhance automated driving technologies–Investigating uncertainty and anticipation in traffic | |
Green | Initial on-the-road tests of driver information system interfaces: route guidance, traffic information, IVSAWS, and vehicle monitoring. Final report | |
Nowakowski et al. | Common automotive navigation system usability problems and a standard test protocol to identify them | |
Classen et al. | Feasibility of automated in-vehicle technologies on volunteers’ driving performance | |
Pape | Role of Human Factors in Preventing Cargo Tank Truck Rollovers | |
Green | Human factors and new driver interfaces: Lessons learned from a major research project | |
Sayer et al. | Integrated vehicle-based safety systems field operational test plan | |
Dreßler et al. | Development and Trial of an Item Set for Testing Traffic Perception and Hazard Avoidance | |
Ryan | Driver Performance Due to Unmanned Aerial System Applications in the Vicinity of Surface Transportation | |
Winkelbauer et al. | Naturalistic driving: A new method of data collection | |
Raman et al. | IoT-Enhanced Driver Training Simulators for Real-Time Performance Monitoring and Analysis | |
JP2022032244A (en) | Driving analysis device and driving analysis method | |
Dols et al. | TRAINER Project: Development of an Improved Learning Method for Training Novice Drivers with Simulators | |
Hanscom et al. | Human Factors Evaluation Methods For Traffic Control Devices | |
Green et al. | Initial On-the-Road Tests of Driver Information System Interfaces: Route Guidance, Traffic Information, Vehicle Monitoring, and IVSAWS |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: VIGIL SYSTEMS PTY. LTD., AUSTRALIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HAYNES, FREDERICK;SCHULTZ, BRADLEY JOHN;LARKIN, STEPHEN CONWAY;AND OTHERS;REEL/FRAME:020795/0896 Effective date: 20080318 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.) |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.) |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20180121 |