US20010041953A1 - Automatic drive control system - Google Patents

Automatic drive control system Download PDF

Info

Publication number
US20010041953A1
US20010041953A1 US09/134,522 US13452298A US2001041953A1 US 20010041953 A1 US20010041953 A1 US 20010041953A1 US 13452298 A US13452298 A US 13452298A US 2001041953 A1 US2001041953 A1 US 2001041953A1
Authority
US
United States
Prior art keywords
vehicle
running
road
signal
generating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/134,522
Other versions
US6343247B2 (en
Inventor
Eishi Jitsukata
Sachio Kobayashi
Kazuya Tamura
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Assigned to HONDA GIKEN KOGYO KABUSHIKI KAISHA reassignment HONDA GIKEN KOGYO KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOBAYASHI, SACHIO, TAMURA, KAZUYA, JITSUKATA, EISHI
Publication of US20010041953A1 publication Critical patent/US20010041953A1/en
Application granted granted Critical
Publication of US6343247B2 publication Critical patent/US6343247B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0257Control of position or course in two dimensions specially adapted to land vehicles using a radar
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/027Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means comprising intertial navigation means, e.g. azimuth detector
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0274Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
    • G05D1/0278Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle using satellite positioning signals, e.g. GPS
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60TVEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T2201/00Particular use of vehicle brake systems; Special systems using also the brakes; Special software modules within the brake system controller
    • B60T2201/08Lane monitoring; Lane Keeping Systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60TVEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
    • B60T2201/00Particular use of vehicle brake systems; Special systems using also the brakes; Special software modules within the brake system controller
    • B60T2201/08Lane monitoring; Lane Keeping Systems
    • B60T2201/087Lane monitoring; Lane Keeping Systems using active steering actuation
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0259Control of position or course in two dimensions specially adapted to land vehicles using magnetic or electromagnetic means
    • G05D1/0261Control of position or course in two dimensions specially adapted to land vehicles using magnetic or electromagnetic means using magnetic plots

Definitions

  • the invention relates to an automatic drive control system.
  • Japanese Patent Kokai 9-62346 As a prior art, for example, there is a system disclosed in Japanese Patent Kokai 9-62346.
  • This system comprises: a navigation apparatus for detecting a position of a vehicle carrying the navigation apparatus by using not only signals which are generated because of the magnetic nails but also signals from the global positioning system (GPS); and a communicating apparatus which can receive various traffic information from beacons provided at every predetermined intervals on the sides of the road.
  • GPS global positioning system
  • a communicating apparatus which can receive various traffic information from beacons provided at every predetermined intervals on the sides of the road.
  • a running line is set along the reference line in accordance with the running environment and the vehicle is steered along the set running line.
  • the system In order to detect a running on a rut formed on the road, the system has a yaw rate sensor and a lateral acceleration sensor and detects a forming state of the rut by a camera mounted thereon, thereby setting the running line suitable for the road on which the vehicle is running.
  • the running line for the reference line can be made unspecified by changing a positional relation between the reference line and the center of the vehicle with the elapse of the time, thereby to prevent the formation of the rut.
  • the reference line is recognized by detecting the signals produced because of the magnetic nails on the road, and the automatic steering is performed so as to trace a desired running line.
  • a running line 3 which is set by tracing the nails does not draw a smooth curve around the center of the lane.
  • a vehicle 4 is so steered that a straight line 5 connecting two adjacent magnetic nails coincides with the vehicle center line.
  • an object of the invention to provide an automatic drive control system for a motor vehicle, which can perform an automatic steering in accordance with a driving situation of the motor vehicle without limiting to only a tracing operation of marks such as magnetic nails or the like provided on a road.
  • an automatic drive control system for a motor vehicle comprising: radar means for detecting an existence of an obstacle in front of a vehicle so as to produce an obstacle detection signal; photographing means for photographing a road surface in front of the vehicle so as to produce a video signal; image processing means for generating a vehicle position signal indicative of a position of the vehicle in the width direction of the road from an image represented by the video signal; a navigation apparatus for generating road data indicative of coordinates of the road in front of the current position of the vehicle; communicating means for receiving a traffic information signal for automatic driving; running command generating means for generating a running command; running course setting means for setting a running course on the basis of the running command, obstacle detection signal, vehicle position signal, road data, and traffic information signal for automatic driving; and target running locus calculating means for obtaining a target running locus on the basis of the set running course, wherein the vehicle is steered so as to trace the target running locus.
  • the vehicle sets the running course on the road where it is running, it is unnecessary to provide the lane markers such as magnetic nails or the like on the road surface and detecting the signals from the lane markers even for the automatic staring for the motor vehicle. Even in the running state of the vehicle such as lane change, branching, or junction in which the detection of the lane markers is interrupted (discontinued), smooth steering for the vehicle can be maintained.
  • FIGS. 1A and 1B are diagrams showing target running loci of vehicles according to the prior art and the invention.
  • FIG. 2 is a block constructional diagram showing an embodiment of the invention
  • FIG. 3 is a flowchart for explaining a process for deciding a running command in a whole plan ECU in FIG. 2;
  • FIG. 4 is a flowchart for explaining a fitting process in the whole plan ECU in FIG. 2.
  • FIG. 2 shows a block constructional diagram of an automatic drive control system as an embodiment of the invention.
  • a laser radar 10 for detecting an existence of an obstacle located in front of a vehicle and a CCD (Charge Coupled Device) camera 11 serving as photographing means for recognizing a form of a road surface of the road in front of the vehicle and a positional relation between the own vehicle and a lane are provided for a front portion of the vehicle (not shown).
  • a video signal obtained by the CCD camera 11 is supplied to an ECU (Electronic Control Unit) 12 for image processing.
  • the ECU 12 is constructed by a microcomputer and generates road surface data and position data indicative of the own vehicle on the lane on the basis of the video signal from the CCD camera 11 .
  • Outputs of the laser radar 10 and ECU 12 for image processing are supplied to a whole plan ECU 13 .
  • Outputs of a navigation apparatus 14 and a communicating apparatus 15 are supplied to the whole plan ECU 13 .
  • beacons controlled by a management center are provided at every predetermined intervals on the sides of the road.
  • the communicating apparatus 15 receives traffic information signals for automatic driving from the beacons.
  • the navigation apparatus 14 has: a GPS (Global Positioning System) apparatus 16 ; a distance sensor 17 ; a yaw rate sensor 18 ; an acceleration sensor 19 ; and road map information 20 in which road map data have been recorded.
  • the navigation apparatus obtains running information by a navigation controller 21 . Since the construction and operation of the navigation apparatus 14 have been well-known, they are not described in detail here.
  • the whole plan ECU 13 first decides running commands such as lane maintaining of the lane or lane change by a run instructing process 23 on the basis of information regarding the obstacle located in front of the vehicle from the laser radar 10 and road information or traffic information in a predetermined distance in front of the vehicle from the communicating apparatus 15 .
  • running commands such as lane maintaining of the lane or lane change by a run instructing process 23 on the basis of information regarding the obstacle located in front of the vehicle from the laser radar 10 and road information or traffic information in a predetermined distance in front of the vehicle from the communicating apparatus 15 .
  • vehicle running information direction, speed, acceleration, and the like
  • map information from the navigation apparatus 14 , more accurate running information can be obtained.
  • FIG. 3 is a flowchart showing an embodiment of a process for obtaining the running command in the whole plan ECU 13 according to the invention.
  • road data in front (for example, 100 meters ahead) of the vehicle generated from the navigation apparatus 14 and a vehicle position signal from the ECU 12 for image processing are obtained (step S 1 ).
  • Road information is obtained for all of the areas where the vehicle may possibly visit from now on in the run from the current position of the vehicle.
  • a command is issued for the run in a range from the current running lane to a lane where those obstacles or an accident can be avoided (step S 6 ).
  • a vehicle which is running at a low speed in front of the own vehicle may be regarded as an obstacle in case the distance between both of the vehicles is narrow.
  • step S 2 When, in step S 2 , no detection signal is detected, it is discriminated whether the running vehicle enters a road whose width decreases or not on the basis of the road data and vehicle position signal obtained in step S 1 (step S 3 ).
  • step S 3 it is determined that the vehicle enters a width decreasing point of the road, a discrimination is made whether the current running lane disappears at the width decreasing point or not (step S 7 ).
  • step S 7 it is detemined that the current running lane will disappear, the operation in step S 6 is executed. If NO in step S 7 , a command is issued for the run to keep the current running lane (step S 5 ).
  • step S 4 When, in step S 3 , the width decreasing point is not confirmed, it is discriminated whether that point is a branching point or not (step S 4 ).
  • the driver When the branching point is now confirmed, the driver is urged to instruct which lane the driver wants to run or whether he wants to keep the current running lane (step S 8 ). There issued a command for the run in a range from the current running lane up to the lane pointed out by the driver (step S 9 ).
  • step S 5 a command is issued for the run to keep the current running lane
  • step S 5 When the vehicle enters the junction, the lane is not changed and the running command in step S 5 is executed.
  • the running command is generated by the run command process 23 , within an information range where the run instructing process 23 has decided the running command (for example, within a range of 100 meters ahead of the motor vehicle), information regarding the decided running command is further extracted.
  • the position in the road width direction of the vehicle is obtained by the CCD camera 11 .
  • a point train serving as a running course in the information range in which the current vehicle position is set to a start point and the running target point is set to an end point is determined by a target point train extracting process 24 .
  • a pattern extracting process 25 and a fitting process 27 which will be described hereinlater, are executed, so that a target running locus is determined.
  • the whole plan ECU 13 transmits a vehicle steering signal based on the obtained target running locus to the vehicle control ECU 22 . Since the construction and operation of the portion for obtaining the vehicle steering signal in accordance with the obtained target running locus are similar to those in the prior art as disclosed in Japanese Patent Kokai 9-62346, they are not described in detail here.
  • FIG. 4 is a flowchart for explaining an embodiment of the pattern extracting process 25 and fitting process 27 of the whole plan ECU 13 according to the invention.
  • a curvature in each point train is first obtained by a calculation on the basis of the curve connecting the neighboring points extracted by the target point train extracting process 24 (step S 11 ).
  • step S 11 From the result in step S 11 , (an n number of) extremal values of the curvature and (an m number of) inflection points of the curve are extracted (step S 12 ).
  • a start point and an end point in the point train are included in the inflection points.
  • the point train is divided into an (m+n ⁇ 1) number of small segments on the basis of the result in step S 12 (step S 13 ).
  • a pattern segment of the shape which is fitted into each small interval, namely, which is adapted thereto is selected from a pattern segment library 26 (step S 14 ).
  • the pattern segment library 26 is means for storing basic elements such as straight line, arc, and the like and road patterns such as U-shape, S-shape, right/left lane change, junction, branching, and the like formed by a combination of those basic elements.
  • step S 15 the minimum allowance radius of the curve where the vehicle can run is determined by the running information serving as a basis for deciding the running command.
  • the shape of the pattern segment is finely adjusted so that the radius of curvature of the curve is equal to or larger than the minimum allowance radius (step S 16 ).
  • step S 17 the pattern segment of the shape adapted to the small interval does not exist, a change ratio of the curvature of the point train in the small interval is obtained by a calculation (step S 17 ).
  • a slack curve adapted to the small interval is determined (step S 18 ).
  • Step S 18 relates to a process for obtaining an average curvature change of the point train by, for example, the method of least squares and deciding a parameter of clothoid (Cornu's spiral).
  • an angle and a magnification of the pattern segment selected in correspondence to the small interval are determined so as to be adapted to the actual running road (step S 19 ).
  • the above processes are performed for all of the small segments or intervals (step S 20 ).
  • the angle and magnification of each pattern segment are further finely adjusted and coupled so that the tangential directions in the coupling portions of the small intervals coincide, and a set target running locus is generated (step S 21 ).
  • a vehicle steering signal is formed on the basis of the target running locus generated by the processes of the whole plan ECU 13 described above and the resultant vehicle steering signal is supplied to the vehicle control ECU 22 .
  • the vehicle control ECU 22 On the basis of the vehicle steering signal, the vehicle control ECU 22 generates control signals to be fed to a throttle actuator, a brake actuator, and a steering actuator (not shown), thereby automatically steering the vehicle.
  • a target running locus 8 is set by the whole plan ECU mentioned above into a vehicle 7 in which the automatic drive control system according to the invention.
  • the vehicle 7 is steered so as to draw a smooth running locus in the center portion of a lane 6 of the road as shown in FIG. 1B.
  • the laser radar 10 , CCD camera 11 , image processing ECU 12 , communicating apparatus 15 , run instructing process 23 , and target point train extracting process 24 correspond to radar means, photographing means, image processing means, communicating means, running command forming means, and running course setting means, respectively.
  • the pattern extracting process 25 and fitting process 27 correspond to target running locus calculating means.
  • the running course is set on the basis of the obstacle detection signal, vehicle position signal, road data, traffic information signal for automatic driving, and running command.
  • the target running locus is obtained on the basis of the set running course and the vehicle can be automatically steered so as to trace and run along the obtained target running locus.
  • the automatic steering of the vehicle can be, therefore, performed irrespective of the lane markers such as magnetic nails or the like provided on the road surface.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Electromagnetism (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Traffic Control Systems (AREA)
  • Steering Control In Accordance With Driving Conditions (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Image Processing (AREA)

Abstract

In an automatic drive control system in a road environment in which an infrastructure has been constructed so as to automatically steer a vehicle, the automatic steering of the vehicle is performed irrespective of lane markers attached on the road surface. A running command and a running course are determined on the basis of an obstacle detection signal, a vehicle position signal, road data, and traffic information signal for automatic driving. A target running locus is obtained on the basis of the set running course. The vehicle is automatically steered so as to trace and run along the obtained running target locus.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0001]
  • The invention relates to an automatic drive control system. [0002]
  • 2. Description of the Related Art [0003]
  • Hitherto, there has been known an automatic drive control system for a vehicle such as an automobile, in which a train of lane markers such as magnetic nails or the like provided on the road surface is used as a reference line and signals which are generated from the lane markers are detected, thereby recognizing a relative position of the vehicle with respect to the reference line and automatically steering the vehicle so as to adjust the center line of the vehicle along the reference line. [0004]
  • As a prior art, for example, there is a system disclosed in Japanese Patent Kokai 9-62346. This system comprises: a navigation apparatus for detecting a position of a vehicle carrying the navigation apparatus by using not only signals which are generated because of the magnetic nails but also signals from the global positioning system (GPS); and a communicating apparatus which can receive various traffic information from beacons provided at every predetermined intervals on the sides of the road. In this system, a running line is set along the reference line in accordance with the running environment and the vehicle is steered along the set running line. [0005]
  • In order to detect a running on a rut formed on the road, the system has a yaw rate sensor and a lateral acceleration sensor and detects a forming state of the rut by a camera mounted thereon, thereby setting the running line suitable for the road on which the vehicle is running. [0006]
  • In this system, the running line for the reference line can be made unspecified by changing a positional relation between the reference line and the center of the vehicle with the elapse of the time, thereby to prevent the formation of the rut. [0007]
  • In the conventional automatic steering system, however, the reference line is recognized by detecting the signals produced because of the magnetic nails on the road, and the automatic steering is performed so as to trace a desired running line. When, for example, positions of the magnetic nails [0008] 2 which are arranged in a center portion of a lane 1 of a road do not exist on a smooth curve along a curvature of the lane, as shown in FIG. 1A, a running line 3 which is set by tracing the nails does not draw a smooth curve around the center of the lane. In other words, a vehicle 4 is so steered that a straight line 5 connecting two adjacent magnetic nails coincides with the vehicle center line. When, therefore, the steering is performed so as to trace the magnetic nails 2 which are not correctly arranged on the center of the road as shown in FIG. 1A, the running line 3 of the vehicle has a zigzag form.
  • When the setting interval of the magnetic nails in the longitudinal direction of the road is wide, the recognition of the nails as a reference line is not stabilized, so that the vehicle is likely out of a desired course. [0009]
  • As disclosed in Japanese Patent Kokai 9-62346, in the method of changing the position of the vehicle relative to the reference line with the elapse of time, there has been a problem such that a predetermined running line is missing, since the change width is limited to a detecting range of magnetic nail signal detecting means provided for the vehicle and the movement of the vehicle exceeding the signal detecting range is necessary or occurs for the reference line for the purpose of, for example, avoidance of an obstacle. [0010]
  • SUMMARY AND OBJECTS OF THE INVENTION
  • It is, therefore, an object of the invention to provide an automatic drive control system for a motor vehicle, which can perform an automatic steering in accordance with a driving situation of the motor vehicle without limiting to only a tracing operation of marks such as magnetic nails or the like provided on a road. [0011]
  • According to the invention, there is provided an automatic drive control system for a motor vehicle, comprising: radar means for detecting an existence of an obstacle in front of a vehicle so as to produce an obstacle detection signal; photographing means for photographing a road surface in front of the vehicle so as to produce a video signal; image processing means for generating a vehicle position signal indicative of a position of the vehicle in the width direction of the road from an image represented by the video signal; a navigation apparatus for generating road data indicative of coordinates of the road in front of the current position of the vehicle; communicating means for receiving a traffic information signal for automatic driving; running command generating means for generating a running command; running course setting means for setting a running course on the basis of the running command, obstacle detection signal, vehicle position signal, road data, and traffic information signal for automatic driving; and target running locus calculating means for obtaining a target running locus on the basis of the set running course, wherein the vehicle is steered so as to trace the target running locus. [0012]
  • Since the vehicle sets the running course on the road where it is running, it is unnecessary to provide the lane markers such as magnetic nails or the like on the road surface and detecting the signals from the lane markers even for the automatic staring for the motor vehicle. Even in the running state of the vehicle such as lane change, branching, or junction in which the detection of the lane markers is interrupted (discontinued), smooth steering for the vehicle can be maintained.[0013]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIGS. 1A and 1B are diagrams showing target running loci of vehicles according to the prior art and the invention; [0014]
  • FIG. 2 is a block constructional diagram showing an embodiment of the invention; [0015]
  • FIG. 3 is a flowchart for explaining a process for deciding a running command in a whole plan ECU in FIG. 2; and [0016]
  • FIG. 4 is a flowchart for explaining a fitting process in the whole plan ECU in FIG. 2.[0017]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • An embodiment of the invention will now be described in detail hereinbelow with reference to the drawings. [0018]
  • FIG. 2 shows a block constructional diagram of an automatic drive control system as an embodiment of the invention. In the system, a [0019] laser radar 10 for detecting an existence of an obstacle located in front of a vehicle and a CCD (Charge Coupled Device) camera 11 serving as photographing means for recognizing a form of a road surface of the road in front of the vehicle and a positional relation between the own vehicle and a lane are provided for a front portion of the vehicle (not shown). A video signal obtained by the CCD camera 11 is supplied to an ECU (Electronic Control Unit) 12 for image processing. The ECU 12 is constructed by a microcomputer and generates road surface data and position data indicative of the own vehicle on the lane on the basis of the video signal from the CCD camera 11. Outputs of the laser radar 10 and ECU 12 for image processing are supplied to a whole plan ECU 13. Outputs of a navigation apparatus 14 and a communicating apparatus 15 are supplied to the whole plan ECU 13.
  • In this instance, as an infrastructure constituting the automatic running system, beacons controlled by a management center are provided at every predetermined intervals on the sides of the road. The communicating [0020] apparatus 15 receives traffic information signals for automatic driving from the beacons. The navigation apparatus 14 has: a GPS (Global Positioning System) apparatus 16; a distance sensor 17; a yaw rate sensor 18; an acceleration sensor 19; and road map information 20 in which road map data have been recorded. The navigation apparatus obtains running information by a navigation controller 21. Since the construction and operation of the navigation apparatus 14 have been well-known, they are not described in detail here.
  • The whole plan ECU [0021] 13 first decides running commands such as lane maintaining of the lane or lane change by a run instructing process 23 on the basis of information regarding the obstacle located in front of the vehicle from the laser radar 10 and road information or traffic information in a predetermined distance in front of the vehicle from the communicating apparatus 15. In this instance, by simultaneously referring to vehicle running information (direction, speed, acceleration, and the like) and map information from the navigation apparatus 14, more accurate running information can be obtained.
  • FIG. 3 is a flowchart showing an embodiment of a process for obtaining the running command in the [0022] whole plan ECU 13 according to the invention. In FIG. 3, road data in front (for example, 100 meters ahead) of the vehicle generated from the navigation apparatus 14 and a vehicle position signal from the ECU 12 for image processing are obtained (step S1). Road information is obtained for all of the areas where the vehicle may possibly visit from now on in the run from the current position of the vehicle. By detecting an obstacle in the obstacle detection signal obtained from the laser radar 10 or obtaining a signal indicative of, for example, the presence or absence of an accident, a position of the accident, and the like in the traffic information signal for automatic driving which is received by the communicating apparatus 15 (step S2), a command is issued for the run in a range from the current running lane to a lane where those obstacles or an accident can be avoided (step S6). In this obstacle detection, a vehicle which is running at a low speed in front of the own vehicle may be regarded as an obstacle in case the distance between both of the vehicles is narrow.
  • When, in step S[0023] 2, no detection signal is detected, it is discriminated whether the running vehicle enters a road whose width decreases or not on the basis of the road data and vehicle position signal obtained in step S1 (step S3). When, in step S3, it is determined that the vehicle enters a width decreasing point of the road, a discrimination is made whether the current running lane disappears at the width decreasing point or not (step S7). When, in step S7, it is detemined that the current running lane will disappear, the operation in step S6 is executed. If NO in step S7, a command is issued for the run to keep the current running lane (step S5). When, in step S3, the width decreasing point is not confirmed, it is discriminated whether that point is a branching point or not (step S4). When the branching point is now confirmed, the driver is urged to instruct which lane the driver wants to run or whether he wants to keep the current running lane (step S8). There issued a command for the run in a range from the current running lane up to the lane pointed out by the driver (step S9). When, in step S4, the branching point is not confirmed, a command is issued for the run to keep the current running lane (step S5).
  • When the vehicle enters the junction, the lane is not changed and the running command in step S[0024] 5 is executed.
  • When, as mentioned above, the running command is generated by the [0025] run command process 23, within an information range where the run instructing process 23 has decided the running command (for example, within a range of 100 meters ahead of the motor vehicle), information regarding the decided running command is further extracted. The position in the road width direction of the vehicle is obtained by the CCD camera 11. A point train serving as a running course in the information range in which the current vehicle position is set to a start point and the running target point is set to an end point is determined by a target point train extracting process 24. On the basis of the point train obtained by the target point train extracting process 24, a pattern extracting process 25 and a fitting process 27, which will be described hereinlater, are executed, so that a target running locus is determined. The whole plan ECU 13 transmits a vehicle steering signal based on the obtained target running locus to the vehicle control ECU 22. Since the construction and operation of the portion for obtaining the vehicle steering signal in accordance with the obtained target running locus are similar to those in the prior art as disclosed in Japanese Patent Kokai 9-62346, they are not described in detail here.
  • FIG. 4 is a flowchart for explaining an embodiment of the [0026] pattern extracting process 25 and fitting process 27 of the whole plan ECU 13 according to the invention. In FIG. 4, a curvature in each point train is first obtained by a calculation on the basis of the curve connecting the neighboring points extracted by the target point train extracting process 24 (step S11). From the result in step S11, (an n number of) extremal values of the curvature and (an m number of) inflection points of the curve are extracted (step S12). In the embodiment, a start point and an end point in the point train are included in the inflection points. Subsequently, the point train is divided into an (m+n−1) number of small segments on the basis of the result in step S12 (step S13). A pattern segment of the shape which is fitted into each small interval, namely, which is adapted thereto is selected from a pattern segment library 26 (step S14). The pattern segment library 26 is means for storing basic elements such as straight line, arc, and the like and road patterns such as U-shape, S-shape, right/left lane change, junction, branching, and the like formed by a combination of those basic elements. If, as a result of the process in step S14, the relevant pattern exists in the small interval (step S15), the minimum allowance radius of the curve where the vehicle can run is determined by the running information serving as a basis for deciding the running command. When the curve is included in the pattern segment selected in step S14, the shape of the pattern segment is finely adjusted so that the radius of curvature of the curve is equal to or larger than the minimum allowance radius (step S16). When, in step S15, the pattern segment of the shape adapted to the small interval does not exist, a change ratio of the curvature of the point train in the small interval is obtained by a calculation (step S17). A slack curve adapted to the small interval is determined (step S18). Step S18 relates to a process for obtaining an average curvature change of the point train by, for example, the method of least squares and deciding a parameter of clothoid (Cornu's spiral).
  • Subsequently, an angle and a magnification of the pattern segment selected in correspondence to the small interval are determined so as to be adapted to the actual running road (step S[0027] 19). The above processes are performed for all of the small segments or intervals (step S20). The angle and magnification of each pattern segment are further finely adjusted and coupled so that the tangential directions in the coupling portions of the small intervals coincide, and a set target running locus is generated (step S21).
  • A vehicle steering signal is formed on the basis of the target running locus generated by the processes of the [0028] whole plan ECU 13 described above and the resultant vehicle steering signal is supplied to the vehicle control ECU 22. On the basis of the vehicle steering signal, the vehicle control ECU 22 generates control signals to be fed to a throttle actuator, a brake actuator, and a steering actuator (not shown), thereby automatically steering the vehicle.
  • In this manner, a [0029] target running locus 8 is set by the whole plan ECU mentioned above into a vehicle 7 in which the automatic drive control system according to the invention. The vehicle 7 is steered so as to draw a smooth running locus in the center portion of a lane 6 of the road as shown in FIG. 1B.
  • In the [0030] run instructing process 23, it is also possible to provide means (not shown) for detecting a steering command by a manual operation from the driver and to decide a running command in accordance with it.
  • The [0031] laser radar 10, CCD camera 11, image processing ECU 12, communicating apparatus 15, run instructing process 23, and target point train extracting process 24 correspond to radar means, photographing means, image processing means, communicating means, running command forming means, and running course setting means, respectively. The pattern extracting process 25 and fitting process 27 correspond to target running locus calculating means.
  • As described above, according to the automatic drive control system of the present invention, the running course is set on the basis of the obstacle detection signal, vehicle position signal, road data, traffic information signal for automatic driving, and running command. The target running locus is obtained on the basis of the set running course and the vehicle can be automatically steered so as to trace and run along the obtained target running locus. The automatic steering of the vehicle can be, therefore, performed irrespective of the lane markers such as magnetic nails or the like provided on the road surface. [0032]
  • Even in the case where there is a disorder in the arrangement of the lane markers or even in the running state such as lane change, branch, or junction such that the detection of the lane markers is interrupted, the smooth steering can be maintained. [0033]

Claims (1)

What is claimed is:
1. An automatic drive control system for automatically steering a vehicle, comprising:
radar means for detecting the existence of an obstacle in front of said vehicle and generating an obstacle detection signal;
photographing means for photographing a road in front of said vehicle and generating a video signal;
image processing means for generating a vehicle position signal showing a position of said vehicle in a road width direction from an image shown by said video signal;
a navigation apparatus for generating road data showing coordinates of the road in front of a current position of said vehicle;
communicating means for receiving a traffic information signal for automatic driving;
running command generating means for generating a running command;
running course setting means for setting a running course on the basis of said obstacle detection signal, said vehicle position signal, said road data, said traffic information signal for automatic driving, and said running command; and
target running locus calculating means for obtaining a target running locus on the basis of said set running course,
wherein a steering is performed so as to trace and run along said target running locus.
US09/134,522 1997-09-01 1998-08-14 Automatic drive control system Expired - Lifetime US6343247B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP9-236177 1997-09-01
JP9236177A JPH1186182A (en) 1997-09-01 1997-09-01 Automatic driving control system

Publications (2)

Publication Number Publication Date
US20010041953A1 true US20010041953A1 (en) 2001-11-15
US6343247B2 US6343247B2 (en) 2002-01-29

Family

ID=16996918

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/134,522 Expired - Lifetime US6343247B2 (en) 1997-09-01 1998-08-14 Automatic drive control system

Country Status (2)

Country Link
US (1) US6343247B2 (en)
JP (1) JPH1186182A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6772062B2 (en) * 2001-05-31 2004-08-03 The Regents Of The University Of California Intelligent ultra high speed distributed sensing system and method for sensing roadway markers for intelligent vehicle guidance and control
US20050216188A1 (en) * 2004-03-24 2005-09-29 Xanavi Informatics Corporations On-vehicle information terminal, abridged map generating apparatus, abridged map display method and display apparatus
US20090287404A1 (en) * 1999-04-19 2009-11-19 Dekock Bruce W System for providing traffic information
CN102632891A (en) * 2012-04-06 2012-08-15 中国人民解放军军事交通学院 Computation method for tracking running track of unmanned vehicle in real time
US20160272243A1 (en) * 2015-03-17 2016-09-22 Fuji Jukogyo Kabushiki Kaisha Travel control apparatus for vehicle
CN105987700A (en) * 2014-11-28 2016-10-05 现代摩比斯株式会社 Apparatus and method for guiding driving route using photographic image
WO2016177469A1 (en) * 2015-05-04 2016-11-10 Qsas.Eu Ug Method for automatic driving
RU2654502C2 (en) * 2013-10-15 2018-05-21 Форд Глобал Технолоджис, ЛЛК System and method for remote vehicle monitoring
RU2659341C2 (en) * 2013-04-01 2018-06-29 Су-Мин ПАРК Vehicle automatic control system
US10269124B2 (en) * 2014-06-16 2019-04-23 Thinkware Corporation Automatic detection and analysis of traffic signal type information using image data captured on a vehicle
CN110065493A (en) * 2018-01-23 2019-07-30 本田技研工业株式会社 Travel reference line determining device and servomechanism
CN113009912A (en) * 2021-02-20 2021-06-22 中国重汽集团济南动力有限公司 Low-speed commercial unmanned vehicle path planning calculation method based on mixed A star
CN113938834A (en) * 2020-06-28 2022-01-14 宝能汽车集团有限公司 Road spectrum acquisition method and device and storage medium

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000348289A (en) * 1999-06-07 2000-12-15 Honda Motor Co Ltd Unit for operation control by inter-vehicle communication
KR100435650B1 (en) * 2001-05-25 2004-06-30 현대자동차주식회사 Detection method of road condition in a vehicle equipped with a camera, and method for detecting distance between vehicles in the same vehicle
JP4327389B2 (en) * 2001-10-17 2009-09-09 株式会社日立製作所 Travel lane recognition device
DE10210546A1 (en) * 2002-03-09 2003-09-18 Bosch Gmbh Robert Automatic vehicle control method and system
DE10218010A1 (en) * 2002-04-23 2003-11-06 Bosch Gmbh Robert Method and device for lateral guidance support in motor vehicles
US8718919B2 (en) * 2002-04-23 2014-05-06 Robert Bosch Gmbh Method and apparatus for lane recognition for a vehicle
US7510038B2 (en) * 2003-06-11 2009-03-31 Delphi Technologies, Inc. Steering system with lane keeping integration
KR100497781B1 (en) * 2004-09-24 2005-06-28 주식회사 삼안 Calculating method for parameters in the road design of s type clothoid, complex clothoid and egg type clothoid
DE602005001841T2 (en) * 2005-01-14 2008-04-17 Alcatel Lucent navigation service
JP2007233604A (en) * 2006-02-28 2007-09-13 Toyota Motor Corp Road information acquisition device, and vehicle traveling control device and road traffic system using it
JP2008191781A (en) * 2007-02-01 2008-08-21 Hitachi Ltd Collision avoidance system
US8355539B2 (en) * 2007-09-07 2013-01-15 Sri International Radar guided vision system for vehicle validation and vehicle motion characterization
JP4995029B2 (en) * 2007-10-18 2012-08-08 富士重工業株式会社 Vehicle driving support device
US8306269B2 (en) * 2009-03-12 2012-11-06 Honda Motor Co., Ltd. Lane recognition device
JP5062497B2 (en) * 2010-03-31 2012-10-31 アイシン・エィ・ダブリュ株式会社 Vehicle position detection system using landscape image recognition
US8509982B2 (en) 2010-10-05 2013-08-13 Google Inc. Zone driving
US8620032B2 (en) * 2011-05-10 2013-12-31 GM Global Technology Operations LLC System and method for traffic signal detection
US8718861B1 (en) 2012-04-11 2014-05-06 Google Inc. Determining when to drive autonomously
US9633564B2 (en) 2012-09-27 2017-04-25 Google Inc. Determining changes in a driving environment based on vehicle behavior
US8949016B1 (en) 2012-09-28 2015-02-03 Google Inc. Systems and methods for determining whether a driving environment has changed
JP6020224B2 (en) * 2013-02-07 2016-11-02 トヨタ自動車株式会社 Target travel locus generator
KR101281499B1 (en) * 2013-03-15 2013-07-02 박수민 Automatic vehicle driving system
US9558408B2 (en) * 2013-10-15 2017-01-31 Ford Global Technologies, Llc Traffic signal prediction
US10377374B1 (en) * 2013-11-06 2019-08-13 Waymo Llc Detection of pedestrian using radio devices
KR101534958B1 (en) * 2013-12-09 2015-07-07 현대자동차주식회사 Apparatus and Method for Controlling of Automatic Steering of Vehicle
US9321461B1 (en) 2014-08-29 2016-04-26 Google Inc. Change detection using curve alignment
US9248834B1 (en) 2014-10-02 2016-02-02 Google Inc. Predicting trajectories of objects based on contextual information
KR102622571B1 (en) * 2015-02-10 2024-01-09 모빌아이 비젼 테크놀로지스 엘티디. Directions for autonomous driving
JP6785859B2 (en) * 2015-11-30 2020-11-18 華為技術有限公司Huawei Technologies Co.,Ltd. Self-driving navigation methods, devices and systems, in-vehicle terminals, and servers
US10586455B2 (en) * 2017-10-19 2020-03-10 Veoneer Us, Inc. Systems and methods for vehicle lane change detection
JP6774445B2 (en) * 2018-02-05 2020-10-21 本田技研工業株式会社 Mobile control system, mobile and mobile control method
KR102279405B1 (en) * 2018-12-26 2021-07-19 바이두닷컴 타임즈 테크놀로지(베이징) 컴퍼니 리미티드 Baseline Smoothing Method Based on Polynomial Fitting for High-Speed Planning of Autonomous Vehicles
CN110262516A (en) * 2019-07-17 2019-09-20 深圳市英博超算科技有限公司 Vehicle, method and device with Function for Automatic Pilot
CN113442924A (en) * 2021-08-03 2021-09-28 浙江吉利控股集团有限公司 Vehicle track planning method and system
CN113781471B (en) * 2021-09-28 2023-10-27 中国科学技术大学先进技术研究院 Automatic driving test field system and method

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295551A (en) * 1986-03-06 1994-03-22 Josef Sukonick System for the cooperative driving of two or more vehicles
JPS63314618A (en) * 1987-06-17 1988-12-22 Nissan Motor Co Ltd Controller for self-traveling vehicle
US5208750A (en) * 1987-06-17 1993-05-04 Nissan Motor Co., Ltd. Control system for unmanned automotive vehicle
US5229941A (en) * 1988-04-14 1993-07-20 Nissan Motor Company, Limtied Autonomous vehicle automatically running on route and its method
EP0488828B1 (en) * 1990-11-30 1996-08-14 Honda Giken Kogyo Kabushiki Kaisha Control device of an autonomously moving body and evaluation method for data thereof
JP3183966B2 (en) * 1992-04-20 2001-07-09 マツダ株式会社 Vehicle travel control device
DE4407757A1 (en) * 1993-03-08 1994-09-15 Mazda Motor Device for detecting obstacles for a vehicle
JP3128176B2 (en) * 1993-05-24 2001-01-29 マツダ株式会社 Vehicle obstacle detection device
US5504482A (en) * 1993-06-11 1996-04-02 Rockwell International Corporation Automobile navigation guidance, control and safety system
US5983161A (en) * 1993-08-11 1999-11-09 Lemelson; Jerome H. GPS vehicle collision avoidance warning and control system and method
US5638116A (en) * 1993-09-08 1997-06-10 Sumitomo Electric Industries, Ltd. Object recognition apparatus and method
JP3357749B2 (en) * 1994-07-12 2002-12-16 本田技研工業株式会社 Vehicle road image processing device
JPH0886662A (en) * 1994-07-18 1996-04-02 Sumitomo Electric Ind Ltd Traveling route indicator on vehicle, road information transmitter, route guide system and display method for navigation system
JP3191621B2 (en) * 1995-03-14 2001-07-23 トヨタ自動車株式会社 Vehicle travel guidance system
JP3564547B2 (en) * 1995-04-17 2004-09-15 本田技研工業株式会社 Automatic driving guidance device
JPH098752A (en) * 1995-06-26 1997-01-10 Matsushita Electric Ind Co Ltd Multiplex information receiver and navigation system
US5911773A (en) * 1995-07-24 1999-06-15 Aisin Aw Co., Ltd. Navigation system for vehicles
JP3457441B2 (en) * 1995-10-31 2003-10-20 本田技研工業株式会社 How to control an autonomous vehicle
JPH09123848A (en) * 1995-11-06 1997-05-13 Toyota Motor Corp Vehicular information display device
JPH09142236A (en) * 1995-11-17 1997-06-03 Mitsubishi Electric Corp Periphery monitoring method and device for vehicle, and trouble deciding method and device for periphery monitoring device
JP3698835B2 (en) * 1996-10-25 2005-09-21 三菱電機株式会社 Traffic information display device, display method thereof, and medium on which display control program for traffic information display device is recorded
JP3732292B2 (en) * 1996-11-27 2006-01-05 本田技研工業株式会社 Vehicle group running control system
JPH113499A (en) * 1997-06-10 1999-01-06 Hitachi Ltd Mobile body management system, mobile body mounting device, base station device and mobile body managing method

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090287404A1 (en) * 1999-04-19 2009-11-19 Dekock Bruce W System for providing traffic information
US6772062B2 (en) * 2001-05-31 2004-08-03 The Regents Of The University Of California Intelligent ultra high speed distributed sensing system and method for sensing roadway markers for intelligent vehicle guidance and control
US20050216188A1 (en) * 2004-03-24 2005-09-29 Xanavi Informatics Corporations On-vehicle information terminal, abridged map generating apparatus, abridged map display method and display apparatus
US7668650B2 (en) * 2004-03-24 2010-02-23 Xanavi Informatics Corporation On-vehicle information terminal, abridged map generating apparatus, abridged map display method and display apparatus
CN102632891A (en) * 2012-04-06 2012-08-15 中国人民解放军军事交通学院 Computation method for tracking running track of unmanned vehicle in real time
RU2659341C2 (en) * 2013-04-01 2018-06-29 Су-Мин ПАРК Vehicle automatic control system
RU2654502C2 (en) * 2013-10-15 2018-05-21 Форд Глобал Технолоджис, ЛЛК System and method for remote vehicle monitoring
US10269124B2 (en) * 2014-06-16 2019-04-23 Thinkware Corporation Automatic detection and analysis of traffic signal type information using image data captured on a vehicle
CN105987700A (en) * 2014-11-28 2016-10-05 现代摩比斯株式会社 Apparatus and method for guiding driving route using photographic image
US9586620B2 (en) * 2015-03-17 2017-03-07 Fuji Jukogyo Kabushiki Kaisha Travel control apparatus for vehicle
US20160272243A1 (en) * 2015-03-17 2016-09-22 Fuji Jukogyo Kabushiki Kaisha Travel control apparatus for vehicle
WO2016177469A1 (en) * 2015-05-04 2016-11-10 Qsas.Eu Ug Method for automatic driving
CN110065493A (en) * 2018-01-23 2019-07-30 本田技研工业株式会社 Travel reference line determining device and servomechanism
CN110065493B (en) * 2018-01-23 2022-06-14 本田技研工业株式会社 Driving reference line determining device and automatic driving device
US11518383B2 (en) 2018-01-23 2022-12-06 Honda Motor Co., Ltd. Travel reference line determination system and automatic driving system
CN113938834A (en) * 2020-06-28 2022-01-14 宝能汽车集团有限公司 Road spectrum acquisition method and device and storage medium
CN113009912A (en) * 2021-02-20 2021-06-22 中国重汽集团济南动力有限公司 Low-speed commercial unmanned vehicle path planning calculation method based on mixed A star

Also Published As

Publication number Publication date
JPH1186182A (en) 1999-03-30
US6343247B2 (en) 2002-01-29

Similar Documents

Publication Publication Date Title
US6343247B2 (en) Automatic drive control system
US6169940B1 (en) Automatic driving system
US6489887B2 (en) Lane-keep assisting system for vehicle
US11731665B2 (en) Driving control method and driving control device
CN107010043B (en) The travel controlling system of vehicle
US6665614B2 (en) Vehicle surroundings monitoring apparatus and vehicle traveling control system incorporating the apparatus
JP3191621B2 (en) Vehicle travel guidance system
US8346436B2 (en) Driving support system
US8085984B2 (en) Image recognizing apparatus and method, and position determining apparatus, vehicle controlling apparatus and navigation apparatus using the image recognizing apparatus or method
CN102463991B (en) Method and device for determining a plausible lane for guiding a vehicle and motor vehicle
EP2939894A2 (en) Driving assistance apparatus
JP6589658B2 (en) Travel control device
JP3670089B2 (en) Automatic steering control device
US20080103661A1 (en) Apparatus for controlling swivel angles of on-vehicle headlights
JP2007219743A (en) Traveling control system for automobile
CN113711285B (en) Road type determination device and driving support device
US11042759B2 (en) Roadside object recognition apparatus
JP2009096361A (en) Vehicle run support system
CN110576849A (en) Vehicle travel control device
JP3372190B2 (en) Vehicle collision prevention device
JPH1125397A (en) Traveling state judging device for vehicle
JPH10105232A (en) Lane changing device for automatic drive road system
JP3436083B2 (en) Travel lane departure warning device
JP7141421B2 (en) VEHICLE CONTROL DEVICE, VEHICLE CONTROL METHOD, AND PROGRAM
US20220266858A1 (en) Vehicle Travel Control Method and Vehicle Travel Control Device

Legal Events

Date Code Title Description
AS Assignment

Owner name: HONDA GIKEN KOGYO KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JITSUKATA, EISHI;KOBAYASHI, SACHIO;TAMURA, KAZUYA;REEL/FRAME:009399/0071;SIGNING DATES FROM 19980806 TO 19980808

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12