CN101957176B - Robot and camera combined calibration based method for detecting high-precision car door - Google Patents
Robot and camera combined calibration based method for detecting high-precision car door Download PDFInfo
- Publication number
- CN101957176B CN101957176B CN2010102867427A CN201010286742A CN101957176B CN 101957176 B CN101957176 B CN 101957176B CN 2010102867427 A CN2010102867427 A CN 2010102867427A CN 201010286742 A CN201010286742 A CN 201010286742A CN 101957176 B CN101957176 B CN 101957176B
- Authority
- CN
- China
- Prior art keywords
- car door
- camera
- measured
- robot
- points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a robot and camera combined calibration based method for detecting high-precision car door, which comprises the steps of: 1, positioning a standard car door in a fixed position, setting a plurality of points to be measured at the edges of the standard car door and a car door to be measured and setting a plurality of marking points near the standard car door, marking coordinates of the marking points; 2, when a robot moves near the points to be measured, recording coordinates of the robot, shooting images of the marking points near the robot by using a first camera, determining coordinates of the first camera, calculating the relation of a coordinate system of a second camera and a workpiece coordinate system; 3, shooting the first point to be measured by using the second camera, solving three-dimensional space coordinates of the first point to be measured; 4, repeating completing the detection of the three-dimensional space coordinates of the points to be measured of the standard car door; and 5, fixing the car door to be measured in the position of the standard car door, and measuring the coordinates of the points to be measured on the edge of the car door to be measured in the workpiece coordinate system. According to the method, the measurement accuracy is improved to 0.1mm.
Description
Technical field
The present invention relates to a kind of detection method of automobile cubing, the invention particularly relates to a kind of detection method of the high precision arrangements for automotive doors based on the calibration of robot combining camera.
Background technology
Auto parts must detect it before the entrucking after punching press or injection moulding are come out, and carry out by means of cubing and detect Chang Bixu.Cubing (Checking Fixture) is just causing the great attention of more and more enterprises as the important auxiliary products of die industry.Production from self needs and its higher added value, many mould enterprises with it as an important developing direction.The correlation technique of cubing as a kind of new technology, is also just introduced by increasing mould enterprise.
The automobile cubing is by detection architecture location structure, clamping structure, supporting construction, base, and other slave parts constitute.Existing design is according to concrete part, according to inspection requirements, one by one, design corresponding structure progressively, and then is assembled together, and finally realizes the exploitation of cubing.This is a complicacy and loaded down with trivial details process, and each design all will start anew, and is difficult to reuse previous design achievement; Can not directly bring utilization to expert's mature experience; Cause duplication of labour amount big, design loaded down with trivial details, to the exploitation designer require problems such as height.
At present, machine vision metrology has obtained development apace, makes vision sensor make the exploitation of cubing that great development arranged to the measurement of putting on the part through robot movement, has improved the flexibility of cubing design.Present detection method that adopts usually based on this technology moves through the computer-controlled robot then and measures each measured point for camera is contained on robot end's the flange, directly obtains the D coordinates value of measured point through coordinate transform.Yet, commercial now most of industrial robots, its positional precision is directly measured for robot and bring bigger error than the low one magnitude of its repeatable accuracy.
Summary of the invention
The objective of the invention is to overcome the deficiency of prior art; Provide a kind of and need not locate workpiece; Eliminate the positioning error that the location workpiece brings, improved the detection method of the high precision arrangements for automotive doors of calibrating based on the robot combining camera of flexibility and the automaticity of cubing simultaneously.
The detection method of the high precision arrangements for automotive doors based on the calibration of robot combining camera of the present invention, it may further comprise the steps:
(1) the standard car door is positioned at a fixed position; Set a plurality of measured points at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points, set up the stereoscopic vision measuring system and demarcate the three dimensional space coordinate of the inside and outside parameter of first and second cameras and described a plurality of gauge points;
(2) computer-controlled robot move to the measured point near, write down the three dimensional space coordinate of robot of this moment, near the image of a plurality of gauge points first camera is taken; Through the three dimensional space coordinate of definite first camera of three dimensional space coordinate conversion,, calculate the coordinates system of second camera and the relation of workpiece coordinate system then through first camera and the second camera external position parameter;
(3) computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system;
(4) repeat the mensuration that all three dimensional space coordinate of standard car door measured point in workpiece coordinate system are accomplished in described step (2)-(3);
(5) the standard car door is changed; Tested car door is fixed on the position of standard car door, measures the three dimensional space coordinate in workpiece coordinate system of a plurality of measured points on the tested vehicle door edge according to step (2)-(4) with the same trajectories of the mensuration of a plurality of gauge points of accomplishing standard car door mobile robot successively then;
(6) measurement data to a plurality of measured points at the edge of standard car door and tested car door compares, to judge the whether accords with production requirement of tested car door.
Adopt the beneficial effect of the inventive method to be: through around part, pasting a series of gauge points; (sensor coordinate system is exactly a coordinate system of oneself definition for camera measurement markers point location camera through the robot end and sensor (sensor is by camera and laser constitution) coordinate system; Calculate for ease; General sensor coordinate system and first camera coordinates system overlap); Control computer starts the measured point on the another one camera shooting part then; And then calculate the measured point the coordinate of workpiece coordinate system (can sensor coordinate system is unified to workpiece coordinate system) through coordinate transform like this completion eliminated the error that robot causes, can measuring accuracy be brought up to 0.1mm through experiment showed, the method.Employing has improved the flexibility of cubing greatly based on the robotic vision measuring system, and through a camera Calibration, another one camera photographic images improves measuring accuracy and automaticity.
Description of drawings
Fig. 1 is the mensuration fundamental diagram that adopts the detection method examination criteria car door of the high precision arrangements for automotive doors based on robot combining camera calibration of the present invention;
Fig. 2 adopts the detection method of the high precision arrangements for automotive doors based on robot combining camera calibration of the present invention to detect the mensuration fundamental diagram of tested car door.
Embodiment
Below in conjunction with concrete embodiment, and, the present invention is done further explanation with reference to accompanying drawing:
Detection method based on the high precision arrangements for automotive doors of robot combining camera calibration; At first the standard car door is positioned at a fixed position; Set a plurality of measured points (like A, B) at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points that (method confirmed of standard car door and tested car door measured point can be to paste a gauge point in the same position of standard car door and tested car door earlier; Every then separated 3cm CW is pasted a series of measured points in vehicle door edge); (the stereoscopic vision measuring system is set up and can be edited referring to Zhang Guangjun: " photoelectricity test technology " to set up the stereoscopic vision measuring system; China Measuring Press, 2008,304-307) and demarcate the inner parameter of first and second cameras and the three dimensional space coordinate of external parameter and described a plurality of gauge points; The inside calibrating parameters of first and second cameras comprises that (effective focal length f, the Δ x that comprehensively distorts, Δ y, image planes center (Cx, Cy)) and external parameter comprise (translation and rotation matrix have reflected that the three-dimensional world coordinate is tied to the transformational relation of camera coordinate system).The standard car door can adopt " 3-2-1 " positioning principle to fix.Mensuration of at first carrying out the standard car door as shown in Figure 1: the computer-controlled robot move to the measured point near; Write down the three dimensional space coordinate of the robot of this moment; First camera is taken the image of the many gauge points (these gauge points had been demarcated well with three coordinate machine or transit etc., and their coordinates under world coordinate system are known) before experiment; Confirm the three dimensional space coordinate of first camera through the three dimensional space coordinate conversion; Then through first camera and the second camera external position parameter; (being connected between first camera and second camera is rigidly connected to calculate the coordinates system of second camera and the relation of workpiece coordinate system (workpiece coordinate system is a near coordinate system that oneself defines the workpiece); Transformational relation between the camera coordinates system of first camera and the camera coordinates system of second camera can be demarcated in advance; Workpiece coordinate system is the coordinate system that is based upon on the workpiece, and the relation between workpiece coordinate system and the world coordinate system can be advanced rower calmly in experiment, has known the three dimensional space coordinate of first camera above; Just can be transformed into the three dimensional space coordinate of first camera under the world coordinate system through the good relation of prior demarcation; Then the three-dimensional coordinate under the world coordinate system is being transformed under the workpiece coordinate system, like this, just can calculating the relation between first camera and the workpiece coordinate system); Computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system; Repeat above-mentioned steps and accomplish the mensuration of all three dimensional space coordinate of standard car door measured point in workpiece coordinate system.The three dimensional space coordinate of first camera confirms that method can be according to the projection model and the calibrating parameters of video camera; Respectively to the image calibration that distorts; The three dimensional space coordinate that goes out camera 1 by stereo vision sensor three-dimensional measurement model solution again (is edited referring to Zhang Guangjun: " photoelectricity test technology "; China Measuring Press, 2008,304-307).Mensuration of carrying out tested car door as shown in Figure 2 then: the standard car door is changed; Tested car door is fixed on the position of standard car door; With the mensuration of a plurality of gauge points of accomplishing the standard car door, measure the coordinate of a plurality of measured points in workpiece coordinate system on the tested vehicle door edge then with same trajectories mobile robot successively and according to the assay method of standard car door.Measurement data to a plurality of measured points at the edge of standard car door and tested car door compares at last, to judge the whether accords with production requirement of tested car door.
(1) the standard car door is positioned at a fixed position; Set a plurality of measured points at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points, set up the stereoscopic vision measuring system and demarcate the three dimensional space coordinate of the inside and outside parameter of first and second cameras and described a plurality of gauge points;
(2) computer-controlled robot move to the measured point near, write down the three dimensional space coordinate of robot of this moment, near the image of a plurality of gauge points first camera is taken; Through the three dimensional space coordinate of definite first camera of three dimensional space coordinate conversion,, calculate the coordinates system of second camera and the relation of workpiece coordinate system then through first camera and the second camera external position parameter;
(3) computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system;
(4) repeat the mensuration that all three dimensional space coordinate of standard car door measured point in workpiece coordinate system are accomplished in described step (2)-(3);
(5) the standard car door is changed; Tested car door is fixed on the position of standard car door, measures the three dimensional space coordinate in workpiece coordinate system of a plurality of measured points on the tested vehicle door edge according to step (2)-(4) with the same trajectories of the mensuration of a plurality of gauge points of accomplishing standard car door mobile robot successively then;
The three-dimensional coordinate of standard car door measured point is (x
A, y
A, z
A); The three-dimensional coordinate of tested car door be (x '
A, y '
A, z '
A); The coordinate of more tested car door and standard car door measured point, coordinate figure does not just meet production requirement with original coordinate figure is different.
Claims (1)
1. based on the detection method of the high precision arrangements for automotive doors of robot combining camera calibration, it is characterized in that it may further comprise the steps:
(1) the standard car door is positioned at a fixed position; Set a plurality of measured points at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points, set up the stereoscopic vision measuring system and demarcate the three dimensional space coordinate of the inside and outside parameter of first and second cameras and described a plurality of gauge points; The method that standard car door and tested car door measured point are confirmed is to paste a gauge point in the same position of standard car door and tested car door earlier, and every then separated 3cm CW is pasted a series of measured points in vehicle door edge;
(2) computer-controlled robot move to the measured point near, write down the three dimensional space coordinate of robot of this moment, near the image of a plurality of gauge points first camera is taken; Through the three dimensional space coordinate of definite first camera of three dimensional space coordinate conversion,, calculate the relation of the coordinate system and the workpiece coordinate system of second camera then through first camera and the second camera external position parameter;
(3) computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system;
(4) repeat the mensuration that all three dimensional space coordinate of standard car door measured point in workpiece coordinate system are accomplished in described step (2)-(3);
(5) the standard car door is changed; Tested car door is fixed on the position of standard car door, measures the three dimensional space coordinate in workpiece coordinate system of a plurality of measured points on the tested vehicle door edge according to step (2)-(4) with the same trajectories of the mensuration of a plurality of gauge points of accomplishing standard car door mobile robot successively then;
(6) measurement data to a plurality of measured points at the edge of standard car door and tested car door compares, to judge the whether accords with production requirement of tested car door.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102867427A CN101957176B (en) | 2010-09-19 | 2010-09-19 | Robot and camera combined calibration based method for detecting high-precision car door |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102867427A CN101957176B (en) | 2010-09-19 | 2010-09-19 | Robot and camera combined calibration based method for detecting high-precision car door |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101957176A CN101957176A (en) | 2011-01-26 |
| CN101957176B true CN101957176B (en) | 2012-05-02 |
Family
ID=43484649
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102867427A Expired - Fee Related CN101957176B (en) | 2010-09-19 | 2010-09-19 | Robot and camera combined calibration based method for detecting high-precision car door |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101957176B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013133277A1 (en) * | 2012-03-05 | 2013-09-12 | 日産自動車株式会社 | Inspection apparatus for opening and closing body and inspection method for opening and closing body |
| KR101416383B1 (en) | 2012-11-16 | 2014-07-16 | 현대자동차 주식회사 | Door inspection system for vehicle |
| US10380764B2 (en) | 2013-12-18 | 2019-08-13 | Cognex Corporation | System and method for performing vision system planar hand-eye calibration from straight line features |
| DE102016205519A1 (en) | 2016-04-04 | 2017-10-05 | Bayerische Motoren Werke Aktiengesellschaft | Mobile measuring system for the three-dimensional optical measurement of vehicles and vehicle parts |
| JP6997106B2 (en) * | 2016-06-27 | 2022-01-17 | モービルアイ ビジョン テクノロジーズ リミテッド | Systems, methods and computer programs for navigating vehicles |
| CN106949863A (en) * | 2017-03-13 | 2017-07-14 | 重庆大学 | White body is main to spell fixture switching system repetitive positioning accuracy detection method |
| CN107803855A (en) * | 2017-12-13 | 2018-03-16 | 大连四达高技术发展有限公司 | A kind of robot automatic positioning mechanism |
| CN108195354A (en) * | 2017-12-21 | 2018-06-22 | 长沙长泰机器人有限公司 | A kind of vehicle positioning method and vehicle positioning system based on robot |
| CN108278973A (en) * | 2018-04-28 | 2018-07-13 | 青岛海之晨工业装备有限公司 | A kind of mobile phone shell size detection equipment |
| CN109530984A (en) * | 2018-11-19 | 2019-03-29 | 施努卡(苏州)智能装备有限公司 | Vision positioning welding and assembling method |
| CN109883326A (en) * | 2019-03-29 | 2019-06-14 | 湖南省鹰眼在线电子科技有限公司 | A kind of videographic measurment formula automobile three-dimensional four-wheel aligner method, system and medium |
| CN109945782B (en) * | 2019-04-02 | 2020-12-08 | 易思维（杭州）科技有限公司 | Method for detecting key position of super-long body-in-white |
| CN110332885A (en) * | 2019-06-03 | 2019-10-15 | 桂林能创信息科技有限公司 | A kind of robot grating is taken pictures the automated execution method of scanning system detection data |
| CN110500967A (en) * | 2019-07-08 | 2019-11-26 | 广西工业职业技术学院 | A kind of method of industrial robot guidance three-dimensional line scanning survey |
| CN113246135B (en) * | 2021-06-03 | 2021-10-12 | 季华实验室 | Robot hand-eye calibration method and device, electronic equipment and storage medium |
| CN114543673B (en) * | 2022-02-14 | 2023-12-08 | 湖北工业大学 | Visual measurement platform for aircraft landing gear and measurement method thereof |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6028672A (en) * | 1996-09-30 | 2000-02-22 | Zheng J. Geng | High speed three dimensional imaging method |
| CN1878318A (en) * | 2006-05-17 | 2006-12-13 | 浙江大学 | Three-dimensional small-sized scene rebuilding method based on dual-camera and its device |
| CN101334276A (en) * | 2007-06-27 | 2008-12-31 | 中国科学院自动化研究所 | Visual sense measurement method and device |
| CN101566465A (en) * | 2009-05-18 | 2009-10-28 | 西安交通大学 | Method for measuring object deformation in real time |
-
2010
- 2010-09-19 CN CN2010102867427A patent/CN101957176B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6028672A (en) * | 1996-09-30 | 2000-02-22 | Zheng J. Geng | High speed three dimensional imaging method |
| CN1878318A (en) * | 2006-05-17 | 2006-12-13 | 浙江大学 | Three-dimensional small-sized scene rebuilding method based on dual-camera and its device |
| CN101334276A (en) * | 2007-06-27 | 2008-12-31 | 中国科学院自动化研究所 | Visual sense measurement method and device |
| CN101566465A (en) * | 2009-05-18 | 2009-10-28 | 西安交通大学 | Method for measuring object deformation in real time |
Non-Patent Citations (1)
| Title |
|---|
| 郑俊.立体视觉坐标测量技术在车身生产线中的应用.《汽车科技》.2004,(第6期),30-33. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101957176A (en) | 2011-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101957176B (en) | Robot and camera combined calibration based method for detecting high-precision car door | |
| CN101949687B (en) | Detection method of automobile door based on vision measurement | |
| CN102135417B (en) | Full-automatic three-dimension characteristic extracting method | |
| US20090019916A1 (en) | Method for calibrating a measuring system | |
| CN103148784B (en) | The full-scale detection method of a kind of large-scale blade | |
| EP3607264B1 (en) | Machine vision system | |
| CN101968343B (en) | Method for detecting automobile door based on robot monocular vision measurement | |
| CN103149086B (en) | Device and method for measuring toughness damage evolution in process of metal uniaxial tension | |
| CN105806251A (en) | Four-axis measuring system based on line laser sensor and measuring method thereof | |
| US20080298673A1 (en) | Three-dimensional data registration method for vision measurement in flow style based on double-sided target | |
| CN104551865A (en) | Image measuring system and method | |
| CN103162623A (en) | Stereoscopic measuring system for double vertically mounted cameras and calibration method | |
| CN104463833A (en) | Method and system for calibrating camera parameters of one-dimensional area array camera set | |
| EP3431920A1 (en) | Device, system, and method for inspecting crankshaft shape | |
| TW201837424A (en) | Object thickness measurement system, method, detecting apparatus, computer readable medium, and computer program product | |
| CN109945782A (en) | Overlength white body key position detection method | |
| CN112828878B (en) | Three-dimensional measurement and tracking method for large-scale equipment in butt joint process | |
| CN110044266B (en) | Photogrammetry system based on speckle projection | |
| Gasparin et al. | Quality control and process capability assessment for injection-moulded micro mechanical parts | |
| US9426425B2 (en) | Method for measuring large components | |
| Rejc et al. | Dimensional measurements of a gray-iron object using a robot and a laser displacement sensor | |
| CN105547181A (en) | Car dashboard beam assembly online detection system | |
| JP2023129329A (en) | Method for calibrating portable reference sensor system, portable reference sensor system, and use of portable reference sensor system | |
| WO2023097491A1 (en) | Machine vision inspection method, and inspection apparatus and inspection system therefor | |
| Luo et al. | A structured-light 3D sensor-based shape measurement method for casting allowance evaluation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120502 Termination date: 20210919 |