CN103706571A - Visual positioning sorting method - Google Patents
Visual positioning sorting method Download PDFInfo
- Publication number
- CN103706571A CN103706571A CN201310744852.7A CN201310744852A CN103706571A CN 103706571 A CN103706571 A CN 103706571A CN 201310744852 A CN201310744852 A CN 201310744852A CN 103706571 A CN103706571 A CN 103706571A
- Authority
- CN
- China
- Prior art keywords
- workpiece
- sorted
- coordinate
- coordinate system
- square area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention belongs to the field of mechanical automation, and in particular relates to a visual positioning sorting method based on a six-degree-of-freedom industrial robot. The visual positioning sorting method can be applied to the industries of logistics, assembly lines and the like. The method has the advantages that an image coordinate system of work pieces to be sorted can be accurately and quickly acquired through an image processing technology and a pattern recognition technology according to an image acquired by a camera; the image coordinate system is converted into coordinates under a robot coordinate system according to a coordinate conversion technology; the work pieces are placed at the designated positions through a manipulator according to the class by flexibly using the coordinates and work piece class information.
Description
Technical field
The invention belongs to mechanical automation field, be specifically related to a kind ofly based on Six-DOF industrial robot vision locating, sorting method, can be applicable to the industries such as logistics, assembling line.
Background technology
At present, industrial robot has been widely used in the fields such as automobile and auto parts and components manufacturing industry, mechanical processing industry, electric industry.The working method of the robot applying in industry now mostly adopts teaching to reproduce, and the working procedure storing by teach programming can repeat expection work, and the pose of robot arrival impact point is fixed like this, and each action all repeats.The working method limitation that this teaching is reproduced is very large, for some material putting position the unknowns in the situation that, the use of industrial robot is restricted, particularly for the workpiece being sticked together, industrial robot is difficult to judge accurately the type of location of workpiece coordinate, workpiece when operation, thereby cannot reach the object that workpiece is sorted.
In the sorting area the present invention relates to, workpiece to be sorted and workbench must have obvious gray scale difference.
Summary of the invention
In order to overcome the defect in background technology, the invention provides a kind of can a plurality of location of workpiece coordinates that are sticked together of Obtaining Accurate, the vision locating, sorting method of workpiece type.
Concrete technical scheme of the present invention is:
A vision locating, sorting method, is characterized in that, comprises the following steps:
1] obtain the coordinate figure of all workpiece to be sorted under image coordinate system; Its concrete steps are:
1.1] pictures taken, carries out pretreatment to picture, extracts the part interested of picture;
1.2] by the method for gray level threshold segmentation, by picture processing, be black and white picture, obtain the image of workpiece to be sorted;
1.3] in step 1.2] the image of workpiece to be sorted in, utilize minimum circumscribed circle method to extract and can comprise the circular image profile of all workpiece to be sorted, and obtain the center point coordinate of circular image profile;
1.4] according to step 1.3] in center point coordinate, select the external square area of minimum of circular image profile;
1.5] to step 1.4] in the external square area of minimum carry out whole scan, determine the coordinate of all workpiece to be sorted;
2] coordinate figure of all workpiece to be sorted under image coordinate system is transformed into the coordinate under robot coordinate system;
3] coordinate figure of the to be sorted workpiece of manipulator based under robot coordinate system, picks up workpiece to be sorted respectively, and workpiece to be sorted is put to assigned address.
Above-mentioned steps 1.5] concrete steps be:
1.5.1] set the square area that area is less than workpiece to be sorted, the external square of minimum is carried out to whole scan;
1.5.2] set gray threshold T, determine whether square area is workpiece to be detected; If square area gray threshold meets the requirement of threshold value T, think that square area is workpiece to be sorted and retains, otherwise give up;
1.5.3] respectively all point coordinates in the square area retaining are averaged, determine the coordinate of each workpiece to be sorted.
Above-mentioned steps 2] adopt the method for two-dimensional transformations to obtain the coordinate figure of workpiece to be sorted under robot coordinate system.
The invention has the beneficial effects as follows:
1, the method Ke Shi robot that the present invention adopts well conforms, can sort workpiece by autonomous classification band, carry out task operating, thereby expanded the application of robot in industries such as logistics, equipment production lines, under the flexibility and intelligentized prerequisite that realize robot, improve production efficiency and the reliability of robot.
2, the present invention adopts minimum circumscribed circle method and sets the square area that the length of side is less than workpiece to be detected, can be good at the workpiece to be sorted that identification is sticked together, and obtains accurately the coordinate of workpiece to be sorted.
Accompanying drawing explanation
Fig. 1 is particular flow sheet of the present invention.
The specific embodiment
The invention provides a kind of vision locating, sorting method that can obtain accurately and rapidly a plurality of location of workpiece coordinates to be sorted, workpiece type.
When employing is of the present invention, need image capture device, industrial computer, display and robot body to form.Image capture device adopts dimension industrial camera, industrial computer be take industrial control board as core, the CPU module forming with industrial control board and keyset spreads over standard computer expansion bus on passive backplane, each module is connected in passive backplane, thereby realize, by standard computer expansion bus and industrial control mainboard, carries out the function that exchanges data realizes corresponding module; The communication of industrial camera and industrial computer adopts ethernet communication, and display adopts regular display.
During work, the image that industrial camera collects, utilize that image processing techniques and mode identification technology are accurate, the coordinate figure of rapid extraction workpiece to be sorted under image coordinate system, and according to Coordinate Conversion technology, image coordinate is transformed into the coordinate under robot coordinate system, finally coordinate and workpiece classification information are sent to industrial computer flexibly, industrial computer control accurately picks up workpiece to be sorted.
Concrete grammar of the present invention is:
Step 1] utilize industrial camera to take pictures, the picture of taking is processed, and finally obtained the coordinate figure (X of all workpiece to be sorted under image coordinate system
1, Y
1);
This step is specifically:
Step 1.1] pictures taken, picture is carried out to pretreatment, extract the part interested of picture; The preprocess method that the present invention adopts in this step is pyramid image partition method, and real image is dwindled and obtains the interested part of picture;
Step 1.2] by the method for gray level threshold segmentation, by picture processing, be black and white picture, obtain the image of workpiece to be sorted;
Step 1.3] in step 1.2] the image of workpiece to be sorted in, utilize minimum circumscribed circle method to extract and can comprise the circular image profile of all workpiece to be sorted, and obtain the center point coordinate (X, Y) of circular image profile;
Step 1.4] according to step 1.3] in center point coordinate (X, Y), select the external square area of minimum of circular image profile;
Step 1.5] to step 1.4] in the external square area of minimum carry out whole scan, determine the coordinate of all workpiece to be sorted;
This step is specifically:
Step 1.5.1] set the square area that area is less than workpiece to be sorted, the external square of minimum is carried out to whole scan;
Step 1.5.2] set gray threshold T, determine whether square area is workpiece to be detected; If square area gray scale meets the requirement of threshold value T, think that square area is workpiece to be sorted and retains, otherwise give up;
Step 1.5.3] respectively the square area retaining is asked for to central point, determine the coordinate (X of each workpiece to be sorted
1, Y
1).
Step 2] adopt the method for two-dimensional transformations by the coordinate figure (X of all workpiece to be sorted under image coordinate system
1, Y
1) be transformed into the coordinate figure (X under robot coordinate system
2, Y
2).
The concrete calculation relational expression of this step is as follows:
Wherein:
[X
1y
1]
tcoordinate for workpiece to be sorted under image coordinate system;
[X
2y
2]
tfor workpiece to be sorted coordinate under robot coordinate system;
[X
0y
0]
tfor robot coordinate system's initial point coordinate under image coordinate system.
θ is that robot coordinate ties up to directions X cosine value under image coordinate system;
Step 3] by the workpiece all to be sorted coordinate under robot coordinate system obtaining, utilize industrial computer control that workpiece to be sorted is put to assigned address.
Claims (3)
1. a vision locating, sorting method, is characterized in that, comprises the following steps:
1] obtain the coordinate figure of all workpiece to be sorted under image coordinate system;
1.1] pictures taken, carries out pretreatment to picture, extracts the part interested of picture;
1.2] by the method for gray level threshold segmentation, by picture processing, be black and white picture, obtain the image of workpiece to be sorted;
1.3] in step 1.2] the image of workpiece to be sorted in, utilize minimum circumscribed circle method to extract and can comprise the circular image profile of all workpiece to be sorted, and obtain the center point coordinate of circular image profile;
1.4] according to step 1.3] in center point coordinate, select the external square area of minimum of circular image profile;
1.5] to step 1.4] in the external square area of minimum carry out whole scan, determine the coordinate of all workpiece to be sorted;
2] coordinate figure of all workpiece to be sorted under image coordinate system is transformed into the coordinate under robot coordinate system;
3] coordinate figure of the to be sorted workpiece of manipulator based under robot coordinate system, picks up workpiece to be sorted respectively, and workpiece to be sorted is put to assigned address.
2. according to the vision locating, sorting method described in claims 1, it is characterized in that: described step 1.5] concrete steps be:
1.5.1] set the square area that area is less than workpiece to be sorted, the external square of minimum is carried out to whole scan;
1.5.2] set gray threshold T, determine whether square area is workpiece to be detected; If square area gray threshold meets the requirement of threshold value T, think that square area is workpiece to be sorted and retains, otherwise give up;
1.5.3] respectively all point coordinates in the square area retaining are averaged, determine the coordinate of each workpiece to be sorted.
3. according to the vision locating, sorting method described in claims 1 or 2, it is characterized in that: described step 2] adopt the method for two-dimensional transformations to obtain the coordinate figure of workpiece to be sorted under robot coordinate system.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310744852.7A CN103706571B (en) | 2013-12-27 | 2013-12-27 | A kind of vision locating, sorting method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310744852.7A CN103706571B (en) | 2013-12-27 | 2013-12-27 | A kind of vision locating, sorting method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103706571A true CN103706571A (en) | 2014-04-09 |
CN103706571B CN103706571B (en) | 2015-12-09 |
Family
ID=50400124
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310744852.7A Active CN103706571B (en) | 2013-12-27 | 2013-12-27 | A kind of vision locating, sorting method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103706571B (en) |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104057459A (en) * | 2014-06-25 | 2014-09-24 | 上海发那科机器人有限公司 | Device and method for intelligently sorting workpieces by robot |
CN105225225A (en) * | 2015-08-31 | 2016-01-06 | 臻雅科技温州有限公司 | A kind of leather system for automatic marker making method and apparatus based on machine vision |
CN105290785A (en) * | 2015-12-01 | 2016-02-03 | 长沙长泰机器人有限公司 | Workpiece sorting and assembling system based on vision |
CN105728328A (en) * | 2016-05-13 | 2016-07-06 | 杭州亚美利嘉科技有限公司 | Goods sorting system and method |
CN106364903A (en) * | 2016-08-18 | 2017-02-01 | 上海交通大学 | Monocular three-dimensional vision sorting method for stacked workpieces |
CN107918939A (en) * | 2017-11-14 | 2018-04-17 | 佛山市南海区广工大数控装备协同创新研究院 | The big visual field localization method of stacking plate on plate fitment production line |
CN108890636A (en) * | 2018-07-06 | 2018-11-27 | 陕西大中科技发展有限公司 | A kind of crawl localization method of industrial robot |
CN109926817A (en) * | 2018-12-20 | 2019-06-25 | 南京理工大学 | Transformer automatic assembly method based on machine vision |
CN109927030A (en) * | 2019-03-28 | 2019-06-25 | 云南国土资源职业学院 | A kind of robot visual orientation method of appearance components detection |
CN110110760A (en) * | 2019-04-17 | 2019-08-09 | 浙江工业大学 | A kind of workpiece positioning and recognition methods based on machine vision |
CN110170456A (en) * | 2019-04-30 | 2019-08-27 | 南京邮电大学 | Fruit sorting equipment based on image procossing |
CN111069073A (en) * | 2019-12-31 | 2020-04-28 | 芜湖哈特机器人产业技术研究院有限公司 | Rubber ring sorting equipment |
CN111195897A (en) * | 2018-11-20 | 2020-05-26 | 财团法人工业技术研究院 | Calibration method and device for mechanical arm system |
CN111515149A (en) * | 2020-04-26 | 2020-08-11 | 广东弓叶科技有限公司 | Man-machine cooperation sorting system and robot grabbing position obtaining method thereof |
CN111582088A (en) * | 2020-04-26 | 2020-08-25 | 广东弓叶科技有限公司 | Man-machine cooperation sorting system and method for sorting multiple types of materials by same |
CN112588621A (en) * | 2020-11-30 | 2021-04-02 | 山东农业大学 | Agricultural product sorting method and system based on visual servo |
CN114298077A (en) * | 2021-12-15 | 2022-04-08 | 湖南视比特机器人有限公司 | Code scanning identification positioning method and system based on 2D vision and storage medium |
CN114310920A (en) * | 2022-03-15 | 2022-04-12 | 广东若贝特智能机器人科技有限公司 | Intelligent sorting parallel robot and control system thereof |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5060290A (en) * | 1989-09-05 | 1991-10-22 | Dole Dried Fruit And Nut Company | Algorithm for gray scale analysis especially of fruit or nuts |
US5073857A (en) * | 1989-06-01 | 1991-12-17 | Accuron Corporation | Method and apparatus for cell analysis |
CN1806940A (en) * | 2006-01-23 | 2006-07-26 | 湖南大学 | Defective goods automatic sorting method and equipment for high-speed automated production line |
CN102974551A (en) * | 2012-11-26 | 2013-03-20 | 华南理工大学 | Machine vision-based method for detecting and sorting polycrystalline silicon solar energy |
-
2013
- 2013-12-27 CN CN201310744852.7A patent/CN103706571B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5073857A (en) * | 1989-06-01 | 1991-12-17 | Accuron Corporation | Method and apparatus for cell analysis |
US5060290A (en) * | 1989-09-05 | 1991-10-22 | Dole Dried Fruit And Nut Company | Algorithm for gray scale analysis especially of fruit or nuts |
CN1806940A (en) * | 2006-01-23 | 2006-07-26 | 湖南大学 | Defective goods automatic sorting method and equipment for high-speed automated production line |
CN102974551A (en) * | 2012-11-26 | 2013-03-20 | 华南理工大学 | Machine vision-based method for detecting and sorting polycrystalline silicon solar energy |
Non-Patent Citations (1)
Title |
---|
吴源远: "《高速分拣机械手视觉识别技术研究》", 《中国优秀硕士学位论文全文数据库(电子期刊)》 * |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104057459A (en) * | 2014-06-25 | 2014-09-24 | 上海发那科机器人有限公司 | Device and method for intelligently sorting workpieces by robot |
CN105225225A (en) * | 2015-08-31 | 2016-01-06 | 臻雅科技温州有限公司 | A kind of leather system for automatic marker making method and apparatus based on machine vision |
CN105225225B (en) * | 2015-08-31 | 2017-12-22 | 温州城电智能科技有限公司 | A kind of leather system for automatic marker making method and apparatus based on machine vision |
CN105290785A (en) * | 2015-12-01 | 2016-02-03 | 长沙长泰机器人有限公司 | Workpiece sorting and assembling system based on vision |
CN105728328A (en) * | 2016-05-13 | 2016-07-06 | 杭州亚美利嘉科技有限公司 | Goods sorting system and method |
CN106364903A (en) * | 2016-08-18 | 2017-02-01 | 上海交通大学 | Monocular three-dimensional vision sorting method for stacked workpieces |
CN107918939B (en) * | 2017-11-14 | 2020-03-13 | 佛山市南海区广工大数控装备协同创新研究院 | Laminated board large-view-field positioning method for board furniture production line |
CN107918939A (en) * | 2017-11-14 | 2018-04-17 | 佛山市南海区广工大数控装备协同创新研究院 | The big visual field localization method of stacking plate on plate fitment production line |
CN108890636A (en) * | 2018-07-06 | 2018-11-27 | 陕西大中科技发展有限公司 | A kind of crawl localization method of industrial robot |
CN111195897B (en) * | 2018-11-20 | 2021-09-14 | 财团法人工业技术研究院 | Calibration method and device for mechanical arm system |
US11524406B2 (en) | 2018-11-20 | 2022-12-13 | Industrial Technology Research Institute | Calibration method and device for robotic arm system |
CN111195897A (en) * | 2018-11-20 | 2020-05-26 | 财团法人工业技术研究院 | Calibration method and device for mechanical arm system |
CN109926817A (en) * | 2018-12-20 | 2019-06-25 | 南京理工大学 | Transformer automatic assembly method based on machine vision |
CN109927030A (en) * | 2019-03-28 | 2019-06-25 | 云南国土资源职业学院 | A kind of robot visual orientation method of appearance components detection |
CN110110760A (en) * | 2019-04-17 | 2019-08-09 | 浙江工业大学 | A kind of workpiece positioning and recognition methods based on machine vision |
CN110170456A (en) * | 2019-04-30 | 2019-08-27 | 南京邮电大学 | Fruit sorting equipment based on image procossing |
CN111069073A (en) * | 2019-12-31 | 2020-04-28 | 芜湖哈特机器人产业技术研究院有限公司 | Rubber ring sorting equipment |
CN111582088A (en) * | 2020-04-26 | 2020-08-25 | 广东弓叶科技有限公司 | Man-machine cooperation sorting system and method for sorting multiple types of materials by same |
CN111515149B (en) * | 2020-04-26 | 2020-12-29 | 广东弓叶科技有限公司 | Man-machine cooperation sorting system and robot grabbing position obtaining method thereof |
CN111515149A (en) * | 2020-04-26 | 2020-08-11 | 广东弓叶科技有限公司 | Man-machine cooperation sorting system and robot grabbing position obtaining method thereof |
CN112588621A (en) * | 2020-11-30 | 2021-04-02 | 山东农业大学 | Agricultural product sorting method and system based on visual servo |
CN112588621B (en) * | 2020-11-30 | 2022-02-08 | 山东农业大学 | Agricultural product sorting method and system based on visual servo |
CN114298077A (en) * | 2021-12-15 | 2022-04-08 | 湖南视比特机器人有限公司 | Code scanning identification positioning method and system based on 2D vision and storage medium |
CN114310920A (en) * | 2022-03-15 | 2022-04-12 | 广东若贝特智能机器人科技有限公司 | Intelligent sorting parallel robot and control system thereof |
Also Published As
Publication number | Publication date |
---|---|
CN103706571B (en) | 2015-12-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103706571B (en) | A kind of vision locating, sorting method | |
CN110176078B (en) | Method and device for labeling training set data | |
CN110900581B (en) | Four-degree-of-freedom mechanical arm vision servo control method and device based on RealSense camera | |
CN110246127A (en) | Workpiece identification and localization method and system, sorting system based on depth camera | |
CN105563481A (en) | Robot vision guide method used for shaft hole assembling | |
CN109461184B (en) | Automatic positioning method for grabbing point for grabbing object by robot mechanical arm | |
CN113379849B (en) | Robot autonomous recognition intelligent grabbing method and system based on depth camera | |
CN109961471B (en) | Method and device for marking position of object in image and electronic equipment | |
CN113610921A (en) | Hybrid workpiece grabbing method, device and computer-readable storage medium | |
CN105096376A (en) | Information processing method and electronic device | |
CN113269723A (en) | Unordered grasping system for three-dimensional visual positioning and mechanical arm cooperative work parts | |
Sardelis et al. | 2-Stage vision system for robotic handling of flexible objects | |
CN202804246U (en) | An intelligent drilling and targeting device | |
Lin et al. | Vision based object grasping of industrial manipulator | |
CN114155610A (en) | Panel assembly key action identification method based on upper half body posture estimation | |
Mizoguchi et al. | Manhattan-world assumption for as-built modeling industrial plant | |
CN112947458A (en) | Robot accurate grabbing method based on multi-mode information and computer readable medium | |
Reddy et al. | Integration of robotic arm with vision system | |
CN113034418B (en) | Circuit board identification and bonding pad/chip rapid positioning method for electronic industry | |
CN113681549B (en) | Robot grabbing method and system based on three-dimensional data analysis | |
CN115601345A (en) | Machine vision-based large-size punching plate hole group leakage-proof detection method and device | |
Wang et al. | Study on the Target Recognition and Location Technology of industrial Sorting Robot based on Machine Vision. | |
CN107020545A (en) | The apparatus and method for recognizing mechanical workpieces pose | |
Somani et al. | Scene perception and recognition in industrial environments for human-robot interaction | |
CN113822946A (en) | Mechanical arm grabbing method based on computer vision |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |