CN103706571A - Visual positioning sorting method - Google Patents

Visual positioning sorting method Download PDF

Info

Publication number
CN103706571A
CN103706571A CN201310744852.7A CN201310744852A CN103706571A CN 103706571 A CN103706571 A CN 103706571A CN 201310744852 A CN201310744852 A CN 201310744852A CN 103706571 A CN103706571 A CN 103706571A
Authority
CN
China
Prior art keywords
workpiece
sorted
coordinate
coordinate system
square area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310744852.7A
Other languages
Chinese (zh)
Other versions
CN103706571B (en
Inventor
张栋栋
郭静
罗华
燕小强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Aerospace Precision Electromechanical Institute
Original Assignee
Xian Aerospace Precision Electromechanical Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Aerospace Precision Electromechanical Institute filed Critical Xian Aerospace Precision Electromechanical Institute
Priority to CN201310744852.7A priority Critical patent/CN103706571B/en
Publication of CN103706571A publication Critical patent/CN103706571A/en
Application granted granted Critical
Publication of CN103706571B publication Critical patent/CN103706571B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention belongs to the field of mechanical automation, and in particular relates to a visual positioning sorting method based on a six-degree-of-freedom industrial robot. The visual positioning sorting method can be applied to the industries of logistics, assembly lines and the like. The method has the advantages that an image coordinate system of work pieces to be sorted can be accurately and quickly acquired through an image processing technology and a pattern recognition technology according to an image acquired by a camera; the image coordinate system is converted into coordinates under a robot coordinate system according to a coordinate conversion technology; the work pieces are placed at the designated positions through a manipulator according to the class by flexibly using the coordinates and work piece class information.

Description

A kind of vision locating, sorting method
Technical field
The invention belongs to mechanical automation field, be specifically related to a kind ofly based on Six-DOF industrial robot vision locating, sorting method, can be applicable to the industries such as logistics, assembling line.
Background technology
At present, industrial robot has been widely used in the fields such as automobile and auto parts and components manufacturing industry, mechanical processing industry, electric industry.The working method of the robot applying in industry now mostly adopts teaching to reproduce, and the working procedure storing by teach programming can repeat expection work, and the pose of robot arrival impact point is fixed like this, and each action all repeats.The working method limitation that this teaching is reproduced is very large, for some material putting position the unknowns in the situation that, the use of industrial robot is restricted, particularly for the workpiece being sticked together, industrial robot is difficult to judge accurately the type of location of workpiece coordinate, workpiece when operation, thereby cannot reach the object that workpiece is sorted.
In the sorting area the present invention relates to, workpiece to be sorted and workbench must have obvious gray scale difference.
Summary of the invention
In order to overcome the defect in background technology, the invention provides a kind of can a plurality of location of workpiece coordinates that are sticked together of Obtaining Accurate, the vision locating, sorting method of workpiece type.
Concrete technical scheme of the present invention is:
A vision locating, sorting method, is characterized in that, comprises the following steps:
1] obtain the coordinate figure of all workpiece to be sorted under image coordinate system; Its concrete steps are:
1.1] pictures taken, carries out pretreatment to picture, extracts the part interested of picture;
1.2] by the method for gray level threshold segmentation, by picture processing, be black and white picture, obtain the image of workpiece to be sorted;
1.3] in step 1.2] the image of workpiece to be sorted in, utilize minimum circumscribed circle method to extract and can comprise the circular image profile of all workpiece to be sorted, and obtain the center point coordinate of circular image profile;
1.4] according to step 1.3] in center point coordinate, select the external square area of minimum of circular image profile;
1.5] to step 1.4] in the external square area of minimum carry out whole scan, determine the coordinate of all workpiece to be sorted;
2] coordinate figure of all workpiece to be sorted under image coordinate system is transformed into the coordinate under robot coordinate system;
3] coordinate figure of the to be sorted workpiece of manipulator based under robot coordinate system, picks up workpiece to be sorted respectively, and workpiece to be sorted is put to assigned address.
Above-mentioned steps 1.5] concrete steps be:
1.5.1] set the square area that area is less than workpiece to be sorted, the external square of minimum is carried out to whole scan;
1.5.2] set gray threshold T, determine whether square area is workpiece to be detected; If square area gray threshold meets the requirement of threshold value T, think that square area is workpiece to be sorted and retains, otherwise give up;
1.5.3] respectively all point coordinates in the square area retaining are averaged, determine the coordinate of each workpiece to be sorted.
Above-mentioned steps 2] adopt the method for two-dimensional transformations to obtain the coordinate figure of workpiece to be sorted under robot coordinate system.
The invention has the beneficial effects as follows:
1, the method Ke Shi robot that the present invention adopts well conforms, can sort workpiece by autonomous classification band, carry out task operating, thereby expanded the application of robot in industries such as logistics, equipment production lines, under the flexibility and intelligentized prerequisite that realize robot, improve production efficiency and the reliability of robot.
2, the present invention adopts minimum circumscribed circle method and sets the square area that the length of side is less than workpiece to be detected, can be good at the workpiece to be sorted that identification is sticked together, and obtains accurately the coordinate of workpiece to be sorted.
Accompanying drawing explanation
Fig. 1 is particular flow sheet of the present invention.
The specific embodiment
The invention provides a kind of vision locating, sorting method that can obtain accurately and rapidly a plurality of location of workpiece coordinates to be sorted, workpiece type.
When employing is of the present invention, need image capture device, industrial computer, display and robot body to form.Image capture device adopts dimension industrial camera, industrial computer be take industrial control board as core, the CPU module forming with industrial control board and keyset spreads over standard computer expansion bus on passive backplane, each module is connected in passive backplane, thereby realize, by standard computer expansion bus and industrial control mainboard, carries out the function that exchanges data realizes corresponding module; The communication of industrial camera and industrial computer adopts ethernet communication, and display adopts regular display.
During work, the image that industrial camera collects, utilize that image processing techniques and mode identification technology are accurate, the coordinate figure of rapid extraction workpiece to be sorted under image coordinate system, and according to Coordinate Conversion technology, image coordinate is transformed into the coordinate under robot coordinate system, finally coordinate and workpiece classification information are sent to industrial computer flexibly, industrial computer control accurately picks up workpiece to be sorted.
Concrete grammar of the present invention is:
Step 1] utilize industrial camera to take pictures, the picture of taking is processed, and finally obtained the coordinate figure (X of all workpiece to be sorted under image coordinate system 1, Y 1);
This step is specifically:
Step 1.1] pictures taken, picture is carried out to pretreatment, extract the part interested of picture; The preprocess method that the present invention adopts in this step is pyramid image partition method, and real image is dwindled and obtains the interested part of picture;
Step 1.2] by the method for gray level threshold segmentation, by picture processing, be black and white picture, obtain the image of workpiece to be sorted;
Step 1.3] in step 1.2] the image of workpiece to be sorted in, utilize minimum circumscribed circle method to extract and can comprise the circular image profile of all workpiece to be sorted, and obtain the center point coordinate (X, Y) of circular image profile;
Step 1.4] according to step 1.3] in center point coordinate (X, Y), select the external square area of minimum of circular image profile;
Step 1.5] to step 1.4] in the external square area of minimum carry out whole scan, determine the coordinate of all workpiece to be sorted;
This step is specifically:
Step 1.5.1] set the square area that area is less than workpiece to be sorted, the external square of minimum is carried out to whole scan;
Step 1.5.2] set gray threshold T, determine whether square area is workpiece to be detected; If square area gray scale meets the requirement of threshold value T, think that square area is workpiece to be sorted and retains, otherwise give up;
Step 1.5.3] respectively the square area retaining is asked for to central point, determine the coordinate (X of each workpiece to be sorted 1, Y 1).
Step 2] adopt the method for two-dimensional transformations by the coordinate figure (X of all workpiece to be sorted under image coordinate system 1, Y 1) be transformed into the coordinate figure (X under robot coordinate system 2, Y 2).
The concrete calculation relational expression of this step is as follows:
X 2 Y 2 = cos θ - sin sin θ cos θ X 1 Y 1 + X 0 Y 0
Wherein:
[X 1y 1] tcoordinate for workpiece to be sorted under image coordinate system;
[X 2y 2] tfor workpiece to be sorted coordinate under robot coordinate system;
[X 0y 0] tfor robot coordinate system's initial point coordinate under image coordinate system.
θ is that robot coordinate ties up to directions X cosine value under image coordinate system;
Step 3] by the workpiece all to be sorted coordinate under robot coordinate system obtaining, utilize industrial computer control that workpiece to be sorted is put to assigned address.

Claims (3)

1. a vision locating, sorting method, is characterized in that, comprises the following steps:
1] obtain the coordinate figure of all workpiece to be sorted under image coordinate system;
1.1] pictures taken, carries out pretreatment to picture, extracts the part interested of picture;
1.2] by the method for gray level threshold segmentation, by picture processing, be black and white picture, obtain the image of workpiece to be sorted;
1.3] in step 1.2] the image of workpiece to be sorted in, utilize minimum circumscribed circle method to extract and can comprise the circular image profile of all workpiece to be sorted, and obtain the center point coordinate of circular image profile;
1.4] according to step 1.3] in center point coordinate, select the external square area of minimum of circular image profile;
1.5] to step 1.4] in the external square area of minimum carry out whole scan, determine the coordinate of all workpiece to be sorted;
2] coordinate figure of all workpiece to be sorted under image coordinate system is transformed into the coordinate under robot coordinate system;
3] coordinate figure of the to be sorted workpiece of manipulator based under robot coordinate system, picks up workpiece to be sorted respectively, and workpiece to be sorted is put to assigned address.
2. according to the vision locating, sorting method described in claims 1, it is characterized in that: described step 1.5] concrete steps be:
1.5.1] set the square area that area is less than workpiece to be sorted, the external square of minimum is carried out to whole scan;
1.5.2] set gray threshold T, determine whether square area is workpiece to be detected; If square area gray threshold meets the requirement of threshold value T, think that square area is workpiece to be sorted and retains, otherwise give up;
1.5.3] respectively all point coordinates in the square area retaining are averaged, determine the coordinate of each workpiece to be sorted.
3. according to the vision locating, sorting method described in claims 1 or 2, it is characterized in that: described step 2] adopt the method for two-dimensional transformations to obtain the coordinate figure of workpiece to be sorted under robot coordinate system.
CN201310744852.7A 2013-12-27 2013-12-27 A kind of vision locating, sorting method Active CN103706571B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310744852.7A CN103706571B (en) 2013-12-27 2013-12-27 A kind of vision locating, sorting method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310744852.7A CN103706571B (en) 2013-12-27 2013-12-27 A kind of vision locating, sorting method

Publications (2)

Publication Number Publication Date
CN103706571A true CN103706571A (en) 2014-04-09
CN103706571B CN103706571B (en) 2015-12-09

Family

ID=50400124

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310744852.7A Active CN103706571B (en) 2013-12-27 2013-12-27 A kind of vision locating, sorting method

Country Status (1)

Country Link
CN (1) CN103706571B (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104057459A (en) * 2014-06-25 2014-09-24 上海发那科机器人有限公司 Device and method for intelligently sorting workpieces by robot
CN105225225A (en) * 2015-08-31 2016-01-06 臻雅科技温州有限公司 A kind of leather system for automatic marker making method and apparatus based on machine vision
CN105290785A (en) * 2015-12-01 2016-02-03 长沙长泰机器人有限公司 Workpiece sorting and assembling system based on vision
CN105728328A (en) * 2016-05-13 2016-07-06 杭州亚美利嘉科技有限公司 Goods sorting system and method
CN106364903A (en) * 2016-08-18 2017-02-01 上海交通大学 Monocular three-dimensional vision sorting method for stacked workpieces
CN107918939A (en) * 2017-11-14 2018-04-17 佛山市南海区广工大数控装备协同创新研究院 The big visual field localization method of stacking plate on plate fitment production line
CN108890636A (en) * 2018-07-06 2018-11-27 陕西大中科技发展有限公司 A kind of crawl localization method of industrial robot
CN109926817A (en) * 2018-12-20 2019-06-25 南京理工大学 Transformer automatic assembly method based on machine vision
CN109927030A (en) * 2019-03-28 2019-06-25 云南国土资源职业学院 A kind of robot visual orientation method of appearance components detection
CN110110760A (en) * 2019-04-17 2019-08-09 浙江工业大学 A kind of workpiece positioning and recognition methods based on machine vision
CN110170456A (en) * 2019-04-30 2019-08-27 南京邮电大学 Fruit sorting equipment based on image procossing
CN111069073A (en) * 2019-12-31 2020-04-28 芜湖哈特机器人产业技术研究院有限公司 Rubber ring sorting equipment
CN111195897A (en) * 2018-11-20 2020-05-26 财团法人工业技术研究院 Calibration method and device for mechanical arm system
CN111515149A (en) * 2020-04-26 2020-08-11 广东弓叶科技有限公司 Man-machine cooperation sorting system and robot grabbing position obtaining method thereof
CN111582088A (en) * 2020-04-26 2020-08-25 广东弓叶科技有限公司 Man-machine cooperation sorting system and method for sorting multiple types of materials by same
CN112588621A (en) * 2020-11-30 2021-04-02 山东农业大学 Agricultural product sorting method and system based on visual servo
CN114298077A (en) * 2021-12-15 2022-04-08 湖南视比特机器人有限公司 Code scanning identification positioning method and system based on 2D vision and storage medium
CN114310920A (en) * 2022-03-15 2022-04-12 广东若贝特智能机器人科技有限公司 Intelligent sorting parallel robot and control system thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5060290A (en) * 1989-09-05 1991-10-22 Dole Dried Fruit And Nut Company Algorithm for gray scale analysis especially of fruit or nuts
US5073857A (en) * 1989-06-01 1991-12-17 Accuron Corporation Method and apparatus for cell analysis
CN1806940A (en) * 2006-01-23 2006-07-26 湖南大学 Defective goods automatic sorting method and equipment for high-speed automated production line
CN102974551A (en) * 2012-11-26 2013-03-20 华南理工大学 Machine vision-based method for detecting and sorting polycrystalline silicon solar energy

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5073857A (en) * 1989-06-01 1991-12-17 Accuron Corporation Method and apparatus for cell analysis
US5060290A (en) * 1989-09-05 1991-10-22 Dole Dried Fruit And Nut Company Algorithm for gray scale analysis especially of fruit or nuts
CN1806940A (en) * 2006-01-23 2006-07-26 湖南大学 Defective goods automatic sorting method and equipment for high-speed automated production line
CN102974551A (en) * 2012-11-26 2013-03-20 华南理工大学 Machine vision-based method for detecting and sorting polycrystalline silicon solar energy

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吴源远: "《高速分拣机械手视觉识别技术研究》", 《中国优秀硕士学位论文全文数据库(电子期刊)》 *

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104057459A (en) * 2014-06-25 2014-09-24 上海发那科机器人有限公司 Device and method for intelligently sorting workpieces by robot
CN105225225A (en) * 2015-08-31 2016-01-06 臻雅科技温州有限公司 A kind of leather system for automatic marker making method and apparatus based on machine vision
CN105225225B (en) * 2015-08-31 2017-12-22 温州城电智能科技有限公司 A kind of leather system for automatic marker making method and apparatus based on machine vision
CN105290785A (en) * 2015-12-01 2016-02-03 长沙长泰机器人有限公司 Workpiece sorting and assembling system based on vision
CN105728328A (en) * 2016-05-13 2016-07-06 杭州亚美利嘉科技有限公司 Goods sorting system and method
CN106364903A (en) * 2016-08-18 2017-02-01 上海交通大学 Monocular three-dimensional vision sorting method for stacked workpieces
CN107918939B (en) * 2017-11-14 2020-03-13 佛山市南海区广工大数控装备协同创新研究院 Laminated board large-view-field positioning method for board furniture production line
CN107918939A (en) * 2017-11-14 2018-04-17 佛山市南海区广工大数控装备协同创新研究院 The big visual field localization method of stacking plate on plate fitment production line
CN108890636A (en) * 2018-07-06 2018-11-27 陕西大中科技发展有限公司 A kind of crawl localization method of industrial robot
CN111195897B (en) * 2018-11-20 2021-09-14 财团法人工业技术研究院 Calibration method and device for mechanical arm system
US11524406B2 (en) 2018-11-20 2022-12-13 Industrial Technology Research Institute Calibration method and device for robotic arm system
CN111195897A (en) * 2018-11-20 2020-05-26 财团法人工业技术研究院 Calibration method and device for mechanical arm system
CN109926817A (en) * 2018-12-20 2019-06-25 南京理工大学 Transformer automatic assembly method based on machine vision
CN109927030A (en) * 2019-03-28 2019-06-25 云南国土资源职业学院 A kind of robot visual orientation method of appearance components detection
CN110110760A (en) * 2019-04-17 2019-08-09 浙江工业大学 A kind of workpiece positioning and recognition methods based on machine vision
CN110170456A (en) * 2019-04-30 2019-08-27 南京邮电大学 Fruit sorting equipment based on image procossing
CN111069073A (en) * 2019-12-31 2020-04-28 芜湖哈特机器人产业技术研究院有限公司 Rubber ring sorting equipment
CN111582088A (en) * 2020-04-26 2020-08-25 广东弓叶科技有限公司 Man-machine cooperation sorting system and method for sorting multiple types of materials by same
CN111515149B (en) * 2020-04-26 2020-12-29 广东弓叶科技有限公司 Man-machine cooperation sorting system and robot grabbing position obtaining method thereof
CN111515149A (en) * 2020-04-26 2020-08-11 广东弓叶科技有限公司 Man-machine cooperation sorting system and robot grabbing position obtaining method thereof
CN112588621A (en) * 2020-11-30 2021-04-02 山东农业大学 Agricultural product sorting method and system based on visual servo
CN112588621B (en) * 2020-11-30 2022-02-08 山东农业大学 Agricultural product sorting method and system based on visual servo
CN114298077A (en) * 2021-12-15 2022-04-08 湖南视比特机器人有限公司 Code scanning identification positioning method and system based on 2D vision and storage medium
CN114310920A (en) * 2022-03-15 2022-04-12 广东若贝特智能机器人科技有限公司 Intelligent sorting parallel robot and control system thereof

Also Published As

Publication number Publication date
CN103706571B (en) 2015-12-09

Similar Documents

Publication Publication Date Title
CN103706571B (en) A kind of vision locating, sorting method
CN110176078B (en) Method and device for labeling training set data
CN110900581B (en) Four-degree-of-freedom mechanical arm vision servo control method and device based on RealSense camera
CN110246127A (en) Workpiece identification and localization method and system, sorting system based on depth camera
CN105563481A (en) Robot vision guide method used for shaft hole assembling
CN109461184B (en) Automatic positioning method for grabbing point for grabbing object by robot mechanical arm
CN113379849B (en) Robot autonomous recognition intelligent grabbing method and system based on depth camera
CN109961471B (en) Method and device for marking position of object in image and electronic equipment
CN113610921A (en) Hybrid workpiece grabbing method, device and computer-readable storage medium
CN105096376A (en) Information processing method and electronic device
CN113269723A (en) Unordered grasping system for three-dimensional visual positioning and mechanical arm cooperative work parts
Sardelis et al. 2-Stage vision system for robotic handling of flexible objects
CN202804246U (en) An intelligent drilling and targeting device
Lin et al. Vision based object grasping of industrial manipulator
CN114155610A (en) Panel assembly key action identification method based on upper half body posture estimation
Mizoguchi et al. Manhattan-world assumption for as-built modeling industrial plant
CN112947458A (en) Robot accurate grabbing method based on multi-mode information and computer readable medium
Reddy et al. Integration of robotic arm with vision system
CN113034418B (en) Circuit board identification and bonding pad/chip rapid positioning method for electronic industry
CN113681549B (en) Robot grabbing method and system based on three-dimensional data analysis
CN115601345A (en) Machine vision-based large-size punching plate hole group leakage-proof detection method and device
Wang et al. Study on the Target Recognition and Location Technology of industrial Sorting Robot based on Machine Vision.
CN107020545A (en) The apparatus and method for recognizing mechanical workpieces pose
Somani et al. Scene perception and recognition in industrial environments for human-robot interaction
CN113822946A (en) Mechanical arm grabbing method based on computer vision

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant