Monocular vision and calculation of regular three-dimensional target pose based on Otsu and Haar-feature AdaBoost classifier

Yuanhong Li, Hongjun Wang, Weiliang Zhou, Zehao Xue

Abstract


Using machine vision to identify and sort scattered regular targets is an urgent problem to be solved in automated production lines. This study proposed a three-dimensional (3D) recognition method combining monocular vision and machine learning algorithms. According to the color characteristics of the targets, to convert the original color picture into YCbCr mode and use the 2D Otsu algorithm to perform gray level image segmentation on the Cb channel. Then the Haar-feature training was carried out. The comparison of feature training and Haar method for Hough transform showed that the recognized time of Haar-feature AdaBoost trainer reached 31.00 ms, while its false recognized rate was 3.91%. The strong classifier was formed by weight combination, and the Hough contour transformation algorithm was set to correct the normal vector between plane coordinate and camera coordinate system. The monocular vision system ensured that the field of camera view had not obstructed while the dots were being struck. It was measured and calculated angles between targets and the horizontal plane which coordinate points of the identified plane feature. The testing results were compared with the Otsu and AdaBoost trainer where the prediction and training set have an error of no more than 0.25 mm. Its correct rate can reach 95%. It shows that the Otsu and Haar-feature based on AdaBoost algorithm is feasible within a certain error ranges and meet the engineering requirements for solving the poses of automated regular three-dimensional targets.
Keywords: Otsu, Haar-feature, AdaBoost, 3D position, target pose, monocular vision, error analysis
DOI: 10.25165/j.ijabe.20201305.5013

Citation: Li Y H, Wang H J, Zhou W L, Xue Z H. Monocular vision and calculation of regular three-dimensional target pose based on Otsu and Haar-feature AdaBoost classifier. Int J Agric & Biol Eng, 2020; 13(5): 171–180.

Keywords


OTSU, Haar-feature, AdaBoost, 3D position, target pose, monocular vision, error analysis

Full Text:

PDF

References


Baró X, Escalera S, Vitrià J, Pujol O, Radeva P. Traffic sign recognition using evolutionary adaboost detection and forest-ECOC classification. IEEE Transactions on Intelligent Transportation Systems, 2009; 10(1): 113–126.

Sappa D, Dornaika F, Ponsa D, Gerónimo D, López A. An efficient approach to onboard stereo vision system pose estimation. IEEE Transactions on Intelligent Transportation Systems, 2008; 9(3): 476–490.

Sun J. Improved 2D maximum between-cluster variance algorithm and its application to cucumber target segmentation. Transactions of the CSAE, 2009; 25(10): 176–181. (in Chinese)

Guo H X, Li Y J, Li Y N, Liu X, Li J L. BPSO-Adaboost-KNN ensemble learning algorithm for multi-class imbalanced data classification. Engineering Applications of Artificial Intelligence, 2016; 49: 176–193.

Li Z, Yuan Y, Ke F, He W, Su C Y. Robust vision-based tube model predictive control of multiple mobile robots for leader–follower formation.

IEEE Transactions on Industrial Electronics, 2019; 67(4): 3096–3106.

Michels J, Saxena A, Ng A Y. High speed obstacle avoidance using monocular vision and reinforcement learning. In: Proceedings of the 22nd International Conference on Machine Learning, 2005; pp: 593–600.

Sund T, Eilertsen K. An algorithm for fast adaptive image binarization with applications in radiotherapy imaging. IEEE Transactions on Medical Imaging, 2003; 22(1): 22–28.

Fan J L, Zhao F. Two-dimensional Otsu's curve thresholding segmentation method for gray-level images. Acta Electronica Sinica, 2007; 35(4): 751. doi: 10.1002/jrs.1570. (in Chinese)

Gong Q, Ni L, Tang P F, Wang F F. Fast three-dimensional Otsu image segmentation algorithm based on decomposition. Journal of Computer Applications, 2012; 32(6): 1526–1528. (in Chinese)

Meechart K, Auethavekiat S, Sa-ing V. An Automatic Detection for Avian Blood Cell based on Adaptive Thresholding Algorithm. In: 2019 12th Biomedical Engineering International Conference (BMEiCON), 2019; 11: 1–4.

Jin L S, Lei T, Wang R B, Guo L, Chu J W. An improved Otsu image segmentation algorithm for path mark detection under variable illumination. In: IEEE Proceedings. Intelligent Vehicles Symposium, 2005; pp.840–844.

Qiao N, Sun P. Study of improved Otsu algorithm and its ration evaluation analysis for PCB photoelectric image segmentation. Optik, 2014; 125(17): 4784–4787.

Qin J, Shen X, Mei F, Fang Z. An Otsu multi-thresholds segmentation algorithm based on improved ACO. The Journal of Supercomputing, 2019; 75(2): 955–967.

Zhou M, Wei H. Face verification using gaborwavelets and adaboost. In: 18th International Conference on Pattern Recognition (ICPR'06), 2006; 1: 404-407.

Lu H, Wang H, Yoon S W, Won D. Real-Time stencil printing optimization using a hybrid multi-layer online sequential extreme learning and evolutionary search approach. IEEE Transactions on Components, Packaging and Manufacturing Technology, 2019; 9(12): 2490–2498.

Tian H X, Mao Z Z. An ensemble ELM based on modified AdaBoost RT algorithm for predicting the temperature of molten steel in ladle furnace. IEEE Transactions on Automation Science and Engineering, 2009; 7(1): 73–80.

Merzban M H, Elbayoumi M. Efficient solution of Otsu multilevel image thresholding: A comparative study. Expert Systems with Applications, 2019; 116: 299–309.

Bhandari A K, Kumar I V. A context sensitive energy thresholding based 3D Otsu function for image segmentation using human learning optimization. Applied Soft Computing, 2019; 82: 105570. doi: 10.1016/j.asoc.2019.105570.

Khairuzzaman A K, Chaudhury S. Brain MR image multilevel thresholding by using particle swarm optimization, Otsu method and anisotropic diffusion. International Journal of Applied Metaheuristic Computing (IJAMC), 2019; 10(3): 91–106.

Sundaram R, Jayaraman P, Rangarajan R, Rengasri R, Rajeshwari C, Ravichandran K S. Automated optic papilla segmentation approach using normalized Otsu thresholding. Journal of Medical Imaging and Health Informatics, 2019; 9(7): 1346–1353.

Wang W L, Duan L M, Wang Y. Fast image segmentation using two-dimensional Otsu based on estimation of distribution algorithm. Journal of Electrical and Computer Engineering, 2017; 2017(3): 1735176. doi: 10.1155/2017/1735176.

Campbell J, Sukthankar R, Nourbakhsh I, Pahwa A. A robust visual odometry and precipice detection system using consumer-grade monocular vision. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation. Barcelona: IEEE, 2005; pp.3421–3427.

Caballero F, Merino L, Ferruz J, Ollero A. Unmanned aerial vehicle localization based on monocular vision and online mosaicking. Journal of Intelligent and Robotic Systems, 2009; 55(4-5): 323–343.

Hanif S M, Prevost L. Text detection and localization in complex scene images using constrained adaboost algorithm. In: 2009 10th International Conference on Document Analysis and Recognition. Barcelona: IEEE, 2009; pp.1–5.

Kim S, Song W J, Kim S H. Robust ground target detection by SAR and IR sensor fusion using Adaboost-based feature selection. Sensors, 2016; 16(7): 1117. doi: 10.3390/s16071117.

Hu W M, Gao J, Wang Y G, Wu O, Maybank S. Online adaboost-based parameterized methods for dynamic distributed network intrusion detection.

IEEE Transactions on Cybernetics, 2013; 44(1): 66–82.

Liu M H. Fingerprint classification based on Adaboost learning from singularity features. Pattern Recognition, 2010; 43(3): 1062–1070.

Gao Y, Liu H, Sun X H, Wang C, Liu Y. Violence detection using oriented violent flows. Image and Vision Computing, 2016; 48-49: 37–41.

Viola P, Jones M. Fast and robust classification using asymmetric Adaboost and a detector cascade. Advances in Neural Information Processing Systems, 2002; 14: 1311–1318.

Liu Y H, Huang S, Huang Y D. Motor imagery EEG classification for patients with amyotrophic lateral sclerosis using fractal dimension and Fisher’s criterion-based channel selection. Sensors, 2017; 17(7): 1557. doi: 10.3390/s17071557.

Kaur S, Sharma D A. Multi-classifiers comparison for protein secondary structure prediction. In: 2019 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS). Noida: IEEE, 2019; pp.359–364.

Owusu E, Zhan Y, Mao Q R. A neural-AdaBoost based facial expression recognition system. Expert Systems with Applications, 2014; 41(7): 3383–3390.

Ferri M, Mangili F, Viano G. Projective pose estimation of linear and quadratic primitives in monocular computer vision. CVGIP: Image understanding, 1993; 58(1): 66–84.

Guo L, Ge P S, Zhang M H, Li L H, Zhao Y B. Pedestrian detection for intelligent transportation systems combining AdaBoost algorithm and support vector machine. Expert Systems with Applications, 2012; 39(4): 4274–4286.

Solomatine D P, Shrestha D L. AdaBoost.RT: A boosting algorithm for regression problems. In: 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No. 04CH37541). Budapest: IEEE, 2004; 2: pp.1163–1168.

Chaurasia V, Pal S. Skin Diseases prediction: binary classification machine learning & multi model ensemble techniques. Indian Journal of Public Health Research & Development, 2020; 11(1): 737–742.

Bjorkman M, Kragic D. Combination of foveal and peripheral vision for object recognition and pose estimation. In: IEEE International Conference on Robotics and Automation. New Orleans: IEEE, 2004; 5: 5135–5140.

Loianno G, Kumar V. Cooperative transportation using small quadrotors using monocular vision and inertial sensing. IEEE Robotics and Automation Letters, 2017; 3(2): 680–687.

Yang T, Li P Q, Zhang H M, Li J, Li Z. Monocular vision SLAM-based UAV autonomous landing in emergencies and unknown environments.

Electronics, 2018; 7(5): 73. doi: 10.3390/electronics7050073.

Royer E, Lhuillier M, Dhome M, Lavest J M. Monocular vision for mobile robot localization and autonomous navigation. International Journal of Computer Vision, 2007; 74(3): 237–260.

Yuan W B, Cao Z Q, Zhang Y J, Tan M. A robot pose estimation approach based on object tracking in monitoring scenes. International Journal of Robotics and Automation, 2017; 32(3): 256–265.

Pang M L, Tiberius C. Precision and reliability of tightly coupled PPP GNSS and landmark monocular vision positioning. Sensors, 2020; 20(5): 1537. doi: 10.3390/s20051537.

Solomatine D P, Shrestha D L. 2004, July. AdaBoost.RT: a boosting algorithm for regression problems. In: 2004 IEEE International Joint Conference on Neural Networks, 2004; 2: 1163–1168.

Ye N, Yang B W, Zhou H C, Zhang L Y. A calibration trilogy of monocular-vision-based aircraft boresight system. Measurement, 2018; 117: 133–143.

Tournier G, Valenti M, How J, Feron E. Estimation and control of a quadrotor vehicle using monocular vision and moire patterns. In: AIAA Guidance, Navigation, and Control Conference and Exhibit, 2006; 6711. doi: 10.2514/6.2006-6711.

Carreras X, Màrquez L, Padró L. A simple named entity extractor using AdaBoost. In: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, 2003; pp.152–155.

Li X, Liu W, Pan Y, Ma J, Wang F. A knowledge-driven approach for 3D high temporal-spatial measurement of an arbitrary contouring error of CNC machine tools using monocular vision. Sensors, 2019; 19(3): 744. doi: 10.3390/s19030744.

Meng C C, Bao H, Ma Y, Xu X K, Li Y Q. Visual Meterstick: Preceding vehicle ranging using monocular vision based on the fitting method. Symmetry, 2019; 11(9): 1081. doi: 10.3390/sym11091081.

Hu W M, Hu W, Maybank S. Adaboost-based algorithm for network intrusion detection. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008; 38(2): 577–583.

Hwang S Y, Song J B. Monocular vision-based SLAM in indoor environment using corner, lamp, and door features from upward-looking camera. IEEE Transactions on Industrial Electronics, 2011; 58(10): 4804–4812.

Khammari A, Nashashibi F, Abramson Y, Laurgeau C. Vehicle detection combining gradient analysis and AdaBoost classification. In: Proceedings. 2005 IEEE Intelligent Transportation Systems. Vienna: IEEE, 2005; pp.66–71.




Copyright (c) 2020 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office