Point cloud registration for agriculture and forestry crops based on calibration balls using Kinect V2

Sanzhang Zhou, Feng Kang, Wenbin Li, Jiangming Kan, Yongjun Zheng

Abstract


For the process of point cloud registration, and the problem of inaccurate registration due to errors in correspondence between keypoints. In this paper, a registration method based on calibration balls was proposed, the trunk, branch, and crown were selected as experimental objects, and three calibration balls were randomly placed around the experimental objects to ensure different distances between two ball centers. Using the Kinect V2 depth camera to collect the point cloud of the experimental scene from four different viewpoints, the PassThrough filter algorithm was used for point cloud filtering in each view of the experimental scenes. The Euclidean cluster extraction algorithm was employed for point cloud clustering and segmentation to extract the experimental object and the calibration ball. The random sample consensus (RANSAC) algorithm was applied to fit the point cloud of a ball and calculate the coordinates of the ball center so that the distance between two ball centers under different viewpoints can be obtained by using the coordinates of the ball center. Comparing the distance between the ball centers from different viewpoints to determine the corresponding relationship between the ball centers from different viewpoints, and then using the singular value decomposition (SVD) method, the initial registration matrix was obtained. Finally, Iterative Closest Point (ICP) and its improved algorithm were used for accurate registration. The experimental results showed that the method of point cloud registration based on calibration balls can solve the problem of corresponding error of keypoints, and can register point clouds from different viewpoints of the same object. The registration method was evaluated by using the registration running time and the fitness score. The final registration running time of different experimental objects was not more than 6.5 s. The minimum fitness score of the trunk was approximately 0.0001, the minimum fitness score of the branch was approximately 0.0001, and the minimum fitness score of the crown was approximately 0.0006.
Keywords: point cloud registration, calibration balls, Kinect V2, ICP
DOI: 10.25165/j.ijabe.20201301.5077

Citation: Zhou S Z, Kang F, Li W B, Kan J M, Zheng Y J. Point cloud registration for agriculture and forestry crops based on calibration balls using Kinect V2. Int J Agric & Biol Eng, 2020; 13(1): 198–205.

Keywords


point cloud registration, calibration balls, Kinect V2, ICP

Full Text:

PDF

References


Lin Y. LiDAR: An important tool for next-generation phenotyping technology of high potential for plant phenomics? Computers & Electronics in Agriculture, 2015; 119: 61–73.

Deans A R, Lewis S E, Huala E, Anzaldo S S, Ashburner M, Balhoff J P, et al. Finding Our Way through Phenotypes. Plos Biology, 2015; 13(1): e1002033.

Karkee M, Adhikari B. A method for three-dimensional reconstruction of apple trees for automated pruning. Transactions of the ASABE, 2015; 58(3): 565–74.

Colaco A F, Trevisan R G, Molin J P, Rosell-Polo J R, Escola A. A method to obtain orange crop geometry information using a mobile terrestrial laser scanner and 3D modeling. Remote Sensing, 2017; 9(8): 763.

Li D W, Xu L H, Tang X S, Sun S Y, Cai X, Zhang P. 3D imaging of greenhouse plants with an inexpensive binocular stereo vision system. Remote Sensing, 2017; 9(5): 508.

Li Y Y, Fan X C, Mitra N J, Chamovitz D, Cohen-Or D, Chen B Q. Analyzing growing plants from 4D point cloud data. ACM Transactions on Graphics, 2013; 32(6): 157.

Li J, Tang L. Developing a low-cost 3D plant morphological traits characterization system. Computers and Electronics in Agriculture, 2017; 143: 1–13.

Oliver A, Kang S, Wünsche B C, Macdonald B. Using the Kinect as a navigation sensor for mobile robotics. Conference on Image & Vision Computing, New Zealand, 2012.

Liao H J, Long X L. Study on virtual assembly system based on Kinect somatosensory interaction. International Conference on Information Science and Cloud Computing, Guangzhou, China, 2013.

Hondori M H, Khademi M. A review on technical and clinical impact of Microsoft Kinect on physical therapy and rehabilitation. Journal of Medical Engineering, 2014; 2014(1): 846514.

Boutsika E. Kinect in Education: A Proposal for children with autism. Procedia Computer Science, 2014; 27: 123–129.

Vazquez-Arellano M, Reiser D, Paraforos D S, Garrido-Izard M, Burce M E C, Griepentrog H W. 3-D reconstruction of maize plants using a time-of-flight camera. Computers and Electronics in Agriculture, 2018; 145: 235–247.

Gai J Y, Tang L, Steward B. Plant recognition through the fusion of 2D and 3D images for robotic weeding. ASABE Annual International Meeting, New Orleans, USA, Jul 26-29, 2015.

Cheng X, Li Z W, Zhong K, Shi Y S. An automatic and robust point cloud registration framework based on view-invariant local feature descriptors and transformation consistency verification. Optics and Lasers in Engineering, 2017; 98: 37–45.

Rusu R B, Cousins S. 3D is here: Point cloud library (PCL). IEEE International Conference on Robotics & Automation, Shanghai, China; 2011.

Chen H, Bhanu B. 3D free-form object recognition in range images using local surface patches. Pattern Recognition Letters, 2007; 28(10): 1252–1262.

Zhang A L, Zhang B X, Song C J, Shen D P, Zhu E G, Dong F S. Viewpoint calibration method based on point features for point cloud fusion. IEEE International Conference on Image Processing, Beijing, China; 2017.

Kalman D. A singularly valuable decomposition: the SVD of a matrix. The College Mathematics Journal, 1996; 27(1): 2–23.

Lachat E, Macher H, Landes T, Grussenmeyer P. Assessment and calibration of a RGB-D camera (Kinect v2 sensor) towards a potential use for close-range 3D modeling. Remote Sensing, 2015; 7(10): 13070–13097.

Yang L, Zhang L Y, Dong H W, Alelaiwi A, Saddik A E. Evaluating and improving the depth accuracy of Kinect for Windows v2. IEEE Sensors Journal, 2015; 15(8): 4275–4285.

Miknis M, Davies R, Plassmann P, Ware A. Near real-time point cloud processing using the PCL. International Conference on Systems, Signals and Image Processing; 2015.

Rusu R B, Blodow N, Marton Z C, Beetz M. Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments. IEEE/RSJ International Conference on Intelligent Robots and Systems, St Louis, MO, USA, 2009.

Hautamaki V, Karkkainen I, Franti P. Outlier detection using k-nearest neighbour graph. Proceedings of the 17th International Conference on Pattern Recognition, IEEE, 2004.

Schnabel R, Wahl R, Klein R. Efficient RANSAC for point‐cloud shape detection. Computer graphics forum; 2007: Wiley Online Library.

Besl P J, McKay N D. Method for registration of 3-D shapes. In Proceedings of Sensor Fusion IV: Control paradigms and data structures, 1992; pp.586-607.

Maiseli B, Gu Y F, Gao H J. Recent developments and trends in point set registration methods. Journal of Visual Communication and Image Representation, 2017; 46: 95–106.

Alexa M, Behr J, Cohen-Or D, Fleishman S, Levin D, Silva C T. Computing and rendering point set surfaces. IEEE Transactions on Visualization and Computer Graphics, 2003; 9(1): 3–15.

Xian Y R, Xiao J, Wang Y. A fast registration algorithm of rock point cloud based on spherical projection and feature extraction. Frontiers of Computer Science, 2019; 13: 170–182.




Copyright (c) 2020 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office