Kiwifruit recognition at nighttime using artificial lighting based on machine vision

Authors

  • Fu Longsheng College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling 712100, China
  • Wang Bin College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling 712100, China
  • Cui Yongjie College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling 712100, China
  • Su Shuai Beijing Research Center of Intelligent Equipment for Agriculture, Beijing 100089, China;
  • Yoshinori Gejima Faculty of Agriculture, University of Miyazaki, Miyazaki 889-2192, Japan
  • Taiichi Kobayashi Faculty of Agriculture, University of Miyazaki, Miyazaki 889-2192, Japan

DOI:

https://doi.org/10.25165/ijabe.v8i4.1576

Keywords:

Elliptic Hough transform, image capturing method, Kiwifruit, minimal bounding rectangle, optimal illumination intensity

Abstract

Most researches involved so far in kiwifruit harvesting robot suggest the scenario of harvesting in daytime for taking advantage of sunlight. A robot operating at nighttime can overcome the problem of low work efficiency and would help to minimize fruit damage. In addition, artificial lights can be used to ensure constant illumination instead of the variable natural sunlight for image capturing. This paper aims to study the kiwifruit recognition at nighttime using artificial lighting based on machine vision. Firstly, an RGB camera was placed underneath the canopy so that clusters of kiwifruits could be included in the images. Next, the images were segmented using an R-G color model. Finally, a group of image processing conventional methods, such as Canny operator were applied to detect the fruits. The image processing results showed that this capturing method could reduce the background noise and overcome any target overlapping. The experimental results showed that the optimal artificial lighting ranged approximately between 30-50 lx. The developed algorithm detected 88.3% of the fruits successfully. Keywords: Elliptic Hough transform, image capturing method, Kiwifruit, minimal bounding rectangle, optimal illumination intensity DOI: 10.3965/j.ijabe.20150804.1576 Citation: Fu L S, Wang B, Cui Y J, Su S, Gejima Y, Kobayashi T. Kiwifruit recognition at nighttime using artificial lighting based on machine vision. Int J Agric & Biol Eng, 2015; 8(4): 52－59.

References

Sun Z. Fruit area and yield was increased 12 years in shannxi. China Fruit News, 2013; 30(1): 44–45. (in Chinese with English abstract)

Gao X D, Wu P T, Zhao X N, Wang J W, Shi Y G, Zhang B Q, et al. Estimation of spatial soil moisture averages in a large gully of the loess plateau of china through statistical and modeling solutions. Journal of Hydrology, 2013; 486: 466–478. Doi: 10.1016/j.jhydrol.2013.02.026.

Zhao Z, Gao X, Huang Q, Huang L, Qin H, Kang Z. Identification and characterization of the causal agent of bacterial canker of kiwifruit in the shaanxi province of china. J Plant Pathol, 2013; 95(1): 155–162. Doi: 10.4454/JPP. V95I1.005.

Miller S A, Broom F D, Thorp T G, Barnett A M. Effects of leader pruning on vine architecture, productivity and fruit quality in kiwifruit (actinidia deliciosa cv. Hayward). Sci Hortic, 2001; 91(3–4): 189–199. Doi: 10.1016/S0304- 4238(01)00259-X.

Chen Y, Chen X, Liu Y. Study on frame type of kiwifruit. North Hortic, 2012; 14: 56–57. (in Chinese with English abstract)

Fu L, Zhang F, Gejima Y, Li Z, Wang B, Cui Y. Development and experiment of end-effector for kiwifruit harvesting robot. Trans Chin Soc Agric Mach, 2015; 46(3): 1–8. Doi: 10.6041/j.issn.1000-1298.2015.03.001. (in Chinese with English abstract)

Zhao D, Lv J, Ji W, Zhang Y, Chen Y. Design and control of an apple harvesting robot. Biosyst Eng, 2011; 110(2): 112–122. Doi: 10.1016/j.biosystemseng.2011.07.005.

Ji W, Zhao D, Cheng F, Xu B, Zhang Y, Wang J. Automatic recognition vision system guided for apple harvesting robot. Comput Electr Eng, 2012; 38(5): 1186–1195. Doi: 10.1016/j.compeleceng.2011.11.005.

Lü Q, Cai J, Liu B, Deng L, Zhang Y. Identification of fruit and branch in natural scenes for citrus harvesting robot using machine vision and support vector machine. Int J Agric Biol Eng, 2014; 7(2): 115–121. Doi: 10.3965/j.ijabe.20140702. 014.

Mehta S S, Burks T F. Vision-based control of robotic manipulator for citrus harvesting. Comput Electron Agric, 2014; 102(0): 146–158. Doi: 10.1016/j.compag.2014.01.003.

Hannan M, Burks T, Bulanon D M. A machine vision algorithm combining adaptive segmentation and shape analysis for orange fruit detection. Agric Eng Int: CIGR J, 2009; XI: Manuscript 1281.

Muscato G, Prestifilippo M, Abbate N, Rizzuto I. A prototype of an orange picking robot: Past history, the new robot and experimental results. Industrial Robot: An Int J, 2005; 32(2): 128–138. Doi: 10.1108/01439910510582255.

Feng Q, Cheng W, Zhou J, Wang X. Design of structured-light vision system for tomato harvesting robot. Int J Agric Biol Eng, 2014; 7(2): 19–26. Doi: 10.3965/j.ijabe. 20140702.003.

Ding Y, Geng N, Zhou Q. Research on the object extraction of kiwifruit based on images. Microcomput Inf, 2009; 25(18): 294–295. (in Chinese with English abstract)

Scarfe A J, Flemmer R C, Bakker H, Flemmer C L, editors. Development of an autonomous kiwifruit picking robot. Autonomous Robots and Agents, 4th International Conference on; 2009: IEEE.

Wu T, Yuan C, Chen J. Research on the object extraction of kiwifruit based on machine vision. J Agric Mech Res, 2012; 34(12): 21–26. Doi: 10.3969/j.issn.1003-188X.2012.12.005. (in Chinese with English abstract)

Cui Y, Su S, Wang X, Tian Y, Li P, Zhang F. Recognition and feature extraction of kiwifruit in natural environment based on machine vision. Trans Chin Soc Agric Mach, 2013; 44(05): 247–252. Doi: 10.6041/j.issn.1000-1298.2013. 05.043. (in Chinese with English abstract)

Zhan W, He D, Shi S. Recognition of kiwifruit in field based on adaboost algorithm. Trans Chin Soc Agric Eng, 2013; 29(23): 140–146. Doi: 10.3969/j.issn.1002-6819.2013. 23.019. (in Chinese with English abstract)

Mu J, Chen J, Sun G, Liu F, Ma Y, Wang F. Characteristic parameters extraction of kiwifruit based on machine vision. J Agric Mech Res, 2014; 36(6): 138–142. Doi: 10.13427/j.cnki. njyi.2014.06.035. (in Chinese with English abstract)

Hayashi S, Shigematsu K, Yamamoto S, Kobayashi K, Kohno Y, Kamata J, et al. Evaluation of a strawberry-harvesting robot in a field test. Biosyst Eng, 2010; 105(2): 160–171. Doi: 10.1016/j.biosystemseng.2009. 09.011.

Cui Y, Su S, Lv Z, Li P, Ding X. A method for separation of kiwifruit adjacent fruits based on hough transformation. J Agric Mech Res, 2012; 34(12): 166–169. Doi: 10.3969/j.issn. 1003-188X.2012.12.041. (in Chinese with English abstract)

Otsu N. A threshold selection method from gray-level histograms. Autom, 1975; 11(285-296): 23–27. Doi: 10.1109/TSMC.1979.4310076

Canny J. A computational approach to edge detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on. 1986; (6): 679–698. Doi: 10.1109/ TPAMI.1986.4767851.

Al-Mallahi A, Kataoka T, Okamoto H, Shibata Y. An image processing algorithm for detecting in-line potato tubers without singulation. Comput Electron Agric, 2010; 70(1): 239–244. Doi: 10.1016/j.compag.2009.11.001.

Pastrana J C, Rath T. Novel image processing approach for solving the overlapping problem in agriculture. Biosyst Eng, 2013; 115(1): 106–115. Doi: 10.1016/j.biosystemseng.2012. 12.006.

Wu X, Wang D, Sheng H. An algorithm and implementaion for obtaining minimum exterior rectangle of image region. Comput Eng, 2004; 30(12): 124–125, 42. Doi: 10.3969/j.issn.1000-3428.2004.12.048.

Xie Y, Ji Q, editors. A new efficient ellipse detection method. Pattern Recognition 16th International Conference on; 2002: IEEE

Downloads

Published

2015-08-25

How to Cite

Longsheng, F., Bin, W., Yongjie, C., Shuai, S., Gejima, Y., & Kobayashi, T. (2015). Kiwifruit recognition at nighttime using artificial lighting based on machine vision. International Journal of Agricultural and Biological Engineering, 8(4), 52–59. https://doi.org/10.25165/ijabe.v8i4.1576

Issue

Vol. 8 No. 4 (2015): IJABE

Section

Information Technology, Sensors and Control Systems

License

IJABE is an international peer reviewed, open access journal, adopting Creative Commons Copyright Notices as follows.

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).