Automated Chinese medicinal plants classification based on machine learning using leaf morpho-colorimetry, fractal dimension and visible/near infrared spectroscopy

Jinru Xue, Sigfredo Fuentes, Carlos Poblete-Echeverria, Claudia Gonzalez Viejo, Eden Tongson, Hejuan Du, Baofeng Su

Abstract


The identification of Chinese medicinal plants was conducted to rely on ampelographic manual assessment by experts. More recently, machine learning algorithms for pattern recognition have been successfully applied to leaf recognition in other plant species. These new tools make the classification of Chinese medicinal plants easier, more efficient and cost effective. This study showed comparative results between machine learning models obtained from two methods: i) a morpho-colorimetric method and ii) a visible (VIS)/Near Infrared (NIR) spectral analysis from sampled leaves of 20 different Chinese medicinal plants. Specifically, the automated image analysis and VIS/NIR spectral based parameters obtained from leaves were used separately as inputs to construct customized artificial neural network (ANN) models. Results showed that the ANN model developed using the morpho-colorimetric parameters as inputs (Model A) had an accuracy of 98.3% in the classification of leaves for the 20 medicinal plants studied. In the case of the model based on spectral data from leaves (Model B), the ANN model obtained using the averaged VIS/NIR spectra per leaf as inputs showed 92.5% accuracy for the classification of all medicinal plants used. Model A has the advantage of being cost effective, requiring only a normal document scanner as measuring instrument. This method can be adapted for non-destructive assessment of leaves in-situ by using portable wireless scanners. Model B combines the fast, non-destructive advantages of VIS/NIR spectroscopy, which can be used for rapid and non-invasive identification of Chinese medicinal plants and other applications by analyzing specific light spectra overtones from leaves to assess concentration of pigments such as chlorophyll, anthocyanins and others that are related active compounds from the medicinal plants.
Keywords: ampelography, computer vision, artificial neural networks, pattern recognition, Chinese medicinal plants
DOI: 10.25165/j.ijabe.20191202.4637

Citation: Xue J R, Fuentes S, Poblete-Echeverria C, Viejo C G, Tongson E, Du H J, et al. Automated Chinese medicinal plants classification based on machine learning using leaf morpho-colorimetry, fractal dimension and visible/near infrared spectroscopy. Int J Agric & Biol Eng, 2019; 12(2): 123–131.

Keywords


ampelography, computer vision, artificial neural networks, pattern recognition, Chinese medicinal plants

Full Text:

PDF

References


Edeoga H, Okwu D, Mbaebie B. Phytochemical constituents of some Nigerian medicinal plants. African Journal of Biotechnology, 2005; 4(7): 685–688.

Chi X, Zhang Z, Xu X, Zhang X, Zhao Z, Liu Y, et al. Threatened medicinal plants in China: Distributions and conservation priorities. Biological Conservation, 2017; 210: 89–95.

Zhang H, Xu T, Qin L, Guo C. The Progress in the Identification Skill of Traditional Chinese Medicine and the Introduction of Modern Indentification Technique. Chinese Traditional Patent Medicine, 2000; 22(1): 101–110.

Fuentes S, Hernández-Montes E, Escalona J, Bota J, Viejo C G, Poblete-Echeverría C, et al. Automated grapevine cultivar classification based on machine learning using leaf morpho-colorimetry, fractal dimension and near-infrared spectroscopy parameters. Computers and Electronics in Agriculture, 2018; 151: 311–8.

Chitwood D H, Ranjan A, Martinez C C, Headland L R, Thiem T, Kumar R, et al. A modern ampelography: a genetic basis for leaf shape and venation patterning in grape. Plant Physiology, 2014; 164(1): 259–272.

Singh K, Gupta I, Gupta S. Svm-bdt pnn and fourier moment technique for classification of leaf shape. International Journal of Signal Processing, Image Processing and Pattern Recognition, 2010; 3(4): 67–78.

Wang P, Zhou H L, Xue F Z, Wang Z G. Analysis of infrared spectra of 60 kinds of plant extract of traditional Chinese medicine and study on the identification and evaluation of characteristics of the regional markers associated with cold and heat nature. Spectroscopy and Spectral Analysis, 2014; 34(1): 58–63. (in Chinese)

Rzanny M, Seeland M, Wäldchen J, Mäder P. Acquiring and preprocessing leaf images for automated plant identification: understanding the tradeoff between effort and information gain. Plant Methods, 2017; 13(1): 97.

Du J, Huang D, Wang X, Gu X. Computer-aided plant species identification (CAPSI) based on leaf shape matching technique. Transactions of the Institute of Measurement and Control, 2006; 28(3): 275–285.

Cope J S, Corney D, Clark J Y, Remagnino P, Wilkin P. Plant species identification using digital morphometrics: A review. Expert Systems with Applications, 2012; 39(8): 7562–7573.

Barbedo J G A. Digital image processing techniques for detecting, quantifying and classifying plant diseases. SpringerPlus, 2013; 2(1): 660.

Kumar N, Belhumeur P N, Biswas A, Jacobs D W, Kress W J, Lopez I C, et al. Leafsnap: A computer vision system for automatic plant species identification. Computer Vision–ECCV 2012: Springer, 2012; pp.502–516.

Backhaus A, Kuwabara A, Bauch M, Monk N, Sanguinetti G, Fleming A. LEAFPROCESSOR: a new leaf phenotyping tool using contour bending energy and shape cluster analysis. New Phytologist, 2010; 187(1): 251–261.

Bruno O M, de Oliveira Plotze R, Falvo M, de Castro M. Fractal dimension applied to plant identification. Information Sciences, 2008; 178(12): 2722–2733.

Wu S G, Bao F S, Xu E Y, Wang Y-X, Chang Y-F, Xiang Q-L, editors. A leaf recognition algorithm for plant classification using probabilistic neural network. IEEE International Symposium on Signal Processing and Information Technology, 2007.

Rossatto D R, Casanova D, Kolb R M, Bruno O M. Fractal analysis of leaf-texture properties as a tool for taxonomic and identification purposes: a case study with species from Neotropical Melastomataceae (Miconieae tribe). Plant Systematics and Evolution, 2011; 291(1-2): 103–116.

Chaki J, Parekh R. Plant leaf recognition using shape based features and neural network classifiers. International Journal of Advanced Computer Science and Applications, 2011; 2(10): 41–47.

Pan J, He Y. Recognition of plants by leaves digital image and neural network. 2008 International Conference on Computer Science and Software Engineering, IEEE, 2008.

Fu H, Fan Y, Zhang X, Lan H, Yang T, Shao M, et al. Rapid discrimination for traditional complex herbal medicines from different parts, collection time, and origins using high-performance liquid chromatography and near-infrared spectral fingerprints with aid of pattern recognition methods. Journal of Analytical Methods in Chemistry, 2015(2015): 1–10.

Yuan L, Huang Y, Loraamm R W, Nie C, Wang J, Zhang J. Spectral analysis of winter wheat leaves for detection and differentiation of diseases

and insects. Field Crops Research, 2014; 156: 199–207.

De Bei R, Cozzolino D, Sullivan W, Cynkar W, Fuentes S, Dambergs R, et al. Non-destructive measurement of grapevine water potential using near infrared spectroscopy. Australian Journal of Grape and Wine Research, 2011; 17(1): 62–71.

Fuentes S, De Bei R, Tyerman S D. Image analysis techniques applied to canopies, berries, plant tissues and leaves. unpublished.[23] Borkowski W. Fractal dimension based features are useful descriptors of leaf complexity and shape. Canadian Journal of Forest Research, 1999; 29(9): 1301–1310.

Foroutan-pour K, Dutilleul P, Smith D L. Advances in the implementation of the box-counting method of fractal dimension estimation. Applied Mathematics and Computation, 1999; 105(2): 195–210.

Liebovitch L S, Toth T. A fast algorithm to determine fractal dimensions by box counting. Physics Letters A, 1989; 141(8-9): 386–390.

Viejo C G, Fuentes S, Li G J, Collmann R, Condé B, Torrico D. Development of a robotic pourer constructed with ubiquitous materials, open hardware and sensors to assess beer foam quality using computer vision and pattern recognition algorithms: RoboBEER. Food Research International, 2016; 89(1): 504–513.

Gonzalez Viejo C, Fuentes S, Torrico D, Howell K, Dunshea F R. Assessment of beer quality based on foamability and chemical composition using computer vision algorithms, near infrared spectroscopy and machine learning algorithms. J Sci Food Agric., 2018; 98(2): 618–627.

Gitelson A A, Gritz Y, Merzlyak M N. Relationships between leaf chlorophyll content and spectral reflectance and algorithms for non-destructive chlorophyll assessment in higher plant leaves. Journal of Plant Physiology, 2003; 160(3): 271–282.

Gitelson A A, Merzlyak M N. Non-destructive assessment of chlorophyll carotenoid and anthocyanin content in higher plant leaves. Principles and Algorithms, 2004: 78–94.

Yang Z H, Hu H P, Bai Y P. Classification method research of leaves based on principal component analysis and POS-SVM. Mathematics in Practice and Theory, 2016; 46(18): 170–175. (in Chinese).

Jia Y F, Min C M, Ju C, Zhu B, Wang P. Application and MATLAB realization of drugs' classification based on the combination of NIRS detection and BP ANN algorithm. International Journal of Biomedical Engineering, 2016; 39(4): 222–225.

Zhang S T, Wang Z Y, Zou X G, Qian Y, Yu L. Recognition of tea disease spot based on hyperspectral image and genetic optimization neural network. Transactions of the CSAE, 2017; 33(22): 200–207. (in Chinese)

Wei C S, Lei F H, Ai W X, Feng J, Zheng H, Ma D, et al. Rapid identification of 6 kinds of traditional Chinese medicines containing resins and other components based on near infrared refectance spectroscopy and PCA-SVM algorithm. Chinese Journal of Experimental Traditional Medical Formulae, 2017; 23(9): 25–31. (in Chinese)

Gitelson A A, Zur Y, Chivkunova O B, Merzlyak M N. Assessing Carotenoid Content in Plant Leaves with Reflectance Spectroscopy. Photochemistry & Photobiology, 2002; 75(3): 272–281.

Yuan M Y, Huang B S, Yu C, Liu Y M, Chen K L. A NIR qualitative and quantitative model of 8 kinds of carbonate-containing mineral Chinese medicines. China Journal of Chinese Materia Medica, 2014; 39(2): 267–272. (in Chinese)

Vesali F, Omid M, Kaleita A, Mobli H. Development of an android app to estimate chlorophyll content of corn leaves based on contact imaging. Computers & Electronics in Agriculture, 2015; 116(C): 211–220.




Copyright (c) 2019 International Journal of Agricultural and Biological Engineering



2023-2026 Copyright IJABE Editing and Publishing Office