Adnan Sallom ^{1, 2}*; Michael Alabboud ^1,2

1, Department of Horticultural Sciences, University College of Agriculture and Natural Resources, University of Tehran, Iran

2, Department of Horticulture, Faculty of Agricultural Engineering, Al-Baath University, Homs, Syria

 

Manuscript link
http://dx.doi.org/10.30493/DAS.2022.353877

Abstract

Anthracnose and blight are among the most important fungal diseases affecting walnut orchards. Therefore, evaluating germplasm sensitivity to these diseases is of high importance in breeding programs. However, visual assessment of disease severity requires extensive time and effort. In this research, a new automated technique was developed through image segmentation to assist in accurate automated anthracnose and blight severity estimation. For this purpose, anthracnose and blight severity in 130 walnut genotypes was estimated by visually screening 15 randomly collected leaves per genotype. Then, digital images of the evaluated leaves were acquired and preprocessed. A color segmentation function was developed to estimate the anthracnose and blight-infected area. Correlation and regression were used to compare image segmentation results with actual visual results. Results showed that actual results were highly correlated with their counterparts of image segmentation with values of r = 0.91 (R² = 0.83) and r = 0.96 (R² = 0.92) for individual samples and genotype averages, respectively. These results indicate that the color segmentation method can be reliably used for walnut anthracnose and blight severity estimation as an automatic substitute for expert evaluation. Further research is needed to enhance the system’s capability to handle background noise and conduct real-time field inspections.

Keywords: Image segmentation, Walnut, Anthracnose, Blight, Disease severity

Introduction

Walnut is one of the main horticultural crops in Iran, and the country is ranked third in terms of production after China and the USA, with a production rate of 356.7 tonnes [1]. However, fungal diseases, especially anthracnose and blight, constitute a major loss in walnut orchards, which may have a disastrous economic impact. The main causative agent of nut anthracnose is the fungus Gnomonia leptostyla and its asexual form Marssonina juglandis [2]. Anthracnose is considered one of the most threatening diseases for walnut orchards worldwide and in Mediterranean countries in particular [3]. This fungus spreads easily in the walnut orchards via wind or rainwater and attacks all tree parts, including leaves, fruits, shoots, and buds. The infection begins in the form of circular spots of dark brown color that, with the progression of the infection, merge to form sunken necrotic spots [4]. After that, it severely damages the leaves, which negatively affects the efficiency of photosynthesis and in the advanced stages leads to leaf fall and a decrease in the quality of the fruits, and may result in the overall weakness and death of trees in severe infections [2-6].

The bacterium Xanthomonas arboricola pv. juglandis causes walnut blight disease [7]. The blight can attack all tree tissues, including catkin, female flowers, buds, shoots, leaves, and fruits. This disease causes heavy losses in walnut orchards worldwide, especially in wet years [8]. Considering the significant losses caused by anthracnose and blight, estimating genotypes’ resistance to these two diseases is among the primary goals of any walnut breeding program.

The conventional estimation of plant disease severity by visual screening is a laborious task. This evaluation requires long hours of inspection by skilled experts to generate reliable results. Therefore, automating this task is highly important in plant protection research and large germplasm evaluation. For this purpose, several image processing techniques are being employed. For instance, color segmentation was proven highly efficient in this area [9]. Image segmentation is the process where different regions of the image are classified and clustered based on a simple thresholding function or more elaborate algorithm. Then, the segmented image is masked for further analysis or processing. In fact, numerous works employed image segmentation to detect and estimate the severity of plant disease [10-12]. Therefore, this study aimed to develop an automated anthracnose and blight severity estimation by utilizing image segmentation approach. Furthermore, this study aims to compare the developed system results with visual screening.

Material and Methods

Plant material and visual inspection

In this research, approximately 130 walnut trees grown at the Research Station of the Department of Horticultural Sciences, University of Tehran, were visually evaluated to determine their tolerance to anthracnose and blight. The leaf samples were collected randomly at a rate of 15 per genotype. The severity of infection in each sample was estimated based on visual screening. Then, the combined disease severity (for anthracnose and blight) was expressed as a percentage for each leaf.

Images acquiring

The images of all visually inspected leaf samples across the studied genotypes were acquired with a 13-megapixel digital camera under constant lighting conditions.

Image segmentation

In order to generate a binary mask of the total leaf area, the leaf’s background was omitted via a simple mono-color threshold function, and all holes were filled using image processing toolbox in Matlab R2021a. The total leaf region was measured using the binary mask. Approximately 50 representative samples of leaves (Fig. 1 A) and infected regions (Fig. 1 B) were arranged in a collage to generate the color thresholds for the image segmentation function using Matlab’s color thresholder app. For this task Lab color space was chosen. The exported function was used to generate an infected area estimation using the following formula automatically:

Where

IA is the estimated infection area (%)

∑TIA is the total infected area in pixels

∑THA is the total holes and losses area in pixels 

TLA is the total leaf area in pixels (including healthy areas, infected areas, and leaf holes/losses)

Evaluating segmentation function

The segmentation function estimates of each sample and each genotype (as an average) were compared to their visualized counterparts with two-tailed Pearson’s correlation coefficient and regression.

Results and Discussion

The channel thresholds of the segmentation function were defined manually based on the presented arrangement (Fig. 1) in Lab color space on the images with omitted backgrounds (Fig. 2 A). The optimized thresholds were 4.015 to 47.209, 5.314 to 19.579, and 4.289 to 33.699 for L, a*, and b* channels, respectively. The image fill function was employed to fill the holes and losses caused by the studied disease. Binary masks for the total leaf area (Fig. 2 B) and the infected areas (Fig. 2 C) were generated, and the aggregated areas of each mask were measured to calculate the estimated infection percentile.

The validation of image processing techniques is usually carried out by comparing its results with actual results. These actual results might be visual inspection (expert inspections) [13] or manual image analysis [14]. The chosen actual values are then compared with image processing values via correlation (r) and regression (R²), which usually fall within the range of 0.7-1 in similar tasks [15]. Correlation and regression analysis showed that visual estimations were strongly correlated with their image segmentation counterparts with values of r = 0.91 (R² = 0.83) (Fig. 3 A) and r = 0.96 (R² = 0.92) (Fig. 3 B) for individual samples and genotype averages, respectively. Therefore, both values are comparable to previous works in the field [10]. Thus, the proposed system can be a reliable automated substitute for expert evaluation.

Previous research showed that other color spaces, such as HSV, outperformed Lab in color segmentation tasks [16]. However, the current work showed that Lab handled the studied problem adequately, corresponding to other research with similar tasks [17]. This observation might be due to the high flexibility of Lab in distinguishing between the brown (infected) and green (healthy) regions. The proposed system could only estimate the severity of both diseases (Anthracnose and blight) combined due to the high similarities between the two infections in terms of color. Therefore, a more elaborate system is needed to differentiate between the two diseases. Furthermore, the background isolation was feasible through simple color segmentation since images were acquired under lab conditions, with constant light intensity and mono-color background. Therefore, enhancing the system’s capability to handle noisy backgrounds might be an interesting goal. Both enhancements can be achieved through deep learning techniques and would render the system capable of carrying out reliable real-time field estimations of each disease individually.

Conflict of interest statement

The authors declared no conflict of interest.

Funding statement

The authors declared that no funding was received in relation to this manuscript.

Data availability statement

The codes and datasets used and developed in this article are available from the corresponding author upon reasonable request.

References

1	FAO statistical yearbook. Agricultural production. Food and Agriculture Organization of the United Nations. 2020.
2	Belisario A, Scotton M, Santori A, Onofri S. Variability in the Italian population of Gnomonia leptostyla, homothallism and resistance of Juglans species to anthracnose. For. Pathol. 2008; 38(2):129-45. DOI
3	Belisario A. Aspetti di eziologia, epidemiologia e difesa delle principali avversità patologiche del noce in Italia. Inf. Fitopatol. 2005;7(8):51-7.
4	Belisario A, Zoina A, Forti E, Barbieri G, Valier A. Epidemiological surveys of Gnomonia leptostyla in Juglans regia hedgerow trained orchard. Acta Hortic. 2001;544:405-8. DOI
5	Anagnostis A, Asiminari G, Papageorgiou E, Bochtis D. A convolutional neural networks based method for anthracnose infected walnut tree leaves identification. Appl. Sci. 2020;10(2):469. DOI
6	Berry FH. Walnut anthracnose. Vol. 85. US Department of Agriculture. Forest Service. 1981.
7	Frutos D. Bacterial diseases of walnut and hazelnut and genetic resources. Plant Pathol. 2010.
8	Sagawa CHc, Assis DRAB, Zaini PA, Wilmarth PA, Phinney BS, Moreira LM, Dandekar AM. Proteome analysis of walnut bacterial blight disease. Int. J. Mol. Sci. 2020; 21(20):7453. DOI
9	Singh V, Misra AK. Detection of plant leaf diseases using image segmentation and soft computing techniques. Inf. Process. Agric. 2017;4(1):41-9. DOI
10	Bock CH, Barbedo JG, Del Ponte EM, Bohnenkamp D, Mahlein AK. From visual estimates to fully automated sensor-based measurements of plant disease severity: status and challenges for improving accuracy. Phytopathol. Res. 2020;2(1):1-30. DOI
11	Shrivastava S, Singh SK, Hooda DS. Color sensing and image processing-based automatic soybean plant foliar disease severity detection and estimation. Multimed. Tools. Appl. 2015;74(24):11467-84. DOI
12	Cui D, Zhang Q, Li M, Hartman GL, Zhao Y. Image processing methods for quantitatively detecting soybean rust from multispectral images. Biosyst Eng. 2010;107(3):186-93. DOI
13	El Jarroudi M, Kouadio AL, Mackels C, Tychon B, Delfosse P, Bock CH. A comparison between visual estimates and image analysis measurements to determine Septoria leaf blotch severity in winter wheat. Plant Pathol. 2015;64(2):355-64. DOI
14	Peressotti E, Duchêne E, Merdinoglu D, Mestre P. A semi-automatic non-destructive method to quantify grapevine downy mildew sporulation. J. Microbiol. Methods. 2011;84(2):265-71. DOI
15	De Coninck BM, Amand O, Delauré SL, Lucas S, Hias N, Weyens G, Mathys J, De Bruyne E, Cammue BP. The use of digital image analysis and real‐time PCR fine‐tunes bioassays for quantification of Cercospora leaf spot disease in sugar beet breeding. Plant Pathol. 2012;61(1):76-84. DOI
16	Bora DJ, Gupta AK, Khan FA. Comparing the performance of L* A* B* and HSV color spaces with respect to color image segmentation. arXiv preprint. 2015. DOI
17	Niu X, Wang M, Chen X, Guo S, Zhang H, He D. Image segmentation algorithm for disease detection of wheat leaves. The 2014 International Conference on Advanced Mechatronic Systems. 2014;270-3. DOI

Cite this article:

Sallom, A., Alabboud, M. Evaluating image segmentation as a valid method to estimate walnut anthracnose and blight severity. DYSONA – Applied Science, 2023;4(1): 1-5. doi: 10.30493/das.2022.353877