Crop recognition under weedy conditions based on 3D imaging for robotic weed control

Li, Ji
Tang, Lie
Tang, Lie
Journal Title
Journal ISSN
Volume Title
Tang, Lie
Research Projects
Organizational Units
Journal Issue

A 3D time‐of‐flight camera was applied to develop a crop plant recognition system for broccoli and green bean plants under weedy conditions. The developed system overcame the previously unsolved problems caused by occluded canopy and illumination variation. An efficient noise filter was developed to remove the sparse noise points in 3D point cloud space. Both 2D and 3D features including the gradient of amplitude and depth image, surface curvature, amplitude percentile index, normal direction, and neighbor point count in 3D space were extracted and found effective for recognizing these two types of plants. Separate segmentation algorithms were developed for each of the broccoli and green bean plant in accordance with their 3D geometry and 2D amplitude characteristics. Under the experimental condition where the crops were heavily infested by various types of weed plants, detection rates over 88.3% and 91.2% were achieved for broccoli and green bean plant leaves, respectively. Additionally, the crop plants were segmented out with nearly complete shape. Moreover, the algorithms were computationally optimized, resulting in an image processing speed of over 30 frames per second.

<p>This is the peer-reviewed version of the following article: Li, Ji, and Lie Tang. "Crop recognition under weedy conditions based on 3D imaging for robotic weed control." <em>Journal of Field Robotics</em> 35, no. 4 (2018): 596-611, which has been published in final form at DOI: <a href="" target="_blank">10.1002/rob.21763</a>. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.</p>
3D point cloud, machine vision, plant recognition, robotic weed control