Kankanet: An artificial neural network-based object detection smartphone application and mobile microscope as a point-of-care diagnostic aid for soil-transmitted helminthiases

Background Endemic areas for soil-transmitted helminthiases often lack the tools and trained personnel necessary for point-of-care diagnosis. This study pilots the use of smartphone microscopy and an artificial neural network-based (ANN) object detection application named Kankanet to address those two needs. Methodology/Principal findings A smartphone was equipped with a USB Video Class (UVC) microscope attachment and Kankanet, which was trained to recognize eggs of Ascaris lumbricoides, Trichuris trichiura, and hookworm using a dataset of 2,078 images. It was evaluated for interpretive accuracy based on 185 new images. Fecal samples were processed using Kato-Katz (KK), spontaneous sedimentation technique in tube (SSTT), and Merthiolate-Iodine-Formaldehyde (MIF) techniques. UVC imaging and ANN interpretation of these slides was compared to parasitologist interpretation of standard microscopy.Relative to a gold standard defined as any positive result from parasitologist reading of KK, SSTT, and MIF preparations through standard microscopy, parasitologists reading UVC imaging of SSTT achieved a comparable sensitivity (82.9%) and specificity (97.1%) in A. lumbricoides to standard KK interpretation (97.0% sensitivity, 96.0% specificity). The UVC could not accurately image T. trichiura or hookworm. Though Kankanet interpretation was not quite as sensitive as parasitologist interpretation, it still achieved high sensitivity for A. lumbricoides and hookworm (69.6% and 71.4%, respectively). Kankanet showed high sensitivity for T. trichiura in microscope images (100.0%), but low in UVC images (50.0%). Conclusions/Significance The UVC achieved comparable sensitivity to standard microscopy with only A. lumbricoides. With further improvement of image resolution and magnification, UVC shows promise as a point-of-care imaging tool. In addition to smartphone microscopy, ANN-based object detection can be developed as a diagnostic aid. Though trained with a limited dataset, Kankanet accurately interprets both standard microscope and low-quality UVC images. Kankanet may achieve sensitivity comparable to parasitologists with continued expansion of the image database and improvement of machine learning technology.
Author summary For rainforest-enshrouded rural villages of Madagascar, soil-transmitted helminthiases are more the rule than the exception. However, the microscopy equipment and lab technicians needed for diagnosis are a distance of several days’ hike away. We piloted a solution for these communities by leveraging resources the villages already had: a traveling team of local health care workers, and their personal Android smartphones. We demonstrated that an inexpensive, commercially available microscope attachment for smartphones could rival the sensitivity and specificity of a regular microscope using standard field fecal sample processing techniques. We also developed an artificial neural network-based object detection Android application, called Kankanet, based on open-source programming libraries. Kankanet was used to detect eggs of the three most common soil-transmitted helminths: Ascaris lumbricoides, Trichuris trichiura, and hookworm. We found Kankanet to be moderately sensitive and highly specific for both standard microscope images and low-quality smartphone microscope images. This proof-of-concept study demonstrates the diagnostic capabilities of artificial neural network-based object detection systems. Since the programming frameworks used were all open-source and user-friendly even for computer science laymen, artificial neural network-based object detection shows strong potential for development of low-cost, high-impact diagnostic aids essential to health care and field research in resource-limited communities.