|
Hey there, Happy Sunday! I have a small request. If you haven't already, please fill out this 1-minute survey about your expectations from Medical Notes. Your feedback is crucial to me. Alternatively, you can react with 👍 or 👎 on the bottom of this email. Thanks! Almost 30 million Americans suffer from diabetes and its prevalence is steadily rising. One of its major complications, diabetic retinopathy (DR), is present in about 30% of diabetics. If left untreated, it leads to blindness. To prevent it, diabetics are involved in yearly screening programs and checkups. However, we can only assume that the prevalence of diabetes and thus DR will continue to rise. And as stated many times before, the number of doctors simply cannot follow up to the demand. That's why AI and other digital technologies are on the rise and why countless studies are conducted on the topic. Google took on the challenge by funding one of the most impactful papers from 2016, boasting with almost 5000 citations and more than 153 highly influential ones since. They wanted to show how DR screening could be automated with deep learning and (convolutional) neural networks. Achieving even some form of automation would be very positive for screening efficiency and reproducibility. Not to mention, it would significantly improve patient access. 💡 A neural network is a computer model inspired by the human brain that learns to recognize patterns and solve problems. A convolutional neural network is a specialized type designed specifically for handling images, learning visual patterns directly from pixels with minimal preprocessing. Developing the algorithmThe study was similar to The Panda Challenge, except for the competition part. The researchers used 3 data sets - one for training the algorithm and two for clinical validation. Multiple ophthalmologists in turn graded all images for DR on a scale from 1 to 5. A deep learning function separately graded the severity of DR based on intensities of the pixels on fundus images and used ophthalmologists' diagnoses to train itself. ResultsAfter training the algorithm on almost 130K fundus images and validating it on two separate image sets, the researchers determined its performance. They used different operating points, and evaluated its specificity and sensitivity for each. 💡 An operating point in this case refers to a specific threshold or configuration of the algorithm's parameters, which determines how it classifies images as positive or negative. In the case of screening for DL, it's crucial for the algorithm to have high sensitivity, which is also how the operating points were chosen. The end result was 97.5% sensitivity and 93.4% specificity. The results indeed confirmed that deep neural networks can be trained to identify DR in retinal fundus images with high sensitivity and specificity. 💡 Sensitivity measures a test's ability to correctly identify those with a condition (true positives), whereas specificity measures its ability to correctly identify those without the condition (true negatives). Limitations and epilogueThe effectiveness of every algorithm is dependent on the data that we feed it. As a result, if the majority of ophthalmologists wouldn't be able to recognize the images, nor could the algorithm. Though unlikely, there's room for potential errors. Furthermore, deep networks learn by themselves, so it's possible the algorithm is using image features unknown to humans. Given that it's trained to only detected diabetic DR, it could also miss other (but similar) diseases, such as non-diabetic DR. It thus cannot fully replace a comprehensive eye examination. The epilogue of this paper is especially interesting and exciting. After publishing it, Google partnered with its healthcare branch Verily to put theory into practice. In 2019, they launched a screening system in India, using the findings from this study and an application called ARDA (Automated Retinal Disease Assessment) to help prevent blindness caused by DR. They demonstrated that it is in fact possible to (partially) automate DR screening and apply it in a clinical setting. It certainly helps if you're Google.
Accuracy of a Deep Learning Algorithm for Detection of Diabetic Retinopathy
This study assesses the sensitivity and specificity of an algorithm based on deep machine learning for automated detection of diabetic retinopathy and diabetic macular edema in retinal fundus photographs.
Thanks for reading. It takes me 10+ hours to find and summarize these papers every week. If you enjoyed it: - Please forward it to a friend. It takes ten seconds and makes a big difference. They can subscribe here.
- React and comment using the buttons below and fill out this 1-minute survey.
- Spotted an error? Let me know by replying.
See you next week, Martin
This summary is based on research from the article Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs by Gulshan V, Peng L, Coram M, et al. published in JAMA. The original work is freely available and licensed under the Creative Commons Attribution 4.0 International License. Adaptations and summaries are provided by Medical Notes and are not endorsed by the original authors or publisher.
|
