Transfer Learning in Polyp and Endoscopic Tool Segmentation from Colonoscopy Images

Authors

  • Nefeli Panagiota Tzavara National Technical University of Athens
  • Bjørn-Jostein Singstad University of Oslo

DOI:

https://doi.org/10.5617/nmi.9132

Keywords:

Polyp segmentation, Transfer learning, HyperKvasir, Convolutional neural networks, MedAI challenge

Abstract

Colorectal cancer is one of the deadliest and most widespread types of cancer in the world. Colonoscopy is the procedure used to detect and diagnose polyps from the colon, but today's detection rate shows a significant error rate that affects diagnosis and treatment. An automatic image segmentation algorithm may help doctors to improve the detection rate of pathological polyps in the colon. Furthermore, segmenting endoscopic tools in images taken during colonoscopy may contribute towards robotic assisted surgery. In this study, we trained and validated both pre-trained and not pre-trained segmentation models on two different data sets, containing images of polyps and endoscopic tools. Finally, we applied the models on two separate test sets and the best polyp model got a dice score 0.857 and the test instrument model got a dice score 0.948. Moreover, we found that pre-training of the models increased the performance in segmenting polyps and endoscopic tools.

Downloads

Published

2021-11-01 — Updated on 2021-11-16

Versions