T-MIS: Transparency Adaptation in Medical Image Segmentation


  • Ayush Somani UiT The Arctic University of Norway
  • Divij Singh Indian Institute of Technology (BHU), Varanasi
  • Dilip K. Prasad UiT The Arctic University of Tromsø
  • Alexander Horsch UiT The Arctic University of Tromsø




Image segmentation, Medical imaging, Transparency, Deep learning, Image Processing


We often locate ourselves in a trade-off situation between what is predicted and understanding why the predictive modeling made such a prediction. This high-risk medical segmentation task is no different where we try to interpret how well has the model learned from the image features irrespective of its accuracy. We propose image-specific fine-tuning to make a deep learning model adaptive to specific medical imaging tasks. Experimental results reveal that: a) proposed model is more robust to segment previously unseen objects (negative test dataset) than state-of-the-art CNNs; b) image-specific fine-tuning with the proposed heuristics significantly enhances segmentation accuracy; and c) our model leads to accurate results with fewer user interactions and less user time than conventional interactive segmentation methods. The model successfully classified ’no polyp’ or ’no instruments’ in the image irrespective of the absence of negative data in training samples from Kvasir-seg and Kvasir-Instrument datasets.

Author Biography

Ayush Somani, UiT The Arctic University of Norway

Ph.D. Fellow, Department of Computer Science