MIA / Medical Image Annotation Platform

Building a human-in-the-loop machine learning system to make medical image annotation as enjoyable as possible.

Concept

Problem

Extracting segmentations from medical images is labour- and time-intensive. The scarcity of labelled medical image data poses a significant challenge to the medical machine-learning community.

Solution

MIA allows medical experts to utilize the potential of machine-learning to quickly provide segmentation suggestions for medical images. These can be reviewed and verified and then be used to enhance existing models, creating a positive feedback loop of continuous improvement.

MIA-Workflow

Accelerating Research

By providing a flexible way to manage datasets and an easy setup process, we allow researchers to focus on their actual task at hand.

Scalable Architecture

MIA can be used by both individuals and large research teams. Its microservice architecture allows for secure deployment on-premise.

Data Privacy

Medical image data requires special consideration for privacy. Data never has to leave the organisation when MIA is deployed on private clusters.

Manage your data easily

Create projects to organise your work and view images of datasets at a glance. Images can be annotated directly within the VISIAN editor.

Dataset imported into MIA Progress of a machine-learning job in MIA

Use Machine Learning

Upload and track machine learning models, that you can use in jobs to generate segmentations quickly. Improve existing models with new ground truth data.

Review annotations

Correct auto-generated annotations easily and verify segmentations to mark them as ground truth. MIA allows you to track your annotation progress effortlessly.

Brain scan in the Visian editor with a tumor segmentation mask

Architecture

MIA provides a standalone REST API and is also integrated into the VISIAN editor with a user interface.

Architecture of MIA

The Hub

is our system's central API, coordinating components, managing entities, storing metadata, handling image and annotation files, and queuing new jobs.

The Annotator

uses MLflow models to perform segmentation tasks, pulling jobs from a queue. Annotations are saved in the datastore and created as metadata entities in the hub.

MLflow

enables MIA with model storage, tracking, and deployment for smooth data inference. It offers diverse model flavors, ensuring flexibility and compatibility across frameworks.

Integrations & Collaborations

We collaborate with multiple organizations to advance the process of medical image segmentation.

AI4H Focus Group

MIA integrates with AI4H Focus Group's assessment platform as a pre-annotation engine. Researchers can use machine learning to quickly create segmentation suggestions. These can be collaboratively reviewed using the VISIAN Editor, facilitating a multi-user collaboration in establishing ground-truth data for unbiased AI models.

MDC

MDC researchers contributed their expertise and testing to develop MIA alongside VISIAN. As a result, MIA can now streamline their workflows with seamless dataset management and enable efficient review and annotation of numerous images.

VISIAN

Visian is a tool that empowers researchers to annotate and analyse MRI scans faster than ever before. Its aim is to enhance the work of scientists in various fields with new approaches, features and use of machine learning to enable better, faster and more qualitative research.

BMEII at Mount Sinai

By integrating the VISIAN editor with BMEII's medical imaging platform, we have leveraged mutual strengths to enhance both systems. This collaboration has provided us with extensive domain expertise and critical insight into user requirements, enabling us to further refine our approach to medical image analysis.

Team

We are students at the Hasso-Plattner-Institute who started working on MIA as part of our bachelor project in 2022/23 and continued the project in a seminar.

News

Bachelorpodium at HPI

Bachelorpodium at HPI

On July 6, at the 20th Bachelorpodium, HPI's soon-to-be graduates presented innovative software solutions developed in teams over two semesters with external partners. Our focus was on MIA, addressing challenges in manually segmenting medical image data and demonstrating its facilitative features.

Federal Minister of Health Karl Lauterbach visits HPI

Federal Minister of Health Karl Lauterbach visits HPI

On June 8, the Hasso Plattner Institute's Digital Health Cluster hosted the German Federal Minister of Health, Karl Lauterbach, as a guest. The focus of Prof. Karl Lauterbach's visit was an exchange about current research initiatives in the field of Digital Health and Artificial Intelligence, which included MIA.