Dermatolog AI Scan application

25 February 2026

The privacy first application that helps in early skin cancer identification takes part in The MedGemma Impact Challenge at Kaggle.

While approximately 1 in 5 Americans will develop some form of skin cancer by the age of 70 [src], when caught early, skin cancer is one of the most highly preventable and treatable forms of cancer [src].

Simultaneously, we are seeing increasing concerns about sensitive data leakage and the need for greater control over the geographical location where data is processed. These factors collectively highlight the necessity of minimizing the data footprint.

The Dermatolog AI Scan application offers a solution to these challenges by implementing a lesion scanner that assesses tumor risk while ensuring user privacy. The application utilizes the newest MedGemma AI model family, specifically MedSigLIP for image classification, and stores absolutely zero user data on the server.

Additionally it allows the user to freely install on any geographic locations, or even execute AI inference locally. The solution is also designed as a template for next-generation clinical applications with privacy prioritized.

Overall solution

The core of the application is the MedSigLIP model embedded into one page application of stateless design with several privacy focused characteristics. Application performs classification to identify 11 dermatological conditions (that can be easily extended).

MedSigLIP also serves to generate Grad-CAM heatmaps (Saliency Maps) to visually indicate the specific areas of an image the AI focused on when making a prediction, thereby contributing to Explainable AI.

Results are interpreted for a quick assessing confidence with a special case for malignant tumor and to provide high-confidence malignancy reports even if the model does not decide on the exact cancer type.

Privacy-first capabilities

  • Images are processed as DataURLs in the browser's memory; the backend processes them entirely in-memory without ever writing image files to the server's disk.
  • Session-based isolation: each user is assigned a unique session, ensuring that their images and analysis results are isolated and disappear when the session is cleared or the browser tab is closed.
  • No need for authentication.
  • Local or server deployment options: designed to run locally or on private cloud instances to maintain patient data sovereignty.

Bit more on technical details

  • Local inference with google/medsiglip-448 MedGemma family model.
  • Automatic lesion detection with YOLOv8-Nano for smart cropping aimed for optimized preprocessing image format.
  • One page, all device friendly, with timeline navigation.
  • Supports drag-and-drop, direct clipboard pasting, and device camera support.
  • Debug mode with calibration settings.

Thank you

Links

blog comments powered by Disqus
back to top