Back to projects

2024 · Completed

AIGTatt

A research-style course project written under BIOSIG-style guidelines, using AI-generated tattoos to train and evaluate biometric tattoo recognition models.

Project cover for AIGTatt.

Overview

AIGTatt was a research-style course project written in the format of a BIOSIG 2024 paper. It explored whether fully synthetic tattoo data could help address the scarcity and privacy constraints of public tattoo datasets used in biometric recognition research.

The dataset pipeline generated structured tattoo prompts with GPT-4 Turbo, produced tattoo images through SDXL and a tattoo-specific fine-tuned SDXL model, cropped the tattoo regions, and created realistic variations with rotation, scale, brightness, noise, and other augmentations. The final study used 250 isolated tattoo identities and 5,000 variations.

The retrieval experiments trained EfficientNetV2 and Swin embedding models with ArcFace-style objectives, then evaluated them on real-world tattoo datasets including WebTattoo and BIVTatt. The work showed that synthetic tattoo data can bootstrap recognition systems, while also making clear that larger and more diverse datasets are needed for stronger generalization.

Highlights

  • Created AIGTatt, a fully synthetic tattoo dataset with 250 unique AI-generated tattoos and 5,000 augmented variations.
  • Fine-tuned SDXL for tattoo generation and compared DALL-E 3, Stable Diffusion 2.1, Stable Diffusion 3, SDXL, and the fine-tuned SDXL model.
  • Trained EfficientNetV2 and Swin tattoo retrieval models, reaching top-20 identification rates around 95% on WebTattoo and 98% on BIVTatt.