multilingual-pii-detection

An API for the Personally Identifiable Information detection task

Installation

Build llamafile container

cd containers/llamafile

podman build -t gemma3-it-llamafile .

Run instances

podman run --device "nvidia.com/gpu=0" -p 8080:8080 localhost/gemma3-it-llamafile:latest

podman run --device "nvidia.com/gpu=0" -p 8081:8080 localhost/gemma3-it-llamafile:latest

podman run --device "nvidia.com/gpu=1" -p 8082:8080 localhost/gemma3-it-llamafile:latest