AI Model Text Classification Resource

Description

The resource is used to fetch and invoke a text classification model for Gravitee gateway policies. Models are fetched from Hugging Face.

Compatibility

AI Model Text Classification Resource plugin	APIM
1.x	4.8.x

Notice

This plugin exposes models based on meta LLama 4:

• gravitee-io/Llama-Prompt-Guard-2-22M-onnx

• gravitee-io/Llama-Prompt-Guard-2-86M-onnx

Llama 4 is licensed under the Llama 4 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.

Available models

The AI model text classification resource provides the following models:

• minuva/MiniLMv2-toxic-jigsaw-onnx

• gravitee-io/detoxify-onnx

• gravitee-io/distilbert-multilingual-toxicity-classifier

• gravitee-io/Llama-Prompt-Guard-2-22M-onnx

• gravitee-io/Llama-Prompt-Guard-2-86M-onnx

In addition to the models above, we’ve added 3 new lightweight models: - gravitee-io/bert-tiny-toxicity - gravitee-io/bert-mini-toxcity - gravitee-io/bert-small-toxcity

Note	The models are not included in the resource package. The resource automatically downloads the models from Hugging Face when they are not available locally. The Models files are stored in $GRAVITEE_HOME/models directory. Ensure that the user that runs the Gateway can write in that directory.

Warning

Models are loaded in memory. You may need to increase the memory (Java Heap size and Kubernetes resource limits) of the Gateway to avoid any OutOfMemory error. The increase depends on the model size and the number of APIs that use the resource.