Add GPU Support for GLiNERRecognizer and Validator Module for PII Detection #13
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request introduces GPU support for the
GLiNERRecognizer
class and updates thevalidator
module to allow GPU usage for PII detection. The changes include adding ause_gpu
parameter, determining the device for model inference, and ensuring the model is loaded and executed on the appropriate device.GPU Support for
GLiNERRecognizer
:use_gpu
parameter to theGLiNERRecognizer
constructor to enable or disable GPU usage. The_get_device
method determines whether to use a GPU or CPU based on availability and theuse_gpu
flag. (validator/gliner_recognizer.py
, [1] [2]load
method to move the model to the appropriate device and set it to evaluation mode if GPU is used. (validator/gliner_recognizer.py
, validator/gliner_recognizer.pyR24-R44)analyze
method to ensure the model is on the correct device and to disable gradients during inference for efficiency. (validator/gliner_recognizer.py
, validator/gliner_recognizer.pyR24-R44)Integration with
validator
Module:use_gpu
parameter to theValidator
class constructor and passed it to theGLiNERRecognizer
instance whenuse_local
is enabled. (validator/main.py
, [1] [2] [3]