[Feature] DocSum Guardrails

[daniel-de-leon-user293]

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon, Gaudi2 & Gaudi 3

Running nodes

Single Node

Description

DocSum is catered for enterprise usage but does not offer configurable guardrails to protect company confidential and personally identifiable information. This feature provides users with the option to enable static and agentic guardrails to protect from outputting sensitive information.

[joshuayao]

Hi @daniel-de-leon-user293 will you continue to contribute for this feature?