Releases: foundation-model-stack/fms-guardrails-orchestrator
Releases · foundation-model-stack/fms-guardrails-orchestrator
0.10.0
What's Changed
- 🐛 Stream content tests and error handling fix by @mdevino in #350
- ✅ Integration tests for
/api/v2/chat/completions-detection
by @pmcjr in #360 - 📦 Bump openssl from 0.10.71 to 0.10.72 by @dependabot in #361
- 📦 Update Rust to 1.86 by @mdevino in #364
- 📦 Bump tokio from 1.44.1 to 1.44.2 by @dependabot in #365
- ✅ Single detector tests by @mdevino in #362
- ♻️ Task handlers by @declark1 in #355
- ➖ Drop faux by @mdevino in #374
- 🔥 Chunker client cleanup by @evaline-ju in #376
- 🦺 Guardrails request config validation by @mdevino in #371
- ✅ No detectors tests by @mdevino in #373
- ♻️ Refactor ChatCompletionsRequest by @declark1 in #375
- ✅ Tests cleanup by @mdevino in #379
- 🐛 Fix DetectionBatchStream by @declark1 in #381
- 👷 To support s390x by @Sanketha-Cr in #369
- ✨ Chat completions batcher by @evaline-ju in #380
- 🥅 Handle unsupported media type errors by @evaline-ju in #386
- 🐛 Allow input detection on whole input for streaming text generation endpoint by @evaline-ju in #388
- ♻️ server cleanups by @declark1 in #387
- 🧑💻 OpenAiClient updates & completions implementation by @declark1 in #390
- ✅ Implement re-try logic for TestOrchestratorServer port binding by @mdevino in #392
- 🚸 Batcher simplifications by @declark1 in #394
- 🦺 Validate message content on chat completions endpoint by @mdevino in #383
- 📦 Update Rust to 1.87.0 and dependencies by @mdevino in #404
New Contributors
- @Sanketha-Cr made their first contribution in #369
Full Changelog: 0.9.4...0.10.0
0.9.4
What's Changed
- 🛂 Add code of conduct by @spzala in #309
- 🐛 Accumulate DetectionResults for detections with same message_index in chat completions api by @swith004 in #310
- ⬆️ Bump hickory-proto from 0.24.2 to 0.24.3 by @dependabot in #300
- ⬆️ Bump openssl from 0.10.68 to 0.10.70 by @dependabot in #291
- ♻️ pre-refactor: A few type and organization tweaks by @declark1 in #325
- 🐛 process stream-content requests as ndjson (w/jsonlines) by @swith004 in #327
- 🐛 Use jsonlines as response in stream-content by @swith004 in #329
- ♻️ pre-refactor: Add orchestrator.types module with common types by @declark1 in #326
- ✅ Integration tests for input detection cases in
/api/v1/task/server-streaming-classification-with-text-generation
by @mdevino in #312 - ♻️ Refactor TestOrchestratorServerBuilder and TestOrchestratorServer to avoid mock server ownership by @declark1 in #333
- ✅ Integration tests for
/api/v2/text/detection/content
by @mdevino in #314 - 📝 ADR and API updates for additional detector fields by @evaline-ju in #334
- reverted response_stream processing and message json conversion for stream content detection by @swith004 in #336
- 📝 API update - add tools to chat detections by @evaline-ju in #335
- ♻️ Update existing integration tests to new mocktail API, add tests for
/api/v2/text/detection/generated
by @mdevino in #318 - ✅ Integration tests for input detections in
/api/v2/text/detection/context/
by @mdevino in #319 - ✅ Integration tests for
/api/v2/text/detection/chat
by @mdevino in #320 - ✅ Integration tests for
/api/v1/task/classification-with-text-generation
by @pmcjr in #340 - ✅ Output streaming integration tests by @mdevino in #342
- ✅ Generation with detection integration tests by @mdevino in #345
- pre-refactor: Add common.tasks and common.clients modules by @declark1 in #337
- 👷 Update CI checks by @mdevino in #346
- 📦 Update rust version by @mdevino in #347
- ✨ Add tools to standalone chat detection by @evaline-ju in #351
- ✨ Add metadata object by @gkumbhat in #353
- 👷 Healthcheck command for Dockerfile by @evaline-ju in #356
New Contributors
- @spzala made their first contribution in #309
- @dependabot made their first contribution in #300
Full Changelog: 0.9.3...0.9.4
0.9.3 - Output detection, CI improvements and DNS interval config
What's Changed
- 👷 removed most of the warnings from Dockerfile when running docker build by @resoluteCoder in #301
- 👷 added arg statement to each layer in Dockerfile by @resoluteCoder in #303
- ❇️ output detection for chat completions by @resoluteCoder in #288
- 🔧 Make grpc dns probe interval configurable per client by @gkumbhat in #306
Full Changelog: 0.9.2...0.9.3
0.9.2
What's Changed
- Add Role enum to openai module by @swith004 in #287
- Revert ":wrench: Assume http2 for grpc clients (#284)" by @evaline-ju in #293
- Add error handling for unknown fields for chat completion detection request by @swith004 in #296
Full Changelog: 0.9.1...0.9.2
0.9.1 - Fix http2 negotiation, error handling improvements and input detection on chat
What's Changed
- ✨ Add chat content detector (input detection only) by @gkumbhat in #276
- 🔧 Assume http2 for grpc clients by @evaline-ju in #284
- 🥅 Add error handling for unknown fields in orchestrator request by @swith004 in #285
- 🔧 Add header on detector requests by @evaline-ju in #283
Full Changelog: 0.9.0...0.9.1
0.9.0 - Client OpenTelemetry, bidirectional streaming content, deps update
What's Changed
- 📝 Document detector rules by @evaline-ju in #255
- ✨ Introduce tower service into clients by @evaline-ju in #259
- ✨ Client metric trace layers by @evaline-ju in #260
- 📝 OpenTelemetry docs by @evaline-ju in #264
- Expose modules and types publicly for integration tests, add ServiceConfig::new by @declark1 in #267
- ♻️ Combine tracing info logs by @evaline-ju in #269
- ♻️🔊 Update grpc client trace layer by @evaline-ju in #270
- Update chat_completions to stream ChatCompletionChunk messages by @declark1 in #268
- 🔥 Remove legacy tokenization client by @evaline-ju in #273
- Stream content endpoint by @mdevino in #272
- Bug fix - added json header to detector client response by @resoluteCoder in #279
- ⬆️ Upgrade Rust and project dependencies by @evaline-ju in #281
- ⬆️♻️ Update open telemetry dependencies by @evaline-ju in #282
- Add detector_id in response for orchestrator apis by @swith004 in #278
New Contributors
API update
detector_id
is now included in orchestrator responses, to allow users to easily attribute each detection to a detector
Full Changelog: 0.8.0...0.9.0
0.8.0
What's Changed
- 🐛 Fix threshold getting passed through beyond orchestrator proces… by @gkumbhat in #236
- ✨🐛 Pass on non-threshold detector parameters by @evaline-ju in #235
- ✨ Integrate telemetry client instrumentation and traceparent propagation in orchestrator by @pscoro in #231
- ✨ Add OpenAiClient stream handling, update types by @declark1 in #230
- added error messages to various unwraps by @resoluteCoder in #243
- ✨ Implement Chat Completions API by @declark1 in #240
- 📝 Streaming content API by @evaline-ju in #246
- 🐛 Update stream content API with intended response by @evaline-ju in #251
- 🐛 added ability to cancel streaming generation when client disconnects by @resoluteCoder in #254
- 🔧 Migrate clients implementation from
reqwest
tohyper
by @pscoro in #252
New Contributors
- @resoluteCoder made their first contribution in #243
Full Changelog: 0.7.0...0.8.0
0.7.0
What's Changed
- 🔧 Remove context from chat endpoint in detector API by @evaline-ju in #222
- 🔧 Add detector_params as optional for every detectors endpoint by @evaline-ju in #212
- Client refactor by @declark1 in #220
- Initial opentelemetry setup for orchestrator by @pscoro in #221
- 🐛 Fix whole_doc_chunker missing from client list by @gkumbhat in #229
- Add missing licence comments on recent new files by @pscoro in #232
- Chat standalone endpoint by @mdevino in #233
Main config change
detectors:
# Detector ID/name to be used in user requests
hap-en:
# Detector type (text_contents, text_generation, text_chat, text_context_doc)
type: text_contents # <----- (1) Add a detector type!
service:
hostname: localhost # <--- (2) No longer requires the full URL, just the base hostname
port: 8080
Full Changelog: 0.6.0...0.7.0
0.6.0
What's Changed
- 💡 Add config description by @evaline-ju in #186
- 🧪 Add axum-test package for integration tests by @mdevino in #188
- ✨ Detection result ordering by start span by @evaline-ju in #190
- 🔊 Add http error source logging by @gkumbhat in #199
- ♻️ Re-order endpoints and add tags by @evaline-ju in #201
- ✅ 🧪 Prepare integration tests for stateful request handling without mocking orchestrator by @pscoro in #200
- 📝 Document APIs and server config in README by @evaline-ju in #204
- 🦯 🧑⚕️ Orchestrator HTTP/gRPC health checks and health readiness probe by @pscoro in #183
- 📝 Document
/health
detector endpoint by @mdevino in #207 - 📝✨ Add API for detections on chat completions and ADR by @evaline-ju in #209
- 🔧 Update standalone chat detections API by @evaline-ju in #211
- 🔧 Turnoff default health check by @gkumbhat in #216
- 🐛 Fix the config path CLI arg's corresponding env variable to match the documentation by @pscoro in #219
- ✨ Add header passthrough for NLP and detector clients by @gkumbhat in #214
Full Changelog: 0.5.0...0.6.0
0.5.0 - Updated chunker API, improved streaming
What's Changed
- Orchestrator Service Config Validation by @pscoro in #176
- 🐛 whole doc chunker streaming hang by @declark1 in #182
- ♻️ Refactor aggregator architecture by @declark1 in #154
- 🏷️ Update based on open-sourced types by @evaline-ju in #185
New Contributors
Full Changelog: 0.4.1...0.5.0