Skip to content

Release 0.9.7

Pre-release
Pre-release
Compare
Choose a tag to compare
@ciprianjichici ciprianjichici released this 10 Jun 11:26
0.9.7
1440847
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

FoundationaLLM 0.9.7 Pre-Release Notes

Introduction

Welcome to FoundationaLLM version 0.9.7! This release includes new features, enhancements, performance improvements and bug fixes. Below is a detailed summary of the changes.

Enhancements and Features

New Agent Types

  • In this first release of model agnostic agents, we are introducing a new way to create agents that are not tied to a specific language model or to the OpenAI Assistants API and can use any function calling model to invoke tools. Supported models include GPT models and Claude models, with support for Gemini coming soon.
  • Agents can now also be created that directly invoke agents created in Azure AI Foundry Agent Service.
  • Agents can be created that utilize the Azure AI Inference API to invoke models from Azure AI Foundry.

New Tools

New tools for agents to use include:

  • KnowledgeTool for performing file search and vector data store retrieval.
  • Code Interpreter tool allows for code execution in the conversation, using Azure Container Apps dynamic sessions or custom containers.
  • SQL Tool allows for the execution of SQL queries against a database.
  • KQL Tool allows for the execution of KQL queries against a Kusto database.
  • File Analysis Tool allows for the analysis of Parquet files in cloud storage.

Data Pipelines

  • Data Pipelines allow for the creation of data pipelines that can be used to transform and prepare data for use by the agent. These are used transparently by the file upload capability in the user portal, and can be used via the API programmatically.

Semantic Cache & Prompt Rewriting

  • Semantic cache, configurable in the Management Portal, reduces the number of calls to the language model when enabled.
  • Prompt rewriting, configurable in the Management Portal, enables better tool behavior in conversations and better cache hits with the semantic cache by using an LLM to rewrite the user prompt before sending it on.

Quota Management

  • Quota support for Core API raw requests by count and agent completion requests by count

Agent Test Harness

  • Automate the execution of prompts defined in a CSV against an agent, includes support for file uploads.

Improvements

  • Agents now have a notion of history of files uploaded to the agent and can be asked about the files available to them.
    Various improvements to the user experience in the User Portal and the Management Portal.
  • Performance improvements to the authorization cache.

Contact Information

For support and further inquiries regarding this release, please reach out to us:

Conclusion

We hope you enjoy the new features and improvements in FoundationalLLM version 0.9.7. Your feedback continues to be instrumental in driving our product forward. Thank you for your continued support.

Assets 2
Loading