v0.3.6

What's Changed

• Feature/chrf score by @kauabh in #2221
• Fix/asyncio by @anistark in #2294
• Fix: update simple RAG init to use embed_text(s) (docs) by @s3pi in #2292
• Update _bleu_score.py by @kauabh in #2297
• Refactor/update gemini to genai sdk by @sahusiddharth in #2240
• Feature/metrics input flexibility by @anistark in #2298
• Ensure old_temperature is set correctly. Fixes #1937 and #2110 by @claudepi in #2295
• Enhance EmbeddingExtractor to support both async and sync methods for… by @telesoho in #2286
• Tokens counting by @anistark in #2299
• Fix/tool call accuracy by @anistark in #2300
• fix: coroutine warning for bleu by @anistark in #2301
• Add base_url parameter to embedding_factor by @anistark in #2303
• fix: add disallowed_special on tiktoken encode by @anistark in #2304
• Feat/tool call f1 1893 by @anistark in #2305
• Feature/azure token usage extraction by @anistark in #2306
• fix: improve metric decorators with better validation and error handling by @jjmachan in #2302
• Metric/parallel tool call by @anistark in #2307
• Fix: avoid ambiguous truth value for empty numpy array in HuggingfaceEmbeddings (fixes #2080) by @Rahul2512Chauhan in #2308
• Devpod cn/main by @anistark in #2309
• Feat/quoted spans metric by @anistark in #2311
• Fix noise sensitivity compute by @anistark in #2312
• Corrected numerous typos in Markdown files. by @ker2xu in #1994
• Deprecation warnings for LLMs and Prompts by @rhlbhatnagar in #2253
• Docs/eval_rag_agent - how to evaluate and improve rag app by @sanjeed5 in #2293
• Add llamaindex agentic evals gemini by @anistark in #2317
• fix: type str in tests by @anistark in #2318
• Fix generate_multiple caching issue (#1980) by @Rahul2512Chauhan in #2314
• fix: metric inheritance patterns: separate factory-created metrics from class-instantiated metrics by @jjmachan in #2316
• fix: concurrent ResponseRelevancy by @anistark in #2328
• fix: answer_relevancy scoring logic to prevent false zero by @anistark in #2327
• feat: Add OCI Gen AI Integration for Direct LLM Support by @harshil-sanghvi in #2321
• feat: Add save/load functionality and improved repr for LLM-based metrics by @jjmachan in #2320
• Fix: Fixed the Numpy 3.13 issue by @Prigoistic in #2282
• refactor: docs and warnings for metric base new structure by @anistark in #2333
• fix: typing by @anistark in #2334

New Contributors

• @kauabh made their first contribution in #2221
• @s3pi made their first contribution in #2292
• @claudepi made their first contribution in #2295
• @telesoho made their first contribution in #2286
• @ker2xu made their first contribution in #1994
• @harshil-sanghvi made their first contribution in #2321
• @Prigoistic made their first contribution in #2282

Full Changelog: v0.3.5...v0.3.6