GitHub · Where software is built

Labels Milestones New issue

[BFCL] benchmark leaderboard isn't the same as GitHub

#1140

· willleeney opened

on Jul 31, 2025

[Apibench] Evaluation Metrics Confusion

#1139

· Dipto084 opened

on Jul 30, 2025

[BFCL] Error in Multi-turn-base ID 75: Misspelling in question propagates into ground truth: causes LLMs to mistakenly fail across the board

#1137

· viyercal opened

on Jul 29, 2025

[feature] Host datasets on the Hugging Face Hub

#1136

· lewtun opened

on Jul 28, 2025

[BFCL] More flexibly run any model, without a model config present.

#1134

· aaronvg opened

on Jul 25, 2025

[BFCL] Multiple Ground Truth and Evaluation Inconsistencies in BFCL Benchmark

#1133

· JakobGr opened

on Jul 25, 2025

[BFCL] Extending Model support for Gemma Based models using Google AI Studio(API Option)

#1118

· prasad-yashdeep opened

on Jul 17, 2025

[BFCL] Gemma Prompt Structure

#1116

· mitchelldehaven opened

on Jul 16, 2025

[BFCL] The results of local_inference for Qwen/Qwen3-8B-FC are difficult to match the api_inference version of qwen3-8B-FC

#1109

· zkangning opened

on Jul 10, 2025

[BFCL] Reproduction results for Llama-xLAM-2-8b-fc-r do not match the report

#1105

· LTEnjoy opened

on Jul 8, 2025

[BFCL] Inference by prompting takes more time than inference by native FC

#1095

· praveena2j opened

on Jul 3, 2025

[BFCL] Verification Needed for Live-relevance Data and Ground Truth

#1094

· lanx7 opened

on Jul 3, 2025