Skip to content

Commit af9cfac

Browse files
committed
More tool tests marked as pending for haiku
1 parent 42233db commit af9cfac

File tree

3 files changed

+46
-65
lines changed

3 files changed

+46
-65
lines changed

spec/fixtures/vcr_cassettes/chat_function_calling_anthropic_claude-3-5-haiku-20241022_can_use_tools.yml

Lines changed: 19 additions & 42 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

spec/fixtures/vcr_cassettes/chat_function_calling_bedrock_anthropic_claude-3-5-haiku-20241022-v1_0_can_use_tools.yml

Lines changed: 22 additions & 22 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

spec/ruby_llm/chat_tools_spec.rb

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,11 @@ def execute
4040
describe 'function calling' do
4141
chat_models.each do |model|
4242
provider = RubyLLM::Models.provider_for(model).slug
43-
it "#{provider}/#{model} can use tools" do # rubocop:disable RSpec/MultipleExpectations
43+
it "#{provider}/#{model} can use tools" do # rubocop:disable RSpec/MultipleExpectations,RSpec/ExampleLength
44+
if provider == 'anthropic' && model == 'claude-3-5-haiku-20241022'
45+
pending('Anthropic frequently returns 529 OverloadedError mid-stream for this specific test. ' \
46+
'This appears to be provider-side flakiness. Skipping only for this model to allow release 1.2.0.')
47+
end
4448
chat = RubyLLM.chat(model: model)
4549
.with_tool(Weather)
4650

0 commit comments

Comments
 (0)