Skip to content

Remove broken model #1346

@rogthefrog

Description

@rogthefrog

This error happens frequently in the smoke test:

modelgauge.dynamic_sut_factory.ModelNotSupportedError: Model meta-llama/Llama-3-70b-chat-hf not found or not available on together: Error code: 503 - The server is overloaded or not ready yet.

  1. swap out the model in the dynamic factory test since we dont need to be testing any specific model.
  2. possibly remove the static sut as well if its not on together anymore

Metadata

Metadata

Assignees

Labels

choreShould do it, but it doesn't directly create value

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions