Skip to content

Conversation

@Dornavineeth
Copy link
Collaborator

What does this PR do?

  • Adds support for model handlers beyond AutoModelForCausalLM
  • Support Probe models
  • Added support for evaluation on paraphrased questions on tofu
  • Define batch_size as global variable in eval.tofu.batch_size

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Have you gone through the contributions guide?
  • Are your changes documented? Read documentation guidelines here.

@Dornavineeth Dornavineeth merged commit 679dd0d into locuslab:main May 22, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants