Skip to content

Consider allowing A, B, C, D, etc. enumerations of questions options to be consistent with some evals #1222

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
johnjosephhorton opened this issue Oct 31, 2024 · 1 comment · May be fixed by #1853
Open

Consider allowing A, B, C, D, etc. enumerations of questions options to be consistent with some evals #1222

johnjosephhorton opened this issue Oct 31, 2024 · 1 comment · May be fixed by #1853
Assignees
@johnjosephhorton
Labels
claude A task for claude to do enhancement New feature or request

Comments

@johnjosephhorton
Copy link
Contributor

No description provided.

@johnjosephhorton johnjosephhorton added the enhancement New feature or request label Oct 31, 2024
@johnjosephhorton johnjosephhorton self-assigned this Oct 31, 2024
@johnjosephhorton johnjosephhorton added the claude A task for claude to do label Apr 5, 2025
@johnjosephhorton
Copy link
Contributor Author

Claude Instructions

Right now, in question/questions_multiple_choice.py, if a code is used, the options are enumerated with 0, 1, 2, 3 ... and so on. I'd like to re-factor so that the user can control this with various options such as:

  • a) b), c)
  • a], b], c]
  • a: , b: , c:
  • A, B, C (and all the variancts above)
  • Starting from 1 instead of 0

This could be done by passing optional arguments to the QuestionMultipleChoice, QuestionCheckBox, and so on. It would be important that these options be decoded to generate the answers.

johnjosephhorton added a commit that referenced this issue Apr 6, 2025
@johnjosephhorton
Add letter enumeration support for multiple choice questions
59649a8 
- Add enumeration_style parameter with "numeric" and "letter" options
- Update templates to support A, B, C style option labeling
- Handle letter responses in validation and answer processing
- Add tests for the new functionality

Fixes #1222 - Allow A, B, C, D enumerations of question options

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@johnjosephhorton johnjosephhorton linked a pull request Apr 6, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@johnjosephhorton johnjosephhorton

Labels
claude A task for claude to do enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Allow A, B, C, D enumeration of question options expectedparrot/edsl
1 participant
@johnjosephhorton