Skip to content

Add getter functions for TLM defaults #59

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 17 commits into from
May 4, 2025
Merged

Add getter functions for TLM defaults #59

Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
4e24abc
Init
AshishSardana Apr 28, 2025
65278e4
Fix lint
AshishSardana Apr 28, 2025
e1b7162
Add tests for default context limit
AshishSardana May 1, 2025
ee94b0e
Bump version
AshishSardana May 1, 2025
53382fb
Update CHANGELOG
AshishSardana May 1, 2025
cc91018
Linting
AshishSardana May 1, 2025
8a528bd
Add test for `get_default_quality_preset` and update word_to_token
AshishSardana May 2, 2025
d456a60
Update existing tests to use WORD_THAT_EQUALS_ONE_TOKEN instead of "a"
AshishSardana May 2, 2025
c132348
Add test for `get_default_max_tokens()`, introduce constant `_DEFAULT…
AshishSardana May 2, 2025
0b9c607
Add type checks
AshishSardana May 2, 2025
5d14592
Fix type check error
AshishSardana May 2, 2025
8521516
Assert return type of single prompt to TLM
AshishSardana May 2, 2025
9045cf5
Use "hello " instead of "no " as some tests depend on characters base…
AshishSardana May 2, 2025
71c802e
Revert to assertion string used throughout `test_validation`
AshishSardana May 3, 2025
43f6628
Catch error in fetching tokenizer of newer GPT (4.1-mini, etc.) models
AshishSardana May 3, 2025
23605da
Specify error to catch
AshishSardana May 3, 2025
3608f9c
We need 4 character = 1 token to satisfy both (character counter, act…
AshishSardana May 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion tests/constants.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,8 @@
MAX_COMBINED_LENGTH_TOKENS: int = 70_000

CHARACTERS_PER_TOKEN: int = 4
WORD_THAT_EQUALS_ONE_TOKEN = "hello " # noqa: S105
# 4 character (3 character + 1 space) = 1 token
WORD_THAT_EQUALS_ONE_TOKEN = "orb " # noqa: S105

# Property tests for TLM
excluded_tlm_models: list[str] = [
Expand Down
Loading