We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent bf80fec commit 9128c27Copy full SHA for 9128c27
attn_gym/masks/sliding_window.py
@@ -11,7 +11,7 @@ def generate_sliding_window(window_size: int) -> _mask_mod_signature:
11
window_size: The size of the sliding window.
12
13
Note:
14
- We assume that the window size is represents the lookback size and we mask out all future tokens
+ We assume that the window size represents the lookback size and we mask out all future tokens
15
similar to causal masking.
16
"""
17
0 commit comments