Search results

Reshape error in causal_flash_attention when sequence length is not a multiple of 1024

Status: Open.

#14 In lucidrains/flash-attention-jax;

· enolan opened on Dec 14, 2023

Question about calculation of Q and transpose(K).

Status: Open.

#10 In lucidrains/flash-attention-jax;

· jaes77 opened on Apr 20, 2023

Performance benchmarks?

Status: Open.

#9 In lucidrains/flash-attention-jax;

· imoneoi opened on Dec 7, 2022

fix compatibility with jax transformations

Status: Open.

#7 In lucidrains/flash-attention-jax;

· GallagherCommaJack opened on Sep 23, 2022

support for per-head scales for cosine sim attention

Status: Open.

#6 In lucidrains/flash-attention-jax;

· GallagherCommaJack opened on Sep 23, 2022

more general mask support

Status: Open.

#5 In lucidrains/flash-attention-jax;

· GallagherCommaJack opened on Sep 20, 2022

can I work on making a flax attention function out of this repository?

Status: Open.

#3 In lucidrains/flash-attention-jax;

· MiladInk opened on Sep 19, 2022