Search results

What happens with block_k == kv_seq_len

Status: Open.

#23 In haoliuhl/ringattention;

· qihqi opened on Mar 21, 2025

[BPT] Question about the Scaling Factor in Equation from the Paper

Status: Open.

#22 In haoliuhl/ringattention;

· Xiaoming-Zhao opened on Oct 24, 2024

Llama 3 ring attention implementation for inference

Status: Open.

#21 In haoliuhl/ringattention;

· joshpopelka20gmail opened on Jul 25, 2024

This work doesn't change kernel, but utilize dependency to compute a whole line?

Status: Open.

#20 In haoliuhl/ringattention;

· ziyuhuang123 opened on Jul 2, 2024

Could you provice GPU code like A100?

Status: Open.

#19 In haoliuhl/ringattention;

· ziyuhuang123 opened on Jul 2, 2024

scripts/jax2hf. py error

Status: Open.

#17 In haoliuhl/ringattention;

· liuxpro opened on May 8, 2024

Test Script Issues

Status: Open.

#15 In haoliuhl/ringattention;

· djbyrne opened on Mar 18, 2024

Questions about the paper

Status: Open.

#14 In haoliuhl/ringattention;

· hiroshinoji opened on Mar 13, 2024

JAX partitioning error when attempting to run with sequence parallelism factor not a power of 2

Status: Open.

#9 In haoliuhl/ringattention;

· exists-forall opened on Oct 24, 2023