Skip to content

Instantly share code, notes, and snippets.

@FareedKhan-dev

FareedKhan-dev/pr.md

Created July 4, 2025 04:56
Show Gist options
  • Save FareedKhan-dev/87abe868f94d3e34386e3d17f518e51c to your computer and use it in GitHub Desktop.
Save FareedKhan-dev/87abe868f94d3e34386e3d17f518e51c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pr.md
Sequence Length (N) Memory Needed (bfloat16, 40 heads)
1,000 ~76 MB
16,000 ~19 GB
100,000 ~745 GB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment