Skip to content

Instantly share code, notes, and snippets.

@furixturi

furixturi/dot_product_attention_formula.md

Created July 28, 2025 06:51
Show Gist options
  • Save furixturi/661b5c297c75d5e0b6d00e81a4452481 to your computer and use it in GitHub Desktop.
Save furixturi/661b5c297c75d5e0b6d00e81a4452481 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
dot_product_attention_formula.md

$$Attention(Q,K,V)=Softmax(\frac{QK^T}{\sqrt{d_k}})V$$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment