Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Can someone please explain the "Scaled dot-product attention" function from the article?

Attention(Q, K, V ) = softmax( (Q * TRANSPOSED(T)) / sqrt(Dk) ) V

That's where i start to shake my head.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: