Express YourSelf !

Here are few links

The Paper

https://arxiv.org/pdf/1706.03762.pdf

------------------------

Medium

https://medium.com/@SimplifyingFutureTech/understanding-attention-is-all-you-need-750713a1631b

https://medium.com/codex/attention-is-all-you-need-explained-ebdb02c7f4d4

-------------

PoloClub

https://poloclub.github.io/transformer-explainer/

https://arxiv.org/abs/2408.04619

https://www.youtube.com/watch?v=ECR4oAwocjs

-----------

Last Few videos of https://www.youtube.com/watch?v=2dH_qjc9mFg&list=PLKnIA16_RmvYuZauWaPlRTC54KxSNLtNn

https://hasgeek.com/fifthelephant/paper-reading-meet-up-december-2023/

https://www.linkedin.com/pulse/decoding-attention-all-you-need-how-transformers-ai-yuri-sylse/

--------------

Embedding is representation of text in multi dimensional space

Diffusion model add noise and then remove it. It is for multimodal.  

Multi head = syntax + semantics + position. It improves expressiveness and captures richer patterns. 

Attention is about which embedding to look at. It does not change embedding. 

Few other miscellaneous link from event https://luma.com/d0yhf0ib

1. IronClaw

https://github.com/nearai/ironclaw

https://www.ironclaw.com/

IronClaw is the secure, open-source alternative to OpenClaw that runs in encrypted enclaves on NEAR AI Cloud.  TEE (Trusted Execution Environment)