Alon Arad PhD’s Post

Watch this video to understand how LLMs store facts. The entire series is excellent to get an intuitive understanding. It all boils down to basic linear algebra. About 18 minutes into the video, it touches on sparse auto encoders and why LLMs generalize so well as the dimensionality increases

How might LLMs store facts | DL7

https://www.youtube.com/

To view or add a comment, sign in

Explore topics