Open main menu
Article
Quizzes
Tools
EN
Article
Quizzes
Tools
All quizzes
/
LLM Fundamentals
/
What does ...
What does self-attention allow a language model to do?
Weigh the relevance of each token in the context relative to all other tokens when making a prediction
Remember all previous conversations the model has ever processed
Look up facts from an external database during inference
Skip irrelevant parts of the input to save computation
Submit answers