Open main menu
Article
Quizzes
Tools
EN
Article
Quizzes
Tools
All quizzes
/
LLM Fundamentals
/
Why did Tr...
Why did Transformer models largely replace RNNs (recurrent neural networks) for language modelling?
Transformers process the entire sequence in parallel during training, while RNNs process tokens sequentially
Transformers use less memory than RNNs at all sequence lengths
RNNs require labelled data while Transformers can train without labels
Transformers have fewer parameters, making them easier to train
Submit answers