Large Language Models
EOS Token
End Of Sequence token - signals when the model has finished generating a complete output.
This concept is essential for understanding large language models and forms a key part of modern AI systems.
Related Concepts
- Stop Token
- Generation
- Special Token
Tags
large-language-models stop-token generation special-token