Large Language Models
Length Penalty
Adjusting generation scores based on output length to avoid bias toward shorter or longer sequences.
This concept is essential for understanding large language models and forms a key part of modern AI systems.
Related Concepts
- Generation
- Beam Search
- Decoding
Tags
large-language-models generation beam-search decoding