Large Language Models

Length Penalty

Adjusting generation scores based on output length to avoid bias toward shorter or longer sequences.

This concept is essential for understanding large language models and forms a key part of modern AI systems.

  • Generation
  • Beam Search
  • Decoding

Tags

large-language-models generation beam-search decoding

Related Terms

Added: November 18, 2025