Large Language Models

Masked Language Modeling

A pre-training objective where random tokens are masked and the model learns to predict them from context.

  • BERT: Explore how BERT relates to Masked Language Modeling
  • Pre-training: Explore how Pre-training relates to Masked Language Modeling
  • Masking: Explore how Masking relates to Masked Language Modeling

Why It Matters

Understanding Masked Language Modeling is crucial for anyone working with large language models. This concept helps build a foundation for more advanced topics in AI and machine learning.

Learn More

This term is part of the comprehensive AI/ML glossary. Explore related terms to deepen your understanding of this interconnected field.

Tags

large-language-models bert pre-training masking

Related Terms

BERT

Bidirectional Encoder Representations from Transformers - a model that understands context by looking at text from both directions.

Pre-training

Training a model on a large dataset (often self-supervised) before fine-tuning on specific tasks, enabling transfer learning.

Added: November 18, 2025

← Back to All Terms