13 Gen AI Interview Preparation: What is MLM Maked Language Modelling

Masked Language Modeling is one of those foundational concepts that has been asked in Facebook and Apple interviews - yet most candidates cannot explain it beyond "BERT masks some tokens." In this video, we break down MLM from the core idea all the way to the exact masking strategy used during BERT pretraining, in a structured interview Q&A format built for AI Engineer and GenAI interview preparation in 2026. We cover what masked language modeling is and how BERT learns by predicting hidden tokens using both left and right context, why bidirectional context makes BERT fundamentally different …