Q1
Walk me through how you would implement and fine-tune a transformer-based model like BERT for a custom text classification task. What considerations would you make regarding tokenization, training data size, and hyperparameter selection?
Why they ask this:* Assesses understanding of modern NLP architectures, practical fine-tuning experience, and ability to make informed decisions about model selection and optimization for domain-specific problems.
Q2
Describe your experience with handling class imbalance and data quality issues in NLP datasets. What techniques have you used, and how did you measure their effectiveness?
Why they ask this:* Tests real-world problem-solving skills and understanding that production NLP systems rarely have clean, balanced data. Evaluates awareness of metrics beyond accuracy.
Q3
Explain the trade-offs between using pre-trained language models versus training custom embeddings from scratch for a low-resource language with limited labeled data.
Why they ask this:* Evaluates strategic thinking about resource constraints, understanding of transfer learning limitations, and ability to balance performance with practical constraints in industry settings.
Q4
Walk me through your experience with NLP evaluation metrics. When would you use BLEU versus ROUGE versus semantic similarity scores, and how would you design an evaluation framework for a production system?