Understanding the Architecture
nlpberttransformer
A deep dive into BERT architecture exploring the Transformer encoder and multi-head self-attention mechanism
Read article
Blog
Thoughts & Insights
Sharing my journey in front-end engineering, best practices, and lessons learned across different industries. Plus occasional musings on hobbies and life beyond code.
Deep-learning
How BERT Works and Why It Helps Code-Mixed Text
nlpberttransformer
A whitebox conceptual view of how BERT works, what it learns during pretraining, and why it fits code-mixed text
Read article
Why Pretrained Language Models Matter
nlpbertmachine-learning
Exploring why pretrained language models like BERT are practical when labeled data and compute are limited
Read article