Blog

Thoughts & Insights

Sharing my journey in front-end engineering, best practices, and lessons learned across different industries. Plus occasional musings on hobbies and life beyond code.

Transformer

Understanding the Architecture

nlpberttransformer

A deep dive into BERT architecture exploring the Transformer encoder and multi-head self-attention mechanism

Read article

How BERT Works and Why It Helps Code-Mixed Text

nlpberttransformer

A whitebox conceptual view of how BERT works, what it learns during pretraining, and why it fits code-mixed text

Read article
transformer | Laksmita Widya Astuti - Front End Engineer