🚀 Introducing An Updated Implementation of The Annotated Transformer (2025)

[yflyzhang]

Hi all,

First, I want to express my gratitude for the amazing work on The Annotated Transformer. It has been an invaluable resource for the AI community and a fantastic learning tool for understanding the Transformer architecture.

Since the last update to this repository was in 2022, I noticed that some parts of the codebase are no longer compatible with the latest libraries or environments, leading to errors for new learners. To address this, I’ve created an updated implementation of The Annotated Transformer that is compatible with 2025’s software ecosystem, including modern versions of libraries like PyTorch.

You can find my updated version here: https://github.com/yflyzhang/AnnotatedTransformer.
Google Colab version here:

The goal was to preserve the spirit of the original project while ensuring it runs smoothly for today’s learners. It includes updated dependencies, fixed compatibility issues, and some minor enhancements to make it easier to follow.

I’d love for the community to check it out, provide feedback, or contribute to keeping this fantastic resource accessible. If this aligns with the project’s goals, I’d be happy to discuss how we might integrate updates or share them further.

Thank you again for this incredible project, and I hope my contribution can help keep it alive for new learners!