Grokking Modular Addition

Exploring the 'grokking' phenomenon for modular addition using a one-layer transformer with bidirectional attention.

Grokking Modular Addition
Repository

This project explores grokking in modular addition with a one-layer transformer using bidirectional attention.