TokenTown: A visual way to understand how LLMs work
TokenTown visualizes a transformer language model as an isometric city, with each district representing a stage of the model. A convoy transports a hidden state through various processes, including tokenization, vector casting, and layer processing, ultimately producing a probability distribution for token selection.
laurentiugabriel.github.io
2 min
8h ago
TokenTown: A visual way to understand how LLMs work
TokenTown visualizes a transformer language model as an isometric city, with each district representing a stage of the model. A convoy transports a hidden state through various processes, including tokenization, vector casting, and layer processing, ultimately producing a probability distribution for token selection.
laurentiugabriel.github.io
2 min
8h ago
TokenTown: A visual way to understand how LLMs work
TokenTown visualizes a transformer language model as an isometric city, with each district representing a stage of the model. A convoy transports a hidden state through various processes, including tokenization, vector casting, and layer processing, ultimately producing a probability distribution for token selection.
laurentiugabriel.github.io
2 min
8h ago
No more articles to load