BertViz is an interactive tool for visualizing attention in Transformer language models such as BERT, GPT2, or T5. It provides insight into the model’s decision-making process and how it allocates attention to different parts of the input.
BertViz: Visualize Attention in Transformer Language Models
