arXiv 2511.14691
Attention via Synaptic Plasticity is All You Need: A Biologically Inspired Spiking Neuromorphic Transformer
By Kallol Mondal and Ankush Kumar
Published 2025-11-18
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Attention is the brain's ability to selectively focus on a few specific aspects while ignoring irrelevant ones. This biological principle inspired the attention mechanism in modern Transformers. Transformers now underpin large language models (LLMs) such as GPT, but at the cost of massive training and inference energy, leading to a large carbon footprint. While brain attention emerges from neural circuits, Transform…