arXiv 2410.07507
Thought2Text: Text Generation from EEG Signal using Large Language Models (LLMs)
By Abhijit Mishra, Shreya Shukla, et al.
Published 2024-10-10
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Decoding and expressing brain activity in a comprehensible form is a challenging frontier in AI. This paper presents Thought2Text, which uses instruction-tuned Large Language Models (LLMs) fine-tuned with EEG data to achieve this goal. The approach involves three stages: (1) training an EEG encoder for visual feature extraction, (2) fine-tuning LLMs on image and text data, enabling multimodal description generation,…