DeWave: Discrete Encoding of EEG Waves for EEG to Text Translation

DeWave is a pioneering framework that uses discrete encoding sequences to translate EEG waves into text.

It integrates a quantized variational encoder with pre-trained language models to address issues like individual differences in EEG signals and order mismatches between eye fixations and spoken words.

This approach enables the translation of entire EEG signal periods without word-level markers.