This article explores the impact of language understanding on neural tracking using a deep learning framework. The study evaluates the added value of linguistics over lexical segmentation features and includes a language classification task. Participants listened to comprehensible and incomprehensible stories in Dutch and Frisian, as well as a list of scrambled Dutch words. The results suggest that language-specific brain responses can be learned by the framework.