A double index for assessing symptoms in psychosis based on acoustic and semantic information

<jats:p>Recent computational approaches to speech in psychosis generate large multidimensional feature spaces capturing semantic and acoustic aspects of language production. However, the clinical relevance of individual measures often becomes difficult to interpret due to redundancy, interaction effects, and high intercorrelation among features. Building upon previous work constructing a single composite index derived from semantic features based on language model embeddings, we here build a second acoustic index derived from speech acoustic features. Our aim was to evaluate the differential performance of both indices in conjunction in PANSS symptom prediction in psychosis in a cross-linguistic setting, including positive symptoms (P1, P2, P3), negative symptoms (N1, N4, N6), and general measures (G5, G9). The dataset comprised five languages and 221 patients with schizophrenia spectrum disorder (SSD). Both indices showed predictive power for individual PANSS scores, while also demonstrating clinically important complementarity: semantic indices were more strongly associated with positive symptom dimensions (P2, P3, Total Positive), whereas acoustic indices showed stronger relationships with negative and general symptoms (N1, N4, G5, G9). Both domains shared predictive overlap for global measures, such as PANSS Total scores. These findings suggest that both indices capture complementary and partially overlapping dimensions of psychopathology. The proposed composite index framework contributes to the advancement of low-dimensional speech-derived markers of symptom severity variation, potentially informing vulnerability to relapse and remission in psychosis.</jats:p>