Modelling phenomenological differences in aetiologically distinct visual hallucinations using deep neural networks
Frontiers in Human Neuroscience – January 03, 2024
Source: OpenAlex
Summary
Visual hallucinations, despite a shared lack of sensory input, manifest profoundly different perceptual characteristics depending on their origin. A novel computational neuroscience approach, leveraging deep neural networks, explored these distinct experiences across three groups: individuals with neurodegenerative conditions (like Parkinson's disease or Lewy body dementia), visual loss, and those experiencing psychedelic effects. This cognitive science method identified three key phenomenological dimensions—realism, spontaneity, and complexity—that distinguish these hallucinations. By tuning model parameters, characteristic synthetic visual hallucinations were generated, accurately reflecting each group's unique perception.
Abstract
Visual hallucinations (VHs) are perceptions of objects or events in the absence of the sensory stimulation that would normally support such perceptions. Although all VHs share this core characteristic, there are substantial phenomenological differences between VHs that have different aetiologies, such as those arising from Neurodegenerative conditions, visual loss, or psychedelic compounds. Here, we examine the potential mechanistic basis of these differences by leveraging recent advances in visualising the learned representations of a coupled classifier and generative deep neural network—an approach we call ‘computational (neuro)phenomenology’. Examining three aetiologically distinct populations in which VHs occur—Neurodegenerative conditions (Parkinson’s Disease and Lewy Body Dementia), visual loss (Charles Bonnet Syndrome, CBS), and psychedelics—we identified three dimensions relevant to distinguishing these classes of VHs: realism (veridicality), dependence on sensory input (spontaneity), and complexity. By selectively tuning the parameters of the visualisation algorithm to reflect influence along each of these phenomenological dimensions we were able to generate ‘synthetic VHs’ that were characteristic of the VHs experienced by each aetiology. We verified the validity of this approach experimentally in two studies that examined the phenomenology of VHs in Neurodegenerative and CBS patients, and in people with recent psychedelic experience. These studies confirmed the existence of phenomenological differences across these three dimensions between groups, and crucially, found that the appropriate synthetic VHs were rated as being representative of each group’s hallucinatory phenomenology. Together, our findings highlight the phenomenological diversity of VHs associated with distinct causal factors and demonstrate how a neural network model of visual phenomenology can successfully capture the distinctive visual characteristics of hallucinatory experience.