These Psychedelic GIFs Show the Future of Brain Mapping

Brain mapping in the most psychedelic visual of all.

In 1956, Aldous Huxley and psychiatrist Humphry Osmond were in the throes of a multi-year struggle to come up with a term to describe the mind-altering effects of mescaline when Osmond suggested the neologism "psychedelic," drawing its roots from the Greek "psyche" (mind) and "delos" (manifest, reveal). Since then, the word has been used to characterize drugs, works of art, and even portraits of Pluto.

However, there remains an area—one where the term could be quite literally applied—that has generally been overlooked as being psychedelic work.

As a researcher at the University of Southern California's Laboratory of Neuro Imaging (LONI), I spend large parts of my day staring at brain images that are as beautiful as they are data-ful. The images are generated from a wide spectrum of brain mapping data, ranging from diffusion MRI tractography via the Human Connectome Project, to genetic brain maps via the ENIGMA Consortium, and injected neural tracers via the Mouse Connectome Project.

Although the data visualization tools used in these studies can vary widely in terms of modality and specific goals, the resultant images are all critical to the understanding and dissemination of results… while being psychedelic as hell.

If the term "psychedelic" in its original conception means "mind manifesting," then the images generated in brain mapping studies are the essence of psychedelia. If we expand the definition to include the "trippy" aesthetic typically referred to as psychedelic, then the algorithmic fractals and rainbow-hued representations of neural connections would not seem out of place in a record shop in the Haight. In a sense, "psychedelic" doesn't feel adequate as a descriptor; that is, to the extent that the images are literal manifestations of the mind generated using psychedelic colors and motifs, they can be conceived of as being "meta-psychedelic."

Of course, the images used in the studies we work on at LONI are more than just pretty pictures, and any "trippy" qualities are unintended byproducts of trying to show the largest amount of data possible in two dimensions. For this article, however, I purposely kicked the psychedelia up a notch and turned some already beautiful brain pictures into some seriously meta-psychedelic GIFs, with captions explaining the meaning behind all the rainbows tubes and convoluted mesh lattices.

Corpus Callosum

What it shows: A slice of the corpus callosum, a thick band of nerve fibers connecting the two hemispheres of the brain.

Details: This image was generated using diffusion-weighted MRI, which uses magnetic gradients to measure the non-random movement of water molecules along axons. The movement of water molecules in close proximity to neural pathways is restricted parallel to axons, as opposed to the movement of water molecules in other regions of the brain, which is unrestricted in all directions. The unrestricted flow in other regions is known as isotropic movement, and the restricted flow near neural pathways is known as anisotropic movement.

Anisotropic movement of water molecules can be detected through pulsed magnetic gradients using diffusion-weighted MRI and measured to quantify the degree and direction(s) of restricted movement. These data are collected for roughly one million "voxels" (like 3D pixels) per brain, and the diffusion information within each voxel can be modeled with a mathematical function.

In the early days of diffusion imaging, the directional information was modeled using a tensor ("diffusion tensor imaging"), which represented all of the diffusion data within each voxel as a single ellipsoid. However, this method proved to be problematic because each voxel is 1-3 cubic millimeters, which is large enough to contain several different populations of nerve fibers all coursing in different directions.

Because a solitary ellipsoid can't represent the directional information of perpendicular fiber bundles (the tensor would be more like a sphere in that case), a new way of modeling diffusion data—the fiber orientation distribution—was developed. Rather than modeling the diffusion data as a single ellipsoid, the fiber orientation distribution (FOD, see next GIF) has multiple arms that enable it to represent multiple fiber directions within each voxel (see the progression from top to bottom in this image).

Once the FODs are generated, a probabilistic algorithm is used to more-or-less "connect the dots" between FODs and map out the pathways of axons, a process known as tractography. I use the workflow software LONI Pipeline to run tractography, which provides a graphical user interface for the parallel processing of many brains at the same time. The workflow requires inputs known as "seed regions" and "regions of interest" (the regions of the brain we're trying to connect), and allows for fine-tuning of variables such as angles of curvature, lengths of tracts, and thresholds to stop tracking.

Fiber Orientation Distributions

What it shows: These balloon-animal-looking things are individual FODs from voxels in the optic chiasm, which is where half of the nerve fibers from each eye cross to the opposite hemisphere.

Details: As explained in the first GIF, the FOD is a way of modeling the strength and direction of anisotropic flow of water within a voxel, i.e. the non-random movement of water molecules along the length of axons. The "arms" of each FOD represent the probability of fiber tracts along a given direction. These particular FODs were generated using a method that can handle a large number of diffusion gradients and an arbitrary number of gradient strengths (b-values).

The optic chiasm was chosen for this example because it's a classic location of "crossing fibers," i.e. two bundles of axons that cross paths in the same voxel. The old method of modeling fibers using tensor models wouldn't be able to resolve both directions within the same voxel; it would just come out looking like a blob. With FODs, the directions of fibers are sharp and able to traced with a tractography algorithm with much higher anatomical accuracy.

Optic Chiasm

What it shows: the optic chiasm, after tractography has been performed using the FODs generated in the previous GIF.

Details: This image was generated in a similar way as the first GIF, i.e. using a probabilistic tractography algorithm to connect FODs and model the most likely paths of brain fibers traveling through the optic chiasm.

The Corticospinal Tract

What it shows: One side of the corticospinal tract (the pathway responsible for voluntary movement) connecting the brain to the spinal cord, superimposed onto the FODs used to track the pathway.

Details: The background of this GIF is a screenshot of all of the FODs in one coronal slice of the brain. Using these FODs, probabilistic tractography was run to connect the primary motor cortex to the pyramidal tract in the brainstem. The primary motor cortex was automatically located using a software called FreeSurfer. The pyramidal tract was located manually in the brainstem by yours truly, using a software called ITK-SNAP.

The Hippocampus

What it shows: Different methods of mapping the surface of the hippocampus

Details: Surface mapping allows for the detection of changes in brain structures. This GIF demonstrates advances in surface mapping technology that use a distributed network-based model of surfaces. This allows for a highly accurate automated analysis of a large number of subjects.

The Hippocampus in Alzheimer's Disease

What it shows: Changes in the hippocampus with (a) early mild cognitive impairment, (b) late mild cognitive impairment, and (c) Alzheimer's disease.

Details: This GIF uses the technology demonstrated in the previous GIF to show how the hippocampus changes as Alzheimer's disease (AD) progresses. The hippocampus is highly implicated in the pathophysiology of AD and is known to decrease in size over the course of the disease. The new mapping technology allows for earlier and more accurate identification of hippocampal changes, which could lead to earlier diagnosis and improved monitoring of treatment efficacy.

The Trippocampus

What it shows: This is a rendering of the surface of the hippocampus that I thought looked particularly trippy, hence the name Trippocampus.

The Human Visual Pathway

What it shows: The pathway from the optic chiasm (see third GIF) to the lateral geniculate nucleus and the primary visual cortex. The top of the GIF (optic chiasm) is anterior, bottom (primary visual cortex) is posterior.

Details: This GIF comes from my research on automated methods of mapping the visual pathway using high-resolution diffusion imaging. It was created using the techniques described in the first three GIFs, i.e. fiber orientation distributions and probabilistic tractography.

The main challenge in mapping the pathway lies in getting the probabilistic tracking algorithm to navigate the sharp curve of Meyer's loop (the portion of optic radiation fibers that briefly course anteriorly around the temporal horn before continuing to travel posteriorly to the visual cortex) because the algorithm tends to continue along the path of least resistance, i.e. a straight line.

To overcome this, we developed a two-stage tracking method that began tractography first in the optic chiasm, and then used these results to automatically create a second starting location in the lateral geniculate of the thalamus (where Meyer's loop begins).

Flying Through the Corpus Callosum

What it shows: An anterior-to-posterior "flight" between the two sides of the corpus callosum

Details: This GIF is the whole-brain version of the first GIF, which was only a small coronal slice of the corpus callosum. It was created using the visualization software TrackVis, which has the ability to automatically take screenshots along a given path. If you've ever wondered what it was like to fly between the two hemispheres of your brain (on acid?), now you know.