Scientists have built a monster with many arms—and it might finally help us understand how thought emerges from tangled neurons.
Key Points at a Glance
- The Krakencoder combines dozens of brain imaging outputs to create a unified brain map.
- It can predict an individual’s brain activity patterns up to 20x better than earlier tools.
- The model links brain structure to cognitive function, offering insights into age, sex, and behavior.
- Its potential applications include stroke recovery prediction and brain stimulation therapies.
Researchers at Weill Cornell Medicine have unveiled a powerful new AI tool capable of bridging the complex relationship between how our brain is wired and how it behaves. Called the Krakencoder, this innovative algorithm fuses data from over a dozen different brain mapping techniques into a single cohesive picture of brain connectivity—something never achieved at this level before.
The work, published June 5 in Nature Methods, addresses a long-standing mystery: how does the brain’s physical structure give rise to its dynamic patterns of activity? While scientists have been mapping the brain’s “wiring” (structural connectome) and its “firing” (functional connectome), the two often don’t line up. And interpreting these discrepancies has been a major challenge for neuroscience.
“Everybody uses different methods to scan the brain, and they all tell slightly different stories,” said Dr. Amy Kuceyeski, senior author of the study. “We needed a way to bring those perspectives together into one consistent interpretation.”
Enter the Krakencoder, an AI model with a monster name and monster capabilities. Developed by first author Keith Jamison, it works like a data alchemist: compressing and reconstructing brain data from over 700 subjects in the Human Connectome Project, it generates a fused map that more accurately represents how structure and function intertwine in the brain.
Compared to previous tools, Krakencoder predicted a person’s functional connectome—how brain regions activate together—20 times more accurately using only structural information. It also could predict individual traits like age, sex, and even cognitive performance test scores, using only this fused neural blueprint.
That has enormous implications. For instance, in stroke patients, Krakencoder—when paired with another tool called NeMo—can simulate brain activity based on standard MRI scans, giving doctors powerful new insights into likely outcomes and recovery paths. These predicted connectomes also show promise in targeting brain stimulation therapies for maximum recovery impact.
“What we’re seeing is a clearer link between the brain’s architecture and how it supports thought, behavior, and recovery,” said Kuceyeski. “It opens up a world where we might not just observe brain networks—but modulate them.”
The Krakencoder project is funded by major U.S. research agencies, including the National Institute of Mental Health and the National Institute on Aging. As its creators continue refining the model, the future of neuroscience may lie not in the wires or signals alone—but in the precise fusion of both.
Source: Weill Cornell Medicine
Enjoying our articles?
We don’t show ads — so you can focus entirely on the story, without pop-ups or distractions. We don’t do sponsored content either, because we want to stay objective and only write about what truly fascinates us. If you’d like to help us keep going — buy us a coffee. It’s a small gesture that means a lot. Click here – Thank You!