fMRI Data Modelling
Abstract
The Brain-Like Artificial Intelligence (BLAI) is pioneered by Prof.Nikola Kasabov and here it is applied to a specific application.
The project introduces a new methodology and a system for dynamic learning, visualisation and classification of functional Magnetic Resonance Imaging (fMRI) as Spatio-Temporal Brain Data (STBD). The method is based on an evolving spatio-temporal data machine (eSTDM) of evolving spiking neural networks (SNN) exemplified by the NeuCube architecture. The method consists of several steps: mapping spatial coordinates of fMRI data into a 3D SNN cube that represents a brain template; input data transformation into trains of spikes; deep, unsupervised learning in the 3D SNN cube of spatio-temporal patterns from data; supervised learning in an evolving SNN classifier; parameter optimisation; 3D visualisation and model interpretation. The learned connections in the SNN cube represent dynamic spatio-temporal relationships derived from the fMRI data. They can reveal new information about the underpinning brain functions under different conditions. The proposed methodology allows for the first time to analyse dynamic functional and structural connectivity of a learned SNN model from fMRI data. This can be used for a better understanding of brain activities and also for on-line generation of appropriate neuro-feedback to subjects for improved brain functions. The proposed NeuCube-based methodology offers also a superior classification accuracy when compared with traditional AI and statistical methods. The created NeuCube-based models of fMRI data are directly and efficiently implementable on high performance and low energy consumption neuromorphic platforms for real–time applications.
FIGURE 1. A block diagram of the NeuCube SNN model for fMRI data encoding, mapping, learning, classification and visualisation.
Related Papers and Benchmarking
The proposed methods and systems, when compared with traditional statistical and machine learning methods, showed superior results in the following aspects:
- An efficient neuromorphic approach, which offers better interpretation of the created models from one of the most complex STBD—fMRI data;
- Better classification accuracy when compared with traditional AI and statistical methods (see table below from Kasabov, Doborjeh, & Doborjeh, 2017);
- Reveals trajectories of functional spatio-temporal associations between areas of the brain (none of the traditional methods can reveal such interactions);
- Better visualisation of the created models, with a possible use of VR;
- Enabling new information and knowledge discovery through meaningful interpretation of the models.
Measure | SVM | MLP | ECF | ECMC | MLR | NeuCube |
|---|---|---|---|---|---|---|
Accuracy (%) | 85 | 76 | 78 | 77 | 68 | 87 |
F -Score | 0.51 | 0.46 | 0.57 | 0.59 | 0.57 | 0.93 |
See also some of the related papers:
Kasabov, N. K., Doborjeh, M. G., & Doborjeh, Z. G. (2017). Mapping, learning, visualization, classification, and understanding of fMRI Data in the NeuCube evolving spatiotemporal data machine of spiking neural networks. IEEE transactions on neural networks and learning systems, 28(4), 887-899.
Kasabov, N., Zhou, L., Doborjeh, M. G., Doborjeh, Z. G., & Yang, J. (2016). New Algorithms for encoding, learning and classification of fmri data in a spiking neural network architecture: a case on modelling and understanding of dynamic cognitive processes.IEEE Transactions on Cognitive and Developmental Systems.
fMRI Data
Data can be download here.
R&D System
For this project, an R&D system has been developed based on NeuCube. The system can be obtained subject to licensing agreement.