A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data
Bi Y, Abrol A, Fu Z, Calhoun V. A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data. Human Brain Mapping 2024, 45: e26783. PMID: 39600159, PMCID: PMC11599617, DOI: 10.1002/hbm.26783.Peer-Reviewed Original ResearchConceptsCross-attention mechanismVision transformerDeep learning modelsBrain disordersCharacteristics of schizophreniaDiagnosis of schizophreniaStructural neuroimaging dataNetwork connectivity matrixData fusion approachAttention mapsMultimodal baselinesFunctional network connectivityFuse informationDeep learningICA algorithmFusion approachGrey matter mapsAI algorithmsFunctional network connectivity matricesLeverage multiple sources of informationGray matter imagesLearning modelsMultiple sources of informationBrain imaging modalitiesNetwork connectivityGray matters: ViT-GAN framework for identifying schizophrenia biomarkers linking structural MRI and functional network connectivity
Bi Y, Abrol A, Jia S, Sui J, Calhoun V. Gray matters: ViT-GAN framework for identifying schizophrenia biomarkers linking structural MRI and functional network connectivity. NeuroImage 2024, 297: 120674. PMID: 38851549, DOI: 10.1016/j.neuroimage.2024.120674.Peer-Reviewed Original ResearchFunctional network connectivityMedial prefrontal cortexBrain structuresFunctional network connectivity matricesPrefrontal cortexStructural MRINetwork connectivityGray matterSelf-attention mechanismGenerative adversarial networkDeep learning architectureBrain disordersDorsolateral prefrontal cortexResearch of schizophreniaNeural signal processingIdentified functional connectivityCross-domain analysisAttention mapsStructural biomarkersAdversarial networkLearning architectureDL-PFCICA algorithmSchizophrenia patientsHigh-dimensional fMRI data