2024
A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data
Bi Y, Abrol A, Fu Z, Calhoun V. A multimodal vision transformer for interpretable fusion of functional and structural neuroimaging data. Human Brain Mapping 2024, 45: e26783. PMID: 39600159, PMCID: PMC11599617, DOI: 10.1002/hbm.26783.Peer-Reviewed Original ResearchConceptsCross-attention mechanismVision transformerDeep learning modelsBrain disordersCharacteristics of schizophreniaDiagnosis of schizophreniaStructural neuroimaging dataNetwork connectivity matrixData fusion approachAttention mapsMultimodal baselinesFunctional network connectivityFuse informationDeep learningICA algorithmFusion approachGrey matter mapsAI algorithmsFunctional network connectivity matricesLeverage multiple sources of informationGray matter imagesLearning modelsMultiple sources of informationBrain imaging modalitiesNetwork connectivity
2023
Data-driven multimodal fusion: approaches and applications in psychiatric research
Sui J, Zhi D, Calhoun V. Data-driven multimodal fusion: approaches and applications in psychiatric research. Psychoradiology 2023, 3: kkad026. PMID: 38143530, PMCID: PMC10734907, DOI: 10.1093/psyrad/kkad026.Peer-Reviewed Original ResearchMultimodal fusionFusion methodBig dataMulti-modal fusion methodMulti-modal fusion techniquesImage fusion applicationsEra of big dataMultimodal fusion approachDeep learning approachExtract meaningful insightsIndependent component analysisFusion approachHidden patternsLearning approachFusion techniqueCanonical correlation analysisPrior informationMultiple modalitiesComplex psychiatric disorderN-wayMeaningful insights