Self-supervised Pre-training Tasks for an fMRI Time-Series Transformer in Autism Detection
Zhou Y, Duan P, Du Y, Dvornek N. Self-supervised Pre-training Tasks for an fMRI Time-Series Transformer in Autism Detection. Lecture Notes In Computer Science 2024, 15266: 145-154. DOI: 10.1007/978-3-031-78761-4_14.Peer-Reviewed Original ResearchSelf-supervised pre-training tasksPre-training tasksFunctional magnetic resonance imagingPre-training stepTransformer-based modelsTime-series fMRI dataTraining data availabilityAutism spectrum disorderTime series transformationsTransformation modelMachine learning methodsFunctional magnetic resonance imaging time-series dataClassification taskPublic datasetsTraining dataOver-fittingComputed functional connectivityLearning methodsModel performanceMasking strategyAutism detectionCross-validationTaskDatasetAverage improvementPrior knowledge-guided vision-transformer-based unsupervised domain adaptation for intubation prediction in lung disease at one week
Yang J, Henao J, Dvornek N, He J, Bower D, Depotter A, Bajercius H, de Mortanges A, You C, Gange C, Ledda R, Silva M, Dela Cruz C, Hautz W, Bonel H, Reyes M, Staib L, Poellinger A, Duncan J. Prior knowledge-guided vision-transformer-based unsupervised domain adaptation for intubation prediction in lung disease at one week. Computerized Medical Imaging And Graphics 2024, 118: 102442. PMID: 39515190, DOI: 10.1016/j.compmedimag.2024.102442.Peer-Reviewed Original ResearchUnsupervised domain adaptationSpatial prior informationDomain adaptationLabeled dataData-driven approachUnsupervised domain adaptation modelMedical image analysis tasksImage analysis tasksTransformer-based modelsMedical image analysisPrior informationOutcome prediction tasksAdversarial trainingDistribution alignmentDomain shiftAttention headsClass tokenPoor generalizationAnalysis tasksTarget domainPrediction taskData distributionKnowledge-guidedLocal weightsMedical images