2024
Self-supervised Pre-training Tasks for an fMRI Time-Series Transformer in Autism Detection
Zhou Y, Duan P, Du Y, Dvornek N. Self-supervised Pre-training Tasks for an fMRI Time-Series Transformer in Autism Detection. Lecture Notes In Computer Science 2024, 15266: 145-154. DOI: 10.1007/978-3-031-78761-4_14.Peer-Reviewed Original ResearchSelf-supervised pre-training tasksPre-training tasksFunctional magnetic resonance imagingPre-training stepTransformer-based modelsTime-series fMRI dataTraining data availabilityAutism spectrum disorderTime series transformationsTransformation modelMachine learning methodsFunctional magnetic resonance imaging time-series dataClassification taskPublic datasetsTraining dataOver-fittingComputed functional connectivityLearning methodsModel performanceMasking strategyAutism detectionCross-validationTaskDatasetAverage improvementCLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning
Du Y, Chang B, Dvornek N. CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning. Lecture Notes In Computer Science 2024, 15012: 465-475. DOI: 10.1007/978-3-031-72390-2_44.Peer-Reviewed Original ResearchContrastive Language-Image Pre-trainingLanguage modelState-of-the-art performanceSelf-supervised representation learningContrastive learning methodFine-tuningProlonged training timeBERT encoderContrastive learningRepresentation learningClass labelsGPU resourcesTraining samplesTraining timeMammography datasetModel sizePre-trainingLearning methodsEfficient frameworkVisual modelRichness of informationDatasetClinical diagnostic dataLearningMedical applications
2019
ShelfNet for Fast Semantic Segmentation
Zhuang J, Yang J, Gu L, Dvornek N. ShelfNet for Fast Semantic Segmentation. 2019, 00: 847-856. DOI: 10.1109/iccvw.2019.00113.Peer-Reviewed Original ResearchFast semantic segmentationSemantic segmentationCityscapes datasetReal-time segmentation modelStreet-scene understandingFast inference speedEncoder-decoder structurePASCAL VOC datasetHigh accuracyInference speedSkip connectionsAutonomous drivingExtensive experimentsResidual blocksSegmentation modelVOC datasetNovel architectureReal-time methodComputation burdenShallow pathsBiSeNetPSPNetParameter numberComparable speedDataset