2023
Synthesizing audio from tongue motion during speech using tagged MRI via transformer
Liu X, Xing F, Prince J, Stone M, Fakhri G, Woo J. Synthesizing audio from tongue motion during speech using tagged MRI via transformer. Proceedings Of SPIE--the International Society For Optical Engineering 2023, 12464: 1246410-1246410-5. PMID: 38009135, PMCID: PMC10669779, DOI: 10.1117/12.2653345.Peer-Reviewed Original ResearchMotion fieldAudio waveformAdversarial training approachImprove synthesis qualityConvolutional decoderAudio dataSynthesis qualityTranslation networkData structureSpeech waveformTemporal modelTagged MRITongue motionTraining approachSpectrogramMuscle deformationSource of informationSpeechIntelligible speechFrameworkDecodingInformationPredictive informationEncodingNetwork
2021
A deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech
Woo J, Xing F, Prince J, Stone M, Gomez A, Reese T, Wedeen V, El Fakhri G. A deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech. Medical Image Analysis 2021, 72: 102131. PMID: 34174748, PMCID: PMC8316408, DOI: 10.1016/j.media.2021.102131.Peer-Reviewed Original ResearchConceptsNon-negative matrix factorizationSparse Non-negative Matrix FactorizationIterative shrinkage-thresholding algorithmNon-negative matrix factorization frameworkDeep neural networksMatrix factorization frameworkDeep learning frameworkTongue motionIdentified functional unitsGraph regularizationClustering performanceWeight mapLearning frameworkSpectral clusteringNeural networkMatrix factorizationModular architectureIncreased interpretabilityMotion dataFactorization frameworkConvoluted natureComparison methodTagged magnetic resonance imagingMuscle coordination patternsSpeech
2020
Identifying the Common and Subject-specific Functional Units of Speech Movements via a Joint Sparse Non-negative Matrix Factorization Framework.
Woo J, Xing F, Prince J, Stone M, Reese T, Wedeen V, El Fakhri G. Identifying the Common and Subject-specific Functional Units of Speech Movements via a Joint Sparse Non-negative Matrix Factorization Framework. Proceedings Of SPIE--the International Society For Optical Engineering 2020, 11313 PMID: 32454553, PMCID: PMC7243345.Peer-Reviewed Original Research
2018
A Sparse Non-Negative Matrix Factorization Framework for Identifying Functional Units of Tongue Behavior From MRI
Woo J, Prince J, Stone M, Xing F, Gomez A, Green J, Hartnick C, Brady T, Reese T, Wedeen V, Fakhri G. A Sparse Non-Negative Matrix Factorization Framework for Identifying Functional Units of Tongue Behavior From MRI. IEEE Transactions On Medical Imaging 2018, 38: 730-740. PMID: 30235120, PMCID: PMC6422735, DOI: 10.1109/tmi.2018.2870939.Peer-Reviewed Original ResearchConceptsNon-negative matrix factorization frameworkProbabilistic graphical model frameworkMatrix factorization frameworkGraphical model frameworkWeight mapSpectral clusteringSynthetic dataMuscle coordination patternsMatrix factorizationMotion dataMotion patternsTongue motionFactorization frameworkTwo-dimensional imagesMuscle groupsLocal regionsLocal muscle groupLocal structural elementsTagged-MRIImagesFunctional muscle groupsStrain map of the tongue in normal and ALS speech patterns from tagged and diffusion MRI
Xing F, Prince J, Stone M, Reese T, Atassi N, Wedeen V, El Fakhri G, Woo J. Strain map of the tongue in normal and ALS speech patterns from tagged and diffusion MRI. Proceedings Of SPIE--the International Society For Optical Engineering 2018, 10574: 1057411. PMID: 29706684, PMCID: PMC5922778, DOI: 10.1117/12.2293028.Peer-Reviewed Original ResearchDiffusion tensor imagingAmyotrophic lateral sclerosis subjectsAmyotrophic lateral sclerosisNormal subjectsMagnetic resonance (MR) techniquesAmyotrophic lateral sclerosis patientsTagged magnetic resonance imagingMagnetic resonance imagingMR imaging techniquesMotion sequencesDeath of neuronsMotion fieldDiffusion tensor imaging dataSwallowing functionLines of actionTongue tissueResonance imagingFiber directionTongue musclesTongue motionSpeech patternsMotion atlasActive regionTensor imaging
2017
Speech Map: a statistical multimodal atlas of 4D tongue motion during speech from tagged and cine MR images
Woo J, Xing F, Stone M, Green J, Reese T, Brady T, Wedeen V, Prince J, Fakhri G. Speech Map: a statistical multimodal atlas of 4D tongue motion during speech from tagged and cine MR images. Computer Methods In Biomechanics And Biomedical Engineering Imaging & Visualization 2017, 7: 361-373. PMID: 31328049, PMCID: PMC6640640, DOI: 10.1080/21681163.2017.1382393.Peer-Reviewed Original ResearchMotion fieldMotion estimationTongue motionAnatomical configurationComplex motion fieldsCourse of speechCine MR imagingMotion informationInternal motionsGlossectomy patientsHealthy subjectsCine MRITongue functionMR imagingSpeech mappingClinical applicationAnatomical referenceTime course of speechTime courseSpeechDiscovering functional units of the human tongue during speech from cine- and tagged-MRI
Woo J, Stone M, Xing F, Green J, Gomez A, Wedeen V, Prince J, Fakhri G. Discovering functional units of the human tongue during speech from cine- and tagged-MRI. The Journal Of The Acoustical Society Of America 2017, 141: 3647-3647. DOI: 10.1121/1.4987883.Peer-Reviewed Original ResearchA four-dimensional motion field atlas of the tongue from tagged and cine magnetic resonance imaging
Xing F, Prince J, Stone M, Wedeen V, Fakhri G, Woo J. A four-dimensional motion field atlas of the tongue from tagged and cine magnetic resonance imaging. Proceedings Of SPIE--the International Society For Optical Engineering 2017, 10133: 101331h-101331h-6. PMID: 29081569, PMCID: PMC5659618, DOI: 10.1117/12.2254363.Peer-Reviewed Original ResearchMotion fieldDense motion fieldTongue motionAtlas spaceThree-dimensional vector fieldsTagged MR imagesCine imagesImage atlasCine MR imagingAtlas constructionMagnetic resonanceVector fieldsFieldMotionImagesRepresentationQuantitative representationMR imagingAtlasDeformation fieldInter-subject variabilityResonanceCine magnetic resonance imagingInter-subject variationTensor