2023
Articulation differences of /s/ observed using inverse tongue atlas modeling
Maity U, Xing F, Stone M, Zhuo J, El Fakhri G, Prince J, Woo J, Fels S. Articulation differences of /s/ observed using inverse tongue atlas modeling. The Journal Of The Acoustical Society Of America 2023, 153: a366-a366. DOI: 10.1121/10.0019184.Peer-Reviewed Original ResearchSynthesizing audio from tongue motion during speech using tagged MRI via transformer
Liu X, Xing F, Prince J, Stone M, Fakhri G, Woo J. Synthesizing audio from tongue motion during speech using tagged MRI via transformer. Proceedings Of SPIE--the International Society For Optical Engineering 2023, 12464: 1246410-1246410-5. PMID: 38009135, PMCID: PMC10669779, DOI: 10.1117/12.2653345.Peer-Reviewed Original ResearchMotion fieldAudio waveformAdversarial training approachImprove synthesis qualityConvolutional decoderAudio dataSynthesis qualityTranslation networkData structureSpeech waveformTemporal modelTagged MRITongue motionTraining approachSpectrogramMuscle deformationSource of informationSpeechIntelligible speechFrameworkDecodingInformationPredictive informationEncodingNetworkQuantifying velopharyngeal motion variation in speech sound production using an audio-informed dynamic MRI atlas
Xing F, Jin R, Gilbert I, El Fakhri G, Perry J, Sutton B, Woo J. Quantifying velopharyngeal motion variation in speech sound production using an audio-informed dynamic MRI atlas. Proceedings Of SPIE--the International Society For Optical Engineering 2023, 12464: 124642m-124642m-6. PMID: 37621417, PMCID: PMC10448831, DOI: 10.1117/12.2654082.Peer-Reviewed Original ResearchMotion fieldReal-time speechHigh-dimensional datasetsAudio waveformAtlas spaceTemporal alignmentMotion variationsDatasetMagnetic resonance imagingMotion atlasMotion differencesSpeech variationImage acquisitionTaskSpeechMotion characteristicsDynamic magnetic resonance imagingPrincipal componentsImages
2022
Tagged-MRI to audio synthesis with a pairwise heterogeneous deep translator
Liu X, Xing F, Stone M, Prince J, Kim J, Fakhri G, Woo J. Tagged-MRI to audio synthesis with a pairwise heterogeneous deep translator. The Journal Of The Acoustical Society Of America 2022, 151: a133-a133. DOI: 10.1121/10.0010891.Peer-Reviewed Original ResearchLatent space featuresEncoder-decoder structureCNN-based encoderSpace featuresDeep learning frameworkTagged MRI sequencesKullback-Leibler divergenceMel-spectrogramSpeech-related disordersLearning frameworkAudio synthesisAudio waveformSpeech productionKullback-LeiblerHeterogeneous representationsEvaluation strategiesIntelligible speechFrameworkTagged-MRISpeechDecodingAudioVisual movementEncodingUtterances
2021
4D magnetic resonance imaging atlas construction using temporally aligned audio waveforms in speech
Xing F, Jin R, Gilbert I, Perry J, Sutton B, Liu X, Fakhri G, Shosted R, Woo J. 4D magnetic resonance imaging atlas construction using temporally aligned audio waveforms in speech. The Journal Of The Acoustical Society Of America 2021, 150: 3500-3508. PMID: 34852570, PMCID: PMC8580575, DOI: 10.1121/10.0007064.Peer-Reviewed Original ResearchConceptsAudio waveformTemporal domain informationMulti-subject dataAtlas constructionMutual information measureMR image datasetsImage datasetsTarget domainDomain informationPost-processing methodImage sequencesTemporal alignmentSpatiotemporal alignmentMatching patternsInformation measuresImage dataSquare errorAligned volumesAlignment mapOverall score increaseMR technologyCross-correlationDeformable registrationSpeechImagesA deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech
Woo J, Xing F, Prince J, Stone M, Gomez A, Reese T, Wedeen V, El Fakhri G. A deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech. Medical Image Analysis 2021, 72: 102131. PMID: 34174748, PMCID: PMC8316408, DOI: 10.1016/j.media.2021.102131.Peer-Reviewed Original ResearchConceptsNon-negative matrix factorizationSparse Non-negative Matrix FactorizationIterative shrinkage-thresholding algorithmNon-negative matrix factorization frameworkDeep neural networksMatrix factorization frameworkDeep learning frameworkTongue motionIdentified functional unitsGraph regularizationClustering performanceWeight mapLearning frameworkSpectral clusteringNeural networkMatrix factorizationModular architectureIncreased interpretabilityMotion dataFactorization frameworkConvoluted natureComparison methodTagged magnetic resonance imagingMuscle coordination patternsSpeechSpeech intelligibility loss due to amyotrophic lateral sclerosis: the effect of tongue movement reduction on vowel and consonant acoustic features
Rong P, Usler E, Rowe L, Allison K, Woo J, Fakhri G, Green J. Speech intelligibility loss due to amyotrophic lateral sclerosis: the effect of tongue movement reduction on vowel and consonant acoustic features. Clinical Linguistics & Phonetics 2021, 35: 1091-1112. PMID: 33427505, DOI: 10.1080/02699206.2020.1868021.Peer-Reviewed Original ResearchConceptsTarget wordsIntelligence declineSpeech intelligibilityPredictors of speech intelligibilityDysarthria secondary to amyotrophic lateral sclerosisMotor performanceHealthy controlsReduced speech intelligibilityAcoustic featuresPhonetic distinctionsSpeech soundsRobust predictorsTongue movementDisease-related changesSpeech intelligibility declinesAmyotrophic lateral sclerosisTongue dynamicsMeasurement typesReduced rangeImpaired tongue movementMovement reductionWordsTongue bladeVowelsSpeech
2018
Magnetic resonance imaging based anatomical assessment of tongue impairment due to amyotrophic lateral sclerosis: A preliminary study
Lee E, Xing F, Ahn S, Reese T, Wang R, Green J, Atassi N, Wedeen V, El Fakhri G, Woo J. Magnetic resonance imaging based anatomical assessment of tongue impairment due to amyotrophic lateral sclerosis: A preliminary study. The Journal Of The Acoustical Society Of America 2018, 143: el248-el254. PMID: 29716267, PMCID: PMC5895467, DOI: 10.1121/1.5030134.Peer-Reviewed Original ResearchConceptsDiffusion tensor imagingHigh-resolution magnetic resonance imagingMagnetic resonance imagingResonance imagingEffects of amyotrophic lateral sclerosisAmyotrophic lateral sclerosisTensor imagingAmyotrophic lateral sclerosis patientsFiber connectionsSpeechNeurological disordersLateral sclerosis
2017
Speech Map: a statistical multimodal atlas of 4D tongue motion during speech from tagged and cine MR images
Woo J, Xing F, Stone M, Green J, Reese T, Brady T, Wedeen V, Prince J, Fakhri G. Speech Map: a statistical multimodal atlas of 4D tongue motion during speech from tagged and cine MR images. Computer Methods In Biomechanics And Biomedical Engineering Imaging & Visualization 2017, 7: 361-373. PMID: 31328049, PMCID: PMC6640640, DOI: 10.1080/21681163.2017.1382393.Peer-Reviewed Original ResearchMotion fieldMotion estimationTongue motionAnatomical configurationComplex motion fieldsCourse of speechCine MR imagingMotion informationInternal motionsGlossectomy patientsHealthy subjectsCine MRITongue functionMR imagingSpeech mappingClinical applicationAnatomical referenceTime course of speechTime courseSpeechDiscovering functional units of the human tongue during speech from cine- and tagged-MRI
Woo J, Stone M, Xing F, Green J, Gomez A, Wedeen V, Prince J, Fakhri G. Discovering functional units of the human tongue during speech from cine- and tagged-MRI. The Journal Of The Acoustical Society Of America 2017, 141: 3647-3647. DOI: 10.1121/1.4987883.Peer-Reviewed Original Research