2023
Synthesizing audio from tongue motion during speech using tagged MRI via transformer
Liu X, Xing F, Prince J, Stone M, Fakhri G, Woo J. Synthesizing audio from tongue motion during speech using tagged MRI via transformer. Proceedings Of SPIE--the International Society For Optical Engineering 2023, 12464: 1246410-1246410-5. PMID: 38009135, PMCID: PMC10669779, DOI: 10.1117/12.2653345.Peer-Reviewed Original ResearchMotion fieldAudio waveformAdversarial training approachImprove synthesis qualityConvolutional decoderAudio dataSynthesis qualityTranslation networkData structureSpeech waveformTemporal modelTagged MRITongue motionTraining approachSpectrogramMuscle deformationSource of informationSpeechIntelligible speechFrameworkDecodingInformationPredictive informationEncodingNetwork
2021
4D magnetic resonance imaging atlas construction using temporally aligned audio waveforms in speech
Xing F, Jin R, Gilbert I, Perry J, Sutton B, Liu X, Fakhri G, Shosted R, Woo J. 4D magnetic resonance imaging atlas construction using temporally aligned audio waveforms in speech. The Journal Of The Acoustical Society Of America 2021, 150: 3500-3508. PMID: 34852570, PMCID: PMC8580575, DOI: 10.1121/10.0007064.Peer-Reviewed Original ResearchConceptsAudio waveformTemporal domain informationMulti-subject dataAtlas constructionMutual information measureMR image datasetsImage datasetsTarget domainDomain informationPost-processing methodImage sequencesTemporal alignmentSpatiotemporal alignmentMatching patternsInformation measuresImage dataSquare errorAligned volumesAlignment mapOverall score increaseMR technologyCross-correlationDeformable registrationSpeechImages