2023
Speech Audio Synthesis from Tagged MRI and Non-negative Matrix Factorization via Plastic Transformer
Liu X, Xing F, Stone M, Zhuo J, Fels S, Prince J, El Fakhri G, Woo J. Speech Audio Synthesis from Tagged MRI and Non-negative Matrix Factorization via Plastic Transformer. Lecture Notes In Computer Science 2023, 14226: 435-445. PMID: 38651032, PMCID: PMC11034915, DOI: 10.1007/978-3-031-43990-2_41.Peer-Reviewed Original ResearchWeight mapAudio waveformEnd-to-end deep learning frameworkMatrix factorization-based approachesFactorization-based approachDeep learning frameworkNon-negative matrix factorizationEnd-to-endAdversarial trainingProcess of speech productionTwo-dimensional spectrogramConventional convolutionLearning frameworkMotion featuresTraining samplesAudio synthesisDimension expansionMatrix inputMatrix factorizationTagged MRISpeech productionTransformation modelExperimental resultsSpectrogramPlastic transformation
2022
Tagged-MRI to audio synthesis with a pairwise heterogeneous deep translator
Liu X, Xing F, Stone M, Prince J, Kim J, Fakhri G, Woo J. Tagged-MRI to audio synthesis with a pairwise heterogeneous deep translator. The Journal Of The Acoustical Society Of America 2022, 151: a133-a133. DOI: 10.1121/10.0010891.Peer-Reviewed Original ResearchLatent space featuresEncoder-decoder structureCNN-based encoderSpace featuresDeep learning frameworkTagged MRI sequencesKullback-Leibler divergenceMel-spectrogramSpeech-related disordersLearning frameworkAudio synthesisAudio waveformSpeech productionKullback-LeiblerHeterogeneous representationsEvaluation strategiesIntelligible speechFrameworkTagged-MRISpeechDecodingAudioVisual movementEncodingUtterances
2017
Discovering functional units of the human tongue during speech from cine- and tagged-MRI
Woo J, Stone M, Xing F, Green J, Gomez A, Wedeen V, Prince J, Fakhri G. Discovering functional units of the human tongue during speech from cine- and tagged-MRI. The Journal Of The Acoustical Society Of America 2017, 141: 3647-3647. DOI: 10.1121/1.4987883.Peer-Reviewed Original Research