2023
Synthesizing audio from tongue motion during speech using tagged MRI via transformer
Liu X, Xing F, Prince J, Stone M, Fakhri G, Woo J. Synthesizing audio from tongue motion during speech using tagged MRI via transformer. Proceedings Of SPIE--the International Society For Optical Engineering 2023, 12464: 1246410-1246410-5. PMID: 38009135, PMCID: PMC10669779, DOI: 10.1117/12.2653345.Peer-Reviewed Original ResearchMotion fieldAudio waveformAdversarial training approachImprove synthesis qualityConvolutional decoderAudio dataSynthesis qualityTranslation networkData structureSpeech waveformTemporal modelTagged MRITongue motionTraining approachSpectrogramMuscle deformationSource of informationSpeechIntelligible speechFrameworkDecodingInformationPredictive informationEncodingNetwork
2022
Cmri2spec: Cine MRI Sequence to Spectrogram Synthesis via A Pairwise Heterogeneous Translator
Liu X, Xing F, Stone M, Prince J, Kim J, El Fakhri G, Woo J. Cmri2spec: Cine MRI Sequence to Spectrogram Synthesis via A Pairwise Heterogeneous Translator. 2013 IEEE International Conference On Acoustics, Speech And Signal Processing 2022, 00: 1481-1485. PMID: 36212702, PMCID: PMC9544268, DOI: 10.1109/icassp43922.2022.9746381.Peer-Reviewed Original ResearchMultimodal representation learningAdversarial training approachCine MRI sequencesCNN encoderRepresentation learningConvolutional decoderAdversarial networkDataset sizeSequence encodingEnhance realismHeterogeneous translationSpeech wordsSynthesis frameworkTraining approachExperimental resultsEncodingSynthesis accuracySpectrogramFrameworkDecodingTagged-MRI to audio synthesis with a pairwise heterogeneous deep translator
Liu X, Xing F, Stone M, Prince J, Kim J, Fakhri G, Woo J. Tagged-MRI to audio synthesis with a pairwise heterogeneous deep translator. The Journal Of The Acoustical Society Of America 2022, 151: a133-a133. DOI: 10.1121/10.0010891.Peer-Reviewed Original ResearchLatent space featuresEncoder-decoder structureCNN-based encoderSpace featuresDeep learning frameworkTagged MRI sequencesKullback-Leibler divergenceMel-spectrogramSpeech-related disordersLearning frameworkAudio synthesisAudio waveformSpeech productionKullback-LeiblerHeterogeneous representationsEvaluation strategiesIntelligible speechFrameworkTagged-MRISpeechDecodingAudioVisual movementEncodingUtterances
2021
A Unified Conditional Disentanglement Framework For Multimodal Brain Mr Image Translation
Liu X, Xing F, Fakhri G, Woo J. A Unified Conditional Disentanglement Framework For Multimodal Brain Mr Image Translation. 2011 IEEE International Symposium On Biomedical Imaging: From Nano To Macro 2021, 00: 10-14. PMID: 34567419, PMCID: PMC8460116, DOI: 10.1109/isbi48211.2021.9433897.Peer-Reviewed Original Research