2023
Synthesizing audio from tongue motion during speech using tagged MRI via transformer
Liu X, Xing F, Prince J, Stone M, Fakhri G, Woo J. Synthesizing audio from tongue motion during speech using tagged MRI via transformer. Proceedings Of SPIE--the International Society For Optical Engineering 2023, 12464: 1246410-1246410-5. PMID: 38009135, PMCID: PMC10669779, DOI: 10.1117/12.2653345.Peer-Reviewed Original ResearchMotion fieldAudio waveformAdversarial training approachImprove synthesis qualityConvolutional decoderAudio dataSynthesis qualityTranslation networkData structureSpeech waveformTemporal modelTagged MRITongue motionTraining approachSpectrogramMuscle deformationSource of informationSpeechIntelligible speechFrameworkDecodingInformationPredictive informationEncodingNetwork
2022
Cmri2spec: Cine MRI Sequence to Spectrogram Synthesis via A Pairwise Heterogeneous Translator
Liu X, Xing F, Stone M, Prince J, Kim J, El Fakhri G, Woo J. Cmri2spec: Cine MRI Sequence to Spectrogram Synthesis via A Pairwise Heterogeneous Translator. 2013 IEEE International Conference On Acoustics, Speech And Signal Processing 2022, 00: 1481-1485. PMID: 36212702, PMCID: PMC9544268, DOI: 10.1109/icassp43922.2022.9746381.Peer-Reviewed Original ResearchMultimodal representation learningAdversarial training approachCine MRI sequencesCNN encoderRepresentation learningConvolutional decoderAdversarial networkDataset sizeSequence encodingEnhance realismHeterogeneous translationSpeech wordsSynthesis frameworkTraining approachExperimental resultsEncodingSynthesis accuracySpectrogramFrameworkDecoding
2021
A Unified Conditional Disentanglement Framework For Multimodal Brain Mr Image Translation
Liu X, Xing F, Fakhri G, Woo J. A Unified Conditional Disentanglement Framework For Multimodal Brain Mr Image Translation. 2011 IEEE International Symposium On Biomedical Imaging: From Nano To Macro 2021, 00: 10-14. PMID: 34567419, PMCID: PMC8460116, DOI: 10.1109/isbi48211.2021.9433897.Peer-Reviewed Original Research