2023
Speech Audio Synthesis from Tagged MRI and Non-negative Matrix Factorization via Plastic Transformer
Liu X, Xing F, Stone M, Zhuo J, Fels S, Prince J, El Fakhri G, Woo J. Speech Audio Synthesis from Tagged MRI and Non-negative Matrix Factorization via Plastic Transformer. Lecture Notes In Computer Science 2023, 14226: 435-445. PMID: 38651032, PMCID: PMC11034915, DOI: 10.1007/978-3-031-43990-2_41.Peer-Reviewed Original ResearchWeight mapAudio waveformEnd-to-end deep learning frameworkMatrix factorization-based approachesFactorization-based approachDeep learning frameworkNon-negative matrix factorizationEnd-to-endAdversarial trainingProcess of speech productionTwo-dimensional spectrogramConventional convolutionLearning frameworkMotion featuresTraining samplesAudio synthesisDimension expansionMatrix inputMatrix factorizationTagged MRISpeech productionTransformation modelExperimental resultsSpectrogramPlastic transformation
2022
Cmri2spec: Cine MRI Sequence to Spectrogram Synthesis via A Pairwise Heterogeneous Translator
Liu X, Xing F, Stone M, Prince J, Kim J, El Fakhri G, Woo J. Cmri2spec: Cine MRI Sequence to Spectrogram Synthesis via A Pairwise Heterogeneous Translator. 2013 IEEE International Conference On Acoustics, Speech And Signal Processing 2022, 00: 1481-1485. PMID: 36212702, PMCID: PMC9544268, DOI: 10.1109/icassp43922.2022.9746381.Peer-Reviewed Original ResearchMultimodal representation learningAdversarial training approachCine MRI sequencesCNN encoderRepresentation learningConvolutional decoderAdversarial networkDataset sizeSequence encodingEnhance realismHeterogeneous translationSpeech wordsSynthesis frameworkTraining approachExperimental resultsEncodingSynthesis accuracySpectrogramFrameworkDecoding