2023
Speech Audio Synthesis from Tagged MRI and Non-negative Matrix Factorization via Plastic Transformer
Liu X, Xing F, Stone M, Zhuo J, Fels S, Prince J, El Fakhri G, Woo J. Speech Audio Synthesis from Tagged MRI and Non-negative Matrix Factorization via Plastic Transformer. Lecture Notes In Computer Science 2023, 14226: 435-445. PMID: 38651032, PMCID: PMC11034915, DOI: 10.1007/978-3-031-43990-2_41.Peer-Reviewed Original ResearchWeight mapAudio waveformEnd-to-end deep learning frameworkMatrix factorization-based approachesFactorization-based approachDeep learning frameworkNon-negative matrix factorizationEnd-to-endAdversarial trainingProcess of speech productionTwo-dimensional spectrogramConventional convolutionLearning frameworkMotion featuresTraining samplesAudio synthesisDimension expansionMatrix inputMatrix factorizationTagged MRISpeech productionTransformation modelExperimental resultsSpectrogramPlastic transformation
2021
A deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech
Woo J, Xing F, Prince J, Stone M, Gomez A, Reese T, Wedeen V, El Fakhri G. A deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech. Medical Image Analysis 2021, 72: 102131. PMID: 34174748, PMCID: PMC8316408, DOI: 10.1016/j.media.2021.102131.Peer-Reviewed Original ResearchConceptsNon-negative matrix factorizationSparse Non-negative Matrix FactorizationIterative shrinkage-thresholding algorithmNon-negative matrix factorization frameworkDeep neural networksMatrix factorization frameworkDeep learning frameworkTongue motionIdentified functional unitsGraph regularizationClustering performanceWeight mapLearning frameworkSpectral clusteringNeural networkMatrix factorizationModular architectureIncreased interpretabilityMotion dataFactorization frameworkConvoluted natureComparison methodTagged magnetic resonance imagingMuscle coordination patternsSpeech
2018
A Sparse Non-Negative Matrix Factorization Framework for Identifying Functional Units of Tongue Behavior From MRI
Woo J, Prince J, Stone M, Xing F, Gomez A, Green J, Hartnick C, Brady T, Reese T, Wedeen V, Fakhri G. A Sparse Non-Negative Matrix Factorization Framework for Identifying Functional Units of Tongue Behavior From MRI. IEEE Transactions On Medical Imaging 2018, 38: 730-740. PMID: 30235120, PMCID: PMC6422735, DOI: 10.1109/tmi.2018.2870939.Peer-Reviewed Original ResearchConceptsNon-negative matrix factorization frameworkProbabilistic graphical model frameworkMatrix factorization frameworkGraphical model frameworkWeight mapSpectral clusteringSynthetic dataMuscle coordination patternsMatrix factorizationMotion dataMotion patternsTongue motionFactorization frameworkTwo-dimensional imagesMuscle groupsLocal regionsLocal muscle groupLocal structural elementsTagged-MRIImagesFunctional muscle groups
2017
Discovering functional units of the human tongue during speech from cine- and tagged-MRI
Woo J, Stone M, Xing F, Green J, Gomez A, Wedeen V, Prince J, Fakhri G. Discovering functional units of the human tongue during speech from cine- and tagged-MRI. The Journal Of The Acoustical Society Of America 2017, 141: 3647-3647. DOI: 10.1121/1.4987883.Peer-Reviewed Original Research