HEART: Learning better representation of EHR data with a heterogeneous relation-aware transformer
Huang T, Rizvi S, Thakur R, Socrates V, Gupta M, van Dijk D, Taylor R, Ying R. HEART: Learning better representation of EHR data with a heterogeneous relation-aware transformer. Journal Of Biomedical Informatics 2024, 159: 104741. PMID: 39476994, DOI: 10.1016/j.jbi.2024.104741.Peer-Reviewed Original ResearchElectronic health recordsElectronic health record datasetDownstream tasksLanguage modelModeling electronic health recordsLearning better representationsPretrained language modelsEntity predictionRepresentation learningAnomaly detectionAttention weightsRelation embeddingsHealthcare applicationsEncoding schemeMed-BERTHigher-order representationsInput sequenceComputational costReadmission predictionPairwise relationshipsEHR dataElectronic health record dataSuperior performanceHeterogeneous contextsMedical entities