CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning
Du Y, Chang B, Dvornek N. CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning. Lecture Notes In Computer Science 2024, 15012: 465-475. DOI: 10.1007/978-3-031-72390-2_44.Peer-Reviewed Original ResearchContrastive Language-Image Pre-trainingLanguage modelState-of-the-art performanceSelf-supervised representation learningContrastive learning methodFine-tuningProlonged training timeBERT encoderContrastive learningRepresentation learningClass labelsGPU resourcesTraining samplesTraining timeMammography datasetModel sizePre-trainingLearning methodsEfficient frameworkVisual modelRichness of informationDatasetClinical diagnostic dataLearningMedical applications