Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropy
Liao D, Liu C, Christensen B, Tong A, Huguet G, Wolf G, Nickel M, Adelstein I, Krishnaswamy S. Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropy. 2024, 00: 1-6. DOI: 10.1109/ciss59072.2024.10480166.Peer-Reviewed Original ResearchMutual information neural estimatorMutual informationHigh-dimensional simulation dataHigh-dimensional dataNeural network representationSpectral entropyCIFAR-10Information-theoretic measuresClass labelsSTL-10Classification networkNeural representationSelf-supervisionSupervised learningIntrinsic dimensionalityClassification accuracyNeural networkAmbient dimensionNoise-resilientNeural estimatorNetwork initializationData geometryNetwork representationOverfittingNetwork