The geometry of efficient codes: How rate-distortion trade-offs distort the latent representations of generative models
by Leo D’Amato, Gian Luca Lancia, Giovanni Pezzulo
Living organisms rely on internal models of the world to act adaptively. These models, because of resource limitations, cannot encode every detail and hence need to compress information. From a cognitive standpoint, information compression can manifest as a distortion of latent representations, resulting in the emergence of representations that may not accurately reflect the external world or its geometry. Rate-distortion theory formalizes... Читать дальше...
