Rate-distortion optimization for transformer inference
Split computing for language models, extending the theory of usable information.
Learning Theory
Lossy common information in a learnable Gray-Wyner Network
Isolate the common information between two dependent computer vision tasks.
Rate-distortion theory in coding for machines and its applications
Theoretical considerations and evaluation of split and distillation points.