Rate-distortion optimization for transformer inference

Split computing for language models, extending the theory of usable information.

April 2026 · Anderson de Andrade, Alon Harell, Ivan V. Bajić

Lossy common information in a learnable Gray-Wyner Network

Isolate the common information between two dependent computer vision tasks.

February 2026 · Anderson de Andrade, Alon Harell, Ivan V. Bajić

Rate-distortion theory in coding for machines and its applications

Theoretical considerations and evaluation of split and distillation points.

July 2025 · Alon Harell, Yalda Foroutan, Nilesh A. Ahuja, Parual Datta, Bhavya Kanzariya, V. Srinivasa Somayazulu, Omesh Tickoo, Anderson de Andrade, Ivan V. Bajić

Towards task-compatible compressible representations

Task reconstruction loss acts as a regularizer, increasing rate-distortion performance in coding for humans and machines.

August 2024 · Anderson de Andrade, Ivan V. Bajić

Base layer efficiency in scalable human-machine coding

Improving the shared channel in coding for machines (CfM).

October 2023 · Yalda Foroutan, Alon Harell, Anderson de Andrade, Ivan V. Bajić

Conditional and residual methods in scalable coding for humans and machines

A comparison between conditional and residual entropy codecs for a two-channel systems of tasks with nested information.

August 2023 · Anderson de Andrade, Alon Harell, Yalda Foroutan, Ivan V. Bajić

An architecture for accelerated large-scale inference of transformer-based language models

Unified batch and online transformer inference.

February 2021 · Amir Ganiev, Colton Chapin, Anderson de Andrade, Chen Liu

Graph representation learning network via adaptive sampling

Graph representations using a learnable attention mechanism to sample the neighbourhood of a graph.

February 2020 · Anderson de Andrade, Chen Liu

DENS: A dataset for multi-class emotion analysis

Dataset for emotion classification of long-form narratives.

November 2019 · Chen Liu, Osama Muhammad, Anderson de Andrade

Exploring multilingual syntactic sentence representations

Sentence embeddings augmented by universal parts-of-speech tags evaluated on low-resource languages.

November 2019 · Chen Liu, Anderson de Andrade, Muhammad Osama

Unsupervised aspect extraction from free-form conversations

Dictionary-based approach for the extraction of “aspect-of” relationships.

August 2017 · En-Shiun Annie Lee, Richie Wenjie Zi, Afsaneh Fazly, Brandon Seibel, Anderson de Andrade

Best practices for convolutional neural networks applied to object recognition in images

Evaluate the performance impact of optimization algorithms, activation functions, dropout, and maxout networks, in CNNs.

April 2014 · Anderson de Andrade

A comparison of neural network training methods for text classification

Benchmark of stochastic gradient descent and Nesterov’s accelerated gradient for text classification.

December 2013 · Anderson de Andrade