Skip to content

Online Minimum Description Length Probes

Home / Concepts / Online Minimum Description Length Probes

Online Minimum Description Length Probes

Auto-generated stub. Edit this file to add more details.

A lightweight probing technique that uses online minimum description length to quantify and test for the presence of specific information features within the internal representations of foundation models.

Why It Matters

Provides a novel, compression-based interpretability framework for auditing internal features in temporal foundation models.

Evidence

Using lightweight online minimum description length probes applied to the decoder architecture, we test for the presence and separability of frequency information in the model’s internal representations.

Metadata & Links