Online Minimum Description Length Probes
Online Minimum Description Length Probes
Auto-generated stub. Edit this file to add more details.
A lightweight probing technique that uses online minimum description length to quantify and test for the presence of specific information features within the internal representations of foundation models.
Why It Matters
Provides a novel, compression-based interpretability framework for auditing internal features in temporal foundation models.
Evidence
Using lightweight online minimum description length probes applied to the decoder architecture, we test for the presence and separability of frequency information in the model’s internal representations.
Related Papers
Metadata & Links
- created_at
- 2026-05-10T06:05:22Z