Continuous-depth Transformer Encoder
Continuous-depth Transformer Encoder
Auto-generated stub. Edit this file to add more details.
A transformer architecture that replaces discrete residual updates with continuous latent dynamics governed by Neural ODEs and adaptive numerical integration.
Why It Matters
This architecture represents a significant departure from standard discrete-time layer architectures by explicitly modeling temporal evolution as a continuous dynamical process.
Evidence
we propose a continuous-depth transformer encoder for weather forecasting that integrates Neural Ordinary Differential Equation (Neural ODE) dynamics within each encoder block.
Related Papers
Metadata & Links
- created_at
- 2026-05-03T06:02:59Z