Breaking Scale Anchoring: Frequency Representation Learning for Accurate High-Resolution Inference from Low-Resolution Training

Published in preprint, 2025

Wenshuo Wang, Fan Zhang† († Corresponding Author)

  • When deep learning models perform spatiotemporal forecasting at higher resolutions, they do not exhibit the power-law error decay characteristic of numerical solvers. Instead, their accuracy remains almost unchanged. We regard this long-accepted behavior as a problem, which we term Scale Anchoring.
  • We identify the core limitation behind Scale Anchoring as the Nyquist frequency of the training data. Based on this insight, we propose Frequency Representation Learning to induce frequency-domain extrapolation with only minor computational overhead, enabling the model to mitigate this issue.

Recommended citation: Wenshuo Wang, Fan Zhang. "Breaking Scale Anchoring: Frequency Representation Learning for Accurate High-Resolution Inference from Low-Resolution Training." preprint, 2025.