Hyden: A Hybrid Dual-Path Encoder for Monocular Geometry of High-Resolution Images
Abstract
We present a hybrid dual-path vision encoder (Hyden) for high-resolution monocular depth, point map and surface normal estimation, surpassing state-of-the-art accuracy with a fraction of the inference cost. The architecture pairs a low-resolution Vision Transformer branch for global context with a full-resolution CNN branch for fine details, fusing features via a lightweight MLP before decoding. By exploiting the linear scaling of CNNs and constraining transformer computation to a fixed resolution, the model delivers fast inference even on multi-megapixel inputs. To overcome the scarcity of high-quality high-resolution supervision, we introduce a self-distillation framework that generates pseudo-labels from existing models at both lower resolution full images and high-resolution crops—global labels preserve geometric accuracy, while local labels capture sharper details. To demonstrate the flexibility of our approach, we integrate Hyden and our self-distillation method into DepthAnything-v2 for depth estimation and MoGe2 for surface normal and metric point map prediction, achieving state-of-the-art results on high-resolution benchmarks with the lowest inference latency among competing methods.
Cite
Text
Zhang et al. "Hyden: A Hybrid Dual-Path Encoder for Monocular Geometry of High-Resolution Images." International Conference on Learning Representations, 2026.Markdown
[Zhang et al. "Hyden: A Hybrid Dual-Path Encoder for Monocular Geometry of High-Resolution Images." International Conference on Learning Representations, 2026.](https://mlanthology.org/iclr/2026/zhang2026iclr-hyden/)BibTeX
@inproceedings{zhang2026iclr-hyden,
title = {{Hyden: A Hybrid Dual-Path Encoder for Monocular Geometry of High-Resolution Images}},
author = {Zhang, Zaiwei and Mapeke, Marc and Ye, Wei and Ranjan, Rakesh and Huang, Jq},
booktitle = {International Conference on Learning Representations},
year = {2026},
url = {https://mlanthology.org/iclr/2026/zhang2026iclr-hyden/}
}