MetricTrail: Revisiting the Power of Metric Depth and Local Optimization for Long-Sequence Streaming 3D Reconstruction

TL;DR: Long-sequence reconstruction without curating additional long-sequence training data.

Teaser Video01:39 / NO AUDIO
01 OVERVIEW

Abstract

We present MetricTrail, a streaming system for accurate camera motion estimation and dense reconstruction from long monocular videos. To keep inference efficient over long sequences, we revisit DPVO's sparse local estimator. We find that single-image metric depth substantially improves its trajectory accuracy, without retraining the correspondence network or enlarging the optimization window. Metric predictions initialize patch depths and remain as soft constraints during optimization. We further improve correspondence estimation through learned adapters that augment matching features and recurrent context with frozen DINOv3 representations. The correspondence estimator and adapters are trained on diverse short clips without additional long-sequence training. This modular design also allows the depth provider to be independently upgraded and supports supplied camera intrinsics and calibrated stereo observations without retraining. Under the reported RGB-only protocols, MetricTrail achieves the lowest average trajectory error among evaluated methods on KITTI, Oxford Spires, and VBR. Pairing the estimated poses with single-image depth predictions also produces strong dense reconstruction on indoor and outdoor benchmarks and coherent reconstructions of in-the-wild videos. With supplied intrinsics, the system processes KITTI-02 at 12.70 FPS with 3.21 GB peak GPU memory.

02 THE SOLUTION

Our Method

Metric priors, learned correspondences, local optimization. Metric depth initializes patches and remains a soft constraint during bundle adjustment. Frozen DINOv3 features augment matching and recurrent context through learned adapters. Poses refined in a bounded local window align dense depth into a shared reconstruction.
03 LONG-SEQUENCE RECONSTRUCTION

Long-sequence Results

Oxford Spires

3,840 frames · 0.80 km

Estimated Ground truth

LingBot-Map

LingBot-Map estimated Oxford trajectory compared with ground truth
ATE ↓27.27 m

HorizonStream

HorizonStream estimated Oxford trajectory compared with ground truth
ATE ↓25.48 m

MetricTrail OURS

MetricTrail estimated Oxford trajectory closely follows ground truth
ATE ↓5.71 m
04 RECONSTRUCTION

In-the-wild Results

Input samples
Input sample: outdoor courtyard with seating and canopy Input sample: courtyard façade and windows Input sample: narrow outdoor passage Input sample: entry bar and surrounding interior Input sample: stairway and surrounding interior Input sample: coffee counter and corridor Input sample: bedroom entrance and adjoining room Input sample: bedroom interior
INDOOR → OUTDOOR → INDOOR Drag to rotate · Scroll to zoom Trajectory: show/hide camera poses

MetricTrail OURS

LingBot-Map

LoGeR

Scal3R

Same input sequence · Downsampled reconstructions · Rainbow camera trajectories

More Scenes

Single-frame depth-prior examples from in-the-wild and benchmark scenes. Rotate the back-projected geometry to inspect the depth input.

05 TRAJECTORY ACCURACY

Quantitative Results

MetricTrail Prior methods ↓ Lower ATE is better

Mean full-sequence ATE (m) · Sim(3) alignment · * Alignment optimization · LC: loop closure

Generalization Across Metric Depth Priors

ATE (m) ↓
DPVO DPVO + prior MetricTrail + prior
06 REFERENCE

Citation

@inproceedings{gao2026metrictrail,
    title={MetricTrail: Revisiting the Power of Metric Depth and Local Optimization for Long-Sequence Streaming 3D Reconstruction},
    author={Gao, Jingnan and Huang, Jiahui and Elflein, Sven and Zheng, Jianhao and Ke, Bingxin and Yang, Xiaokang and Yan, Yichao and Leal-Taix{\'e}, Laura and Zhou, Qunjie and Ren, Jiawei and Huang, Shengyu},
    booktitle={NVIDIA Research Whitepapers},
    year={2026}
}

MetricTrail · Method overview

Enlarged MetricTrail method diagram

Scroll horizontally on smaller screens to inspect the full diagram.