LED: Light Enhanced Depth Estimation at Night

1Mines Paris - PSL University, 2Valeo, 3valeo.ai
LED Overview

Abstract

Nighttime camera-based depth estimation is a highly challenging task, especially for autonomous driving applications, where accurate depth perception is essential for ensuring safe navigation. Models trained on daytime data often fail in the absence of precise but costly LiDAR. Even vision foundation models trained on large amounts of data are unreliable in low-light conditions. In this work, we aim to improve the reliability of perception systems at night time. To this end, we introduce Light Enhanced Depth (LED), a novel, cost-effective approach that significantly improves depth estimation in low-light environments by harnessing a pattern projected by high definition headlights available in modern vehicles. LED leads to significant performance boosts across multiple depth-estimation architectures (encoder-decoder, Adabins, DepthFormer, Depth Anything V2) both on synthetic and real datasets. Furthermore, increased performances beyond illuminated areas reveal a holistic enhancement in scene understanding. Finally, we release the Nighttime Synthetic Drive Dataset, a synthetic and photo-realistic nighttime dataset, which comprises 49,990 comprehensively annotated images.

Qualitative results on real-world scenarios


real-world experiment

Qualitative results on the Nighttime Synthetic Drive Dataset


synthetic experiment

Nighttime Synthetic Drive Dataset


The Nighttime Synthetic Drive Dataset has been generated using Nvidia Drive Sim (Drop 15). It comprises 24,995 images with HD light patterns (structured light) and 24,995 images with high beam illumination. All RGB images have annotations for object detection 2D/3D, depth and normals estimation, semantic and instance segmentation. See the paper and github for more information.


If you use this dataset in your research, please cite our article.
By downloading the dataset, you agree to the terms and conditions.

BibTeX

@inproceedings{deMoreau2025led,
  author    = {Simon de Moreau and Yasser Almehio and Andrei Bursuc and Hafid EL IDRISSI and Bogdan Stanciulescu and Fabien Moutarde},
  title     = {LED: Light Enhanced Depth Estimation at Night},
  booktitle = {BMVC},
  year      = {2025},
}