DimHand: A Large-Scale Benchmark for
Hand Pose Estimation under
Dynamic Low-Light Conditions

Hanling Zhan1    Pengfei Ren2*    Haoyang Zhang3*    Xinyi Wang1    Liang Xie3    Erwei Yin3
1Shanghai Jiao Tong University    2Beijing University of Posts and Telecommunications    3Defense Innovation Institute, Academy of Military Sciences
*Corresponding author

ACM MM 2026

Comparison with Existing Datasets

Dataset Accessible Modality Temporal ⏰ Illumination 💡 Type Subjects Frames Annotation Method Joint MANO
Low-light Human Pose Datasets
UIRE-Net RGB Static Natural Real - 100 Manual
ExLPose RGB Static ND filter Real+Syn. - 2556 Manual
ExLPose-OCN RGB Static Natural Real - 360 Manual
LLIP RGB+MoCap Sequential Mean Pixel Intensity Real 8 (5♂ 3♀) 17.1K Marker
Low-light Hand Pose Datasets
LLHands RGB Static 0.5, 1, 2 lux Real 10 120K Automatic
DimHand RGB+Depth Sequential 0.1-10 lux Real 15 (9♂ 6♀) 745K Semi-Auto

ND: neutral-density; MoCap: motion capture

Project Video

Project overview video demonstrating DimHand dataset and DimNet framework

Abstract

RGB-based 3D hand pose estimation (HPE) in dynamic real-world environments is a foundational technology for human-computer interaction. Although current methods achieve remarkable performance under controlled conditions, they remain sensitive to extremely low-light conditions. Specifically, it involves low signal-to-noise ratios and missing visual cues, making it difficult to acquire precise 3D motion annotations from RGB. As a compromise, existing low-light datasets capture static poses, failing to reflect real-world complex dynamic motions. To this end, we develop a multi-modal, multi-view capture system with adjustable illumination and a high-fidelity illumination-invariance automated annotation pipeline, decoupling 3D annotation from adverse lighting, preserving photometric realism and illumination variations. Based on this pipeline, we propose DimHand, the first large-scale 3D hand pose dataset capturing continuous motion under dynamic low-light conditions, comprising 745,280 frames from 15 subjects performing 15 distinct sequential actions across 5 viewpoints with illumination ranging from 0.1 to 10 lux. However, the coupling between severe visual degradation and the intrinsic complexity of hand structure induces spatial and semantic ambiguity. To address these challenges, we propose DimNet, an end-to-end framework that leverages 3D structural priors via a Kinematic Prior Codebook (KPC) for structural regularization and a Spatial-Semantic Projection (SSP) for local semantic refinement. Extensive experiments demonstrate that DimNet outperforms state-of-the-art methods, particularly in generalizing to unseen dynamic hand motions, thereby establishing a strong low-light baseline for 3D HPE.

DimHand Dataset Overview - Comparison of 3D hand datasets

DimHand is the first large-scale 3D hand pose dataset capturing continuous motion under dynamic low-light conditions, comprising 745,280 frames from 15 subjects performing 15 distinct sequential actions across 5 viewpoints with illumination ranging from 0.1 to 10 lux.

Data acquisition and annotation pipeline

Data acquisition and annotation pipeline. We utilize five synchronized RGB-D cameras and an adjustable illumination capture system to capture multi-modal data. High-precision annotations are automatically generated through a multi-view depth-guided pose estimation framework.

Benchmark

DimNet Architecture

  • (a) IAE — Illumination Adaptation Enhancer performs task-specific restoration to recover fundamental visual signals from degraded low-light inputs.
  • (b) KPC — Kinematic Prior Codebook anchors ambiguous visual features into a structured kinematic manifold for global structural constraints.
  • (c) SSP — Spatial-Semantic Projection establishes 2D–3D spatial correspondence by selectively sampling within geometrically valid regions.
DimNet Architecture Diagram

Dataset & Experiment Details

Subject ID Gender
Hand morphological diversity across 15 subjects

Visual comparison of hand morphological diversity across 15 subjects in the DimHand dataset, illustrating the variance in hand shape, overall size, and the natural bending states of the fingers.

Extended qualitative comparisons on DimHand

Qualitative comparisons on the DimHand dataset. From left to right: (1) RGB input, (2) WiLoR on input, (3) HaMeR on input, (4) DimNet (Ours), (5) HVI-enhanced image, (6) WiLoR applied to the HVI-enhanced image, (7) HaMeR applied to the HVI-enhanced image, and (8) GT on enhanced image. We evaluate the proposed DimNet against state-of-the-art baselines including WiLoR and HaMeR. The notation HVI enh. indicates that the low-light images are preprocessed using the HVI low-light enhancement network, yielding the HVI+WiLoR and HVI+HaMeR pipelines. While DimNet consistently maintains robust structural integrity, the baseline methods suffer from severe estimation failures caused by either extreme dark degradation or the misleading artifacts introduced by the image enhancement process.

Gesture Classes

All 15 gesture classes and their corresponding descriptions defined in the DimHand dataset

ID Name Type Description
00 Calibration Global Open hand rotating and translating freely in all directions
01 Finger Counting Pose-oriented Sequential hand poses representing digits from 0 to 9
02 Finger Bending Action-driven Individual and pairwise joint-by-joint finger bending towards the palm
03 Finger Tapping Action-driven Individual and pairwise finger tapping motions
04 Finger Pinching Action-driven Pairwise, three-finger, and four-finger pinching combinations
05 Thumb Tap Palm Action-driven Thumb sequentially tapping various joints on the palmar side
06 Thumb Tap Back Action-driven Thumb sequentially tapping various joints on the dorsal side
07 Finger Walking Composite Staggered finger walking motions simulating piano playing
08 Finger Snapping Composite Snapping motions by rubbing the thumb against each finger
09 Thumb Sliding Palm Composite Thumb continuously sliding across fingers on the palmar side
10 Thumb Sliding Back Composite Thumb continuously sliding across fingers on the dorsal side
11 Finger Wiggling Action-driven Continuous horizontal wiggling motions of individual fingers
12 Finger Crossing Pose-oriented Fingers stacking and crossing to create severe self-occlusions
13 Finger Interlocking Pose-oriented Thumb interlocking and weaving through gaps between fingers
14 Random Gestures Composite Continuous, spontaneous, and unconstrained natural hand motions

Dataset Directory Structure

${ROOT}
├── multidata/
│   ├── subject1 ~ subject15/          # 15 subjects
│   │   ├── action01 ~ action15/       # 15 actions per subject
│   │   │   ├── camera0 ~ camera4/     # 5 camera views
│   │   │   │   ├── rgb/               # RGB sequences
│   │   │   │   ├── depth/             # Depth map sequences
│   │   │   │   └── center_uvd.json    # Center of Bounding Box
│   │   │   └── camera_paras.json      # Camera parameters
│   │   │...
│   │...
├── annotations/
│   ├── subject1 ~ subject15/
│   │   ├── action01 ~ action15/
│   │   │   ├── joint.json             # 3D joint annotations
│   │   │   ├── mano.json              # MANO parameters
│   │   │   └── mesh.json              # 3D hand mesh
│   │   │...
│   │...

Note: The above directory structure represents how the dataset is organized.

Citation

@inproceedings{zhan2026dimhand,
  title={DimHand: A Large-Scale Benchmark for Hand Pose Estimation under Dynamic Low-Light Conditions},
  author={Zhan, Hanling and Ren, Pengfei and Zhang, Haoyang and Wang, Xinyi and Xie, Liang and Yin, Erwei},
  booktitle={Proceedings of the 34th ACM International Conference on Multimedia (MM '26)},
  year={2026}
}