| Dataset | Accessible | Modality | Temporal ⏰ | Illumination 💡 | Type | Subjects | Frames | Annotation Method | Joint | MANO |
|---|---|---|---|---|---|---|---|---|---|---|
| Low-light Human Pose Datasets | ||||||||||
| UIRE-Net | ✘ | RGB | Static | Natural | Real | - | 100 | Manual | ✔ | ✘ |
| ExLPose | ✔ | RGB | Static | ND filter | Real+Syn. | - | 2556 | Manual | ✔ | ✘ |
| ExLPose-OCN | ✔ | RGB | Static | Natural | Real | - | 360 | Manual | ✔ | ✘ |
| LLIP | ✔ | RGB+MoCap | Sequential | Mean Pixel Intensity | Real | 8 (5♂ 3♀) | 17.1K | Marker | ✔ | ✘ |
| Low-light Hand Pose Datasets | ||||||||||
| LLHands | ✘ | RGB | Static | 0.5, 1, 2 lux | Real | 10 | 120K | Automatic | ✔ | ✘ |
| DimHand | ✔ | RGB+Depth | Sequential | 0.1-10 lux | Real | 15 (9♂ 6♀) | 745K | Semi-Auto | ✔ | ✔ |
ND: neutral-density; MoCap: motion capture
Project overview video demonstrating DimHand dataset and DimNet framework
RGB-based 3D hand pose estimation (HPE) in dynamic real-world environments is a foundational technology for human-computer interaction. Although current methods achieve remarkable performance under controlled conditions, they remain sensitive to extremely low-light conditions. Specifically, it involves low signal-to-noise ratios and missing visual cues, making it difficult to acquire precise 3D motion annotations from RGB. As a compromise, existing low-light datasets capture static poses, failing to reflect real-world complex dynamic motions. To this end, we develop a multi-modal, multi-view capture system with adjustable illumination and a high-fidelity illumination-invariance automated annotation pipeline, decoupling 3D annotation from adverse lighting, preserving photometric realism and illumination variations. Based on this pipeline, we propose DimHand, the first large-scale 3D hand pose dataset capturing continuous motion under dynamic low-light conditions, comprising 745,280 frames from 15 subjects performing 15 distinct sequential actions across 5 viewpoints with illumination ranging from 0.1 to 10 lux. However, the coupling between severe visual degradation and the intrinsic complexity of hand structure induces spatial and semantic ambiguity. To address these challenges, we propose DimNet, an end-to-end framework that leverages 3D structural priors via a Kinematic Prior Codebook (KPC) for structural regularization and a Spatial-Semantic Projection (SSP) for local semantic refinement. Extensive experiments demonstrate that DimNet outperforms state-of-the-art methods, particularly in generalizing to unseen dynamic hand motions, thereby establishing a strong low-light baseline for 3D HPE.
DimHand is the first large-scale 3D hand pose dataset capturing continuous motion under dynamic low-light conditions, comprising 745,280 frames from 15 subjects performing 15 distinct sequential actions across 5 viewpoints with illumination ranging from 0.1 to 10 lux.
Data acquisition and annotation pipeline. We utilize five synchronized RGB-D cameras and an adjustable illumination capture system to capture multi-modal data. High-precision annotations are automatically generated through a multi-view depth-guided pose estimation framework.
| Subject ID | Gender |
|---|
Visual comparison of hand morphological diversity across 15 subjects in the DimHand dataset, illustrating the variance in hand shape, overall size, and the natural bending states of the fingers.
Qualitative comparisons on the DimHand dataset. From left to right: (1) RGB input, (2) WiLoR on input, (3) HaMeR on input, (4) DimNet (Ours), (5) HVI-enhanced image, (6) WiLoR applied to the HVI-enhanced image, (7) HaMeR applied to the HVI-enhanced image, and (8) GT on enhanced image. We evaluate the proposed DimNet against state-of-the-art baselines including WiLoR and HaMeR. The notation HVI enh. indicates that the low-light images are preprocessed using the HVI low-light enhancement network, yielding the HVI+WiLoR and HVI+HaMeR pipelines. While DimNet consistently maintains robust structural integrity, the baseline methods suffer from severe estimation failures caused by either extreme dark degradation or the misleading artifacts introduced by the image enhancement process.
All 15 gesture classes and their corresponding descriptions defined in the DimHand dataset
| ID | Name | Type | Description |
|---|---|---|---|
| 00 | Calibration | Global | Open hand rotating and translating freely in all directions |
| 01 | Finger Counting | Pose-oriented | Sequential hand poses representing digits from 0 to 9 |
| 02 | Finger Bending | Action-driven | Individual and pairwise joint-by-joint finger bending towards the palm |
| 03 | Finger Tapping | Action-driven | Individual and pairwise finger tapping motions |
| 04 | Finger Pinching | Action-driven | Pairwise, three-finger, and four-finger pinching combinations |
| 05 | Thumb Tap Palm | Action-driven | Thumb sequentially tapping various joints on the palmar side |
| 06 | Thumb Tap Back | Action-driven | Thumb sequentially tapping various joints on the dorsal side |
| 07 | Finger Walking | Composite | Staggered finger walking motions simulating piano playing |
| 08 | Finger Snapping | Composite | Snapping motions by rubbing the thumb against each finger |
| 09 | Thumb Sliding Palm | Composite | Thumb continuously sliding across fingers on the palmar side |
| 10 | Thumb Sliding Back | Composite | Thumb continuously sliding across fingers on the dorsal side |
| 11 | Finger Wiggling | Action-driven | Continuous horizontal wiggling motions of individual fingers |
| 12 | Finger Crossing | Pose-oriented | Fingers stacking and crossing to create severe self-occlusions |
| 13 | Finger Interlocking | Pose-oriented | Thumb interlocking and weaving through gaps between fingers |
| 14 | Random Gestures | Composite | Continuous, spontaneous, and unconstrained natural hand motions |
${ROOT}
├── multidata/
│ ├── subject1 ~ subject15/ # 15 subjects
│ │ ├── action01 ~ action15/ # 15 actions per subject
│ │ │ ├── camera0 ~ camera4/ # 5 camera views
│ │ │ │ ├── rgb/ # RGB sequences
│ │ │ │ ├── depth/ # Depth map sequences
│ │ │ │ └── center_uvd.json # Center of Bounding Box
│ │ │ └── camera_paras.json # Camera parameters
│ │ │...
│ │...
├── annotations/
│ ├── subject1 ~ subject15/
│ │ ├── action01 ~ action15/
│ │ │ ├── joint.json # 3D joint annotations
│ │ │ ├── mano.json # MANO parameters
│ │ │ └── mesh.json # 3D hand mesh
│ │ │...
│ │...
Note: The above directory structure represents how the dataset is organized.
@inproceedings{zhan2026dimhand,
title={DimHand: A Large-Scale Benchmark for Hand Pose Estimation under Dynamic Low-Light Conditions},
author={Zhan, Hanling and Ren, Pengfei and Zhang, Haoyang and Wang, Xinyi and Xie, Liang and Yin, Erwei},
booktitle={Proceedings of the 34th ACM International Conference on Multimedia (MM '26)},
year={2026}
}