feat(action): add human hand pose dataset#71
Merged
Conversation
Contributor
Author
|
Need Michael(Zhengyu) Huang's help to review it. |
hans-yang-tps
marked this pull request as draft
July 1, 2026 09:58
Signed-off-by: Hans Yang <hayang@nvidia.com>
hans-yang-tps
force-pushed
the
data/hand-pose-fd
branch
from
July 2, 2026 01:40
fa6744b to
38944bf
Compare
hans-yang-tps
changed the title
Collaborator
|
one more comment. Please fix. |
Contributor
Author
|
Also removed Mecka keywords. |
# Conflicts: # cosmos_framework/data/generator/action/datasets/human_hand_pose_lerobot_dataset.py # cosmos_framework/data/generator/action/datasets/human_hand_pose_lerobot_dataset_test.py # cosmos_framework/data/generator/action/normalizer_stats/human_hand_pose_lerobot_stats.json # cosmos_framework/data/vfm/action/datasets/__init__.py
hans-yang-tps
marked this pull request as ready for review
July 9, 2026 08:45
mli0603
approved these changes
Jul 15, 2026
hans-yang-tps
marked this pull request as draft
July 16, 2026 00:20
hans-yang-tps
marked this pull request as ready for review
July 16, 2026 00:28
hans-yang-tps
changed the title
hans-yang-tps
marked this pull request as draft
July 16, 2026 13:57
hans-yang-tps
force-pushed
the
data/hand-pose-fd
branch
from
July 16, 2026 14:13
99cac1e to
ea6e51b
Compare
hans-yang-tps
changed the title
hans-yang-tps
marked this pull request as ready for review
July 16, 2026 14:14
Contributor
Author
mli0603
enabled auto-merge (squash)
July 17, 2026 01:19
lfengad
approved these changes
Jul 20, 2026
lfengad
pushed a commit
to NVIDIA/cosmos
that referenced
this pull request
Jul 22, 2026
## Description Add a Cosmos3 Nano functional-dexterity hand-pose inference example to the Action cookbook, covering both Cosmos Framework and vLLM-Omni execution paths. Depends on NVIDIA/cosmos-framework#71 for the public human hand-pose dataset definition. ## Changes - Add one self-contained validation episode for the task `unscrew nut with screwdriver` as a LeRobot asset with one Parquet file and one MP4 file. - Reindex the public-facing episode metadata and remove source user IDs, original episode IDs, and private filesystem paths. - Add a hand-pose action-definition section to the Action cookbook README. - Add matching hand-pose setup, inference, and preview sections to `run_fd_with_cosmos_framework.ipynb` and `run_fd_with_vllm.ipynb`. ## Validation - Selected the episode from the validation split, not the training split. - Asset integrity: 1,440 video frames at 30 FPS, 832x480; one matching Parquet episode. - Cosmos Framework notebook: 45 cells, 18 code cells, zero errors, and zero unexecuted non-empty code cells. - vLLM-Omni notebook: 38 cells, 17 code cells, zero errors; only the two pre-existing empty placeholder cells were unexecuted. - Hand-pose output through each path: 17 frames at 15 FPS, 832x480. - Notebook sources contain no stored outputs or execution counts. --------- Signed-off-by: Hans Yang <hayang@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Testing