Contact Sales
EgoChores Sample Dataset

Egocentric manipulation data, collected from scratch

Get a free one-hour sample of the EgoChores dataset: novel, first-person video of real household chores, captured and annotated for dexterous hand-object manipulation. Commission a dataset to your own spec.

Request the free sample

EgoChores Dataset Consultation

Four first-person frames of household chores from the EgoChores dataset
What's included

Dataset specifications

Covered activities

  • Vacuuming & mopping
  • Sweeping
  • Wiping countertops & flat surfaces
  • Scrubbing stovetop
  • Cleaning sink
  • Wiping shower/tub
Plus 21 more Show less
  • Cleaning mirrors/glass
  • Dusting shelves & furniture
  • Dusting ceiling fans
  • Cleaning microwave interior
  • Cleaning oven interior
  • Cleaning refrigerator shelves
  • Loading dishwasher
  • Unloading dishwasher
  • Hand washing dishes
  • Wiping appliance exteriors & handles
  • Trash — removal & bag replacement
  • Scrubbing toilet bowl
  • Scrubbing bathroom tiles
  • Cleaning drain/trap
  • Folding laundry
  • Organizing cabinets
  • Cleaning windows (interior)
  • Spot cleaning carpet
  • Making bed / changing linens
  • Wiping baseboards & trim
  • Picking up pet waste (outdoors)

Capture protocol

  • Head-mounted POV (1080p, 30fps)
  • Natural, un-staged home environments
  • Geographically diverse households
  • Diverse participant demographics
  • Continuous, unedited task recordings

Annotation schema

  • Per-frame action segmentation
  • Dexterous hand-object interaction tracking
  • Strict temporal task boundaries
  • Hierarchical object category labels
  • Standardized, custom taxonomy
Architectural deep dive

A published, machine-readable annotation schema

Precisely annotated in Label Studio, every clip is segmented into timed actions and resolved against a hierarchical object taxonomy created under the supervision of robotics researchers. Commission custom collection runs in the same schema to extend and adapt the dataset.

Timeline & taxonomy
[0:00 – 0:02] Action: Open Appliance Hand: Right Object: Dishwasher Door
[0:03 – 0:05] Action: Grasp Object Hand: Left Object: Ceramic Plate
[0:06 – 0:09] Action: Insert Object Hand: Left Object: Dishwasher Lower Rack
The object hierarchy
  • Environment: Kitchen
    • Appliance: Dishwasher
      • Component: Lower Rack
        • Prongs
      • Manipuland: Ceramic Plate
        • Rim
Engineering note

EgoChores ships with a fully published, machine-readable annotation schema.

Evaluate the sample

Three depths of the EgoChores sample

EgoChores is a sample dataset With household chores performed in a variety of global home environments. Each segment has been precisely annotated inside of Label Studio via custom-trained models and human annotators.

Raw Video Data

What it is

A slice of the EgoChores corpus with basic clip-level tags and metadata, unannotated — the capture on its own terms.

Best for

Judging framing, lighting, household diversity, and whether the raw footage clears the bar for your own annotation pipeline.

Request the Raw Video Data sample

Standard Annotation

What it is

The same clips with a label schema applied to capture action segmentation, dexterous hand-object interaction, and object taxonomy.

Best for

Measuring annotation density, boundary precision, and taxonomy fit against what your VLA training loops actually consume.

Request the Standard Annotation sample

Custom Annotation

What it is

Signal can help your team establish a POC with clips annotated to a schema you specify: custom object classes, edge cases, and proprietary schema configurations.

Best for

Seeing your own schema executed on real footage before committing to a full collection and annotation program.

Request the Custom Annotation sample

FAQ

Common technical questions

Is EgoChores a production dataset I can license as-is?

No, EgoChores is a sample. It exists so you can evaluate how we capture egocentric footage and how we annotate it, at whatever depth matters to your team, without a procurement cycle. Once it clears your bar, we scale the same protocol and taxonomy into a collection program sized and scoped to your models: your task families, your environments, your schema.

How does EgoChores differ from massive open-world datasets like Ego4D?

While Ego4D provides unparalleled unconstrained scale, it lacks the dense task-family specificity needed for highly repeatable robotic policy learning. EgoChores provides tight, standardized taxonomies across identical task categories, minimizing background noise and maximizing target interaction density.

Can HumanSignal reproduce this exact capture protocol in other regions or countries?

Yes. Our human data collection networks span multiple global regions, allowing us to capture diverse architectural styles, appliance form factors, and cultural variations in chore performance.

What annotation formats do you support out of the box?

EgoChores ships natively in standard JSON / COCO-style formats for vision models. Our internal annotation tooling also supports custom schema compilation to format outputs directly for your team's proprietary data loaders.

Ready to build data pipelines your competitors can't replicate?

Let's design your proprietary dataset program today.

EgoChores Dataset — Data Services