Contact Sales

Labeling and evaluation interfaces, built in Label Studio Enterprise

What you can build with programmable interfaces: working labeling and evaluation tools, written in code rather than fixed templates. Open one, adapt it to your data, or build something that isn't here.

  • Document annotation interface with a sample page open and region labeling tools in the toolbar.
    Document AI

    Document Layout & Field Extraction

    Annotate PDFs and scanned documents with layout regions, OCR-backed text spans, table structure, and page and document classifications, then map labeled regions to a structured field schema.

    • Document
    • PDF
    • hOCR
    Document annotation interface with a sample page open and region labeling tools in the toolbar.
    Document AI

    Document Layout & Field Extraction

    Layout, OCR, tables, and classification usually live in four different tools, and field extraction happens somewhere else again. This document AI interface puts them in one task.

    Annotators draw bounding boxes around document elements, select text spans and words backed by hOCR positions, mark up table rows and columns with per-cell labels and merged cells, classify the document and each page, and link related regions, such as a caption to its figure. An extraction panel binds labeled regions to named fields so you can preview the structured record before saving.

    Works on PDFs and single-page images. The region labels, document types, and page types are parameters you replace with your own.

  • Multi-turn chat review with a 1–5 rubric for accuracy, helpfulness, safety, and tone.
    LLM & Agent Evaluation

    Multi-Turn Conversation Evaluation

    Review an assistant conversation one turn at a time, score each turn against a rubric, flag issues, highlight evidence spans, and give a conversation-level verdict.

    • Conversation
    • JSON
    Multi-turn chat review with a 1–5 rubric for accuracy, helpfulness, safety, and tone.
    LLM & Agent Evaluation

    Multi-Turn Conversation Evaluation

    Multi-turn failures accumulate. A turn that looks fine on its own is wrong given what the user said three turns earlier, so the reviewer needs the whole transcript in view while grading one turn. This interface does that.

    Each assistant turn gets four 1 to 5 rubric scores, issue flags, notes, and text spans marked as evidence, claim, or correction; attached assets such as images, code, tables, and audio render inline. A conversation-level rubric at the end computes a verdict (Excellent, Good, Mixed, Poor) and takes summary notes.

  • Agent trace with user, reasoning, SQL tool calls, and reply steps beside a scoring rubric.
    LLM & Agent Evaluation

    Agent Trace Evaluation

    Read a multi-step LLM agent trace, rate each step correct, partial, or incorrect, score the run against a rubric, tag failure modes, and set an overall verdict, each saved as its own result.

    • Agent trace
    • JSON
    Agent trace with user, reasoning, SQL tool calls, and reply steps beside a scoring rubric.
    LLM & Agent Evaluation

    Agent Trace Evaluation

    An agent run is not one answer to grade. It is reasoning, tool calls, subagents, artifacts, and errors, and the failure is usually somewhere in the middle. This interface lays the whole trace out so a reviewer can find it.

    Steps render in order with their arguments, results, tokens, and latency, and a minimap sized by latency, tokens, or cost shows where the run spent its budget. Reviewers rate each step, set a verdict, score a configurable rubric (helpfulness, faithfulness, efficiency, tool use, and instruction following by default), tag failure modes like hallucination or wrong tool, and write a critique.

    Each section saves independently, so partial reviews are fine. Verdicts, step ratings, failure modes, and rubric items are all parameters.

  • Robot arm camera feeds with joint readouts, playback controls, and a labeled subtask timeline.
    Physical AI

    Robotics Episode Review

    Step through a robot policy rollout across multi-camera video, rate execution quality, and refine a timeline of subtasks, mistakes, and subgoals.

    • Video
    • MP4
    • JSON
    Robot arm camera feeds with joint readouts, playback controls, and a labeled subtask timeline.
    Physical AI

    Robotics Episode Review

    A policy rollout is judged on video, but the useful output is a timeline: where each subtask started, where the mistake happened, what the coaching note should say. This interface keeps both in view.

    Annotators watch top, wrist, and other camera streams in a single, gallery, or main-plus-side layout, scrub with frame stepping and speed control, and edit segments from the timeline toolbar: add a subtask, split at the playhead, mark a mistake, pin a subgoal. A metadata panel holds the 1 to 5 quality rating, control mode, speed bin, and robot ID.

  • Dental CT slice with each tooth segmented in color, beside slice controls and DICOM metadata.
    Medical AI

    DICOM Medical Image Annotation

    Step through a DICOM study in both reconstructed views, switching between bone, soft tissue, and dental windowing presets. Labels come from the file's own structures, and a 3D view links back to the slice you're working in.

    • Medical image
    • DICOM
    Dental CT slice with each tooth segmented in color, beside slice controls and DICOM metadata.
    Medical AI

    DICOM Medical Image Annotation

    A DICOM file already carries the structure — the trick is getting it on screen in a form someone can actually work with. This interface reconstructs the study into frontal and side views you can scroll slice by slice, with presets that switch between the file's own header defaults, the full unfiltered pixel range, and standard grayscale ranges for bone, soft tissue, or teeth. Labels are read directly out of the DICOM, so every encoded structure arrives already segmented, ready to refine with brush and erase tools or dial back with an overlay-strength control. A WebGL 3D view renders the whole scan, and selecting a structure there carries that selection back into the slice view, with the file's full header data alongside for reference.

  • LiDAR point cloud and street camera view with 3D boxes around vehicles and a tracking timeline.
    Physical AI

    LiDAR Object Detection & Tracking

    Annotate 3D point clouds with cuboids, track objects across frames with keyframe interpolation, and review calibrated camera views, all in one task.

    • Point cloud
    • Video
    • COPC
    LiDAR point cloud and street camera view with 3D boxes around vehicles and a tracking timeline.
    Physical AI

    LiDAR Object Detection & Tracking

    Most perception teams annotate the same scene four times: once for cuboids, again for camera views, again for tracking, and once more for review. This interface keeps all of it in one workspace.

    Annotators work the 3D point cloud alongside a top-down view and a camera panel that follows whatever cuboid is selected. Keyframe interpolation carries objects across frames, so adjusting one position updates the frames around it instead of redrawing each one — which is where identity swaps usually creep in. Model predictions load as editable suggestions to accept, adjust, or reject. Validation runs inside the task, so blocking errors surface before completion rather than in a separate audit pass weeks later.

    Handles COPC files in the tens of millions of points, with cuboids, points, lines, lanes, and segmentation masks side by side.

    • LiDAR
    • COPC
  • Résumé with numbered bounding boxes and reading-order arrows beside its Doclang XML output.
    Document AI

    DocLang Document Annotation

    Draw regions on a document, set reading order, and fix table structure while the DocLang XML updates beside you. Docling predictions load in for correction, so your annotators fix conversions instead of building them from scratch.

    • Document
    • PDF
    Résumé with numbered bounding boxes and reading-order arrows beside its Doclang XML output.
    Document AI

    DocLang Document Annotation

    Your documents do not look like Docling's training data: a lab report or an internal invoice has little in common with the public PDFs a converter learned on. This interface gives you a place to see where that breaks.

    You draw bounding boxes around document elements, layer reading-order paths across them, and correct merged regions and table structure, with the DocLang XML updating in a sidebar as you work. Predictions from the Docling ML backend load as a starting point, and the result exports as a .dclx archive carrying both the structure and the page images.

  • Heart rate, HRV, motion, respiration, and SpO2 charts with activity and sleep-stage labels.
    Medical AI

    Wearable Sensor Activity Labeling

    Scrub heart rate, HRV, accelerometer, respiration, and SpO2 on one time base, then mark spans in the activity, sleep, or rhythm tab. Both the label sets and the task fields they read are parameters you set per project.

    • Time series
    • JSON
    Heart rate, HRV, motion, respiration, and SpO2 charts with activity and sleep-stage labels.
    Medical AI

    Wearable Sensor Activity Labeling

    A wearable session is five signals that have to be read against each other: heart rate climbing after the accelerometer, HRV dropping, respiration following, SpO2 holding until it dips. This interface puts all five on one time base with a context track underneath, so precomputed activity, sleep, and rhythm segments stay visible while you work, and outdoor sessions carry a GPS route beside the signals.

    Labeling splits across three tabs, and the vocabularies ship as defaults you replace: Running through Sedentary for activity, Awake through Deep Sleep for sleep, Sinus Rhythm through AFib for rhythm, each label with a color and a hotkey.

    The task fields are parameters too, so the interface reads whatever your sensor, segment, and route columns are called instead of forcing your data into its names.

    • Timeseries

Common questions

What is a programmable labeling interface?
A labeling or evaluation UI written as React code inside Label Studio Enterprise, so the layout, tools, validation, and output schema are yours to change and version. The interfaces in this gallery are working examples you can duplicate and edit.
Can I use these interfaces in open source Label Studio?
No. Interfaces run in Label Studio Enterprise and Starter Cloud. The open source edition uses labeling configs from the template gallery , which covers many of the same tasks with a fixed layout.
What data types do these interfaces cover?
Point clouds, video, PDFs and scanned documents, DICOM medical images, time series, conversations, and agent traces, and several combine more than one in a single task. Because an interface is code, a new data type is a new interface, not a new product feature.
How do I start from one of these?
Open it in Label Studio, duplicate it from Interfaces > Templates, and change the params (label sets, task fields) or the code. Each interface's docs page shows its params, input format, and output shape.