Changelog

Refine permissions

There is a new page available from Organization > Settings > Permissions that allows users in the Owner role to refine permissions across the organization.

This page is only visible to users in the Owner role.

For more information, see Customize organization permissions.

Templates for chat and PDF labeling

You can now find the follow templates in the in-app template gallery:

OCR Labeling for PDFs

Chatbot Evaluation

Fine-Tune an Agent with an LLM

Fine-tune an Agent without an LLM

Red-Teaming in Chat

Evaluate Production Conversations for RLHF

Personal Access Token support for ML backends

Previously, if using a machine learning model with a project, you had to set up your ML backend with a legacy API token.

You can now use personal access tokens as well.

Bug fixes

• Fixed an issue with and agreement calculation error when a custom label weight is set to 0%.
• Fixed an issue with a broken metric in the Member Performance dashboard.
• Fixed an an issue with the Annotation Limit project setting in which users could not set it by a percentage and not a fixed number.
• Fixed an issue where the style of the tooltip info icons on the Cloud Storage status card was broken.
• Fixed an issue with colors on the Members dashboard.
• Fixed an issue where users were not being notified when they were paused in a project.

Markdown and HTML in Chat

The Chat tag now supports markdown and HTML in messages.

Improved project quality settings

The Quality section of the project settings has been improved.

• Clearer text and setting names
• Settings that are not applicable are now hidden unless enabled

Improved project onboarding checklist

The onboarding checklist for projects has been improved to make it clearer which steps still need to be taken before annotators can begin working on a project:

Compact display for Data Manager columns

There is a new option to select between the default column display and a more compact version.

Bug fixes

• Fixed an issue where the Apply action was not working on the Member Performance dashboard.
• Fixed an issue where searching for users from the Members dashboard and the Member Performance dashboard would clear previously selected users.
• Fixed an issue where the style of the Create Project header was broken.
• Fixed a bug where when video labeling with rectangles, resizing or rotating them were not updating the shapes in the correct keyframes.
• Fixed an issue where paused annotators were not seeing the "You are paused" notification when re-entering the project.
• Fixed an issue where Chat messages were not being exported with JSON_MIN and CSV.

New Agreement (Selected) column

There is a new Agreement (Selected) column that allows you to view agreement data between selected annotators, models, and ground truths.

This is different than the Agreement column, which displays the average agreement score between all annotators.

Also note that now when you click on a comparison between annotators in the agreement matrix, you will be taken to the Data Manager with the Agreement (Selected) column pre-filtered for those annotators and/or models.

For more information, see Agreement and Agreement (Selected) columns.

Bug fixes

• Fixed an issue with duplicated text area values when using the value parameter.
• Fixed an issue with ground truth agreement calculation.
• Fixed an issue with links from the Members dashboard leading to broken Data Manager views.
• Fixed a small visual issue with the bottom border of the Data Manager.
• Fixed an issue where the user filter on the Member Performance dashboard was not displaying selected users correctly.
• Fixed an issue where users would experience timeouts when attempting to delete large projects.

Additional validation when deleting a project

When deleting a project, users will now be asked to enter text in the confirmation window:

Activity log retention

Activity logs are now only retained for 180 days.

Bug fixes

• Fixed an issue where ordering by media start time was not working for video object tracking.
• Fixed an issue where dashboard summary charts would not display emojis
• Fixed an issue where hotkeys were not working for bulk labeling operations.
• Fixed an issue with some projects not loading on the Home page.
• Fixed some minor visual issues with filters.
• Fixed an issue with selecting multiple users in the Members Performance dashboard.

New Markdown tag

There is a new <Markdown> tag, which you can use to add content to your labeling interface.

For example, adding the following to your labeling interface:

<View>
<Markdown>
## Heading 2
    
### Heading 3
    
- bullet point one
- bullet point two
    
**Bold text** and *italic text*
    
`inline code`
    
```
code block
```
    
[Link](https://humansignal.com/changelog/)

![image](https://upload.wikimedia.org/wikipedia/commons/2/27/Opossum_2.jpg)
</Markdown>
</View>

Produces this:

JSON array input for the Table tag

Previously, the Table tag only accepted key/value pairs, for example:

{
  "data": {
    "table_data": {
      "user": "123456",
      "nick_name": "Max Attack",
      "first": "Max",
      "last": "Opossom"
    }
  }
}

It will now accept an array of objects as well as arrays of primitives/mixed values. For example:

{
  "data": {
    "table_data": [
      { "id": 1, "name": "Alice", "score": 87.5, "active": "true" },
      { "id": 2, "name": "Bob",  "score": 92.0, "active": "false" },
      { "id": 3, "name": "Cara", "score": null, "active": "true" }
    ]
  }
}

Create regions in PDF files - Beta 🧪

You can now perform page-level annotation on PDF files, such as for OCR, NER, and more.

This new beta functionality also supports displaying PDFs natively within the labeling interface, allowing you to zoom and rotate pages as needed.

To use the beta PDF functionality, it must first be enabled for your organization. You can request that here.

New parameters for the Video tag

The Video tag now has the following optional parameters:

• defaultPlaybackSpeed - The default playback speed when the video is loaded.
• minPlaybackSpeed - The minimum allowed playback speed.

The default value for both parameters is 1.

Multiple SDK enhancements

We have continued to add new endpoints to our SDK, including new endpoints for model and user stats.

See our SDK releases and API reference.

Bug fixes

• Fixed an issue where the Start Reviewing button was broken for some users.
• Fixed an issue with prediction validation for per-region labels.
• Fixed an issue where importing a CSV would fail if semicolons were used as separators.
• Fixed an issue where the Ready for Download badge was missing for JSON exports.
• Fixed an issue where changing the task assignment mode in the project settings would sometimes revert to its previous state.
• Fixed an issue where onboarding mode would not work as expected if the Desired agreement threshold setting was enabled.

Invite new users to workspaces and projects

You can now select specific workspaces and projects when inviting new Label Studio users. Those users will automatically be added as members to the selected projects and/or workspaces:

There is also a new Invite Members action available from the Settings > Members page for projects. This is currently only available for Administrators and Owners.

This will create a new user within your organization, and also immediately add them as a member to the project:

Bug fixes

• Fixed an issue where users assigned to tasks were not removed from the list of available users to assign.
• Fixed a small issue with background color when navigating to the Home page.
• Fixed an issue where API taxonomies were not loading correctly.
• Fixed an issue where the Scan all subfolders toggle was appearing for all cloud storage types, even though it is only applicable for a subset.
• Fixed and issue where the Low agreement strategy project setting was not updating on save when using a custom matching function.
• Fixed an issue where the Show Log button was disappearing after deploying a custom matching function.

Improved project Annotation settings

The Annotation section of the project settings has been improved.

• Clearer text and setting names
• When Manual distribution is selected, settings that only apply to Automatic distribution are hidden
• You can now preview instruction text and styling

For more information, see Project settings - Annotation.

Bug fixes

• Fixed an issue where users who belong to more than one organization would not be assigned project roles correctly.
• Fixed an issue with displaying audio channels when splitchannels="true".
• Fixed an issue where videos could not be displayed inside collapsible panels within the labeling config.
• Fixed an issue where navigating back to the Data Manager from the project Settings page using the browser back button would sometimes lead to the Import button not opening as expected.
• Fixed an issue when selecting project members where the search functionality would sometimes display unexpected behavior.
• Fixed an issue where, when opening statistic links from the Members dashboard, closing the subsequent tab in the Data Manager would cause the page to break.
• Fixed an issue preventing annotations from being exported to target storage when using Azure blob storage with Service Principal authentication.
• Fixed an issue with the Scan all sub-folders option when using Azure blob storage with Service Principal authentication.
• Fixed an issue where video files would not open using Azure blob storage with Service Principal authentication when pre-signed URLs were disabled.
• Fixed an issue that was sometimes causing export conversions to fail.

Annotate conversations with a new Chat tag

Chat conversations are now a native data type in Label Studio, so you can annotate, automate, and measure like you already do for images, video, audio, and text.

For more information, see:

Chat tag page

Chat labeling templates

Blog - Introducing Chat: 4 Use Cases to Ship a High Quality Chatbot

Connect your Databricks files to Label Studio

There is a new cloud storage option to connect your Databricks Unity Catalog to Label Studio.

For more information, see Databricks Files (UC Volumes).

Ground truth visibility in the agreement pop-up

When you click the Agreement column in the Data Manager, you can see a pop-up with an inter-annotator agreement matrix. This pop-up will now also identify annotations with ground truths.

For more information about adding ground truths, see Ground truth annotations.

Sort video and audio regions by start time

You can now sort regions by media start time.

Previously you could sort by time, but this would reflect the time that the region was created. The new option reflects the start time in relation to the media.

Support for latest Gemini models

When you add Gemini or Vertex AI models to Prompts or to the organization model provider list, you will now see the latest Gemini models.

gemini-2.5-pro

gemini-2.5-flash

gemini-2.5-flash-lite

Template search

You can now search the template gallery. You can search by template title, keywords, tag names, and more.

Note that template searches can only be performed if your organization has AI features enabled.

Bug fixes

• Fixed an issue where when duplicating older projects tab order was not preserved.
• Fixed an issue where image labeling was broken in the Label Studio Playground.
• Fixed an issue where deleted users remained listed in the organization members list.
• Fixed an issue where clicking a user ID on the Members page redirected to the Data Manager instead of copying the ID.
• Fixed an issue where buttons on the Organization page were barely visible in Dark Mode.
• Fixed an issue where the Members modal would sometimes crash when scrolling.
• Fixed an issue where the Data Manager appeared empty when using the browser back button to navigate there from the Settings page.
• Fixed an issue where clicking the Label All Tasks drop-down would display the menu options in the wrong spot.
• Fixed an issue where the default value in the TTL field in the organization-level API token settings exceeded the max allowed value in the field.
• Fixed an issue where deleted users were appearing in project member lists.
• Fixed an issue where export conversions would not run if a previous attempt had failed.
• Fixed an issue where Reviewers who were in multiple organizations and had Annotator roles elsewhere could not be assigned to review tasks.
• Fixed several validation issues with the Desired ground truth score threshold field.

Vector annotations (beta)

Introducing two new tags: Vector and VectorLabels.

These tags open up a multitude of new uses cases from skeletons, to polylines, to Bézier curves, and more.

Set model provider API keys for an organization

There is a new Model Providers page available at the organization level where you can configure API keys to use with LLM tasks.

If you have previously set up model providers as part of your Prompts workflow, they are automatically included in the list.

For more information, see Model provider API keys for organizations.

Improved UX on the Organization page

The Organization page (only accessible to Owner and Admin roles) has been redesigned to be more consistent with the rest of the app.

Note that as part of this change, the Access Token page has been moved under Settings.

Before:

After:

Hide Data Manager columns from users

There is a new project setting available from Annotation > Annotating Options and Review > Reviewing Options called Show unused data columns to reviewers in the Data Manager.

This setting allows you to hide unused Data Manager columns from any Annotator or Reviewer who also has permission to view the Data Manager.

"Unused" Data Manager columns are columns that contain data that is not being used in the labeling configuration.

For example, you may include meta or system data that you want to view as part of a project, but you don't necessarily want to expose that data to Annotators and Reviewers.

Find user IDs easier

Each user has a numeric ID that you can use in automated workflows. These IDs are now easier to quickly find through the UI.

You can find them listed on the Organization page and in the Annotation Summary table on the Members page for projects.

Manager and Reviewer access to the Annotator Dashboard

Managers and Reviewers will now see a link to the Annotator Dashboard from the Home page.

The Annotator Dashboard displays information about their annotation history.

Managers:

Reviewers:

Multiple SDK enhancements

We have continued to add new endpoints to our SDK, including new endpoints for bulk assign and unassign members to tasks.

See our SDK releases and API reference.

Bug fixes

• Fixed an issue where the Info panel was showing conditional choices that were not relevant to the selected region.
• Fixed an issue where on tasks with more than 10 annotators, the number of extra annotators displayed in the Data Manager column would not increment correctly.
• Fixed an issue where if a project included predictions from models without a model name assigned, the Members dashboard would throw errors.
• Fixed an issue where the workspaces dropdown from the Annotator Performance page will disappear if the workspace name was too long.
• Fixed an issue with the disabled state style for the Taxonomy tag on Dark Mode.
• Fixed an issue where long taxonomy labels would not wrap.

Show models in the Members dashboard

If your project is using predictions, you will now see a Show Models toggle on the Members dashboard.

This will allow you to view model agreement as compared to annotators, other models, and ground truths.

For more information, see the Members dashboard.

Updated UI when duplicating projects

When duplicating a project, you will now see a modal with an updated UI and more helpful text.

Multiple SDK enhancements

We have continued to add new endpoints to our SDK. See our SDK releases.

Bug fixes

• Fixed an issue where Redis usernames were not supported in the wait-for-redis deploy script.
• Fixed an issue where predictions with empty results could not pass validation.
• Fixed an issue where users in the Manager role were shown a permissions error when attempted to access the Settings > Cloud Storage page.
• Fixed a small issue in the Members modal where empty space was not being filled.
• Fixed an issue where in some cases Owners and Admins could be removed from workspace membership.
• Fixed an issue where the Copy button was not showing the correct state in some instances.

New email notification option for users who are not activated

Administrators and Owners can now opt in to get an email notification when a new user logs in who has not yet been assigned a role.

Apply labels from multiple <Labels> controls

When you have a labeling configuration that includes multiple <Labels> blocks, like the following:

<View>
<Text name="text" value="$text" granularity="word"/>
<Labels name="category" toName="text" choice="single">
  <Label value="Animal" background="red"/>
  <Label value="Plant" background="darkorange"/>
</Labels>
<Labels name="type" toName="text" choice="single">
  <Label value="Mammal" background="green"/>
  <Label value="Reptile" background="gray"/>
  <Label value="Bird" background="blue"/>
</Labels>
</View>

You can now choose multiple labels to apply to the selected region.

Improved UI for empty Data Manager

When loading the Data Manager in which you have not yet imported data, you will now see a more helpful interface.

Bug fixes

• Fixed several issues related to loading the Members page and Members modal.
• Fixed several issues related to loading the Annotator Performance dashboard.
• Fixed an issue where the workspaces list would sometimes get stuck loading.
• Fixed an issue where users would see "The page or resource you were looking for does not exist" while performing resource-intensive searches.
• Fixed an issue where too much task information would appear in notification emails.
• Fixed an issue with pausing annotators in projects with a large number of users.
• Fixed an issue where an empty Import modal would be shown briefly when uploading a file.
• Fixed an issue with duplicate entries when filtering for annotators from the Data Manager.
• Fixed an issue where users would sometimes see a 404 error in the labeling stream when there were skipped or postponed tasks.
• Fixed an issue where audio and video would be out of sync when working with lengthy videos.
• Fixed an issue where, when assigning a very large number of annotators, only the first task selected would receive an assignment.

SDK 2.0.0

We released a new version of the SDK, with multiple functional and documentation enhancements.

• Documentation
• Release notes

Prediction validation

All imported predictions are now validated against your project’s labeling configuration and the required prediction schema.

Predictions that are missing required fields (for example, from_name, to_name, type, value) or that don’t match the labeling configuration (for example, to_name must reference an existing object tag) will be rejected with detailed, per-task error messages to help you correct the payloads.

Filter by prediction results

You can now filter prediction results by selecting options that correspond to control tag values.

Previously, you could only filter using an unstructured text search.

The prediction results filter also includes a nested model version filter, which (if specified) will ensure that your filters returns tasks only when the selected prediction result comes from the selected model.

Debug custom agreement metrics

There is a new See Logs option for custom agreement metrics, which you can use to view log history and error messages.

Bug fixes

• Various fixes for button and tooltip appearance.
• Fixed a small issue with column header text alignment in the Data Manager.
• Fixed an issue where users were able to select multiple values when filtering annotation results despite multiselect not being compatible with the labeling config.
• Fixed an issue that caused project search to not match certain word parts.
• Fixed an issue where long storage titles prevented users from accessing the overflow menu.
• Fixed an issue where imported child choices were not selectable when using the leafsOnly parameter for taxonomies.
• Fixed an issue with labeling Text or Hypertext with multiple Taxonomy tags at the same time.
• Fixed an issue in the project dashboard with tasks not being calculated due to timezone issues.
• Fixed an issue where clicking on an annotator's task count opens the Data Manager with the wrong annotator pre-loaded filter.
• Fixed an issue where, when zoomed in, bounding boxes would shift after being flipped.

GPT-5 models for Prompts

When using an OpenAI API key, you will now see the following models as options:

• gpt-5
• gpt-5-mini
• gpt-5-nano

Support for Azure Blob Storage with Service Principal authentication

You can now connect your projects to Azure Blob Storage using Service Principal authentication.

Service Principal authentication uses Entra ID to authenticate applications rather than account keys, allowing you to grant specific permissions and can be easily revoked or rotated.

For more information, see Azure Blob Storage with Service Principal authentication.

Organization-level control over email notifications

The Organization > Usage & License page has new options to disable individual email notifications for all members in the organization.

If disabled, the notification will be disabled for all users and hidden from their options on their Account & Settings page.

Redesigned cloud storage modal

When adding cloud storage, the modal has now been redesigned to add clarity and additional guidance to the process.

For example, you can now preview a list of files that will be imported in order to verify your settings.

Nested annotator filters

When applying an annotation results filter, you will now see a nested Annotator option. This allows you to specify that the preceding filter should be related to the specific annotator.

For example, the following filter will retrieve any tasks that have an annotation with choice "bird" selected, and also retrieve any tasks that have an annotation submitted by "Sally Opossum."

This means if you have a task where "Max Opossum" and "Sally Opossum" both submitted annotations, but only Max chose "bird", the task would be returned in your filter.

With the new nested filter, you can specify that you only want tasks in which "Sally Opossum" selected "bird":

Adjustable height for audio players

While you can still adjust the default height in the labeling configuration, now users can drag and drop to adjust the height as needed.

Breaking changes

Next week, we are releasing version 2.0.0 of the Label Studio SDK, which will contain breaking changes.

If you use the Label Studio SDK package in any automated pipelines, we strongly recommend pinning your SDK version to <2.0.0.

Bug fixes

• Fixed an issue with project list search to ensure special characters are correctly escaped and return expected results.
• Fixed an issue where the custom hotkeys would not take effect until the page was refreshed.
• Fixed an issue where custom hotkeys for the Data Manager were not being applied.
• Fixed an issue that would sometimes render a user in the Data Manager without a display name.

One-click annotation for audio-text dialogues

When labeling paragraphs in dialogue format (layout="dialogue"), you can now apply labels at an utterance level.

There is a new button that you can click to apply the selected label to the entire utterance. You can also use the pre-configured Command + Shift + A hotkey:

Support for high-frequency rate time series data

You can now annotate time series data on the sub-second decimal level.

Note: Your time format must include .%f to support decimals.

For example:
timeFormat="%Y-%m-%d %H:%M:%S.%f"

Export data from the Members page

There is a new option on the Members page to export its data to CSV:

New query params for organization membership

When listing organization members via the API, you can use two new query params to exclude project or workspace members:

• exclude_project_id
• exclude_workspace_id

Breaking changes

The following API endpoints have been deprecated and will be removed on September 16, 2025.

• GET /api/projects/{id}/dashboard-members
• GET /api/projects/{id}/export

Bug fixes

• Fixed various UI issues associated with buttons.
• Fixed various UI issues for dark mode.
• Fixed an issue where snap="pixel" was not included in autocomplete options for RectangleLabels.
• Fixed an issue where certain actions would remove the workspace from the breadcrumb navigation for projects.
• Fixed an issue where the layout was incorrect when pinning Data Manager filters to the sidebar.
• Fixed an issue where sorting was not working as expected when Data Manager filters were pinned.
• Fixed an issue that caused decreased performance when searching projects.
• Fixed an issue where CORS errors would appear for images in duplicated projects if the images had been uploaded directly.
• Fixed several small UI issues related to expanding and collapsing archived workspaces.
• Fixed an issue where a "Duplicating" badge would appear when saving project settings.
• Fixed a small visual issue where the AM/PM options were not centered when selecting date and time.
• Fixed an issue where the video settings modal would not close when clicking away.
• Fixed an issue where the user info popover was not opening in some cases.
• Fixed an issue where the taxonomy drop-drop down was not displaying in the labeling interface preview.

View projects in list format

You now have the option to view the Projects page in list format rather than as a grid of cards:

In the list view, you see will a condensed version of the project information that includes fewer metrics, but more projects per page:

(Admin view)

(Annotator view)

This change also includes a new option to sort projects (available in either view):

Settings for TimelineLabels configurations

When you are using a labeling configuration that includes <TimelineLabels>, you will now see a settings icon.

From here you can specify the following:

• Playback speed for the video
• Whether to loop timeline regions

Snap bounding boxes to pixels

The <Rectangle> and <RectangleLabels> tags now include the snap parameter, allowing you to snap bounding boxes to pixels.

Tip: To see a pixel grid when zoomed in on an image, you must disable pixel smoothing. This can be done as a parameter on the <Image> tag or from the user settings.

Define the default collapsed state

The <Collapse> tag now includes an open parameter. You can use this to specify whether a content area should be open or collapsed by default.

Rate limit improvements

• When you hit the API rate limit, you will now see an error message referring you to the relevant documentation. This message appears when importing data during project creation or importing data from the Data Manager.
• Rate limits for /import API calls no longer apply to GET requests.

Bug fixes

• Fixes for various dark mode UI issues.
• Fixed an issue that caused a negative number to display in the sidebar when performing bulk labeling tasks.
• Fixed an issue where a blank avatar would display in the Data Manager when more than 10 annotators are assigned to a task.
• Fixed an issue where users were unable to delete a duplicated project because of errors during duplication.
• Fixed an issue where task data was appearing in notification emails.
• Fixed an issue where brightness controls were unresponsive when using a bitmask.
• Fixed an issue where partial title match no longer worked when using project search.
• Fixed issues affecting how buttons appear for Ask AI features.
• Fixed an issue where the avatar would still appear for deleted users when viewing the Members page.
• Fixed an issue where the Activity Logs page would not always load as expected.
• Fixed an issue where if the project duplication failed, users were not shown an error.
• Fixed an issue where videos would not resize when resizing the content area.

Custom global hotkeys

You can now configure global hotkeys for each user account. These are available from the Account & Settings page.

Bulk annotation actions for annotators

Previously, the bulk annotation actions were only available to users in the Reviewer role or Manager and higher.

Now, users in the Annotator role can access these action.

Note that this is only available when the project is using Manual distribution and annotators must have access to the Data Manager.

Search by project description and ID

You can now search by project description and project ID.

Navigate to workspaces from the project breadcrumbs

You can now click a link in the project breadcrumbs to navigate back to a specific workspace.

Default zoom for audio

Removed the default zoom level calculation for Audio, allowing it to render the full waveform by default.

API enhancements

• The List all projects call has been updated with include and filter parameters.
• Optimized the /api/tasks/{id} call for tasks with more than 10 annotations.

Bug fixes

• Fixed various UI issues associated with buttons.
• Fixed various UI issues for dark mode.
• Fixed an issue where agreement scores were not populated after using the Propagate annotations action (experimental).
• Fixed an issue where time series charts were not always properly displayed in the playground.
• Fixed an issue where text in a <TextArea> field was still submitted even if the field was conditionally hidden.
• Fixed an issue where all users were selected in the Members modal even if the list was filtered with a search query.

Bitmask support for precise image segmentation

We’ve introduced a new BitMask tag to support pixel-level image annotation using a brush and eraser. This new tag allows for highly detailed segmentation using brush-based region and a cursor that reflects brush size down to single pixels for fine detail. We’ve also improved performance so it can handle more regions with ease.

Additionally, Mac users can now use two fingers to pinch zoom and pan images for all annotation tasks.

New email notifications for project events

Email notifications have been added for important project events, including task assignments, project publishing, and data export completion. This helps annotators and project managers stay in sync without unnecessary distractions.

Users can manage email preferences in their user settings.

AI Assistance now available for all SaaS users

All Label Studio Starter Cloud and Enterprise SaaS users, including those on a free trial can ask inline questions of an AI trained on our docs and even use AI to quickly create projects, including configuring labeling UIs, with natural language.

Account owners can enable the AI Assistant in the Settings > Usage & Licenses by toggling on “Enable AI” and “Enable Ask AI.” For more information see the docs.

Bug fixes and improvements

• Fixed annotation history not saving when target storage fails; now handled via worker jobs for improved performance when clicking Accept/Reject buttons.
• Excluded postponed drafts from label streams and quickview to prevent user confusion.
• Fixed inconsistent task counters and background worker memory issues in Starter Cloud.
• Resolved issues with toggling UI settings and duplicated roles in filters.
• Fixed homepage UI bug with element collisions at half-width.
• SDK improvements: added JWT proxying, token exchange, and support for external workflows.
• Fixed webhooks for bulk labeling: ANNOTATION_CREATED event is sent during bulk labeling.
• Improved large PDF handling in Prompts.
• Addressed race condition in user pausing by annotator evaluation.
• Fixed order by comments when it led to duplicate tasks in the data manager

Spectrogram support for audio analysis

There is a new option to display audio files as spectrograms. You can further specify additional spectrogram settings such as windowing function, color scheme, dBs, mel bands, and more.

Spectrograms can provide a deeper level of audio analysis by visualizing frequency and amplitude over time, which is crucial for identifying subtle sounds (like voices or instruments) that might be missed with traditional waveform views.

Group multiple time series in one channel

There is a new Multichannel tag for visualizing time series data. You can use this tag to combine and view multiple time series channels simultaneously on a single channel, with synchronized interactions.

The Multichannel tag significantly improves the usability and correlation of time series data, making it easier for users to analyze and pinpoint relationships across different signals.

Annotation summary by task

When using the View All action, users who are in the Reviewer role or higher can now see a summary of the annotations for a specific task. This summary includes metadata, agreements, and side-by-side comparisons of labels.

You can use this summary for a more efficient and detailed review of annotated tasks and to better understand consensus and discrepancies, especially when needing to compare the work of multiple annotators.

Filter on annotation results

When applying filters, you will see new options that correspond to annotation results.

These options are identified by the results chip and correspond to control tag names and support complex filtering for multiple annotation results. For example, you can filter by “includes all” or “does not include.”

This enhancement provides a much more direct, predictable, and reliable way to filter and analyze annotation results, saving time and reducing the chances of errors previously encountered with regex matching.

For more information, see Filter annotation results.

Enhanced delete actions from the Data Manager

When deleting annotations, reviews, or assignments, you can now select a specific user for the delete action. Previously, you were only able to delete all instances.

With this change, you will have more granular control over data deletion, allowing for precise management of reviews and annotations.

This enhancement is available for the following actions:

• Delete Annotations
• Delete Reviews
• Delete Review Assignments
• Delete Annotator Assignments

Email notifications for invites

Users can now opt into email notifications when you are invited to a project or workspace. These options are available from the Account & Settings page.

This ensures users are promptly aware of new project and workspace invitations, improving collaboration and onboarding workflows.

Enhanced control and visibility for storage proxies

There are two UI changes related to storage proxies:

• On the Usage & License page, a new Enable Storage Proxy toggle allows organization owners to disable proxying for all projects within the organization. When this setting is disabled, source storages must enable pre-signed URLs. If they are not enabled, the user will be shown an error when they try to add their source storage. 
• On the Source Storage window, the toggle controlling whether you use pre-signed URLs now clearly indicates that OFF will enable proxying.

Usage & License page visibility

The Billing & Usage page has been renamed the Usage & License page. Previously this page was only visible to users in the Owner role. A read-only form of this page is now available to all users in the Admin role.

Session timeout configuration

Organization owners can use the new Session Timeout Policies fields to control session timeout settings for all users within their organization. These fields are available from the Usage & License page.

Owners can configure both the maximum session age (total duration of a session) and the maximum time between activity (inactivity timeout).

UX improvements

• The Data Import step has been redesigned to better reflect the drag and drop target. The text within the target has also been updated for accuracy and helpfulness.

• The empty states of the labeling interface panels have been improved to provide user guidance and, where applicable, links to the documentation.

Bug fixes

• Fixed an issue where the View All action for annotations was incompatible with certain other tags.
• Fixed an issue where it was unclear what default metric was being used for agreements when users had not set a custom metric.
• Fixed an issue where users could not see Personal Access Token information after closing the create modal.
• Fixed an issue with tooltip alignment.
• Fixed an issue where nested toggles were not working as expected.
• Fixed an issue where Collapse tags were not working.
• Fixed an issue where information in Show task source would extend outside the modal.
• Fixed an issue where the agreement score popover did not appear for tasks that included a ground truth annotation.
• Fixed an issue where hovering over a relative timestamp did not display the numerical date.
• Fixed an issue where there was overlap after duplicating and then flipping regions.
• Fixed an issue where the hotkey for the Number tag was not working.
• Fixed several issues where HumanSignal links were appearing in whitelabeled environments.
• Fixed an issue where the date picker for dashboards was extending beyond the viewport.
• Fixed an issue where task agreement was not always calculated in cases where annotators skipped tasks.
• Fixed an issue where DateTime was causing JSONL and Parquet imports to fail.
• Fixed an issue where Prompts would return an error when processing large PDFs.

Time series synchronization with audio and video

You can now use the sync parameter to align audio and video streams with time-series sensor data by mapping each frame to its corresponding timestamp.

For more information, see Time Series Labeling with Audio and Video Synchronization.

Improved grid view configurability

You can now configure the following aspects of the Grid View in the Data Manager:

• Columns
• Fit images to width

Bug fixes

• Fixed a number of UI issues affecting whitelabel customers.
• Fixed an issue where resolved and unresolved comment filters were not working due to a bug in the project duplication process.
• Fixed an issue where some non-standard files such as PDFs were not correctly displayed in Quick View if using nginx.
• Fixed an issue where prediction counts were not always updating correctly when updating or re-running Prompts.
• Fixed an issue where NER entities were misplaced when using Prompts.
• Fixed an issue where PDF files could not be imported through the Import action.
• Fixed an issue where the step parameter on the <Number> tag was not working as expected.
• Fixed an issue where incorrect fonts were being used in the Labeling Interface settings.
• Fixed an issue where filters created in a project that had been duplicated would be shared back to the original project.
• Fixed an issue where annotator limit and evaluation settings were not kept when duplicating projects.
• Fixed an issue where time series data was not properly displayed via the playground.
• Fixed an issue where file extensions and file sizes were not being properly filtered when importing via URL.
• Fixed an issue where the API call for rotating tokens was not setting the expiration correctly on new tokens.

Download full comment text through the SDK

Previously when exporting task information using the SDK, comment text was truncated at 255 characters. Now, you can export the full comment text when using the following:

tasks = list(ls.tasks.list(<PROJECT_ID>, fields="all"))

UI improvements for the workspace list

Improved the scrolling action for the workspace list, making it easier for orgs with very large workspace lists.

Security

Made security improvements around webhook permissions.

Bug fixes

• Fixed an issue where tasks were not being updated as complete when reducing the task overlap.
• Fixed an issue with the wrong logo appearing when loading screens in a white labeled environment.
• Fixed an issue with email template text for white labeled accounts.
• Fixed an issue where inactive admins would appear in the project members list and could not be removed.
• Fixed an issue where an unwanted 0 character appeared in the Quick View when labeling audio data.
• Fixed an issue where audio regions would not reflect multiple labels.
• Fixed UI issues associated with dark mode.
• Fixed an issue with CSV exports when the Repeater tag is used.
• Fixed an issue with the Remove Duplicated Tasks action where it failed when a user selected an odd number of tasks.
• Fixed a validation error when updating the labeling configuration of existing tasks through the API.
• Fixed an issue with overflow and the date picker.

Support for JSONL and Parquet

Label Studio now supports more flexible JSON data import from cloud storage. When importing data, you can use JSONL format (where each line is a JSON object), and import Parquet files.

JSONL is the format needed for OpenAI fine-tuning, and the default format from Sagemaker and HuggingFace outputs. Parquet enables smoother data imports and exports for Enterprise-grade systems including Databricks, Snowflake, and AWS feature store,

This change simplifies data import for data scientists, aligns with common data storage practices, reduces manual data preparation steps, and improves efficiency by handling large, compressed data files (Parquet).

Playground 2.0

The Label Studio Playground is an interactive sandbox where you can write or paste your XML labeling configuration and instantly preview it on sample tasks—no local install required.

The playground has recently been updated and improved, now supporting a wider range of features, including audio labeling. It is also now a standalone app and automatically stays in sync with the main application.

Tip: To modify the data input, use a comment below the <View> tags:

New PDF tag for simplified labeling and extended Prompts support

A new PDF tag lets you directly ingest PDF URLs for classification without needing to use hypertext tags.

This also simplifies the process for using PDFs with Prompts, because you no longer need to first convert your PDFs to images.

Interactive view all

The View All feature when reviewing annotations has been improved so that you can now interact with all annotation elements side-by-side, making it easier to review annotations. For example, you can now play video and audio, move through timelines, and highlight regions.

Performance improvements

Two notable performance improvements include:

• Improved response time for the Updated at filter in the Data Manager, preventing timeouts.
• Reduced /api/users response time, in some cases from P50 > 40s to P50 < 30s.

Bug fixes

• Fixed an issue where some Prompts errors were not properly displayed.
• Fixed multiple UI issues related to the new dark mode design.
• Fixed other small UI issues related to column sizing and padding.
• Fixed an issue where the token refresh function was not using the user-supplied httpx_client.
• Fixed an issue that would cause the Data Manager to crash when interacting with the project link in the navigation bar.
• Fixed an issue where clicking an option on the project role dropdown on the user management modal would cause the modal to close unexpectedly.
• Fixed an issue where users were still able to resize TimeLineLabels regions even if locked.
• Fixed an issue where the COCO export option was appearing even if the labeling configuration was not compatible.
• Fixed an issue where in some situations users were not able to navigate after deleting a project.
• Fixed an issue where exports were included when duplicating a project.
• Fixed an issue which caused workspaces list styles to not apply to the full container when scrolled.

Multi-task JSON imports for cloud

Previously, if you loaded JSON tasks from source storage, you could only configure one task per JSON file.

This restriction has been removed, and you can now specify multiple tasks per JSON file as long as all tasks follow the same format.

For more information, see the examples in our docs here.

Include user emails in new Annotations chart CSV export

The Export Underlying Data option was recently introduced and is available from the Annotations chart in the annotator performance dashboard. This allows you to export information about the tasks that the selected users have annotated.

Previously, users were only identified by user ID within the CSV.

With this update, you can also identify users by email.

Bug fixes

• Fixed an issue where the drop-down menu to select a user role was overflowing past the page edge.
• Fixed an issue where the Not Activated role was hidden by default on the Organization page.
• Fixed an issue where when moving around panels in the labeling interface, groups were not sticking in place.

Automation and AI-Powered Workflows

Gain visibility into LLM metrics per task

Added customizable column selectors for performance tuning and cost management.

This will help you better understand the data behind each request to the LLM for improved troubleshooting and cost management with Prompts.

Expanded model support for Prompts

Added support for the OpenAI GPT-4.1 series models in Prompts. See the complete list of supported base models here.

Annotation and Review Workflows

Dynamic brush sizes

The cursor now adjusts dynamically to brush size to allow for more precision in segmentation tasks.

KeyPointLabel exports for COCO and YOLO

COCO and YOLO export formats now available for KeyPointLabels.

Team Management and Workforce Insights

New exports available for Annotator Performance metrics

Gain clarity into annotator output and productivity; track performance across individuals and teams.

• Export CSVs of key metrics such as lead time (with and without outliers)
• New Export Underlying Data action for the Annotations chart
• Easier navigation and access to insights

Agreement score popover in Data Manager

Click any agreement score to view pairwise agreement scores with others.

• Understand how agreement is calculated
• Identify labeling misalignment and training opportunities
• Improves trust, transparency, and quality auditing

Infrastructure and Security

Performance improvements at scale

• Significant improvements to import and export performance for larger datasets and teams working at scale.
• Membership API enhancements resulting in faster load times for customers and organizations with a large number of members.

Plugin framework access control

You can now restrict Plugin access to Administrators and above. By default, Managers have access to update plugins.

To request that this be restricted to Administrators, contact support.

Public template library (Beta)

Contribute to and browse the open source community templates repository.

• Find templates for common use cases
• Modify and share templates based on your unique use case
• Gain credit and swag for your contributions

View dozens of pre-built templates available today in the Templates Gallery.

Beta features

Dark mode

Label Studio can now be used in dark mode.

Click your avatar in the upper right to find the toggle for dark mode.

• Auto - Use your system settings to determine light or dark mode.
• Light - Use light mode.
• Dark - Use dark mode.

Note that this feature is not available for environments using whitelabeling.

New features

Annotator Evaluation settings

There is a new Annotator Evaluation section under Settings > Quality.

When there are ground truth annotations within the project, an annotator will be paused if their ground truth agreement falls below a certain threshold.

For more information, see Annotator Evaluation.

Feature updates

Prompts model updates

We have added support for the following:

Anthropic: Claude 3.7 Sonnet
Gemini/Vertex: Gemini 2.5 Pro
OpenAI: GPT 4.5

For a full list of supported models, see Supported base models.

Prompts indicator for pages processed

A new Pages Processed indicator is available when using Prompts against a project that includes tasks with image albums (using the valueList parameter on an Image tag).

You can also see the number of pages processed for each task by hovering over the image thumbnail.

Adjustable text spans

You can now click and drag to adjust text span regions.

Support for BrushLabels export to COCO format

You can now export polygons created using the BrushLabels tag to COCO format.

Create support tickets through AI Assistant

If you have AI Assistant enabled and ask multiple questions without coming to a resolution, it will offer to create a support ticket on your behalf:

Clear chat history in AI Assistant

You can now clear your chat history to start a new chat.

Security

• Addressed a CSP issue by removing unsafe-eval usage.
• Improved security on CSV exports.

Bug fixes

• Fixed a server worker error related to regular expressions.
• Fixed an issue where clicking on the timeline region in the region list did not move the slider to the correct position.
• Fixed an issue where the visibleWhen parameter was not working when used with a taxonomy.

New features

New Insert Plugins menu and Testing interface

There are a number of new features and changes related to plugins:

• We have renamed "Custom Scripts" to "Plugins." This is reflected in the UI and in our docs.
• There is a new Insert Plugins menu available. From here you can insert a pre-built plugin that you can customize as necessary.
• When you add a plugin, you will see a new Testing panel below the plugin editing field. You can use this to verify what events are triggered, manually trigger events, and modify the sample data as necessary.
• To accompany the new Insert Plugins menu, there is a new Plugins gallery in the documentation that discusses each option and has information on creating your own custom plugs.
• There is also a new setting that allows you to restrict access to the Plugins tab to Administrator users. By default, it is also available to Managers. If you would like this set, contact your account manager or open a support ticket.

New Label Studio Home page

When you open Label Studio, you will see a new Home page. Here you can find links to your most recent projects, shortcuts to common actions, and links to frequently used resources.

Note that this feature is not available for environments using whitelabeling.

Support for Google Cloud Storage Workload Identity Federation (WIF)

When adding project storage, you now have the option to choose Google Cloud Storage WIF.

Unlike the the standard GCS connection using application credentials, this allows Label Studio to request temporary credentials when connecting to your storage.

For more information, see Google Cloud Storage with Workload Identity Federation (WIF).

Feature updates

Prompts model support changes

We have added support for the following Gemini models:

• gemini-2.0-flash
• gemini-2.0-flash-lite

We have removed support for the following OpenAI models:

• All gpt-3.5 models

Improved tooltips

• Improved tooltips related to pausing annotators.
• Added a tooltip to inform users that Sandbox projects are not supported in Prompts.

Miscellaneous

• Ensured that when a user is deactivated, they are also automatically logged out. Previously they lost all access, but were not automatically logged out of active sessions.
• Multiple performance improvements for our AI Assistant.

Breaking changes

Label Studio is transitioning from user to roles in AWS S3 IAM.

This affects users who are using the Amazon S3 (IAM role access) storage type in projects.

Before you can add new projects with the Amazon S3 (IAM role access) storage type, you must update your AWS IAM policy to add the following principal:

arn:aws:iam::490065312183:role/label-studio-app-production

Please also keep the the previous Label Studio principal in place to ensure that any project connections you set up prior to April 7, 2025 will continue to have access to AWS:

arn:aws:iam::490065312183:user/rw_bucket

For more information, see Set up an IAM role in AWS.

Security

• Made security improvements around the verbosity of certain API calls.
• Made security improvements around SAML.
• Made security improvements around project parameter validation.
• Made security improvements around exception error messages.
• Upgraded Babel to address vulnerabilities.

Bug fixes

• Fixed an issue where users were unable to edit custom agreement metrics if using manual distribution mode.
• Fixed an issue where role changes with LDAP were broken.
• Fixed error handling for Prompts refinement.
• Fixed an issue where Exact frames matching for video was always showing as an option for agreement metrics regardless of whether the labeling config referenced a video.
• Fixed an issue where the prediction-changed value was not being reset after making manual changes to pre-annotations.
• Fixed an issue where a "Script running successfully" message continuously appeared for users who had plugins enabled.
• Fixed an issue where interacting with the Manage Members modal would sometimes throw an error.

Feature updates

Multi-image support for Prompts

Prompts now supports the valueList parameter for the Image tag, meaning you can use prompts with a series of images.

Importantly, this also means expanded support for PDFs in Prompts. For more information on using this parameter, see Multi-Page Documentation Annotation.

Azure AI Foundry support for Prompts

You can now configure Prompts to use AI Foundry models. For more information, see Model provider API keys.

Drag-and-drop adjustment for video timeline segments

You can now drag and drop to adjust the length of video timeline segments.

Security

Fixed an issue with workspace permission checks.

Bug fixes

• Fixed an issue where Prompts was not evaluating projects that used a combination of HyperText and Image tags.
• Fixed an issue where some segments were not previewable when annotating videos with the TimeLineLabels tag.
• Fixed several small issues with how labeled regions appear when completing OCR tasks.
• Fixed an issue where regions would be added to the wrong task when moving quickly between tasks.
• Fixed an issue where a paused annotator is unpaused when a reviewer rejects their annotation and the project is configured to requeue tasks back to the annotator.
• Fixed an issue where importing from the UI would fail when importing from a URL.

New features

Annotation limits

There is a new Quality > Annotation Limit section in the project settings.

You can use these fields to set limits on how many tasks each user is able to annotate. Once the limit is reached, their progress will be paused.

For more information, see Annotation Limit.

Feature updates

Usability improvements for audio tasks

Scrollbar navigation

You can now scroll forward and backward within audio files. This can be activated using the scrolling motion on a trackpad or a mouse.

New settings

We have introduced two new settings for audio tasks:

• Auto-Play New Regions - Automatically play a region after it has been selected.
• Loop Regions - When playing a region, loop the audio

New templates

There are three new templates available from the template gallery:

• Natural Language Processing > Content Moderation
• Computer Vision > Medical Imaging Classification with Bounding Boxes
• Generative AI > LLM Response Grading

Miscellaneous

• The Label Studio URL format has been updated so that you can now link to specific workspaces.
• Improved 4xx and 5xx error page design to include more helpful information.
• Added validation for S3 bucket naming.
• Various performance improvements.
• Various error handling improvements.
• Various UI fixes to ensure consistency in styles across Label Studio.

Security

Made security improvements regarding org membership visibility.

Bug fixes

• Fixed an issue in which agreement scores were missing when creating annotations from Prompts.
• Fixed an issue where images were distorted when zooming in.
• Fixed an issue where users in the Reviewer role were able to submit reviews via the API even if they were not a project member.
• Fixed an issue in which users who were in Manager, Reviewer, or Annotator roles could not access their API token through the UI.
• Fixed an issue where an empty Quick View was displayed if a user tried to open a URL linking to a non-existing task ID.
• Fixed an issue where the token expiration date format was causing issues in Safari browsers.
• Fixed an infinite loading issue with the notification drawer.
• Fixed an issue where deeply nested Choices were visible even if parents were hidden.

New features

Prompts is now generally available

Prompts is now available in Label Studio Enterprise SaaS.

Prompts is a tool that leverages LLMs to automatically generate predictions for your labeling tasks, allowing you to pre-annotate data and quickly bootstrap projects. It can also be used to evaluate your LLM prompts against ground truth data.

For more information, see the Prompts documentation and Accelerate Labeling and Model Evaluation with Prompts—Now Generally Available.

Pause an annotator

There is a new action to pause annotators. This is available from the Members dashboard and via the API.

For more information, see Pause an annotator.

Personal access tokens

There is a new type of token available for API access. The new tokens use JWT standards and, unlike the current tokens in use, allow you to set an expiration date.

You can enable or disable these tokens from the Organization page. Once enabled, they will be available for users to generate from their Account & Settings page. Legacy tokens can still be used unless disabled from the organization level.

For more information, see Access tokens.

Deep link annotations and regions

You can now link directly to specific annotations or regions within an annotation. These actions are available from the labeling interface in the overflow menus for the annotation and the region.

Feature updates

Set ground truths by user

There is a new action from the Data Manager that allows you to mark the annotations submitted by a specific user as ground truth annotations.

Known issues

Users in the Manager, Annotator, and Reviewer role cannot currently retrieve their API access tokens from the Label Studio UI.

This does not affect the functionality of any existing scripts or automations currently using their access tokens.

Bug fixes

• Fixed an issue that was causing intermittent loading errors in the Data Manager.
• Fixed an issue where filters were not being respected when performing bulk annotation actions.
• Fixed an issue where bulk annotation was sometimes failing with a 500 error.
• Fixed an issue where bulk annotation was not respecting the Allow empty annotations setting.
• Fixed an issue that caused incorrect video frame to be rendered when pausing.
• Fixed an issue where users were getting their role reset if they were provisioned via SCIM without an assigned group.
• Fixed an issue where an error was sometimes thrown when loading the workspaces list.
• Fixed an issue that would cause an API error when switching workspaces and fetching the incorrect page of projects.

New features

Bulk labeling

There is a new Bulk label action available from the Data Manager. You can use this to quickly label tasks multiple tasks at once.

This feature also includes enhancements to the Grid View in the Data Manager. Now when viewing images, you can zoom in/out, scroll, and pan.

For more information, see the Bulk labeling documentation and Bulk Labeling: How to Classify in Batches.

Enable AI features

There is a new toggle on the Billing & Usage page (only available to users in the Owner role). You can use this to enable AI features throughout Label Studio. See AI features.

Feature updates

Updated Billing & Usage page

The Billing & Usage page (only accessible to users in the Owner role) has several new options:

• Early Adopter - Opt in to new features before they're generally available.
• Enable AI Features - Enables AI helper tools within Label Studio. See AI features.
• White labeling - Contact sales about enabling white labeling.
• Custom Scripts - Contact sales to enable custom scripts. See Custom scripts for projects.

Anthropic model support for Prompts

You can now configure Prompts to use an Anthropic model. For more information, see Model provider API keys.

Bug fixes

• Fixed an issue where the Annotator Performance drop-down was not filtering the results as expected.
• Fixed an issue where users were unable to select and move bounding box regions after adding brush regions.
• Fixed an issue where seeking within a video would display duplicate frames in the the Video tag.
• Fixed an issue when managers could review skipped tasks in Quick View.

Feature updates

Gemini and Vertex AI model support for Prompts

You can now configure Prompts to use Gemini and Vertex AI models. For more information, see Model provider API keys.

Added OpenAI o3-mini model to Prompts

When you add an OpenAI key to Prompts, you will now see the o3-mini model available in the Base Model drop-down menu. For a list of all available models, see Supported base models.

Display the prediction score in the labeling interface

When you have annotations generated by predictions (pre-annotations), you will now see the prediction score (also known as the "confidence score") under the model name in the labeling interface tabs.

Updated template images

The thumbnail images for the pre-built templates have been redesigned.

Clearer description of annotation count

The annotation counter at the bottom of the Data Manager has been updated to read "Submitted Annotations." It previously read "Annotations," which could cause confusion.

Region number in Relations panel

The Relations panel now displays the number identifier for the region when viewing relations between regions.

Improved readability for relation values

If you are using <Relation> tags in your labeling config, you can specify a value describing the relationship between regions.

In the past, it could be difficult to read these values when there were several overlapping relations and regions. With this release, the text value for the relationship is pulled forward into focus when you hover.

Security

Security enhancements and optimizations.

Bug fixes

• Fixed an issue where project to groups mapping was not working correctly for SSO.
• Fixed TypeError issues causing page crashes when using Prompts.
• Fixed an issue where the error "string indices must be integers, not 'str'" would appear when running Prompts with custom models.
• Fixed an issue that caused would sometimes cause project creation to fail when pasting code into the code editor.

Feature updates

• Previously, when exporting data in YOLO, YOLO_OBB, or COCO format, the images themselves were not included in the export.
  
  To improve this, we have introduced three new choices to the export options:
  • YOLO_WITH_IMAGES
  • YOLO_OBB_WITH_IMAGES
  • COCO_WITH_IMAGES
• Optimized the Projects page for faster load times.
• The Video Frame Classification template is now available when browsing templates within the Label Studio project settings.
• There is a new hotkey available for pausing and starting audio: ctrl+p/command+p. This is in addition to the space hotkey that performs the same function. However, this new hotkey is useful when you are working with audio and have a text area field in focus.

Bug fixes

• Fixed an issue with overlapping relations on the overlay on highlighting

New features

Image support for Prompts

You can now use image data with Prompts. Previously, only text data was supported.

This new feature will allow you to automate and evaluate labeling workflows for image captioning and classification. For more information, see our Prompts documentation.

Beta features

Use AI to create projects

We’ve trained an AI on our docs to help you create projects faster. If you’d like to give it a try early, send us an email.

Feature updates

Use Taxonomy for labeling

There is a new labeling parameter available for the Taxonomy tag. When set to true, you can apply your Taxonomy classes to different regions in text. For more information, see Taxonomy as a labeling tool.

Bug fixes

• Fixed an issue where the Label Studio version as displayed in the side menu was not formatted properly.
• Fixed an issue where, in some cases, project roles were reset on SAML SSO login.
• Fixed an issue affecting Redis credentials with special characters.
• Fixed an issue where task IDs were being duplicated when importing a large number of tasks through the API.
• Fixed an issue where users were not being redirected to the appropriate page after logging in.

New features

Paginated multi-image labeling

Paginated multi-image labeling allows you to label an album of images within a single task. When enabled, a page navigation tool is available within the labeling interface.

While you can use paginated multi-image labeling with any series of related images, it can also be especially useful for document annotation.

For example, you can pre-process a PDF to convert it into image files, and then use the pagination toolbar to navigate the PDF. For more information, see our Multi-Page Document Annotation template.

To enable this feature, use the valueList parameter on the <Image> tag.

Classification reports for Prompts

When your Prompt includes classification elements, you can now view a report that tells you how often each class was identified. This is available for the following tags:

• Choices
• Labels
• Pairwise
• Rating

Feature updates

• Several usability enhancements for Prompts, such as a descriptive header and a reordered version menu.
• Improved the inter-annotater agreement API so that it is more performant and can better handle a high number of annotators.

Bug fixes

• Fixed an issue where SSO/SAML users were not being redirected back to the originally requested URL.
• Fixed an issue where a timeout on the inter-annotator agreement API would cause missing data in the Annotator Summary table on the Members page.
• Fixed an issue where the default date format used when exporting to CSV was incompatible with Google Sheets.
• Fixed an issue where users were unable to edit meta information that they previously added to bounding box regions.

New features

Set task reservation time

There is a new project setting under Annotation > Task Reservation.

You can use this setting to determine how many minutes a task can be reserved by a user. For more information, see Project settings - Task Reservation.

By default, the task reservation time is set to one day (1440 minutes). This setting is only available when task distribution is set to Auto.

Feature updates

• Updated the placeholder text that users see in the labeling configuration preview.

Bug fixes

• Fixed an issue where commas in comment text breaking were causing errors when exporting to CSV from the Annotator Performance report.
• Fixed an issue where annotators were seeing a tooltip message stating that the project was not ready yet, even though the project had already been completed.
• Fixed an issue that was causing 404 errors in the Activity Log.
• Fixed an issue where users were unable to deselect tools from the toolbar by clicking them a second time.
• Fixed an issue where users were presented with Reviewer actions even if the annotation was still in Draft state.
• Fixed an issue with the Source Storage editor in which some fields were overlapping in the user interface.
• Fixed an issue with the Data Manager filters when the columns are different from those in the labeling config and when $undefined$ is present in the task data.
• Fixed an issue where filter options in the Data Manager would disappear on hover.
• Fixed an issue which caused XML comments to incorrectly be considered in the label config validation.
• Fixed an issue causing an error when marking a comment as read.
• Fixed an issue where an error message would appear when selecting or unselecting the Get the latest news & tips from Heidi option on the Account Settings page.

New features

Flexible label configuration support for Prompts

Previously, the projects that you could use with Prompts were limited to relatively simple labeling configurations (for example, only having one set of Choices or one set of Labels).

With this change, you can now use complex projects with Prompts. For example, project with multiple Choices, Labels, and a combination of both. It also adds support for TextArea and Pairwise control tags.

Also as part of this change, you will no longer be asked to select a project Type when creating a new Prompt.

For more information, see Create a Prompt.

Export information from the annotator performance report

There is a new Export action available from the annotator performance dashboard.

• Report - Download the information in the dashboard as CSV or JSON.
• Timeline - Download a detailed timeline of all the user's annotation actions within the timeframe, including when the began and submitted each annotation.
• Comments Received - Download a CSV file with all of the comments that other users have left on the user's annotations.

Feature updates

Edit regions when classifying video frames

We recently introduced the ability to perform video frame classification with the <TimelineLabels> tag.

You now have the ability to edit the frame spans you select in the timeline editor, making it easier to control which frames you want to label.

Improved usability on project settings pages

There are a number of project settings that are only applicable when auto distribution is enabled for users.

To prevent confusion, settings that are not applicable will be hidden when manual distribution is enabled.

This means the following settings will be hidden when Annotation > Distribute Labeling Tasks is set to Manual:

• Annotation > Task Sampling
• Quality > Overlap of Annotations
• Quality > Low Agreement Strategy

Improved TextArea look and feel

TextArea elements have been updated to reflect the look and feel of other labeling elements.

Improved error messages when using Send Test Request for connected ML backends

When using the Send Test Request action for a connected ML backend model, you will now see more descriptive error messages.

Bug fixes

• Fixed an issue in which in certain scenarios users were unable to receive a password reset email.
• Fixed an issue where project-level roles did not affect role upgrades performed at the Organization level.

New features

Use an LLM to help you draft Prompts

There is a new Enhance Prompt action available when writing a prompt.

You can use this feature to allow an LLM to enhance the prompt you already have, using your initial prompt and the tasks as context. For more information, see Draft and run prompts.

Feature updates

Estimate cost for Prompts

You will now see an estimated cost before running a prompt. This estimate is based on the number of tokens required:

Bug fixes

• Fixed an issue where links were not resolving when using multiple S3 storages.
• Fixed an issue where non-unicode symbols would cause the Activity Log page to not load.
• Fixed an issue that could produce duplicate accounts when synced from SCIM.
• Fixed an issue where instructions were not visible to reviewers in the Review Stream.
• Fixed an issue preventing linking comments to an audio field.
• Fixed an issue preventing linking regions in audio tasks.
• Fixed an issue where deleted annotator users were not available as option when building filters in the Data Manager.

New features

Link comments to fields

You can now link comments to specific regions or fields within an annotation.

This change will help improve clarity between Annotators and Reviewers, enhancing the quality review process.

For more information, see Comments and notifications.

Flexible reject options for reviewers

There is a new option on the Review page of the project settings: Allow reviewer to choose: Requeue or Remove.

When enabled, reviewers will see two reject options for an annotation: Remove (reject and remove the annotation from the queue) and Requeue (reject and then requeue the annotation).

This is useful for situations in which some annotations are incorrect or incomplete, but are acceptable with some fixes. In those cases, it may be more useful to send the task back to the annotator. In other cases, where the annotation is far from correct, it is better to remove it entirely.

For more information, see Project settings - Review.

Custom models for Prompts

You can now add a custom, self-hosted LLM to use with Prompts. This will allow you to use your fine-tuned models with your Prompts workflow.

Custom models must be compatible with OpenAI's JSON mode. For more information, see Model provider API keys.

Version control for Prompts

There is a new Save As option when saving a prompt. This allows you to save named versions of a prompt as you refine it.

You can select between saved versions to compare their metrics. You can also manage older versions by updating them, deleting them, or renaming them.

Feature updates

Enhanced Prompts evaluation metrics

When you run a prompt, you will now see the following metrics:

• Inference cost - The cost to run the prompt evaluation.
• F1 Score - Precision and recall scores for the prompt. (Ground truth data sets only)

For more information, see Draft and run prompts.

Hotkey to show/hide all regions

A new hotkey (Ctrl + h) has been added. Use this shortcut to hide all regions. Or, if no regions are visible, show all regions.

Bug fixes

• Fixed a small UI issue seen when displaying drop-down menus with multiple nested selection options.
• Fixed an issue where users were shown a 500 error when attempting to create a project without first selecting a workspace.
• Fixed an issue where the application would crash when annotators who have also had a project role of Reviewer would navigate to the Data Manager.

Feature updates

Multi-class text classification in Prompts

Prompts, our Enterprise tool for evaluating and refining LLM prompts, now supports multi-class text classification projects. This will enable you to label your text with more than one choice, allowing for more complex classification use cases.

This also means that projects with the choice="multiple" parameter set will now appear in the Target Project drop-down menu when creating a Prompt (assuming that the project meets all other eligibility criteria).

Bug fixes

• Fixed an issue where the instructions modal was not appearing for reviewers even though Show before reviewing was enabled in the project settings.
• Fixed an issue in which draft lead time could incorrectly inflate the lead time calculation for an annotation.
• Fixed an issue in which Data Manager drop-down menus were inaccessible in smaller viewports.
• Fixed an issue which caused the Label Config UI preview to display stale information.
• Fixed an issue in which the agreement score was not updating after a reviewer completed the Fix+Accept action.
• Fixed an issue where images were improperly spaced in the Annotator Agreement Matrix.
• Fixed an issue in which Label All Tasks would not respect filters that had been applied in the Data Manager.
• Fixed an issue in which users were not able to use Quick View to load tasks that included an external taxonomy.
• Fixed an issue that caused the time portion of the DateTimePicker in the project Dashboard to not display correctly.

New features

Video frame classification

You can now apply labels to video frames. Previously, we only supported per-video classification.

This new feature allows you to apply labels at a per-frame level. You can implement this feature using a new tag: <TimelineLabels>.

For more information, see New! Video Frame Classification.

Named Entity Recognition projects for Prompts

You can now select NER projects when creating a Prompt. Previously, Prompts only supported Text Classification projects.

For more information, see Named entity recognition (NER) in our Prompts documentation.

Feature updates

• When creating regions that have start and end times (such as when annotating sections of an audio track), you will now see the duration of your selection under the Info tab.

• The Projects page header has been updated with a more compact design:
  
  - The search bar, projects drop-down menu, and create actions have all been consolidated onto one line.
  
  - The Use Template action has been moved and is now available as a drop-down option within the Create Project button.
  
  - For better clarity, the Use Template action has been renamed Create from saved template.
  

• You will now see a progress bar when performing searches against the activity log to indicate that the search is still processing.
• For better clarity, the Sandbox workspace has been renamed Personal Sandbox.

Bug fixes

• Fixed a regression issue with BigInteger support in the Data Manager.
• Fixed an issue with the Activity Logs page where some options would become unavailable.

Feature updates

• Changed the default behavior of the Project Dashboard so that it no longer defaults to the “include time” option in the calendar.

Bug fixes

• Fixed an issue in which project-level roles could not be reverted once set.
• Fixed an issue where user limits were not being enforced when users were added via LDAP.
• Fixed an issue where setting a task agreement threshold incorrectly affected counts in the project Dashboard.

New features

JavaScript for labeling customization

You can now add JavaScript to your Label Studio projects to further customize your labeling experience.

Note that due to security precautions, custom scripts must be enabled for your organization before will see the Scripts option when configuring the labeling interface. Contact your account representative to request this feature.

For more information, see the following resources:

• Custom scripts documentation
• HumanSignal Blog - Transform Your Labeling Workflow with Custom Scripts
• Video demo - Announcing Custom Scripts for Label Studio

Feature updates

You can now use Azure OpenAI when creating Prompts. For more information, see Model provider API keys.

Bug fixes

• Fixed an issue where users were seeing a runtime error when loading the dashboard in situations in which the project’s labeling configuration did not include labels.

Feature updates

• There is a new Performance Score column on the project Members page.
  
  The Performance Score column reflects the overall performance of annotators. This score takes into account all review actions, including annotations that were initially rejected and later accepted. The calculation is as follows:
  
  - Each annotation review action (Accept, Reject, Fix+Accept) contributes to the score.
  
  - The score is calculated by summing the scores of all review actions and dividing by the total number of review actions. For example:
  
  - If an annotation is rejected twice and then accepted once, the Performance Score would be (0 + 0 + 1) / 3 = 33%.
  
  - If an annotation is rejected once and then fixed+accepted with a score of 42%, the Performance Score would be (0 + 0.42) / 2 = 21%.
  
  This is different from the Review Score, which only reflects the current accepted/rejected state of annotations.

• When you make changes to the labeling configuration and attempt to navigate away before leaving, you will now see a warning message prompting you to save your changes.

• You can now reorder tabs in the Data Manager by dragging and dropping them.

Bug fixes

• Fixed an issue with breaking Text/HyperText content that contains emoji when regions are added.
• Fixed an issue where the project summary was not being included when duplicating a project.
• Fixed an issue where tracing was breaking presigned URL requests.
• Fixed an issue where users were seeing an error when visiting the Annotator Performance Report page without first selecting a user. Instead, users should be redirected away from the page until a user is selected.
• Fixed an issue where workspaces could be deleted through the API even if they still contained projects.
• Fixed an issue where, when attempting to select multiple bounding boxes by pressing Command (or Ctrl), a new bounding box would be created instead.
• Fixed an issue with region labels were not displaying the index number if there was not label text.

Feature updates

• When viewing regions with the Show region labels option enabled, the region label will now include the same index identifier that you see in the regions list.
  
  Before:

After:

• When using the Annotator Performance Reports, you can now select whether you want to aggregate data by creation date or updated date.

Bug fixes

• Fixed an issue with agreement scores for Annotators being inaccurately calculated on the Members page within projects. This issue would appear when a Reviewer would reject an annotation and then later accept it.
• Fixed an issue where images were improperly resizing after loading due to how the original dimensions were set.
• Fixed usability issues seen in the Members table once the member user list grows large enough.
• Fixed an issue with displaying large integer numbers in the Data Manager.
• Fixed an issue with tooltips that was causing errors in the transition effects.
• Fixed an issue where Annotators where able to resolve comments made by Reviewers, when this action should not be available to them.
• Fixed an issue where annotation history was not working correctly if created_by was null.
• Fixed an issue affecting SAML users caused by changes to the HumanSignal app domain.
• Fixed an issue where the docs link icon was not properly formatted.

New features

Introducing the Prompts tool

The Prompts tool leverages ChatGPT to help you evaluate and refine your LLM prompts. You can also use Prompts to generate predictions for automating your labeling process, and to quickly bootstrap labeling projects.

For more information, see Automate Data Labeling with HumanSignal and our Prompts documentation.

Refreshed Label Studio interface

The Label Studio UI has been upgraded with updated colors and fonts, giving it a sleek new look while maintaining the same intuitive navigation you're familiar with. All Label Studio tools, features, and settings are still in the same place, ensuring a smooth transition.

Feature updates

Improved performance on the Projects list page due to improvement on the API level.

Breaking changes

Fixed an issue with Google Cloud Storage when the connection has the Use pre-signed URLs option disabled. In these situations, Google was sending pre-signed URLs with the format https://storage.googleapis.com rather than sending BLOBs.

With this fix, Google Cloud Storage will begin returning BLOBs/base64 encoded data when Use pre-signed URLs is off. This means that Label Studio will start reading data from Google Cloud Storage buckets, which can result in large amounts of data being sent to your Label Studio instance - potentially affecting performance.

Bug fixes

• Fixed an issue where Redis storage connections were causing errors due to a missing field in the storage form (Storage Title).
• Fixed an issue where annotators were not being prompted to leave a comment when skipping a task, even though the project settings required them to do so.
• Fixed an issue where connected ML backends were unable to return more than one prediction per task.

Feature updates

When using the annotator performance report, you can now filter by project or workspace.

Bug fixes

• Fixed an issue where sometimes actual usernames were being replaced by a generic “Admin” username in the annotation history.
• Fixed an issue which caused the annotator dashboard project selector to not initialize on first interaction.
• Fix Redis connection with SSL.

Feature updates

• When you create a new snapshot, you will now have the option to include annotation history:

• For organizations with the HIDE_STORAGE_SETTINGS_FOR_MANAGER environment variable set to True, Managers will now be able to sync data from external storage as necessary rather than request assistance from an Admin user.

Bug fixes

• Fixed an issue where regions were disappearing when a user would switch between annotations and predictions.
• Fixed an issue where the Batch Predictions action was failing under certain conditions.
• Fixed an issue where tooltips on the dashboard were causing confusing mouseover behavior even when not visible.
• Fixed an issue with button sizing inconsistency when selecting date ranges.
• Fixed an issue that prevented users from fetching the URL for TimeSeries objects.

Feature updates

There is a new setting that can restrict users from uploading data directly to Label Studio, forcing them to only use cloud storage. If you would like to enable this setting, set the DISABLE_PROJECT_IMPORTS environment variable to True.

Bug fixes

• Fixed an issue with environment variables that have the prefix LABEL_STUDIO_ appearing in context logs.
• Fixed an issue where the progress bar for a project was not properly accounting for tasks that required additional annotators due to low agreement settings.
• Fixed an issue where multiple errors would appear in the console when users navigated away from the Data Manager.
• Fixed an issue where SCIM was not handling adding or disabling users in situations where the user limit was exceeded.
• Fixed an issue where errors were appearing in the user console related to loading large JS files.
• Fixed an issue where SCIM was creating duplicate users in situations in which there were discrepancies in casing used in their domain names.
• Fixed an issue where, if there was no name provided for a cloud storage connection, the project settings page would not load.
• Fixed an issue in which users who have their own organization could not be added to another organization using SCIM.
• Fixed an issue where logs were failing because the default level was set to DEBUG. The default log level is now INFO.