Changelog

Automation and AI-Powered Workflows

Gain visibility into LLM metrics per task

Added customizable column selectors for performance tuning and cost management.

This will help you better understand the data behind each request to the LLM for improved troubleshooting and cost management with Prompts.

Expanded model support for Prompts

Added support for the OpenAI GPT-4.1 series models in Prompts. See the complete list of supported base models here.

Annotation and Review Workflows

Dynamic brush sizes

The cursor now adjusts dynamically to brush size to allow for more precision in segmentation tasks.

KeyPointLabel exports for COCO and YOLO

COCO and YOLO export formats now available for KeyPointLabels.

Team Management and Workforce Insights

New exports available for Annotator Performance metrics

Gain clarity into annotator output and productivity; track performance across individuals and teams.

• Export CSVs of key metrics such as lead time (with and without outliers)
• New Export Underlying Data action for the Annotations chart
• Easier navigation and access to insights

Agreement score popover in Data Manager

Click any agreement score to view pairwise agreement scores with others.

• Understand how agreement is calculated
• Identify labeling misalignment and training opportunities
• Improves trust, transparency, and quality auditing

Infrastructure and Security

Performance improvements at scale

• Significant improvements to import and export performance for larger datasets and teams working at scale.
• Membership API enhancements resulting in faster load times for customers and organizations with a large number of members.

Plugin framework access control

You can now restrict Plugin access to Administrators and above. By default, Managers have access to update plugins.

To request that this be restricted to Administrators, contact support.

Public template library (Beta)

Contribute to and browse the open source community templates repository.

• Find templates for common use cases
• Modify and share templates based on your unique use case
• Gain credit and swag for your contributions

View dozens of pre-built templates available today in the Templates Gallery.

Beta features

Dark mode

Label Studio can now be used in dark mode.

Click your avatar in the upper right to find the toggle for dark mode.

• Auto - Use your system settings to determine light or dark mode.
• Light - Use light mode.
• Dark - Use dark mode.

Note that this feature is not available for environments using whitelabeling.

New features

Annotator Evaluation settings

There is a new Annotator Evaluation section under Settings > Quality.

When there are ground truth annotations within the project, an annotator will be paused if their ground truth agreement falls below a certain threshold.

For more information, see Annotator Evaluation.

Feature updates

Prompts model updates

We have added support for the following:

Anthropic: Claude 3.7 Sonnet
Gemini/Vertex: Gemini 2.5 Pro
OpenAI: GPT 4.5

For a full list of supported models, see Supported base models.

Prompts indicator for pages processed

A new Pages Processed indicator is available when using Prompts against a project that includes tasks with image albums (using the valueList parameter on an Image tag).

You can also see the number of pages processed for each task by hovering over the image thumbnail.

Adjustable text spans

You can now click and drag to adjust text span regions.

Support for BrushLabels export to COCO format

You can now export polygons created using the BrushLabels tag to COCO format.

Create support tickets through AI Assistant

If you have AI Assistant enabled and ask multiple questions without coming to a resolution, it will offer to create a support ticket on your behalf:

Clear chat history in AI Assistant

You can now clear your chat history to start a new chat.

Security

• Addressed a CSP issue by removing unsafe-eval usage.
• Improved security on CSV exports.

Bug fixes

• Fixed a server worker error related to regular expressions.
• Fixed an issue where clicking on the timeline region in the region list did not move the slider to the correct position.
• Fixed an issue where the visibleWhen parameter was not working when used with a taxonomy.

New features

New Insert Plugins menu and Testing interface

There are a number of new features and changes related to plugins:

• We have renamed "Custom Scripts" to "Plugins." This is reflected in the UI and in our docs.
• There is a new Insert Plugins menu available. From here you can insert a pre-built plugin that you can customize as necessary.
• When you add a plugin, you will see a new Testing panel below the plugin editing field. You can use this to verify what events are triggered, manually trigger events, and modify the sample data as necessary.
• To accompany the new Insert Plugins menu, there is a new Plugins gallery in the documentation that discusses each option and has information on creating your own custom plugs.
• There is also a new setting that allows you to restrict access to the Plugins tab to Administrator users. By default, it is also available to Managers. If you would like this set, contact your account manager or open a support ticket.

New Label Studio Home page

When you open Label Studio, you will see a new Home page. Here you can find links to your most recent projects, shortcuts to common actions, and links to frequently used resources.

Note that this feature is not available for environments using whitelabeling.

Support for Google Cloud Storage Workload Identity Federation (WIF)

When adding project storage, you now have the option to choose Google Cloud Storage WIF.

Unlike the the standard GCS connection using application credentials, this allows Label Studio to request temporary credentials when connecting to your storage.

For more information, see Google Cloud Storage with Workload Identity Federation (WIF).

Feature updates

Prompts model support changes

We have added support for the following Gemini models:

• gemini-2.0-flash
• gemini-2.0-flash-lite

We have removed support for the following OpenAI models:

• All gpt-3.5 models

Improved tooltips

• Improved tooltips related to pausing annotators.
• Added a tooltip to inform users that Sandbox projects are not supported in Prompts.

Miscellaneous

• Ensured that when a user is deactivated, they are also automatically logged out. Previously they lost all access, but were not automatically logged out of active sessions.
• Multiple performance improvements for our AI Assistant.

Breaking changes

Label Studio is transitioning from user to roles in AWS S3 IAM.

This affects users who are using the Amazon S3 (IAM role access) storage type in projects.

Before you can add new projects with the Amazon S3 (IAM role access) storage type, you must update your AWS IAM policy to add the following principal:

arn:aws:iam::490065312183:role/label-studio-app-production

Please also keep the the previous Label Studio principal in place to ensure that any project connections you set up prior to April 7, 2025 will continue to have access to AWS:

arn:aws:iam::490065312183:user/rw_bucket

For more information, see Set up an IAM role in AWS.

Security

• Made security improvements around the verbosity of certain API calls.
• Made security improvements around SAML.
• Made security improvements around project parameter validation.
• Made security improvements around exception error messages.
• Upgraded Babel to address vulnerabilities.

Bug fixes

• Fixed an issue where users were unable to edit custom agreement metrics if using manual distribution mode.
• Fixed an issue where role changes with LDAP were broken.
• Fixed error handling for Prompts refinement.
• Fixed an issue where Exact frames matching for video was always showing as an option for agreement metrics regardless of whether the labeling config referenced a video.
• Fixed an issue where the prediction-changed value was not being reset after making manual changes to pre-annotations.
• Fixed an issue where a "Script running successfully" message continuously appeared for users who had plugins enabled.
• Fixed an issue where interacting with the Manage Members modal would sometimes throw an error.

New features

Annotation limits

There is a new Quality > Annotation Limit section in the project settings.

You can use these fields to set limits on how many tasks each user is able to annotate. Once the limit is reached, their progress will be paused.

For more information, see Annotation Limit.

Feature updates

Usability improvements for audio tasks

Scrollbar navigation

You can now scroll forward and backward within audio files. This can be activated using the scrolling motion on a trackpad or a mouse.

New settings

We have introduced two new settings for audio tasks:

• Auto-Play New Regions - Automatically play a region after it has been selected.
• Loop Regions - When playing a region, loop the audio

New templates

There are three new templates available from the template gallery:

• Natural Language Processing > Content Moderation
• Computer Vision > Medical Imaging Classification with Bounding Boxes
• Generative AI > LLM Response Grading

Miscellaneous

• The Label Studio URL format has been updated so that you can now link to specific workspaces.
• Improved 4xx and 5xx error page design to include more helpful information.
• Added validation for S3 bucket naming.
• Various performance improvements.
• Various error handling improvements.
• Various UI fixes to ensure consistency in styles across Label Studio.

Security

Made security improvements regarding org membership visibility.

Bug fixes

• Fixed an issue in which agreement scores were missing when creating annotations from Prompts.
• Fixed an issue where images were distorted when zooming in.
• Fixed an issue where users in the Reviewer role were able to submit reviews via the API even if they were not a project member.
• Fixed an issue in which users who were in Manager, Reviewer, or Annotator roles could not access their API token through the UI.
• Fixed an issue where an empty Quick View was displayed if a user tried to open a URL linking to a non-existing task ID.
• Fixed an issue where the token expiration date format was causing issues in Safari browsers.
• Fixed an infinite loading issue with the notification drawer.
• Fixed an issue where deeply nested Choices were visible even if parents were hidden.

New features

Prompts is now generally available

Prompts is now available in Label Studio Enterprise SaaS.

Prompts is a tool that leverages LLMs to automatically generate predictions for your labeling tasks, allowing you to pre-annotate data and quickly bootstrap projects. It can also be used to evaluate your LLM prompts against ground truth data.

For more information, see the Prompts documentation and Accelerate Labeling and Model Evaluation with Prompts—Now Generally Available.

Pause an annotator

There is a new action to pause annotators. This is available from the Members dashboard and via the API.

For more information, see Pause an annotator.

Personal access tokens

There is a new type of token available for API access. The new tokens use JWT standards and, unlike the current tokens in use, allow you to set an expiration date.

You can enable or disable these tokens from the Organization page. Once enabled, they will be available for users to generate from their Account & Settings page. Legacy tokens can still be used unless disabled from the organization level.

For more information, see Access tokens.

Deep link annotations and regions

You can now link directly to specific annotations or regions within an annotation. These actions are available from the labeling interface in the overflow menus for the annotation and the region.

Feature updates

Set ground truths by user

There is a new action from the Data Manager that allows you to mark the annotations submitted by a specific user as ground truth annotations.

Known issues

Users in the Manager, Annotator, and Reviewer role cannot currently retrieve their API access tokens from the Label Studio UI.

This does not affect the functionality of any existing scripts or automations currently using their access tokens.

Bug fixes

• Fixed an issue that was causing intermittent loading errors in the Data Manager.
• Fixed an issue where filters were not being respected when performing bulk annotation actions.
• Fixed an issue where bulk annotation was sometimes failing with a 500 error.
• Fixed an issue where bulk annotation was not respecting the Allow empty annotations setting.
• Fixed an issue that caused incorrect video frame to be rendered when pausing.
• Fixed an issue where users were getting their role reset if they were provisioned via SCIM without an assigned group.
• Fixed an issue where an error was sometimes thrown when loading the workspaces list.
• Fixed an issue that would cause an API error when switching workspaces and fetching the incorrect page of projects.

New features

Bulk labeling

There is a new Bulk label action available from the Data Manager. You can use this to quickly label tasks multiple tasks at once.

This feature also includes enhancements to the Grid View in the Data Manager. Now when viewing images, you can zoom in/out, scroll, and pan.

For more information, see the Bulk labeling documentation and Bulk Labeling: How to Classify in Batches.

Enable AI features

There is a new toggle on the Billing & Usage page (only available to users in the Owner role). You can use this to enable AI features throughout Label Studio. See AI features.

Feature updates

Updated Billing & Usage page

The Billing & Usage page (only accessible to users in the Owner role) has several new options:

• Early Adopter - Opt in to new features before they're generally available.
• Enable AI Features - Enables AI helper tools within Label Studio. See AI features.
• White labeling - Contact sales about enabling white labeling.
• Custom Scripts - Contact sales to enable custom scripts. See Custom scripts for projects.

Anthropic model support for Prompts

You can now configure Prompts to use an Anthropic model. For more information, see Model provider API keys.

Bug fixes

• Fixed an issue where the Annotator Performance drop-down was not filtering the results as expected.
• Fixed an issue where users were unable to select and move bounding box regions after adding brush regions.
• Fixed an issue where seeking within a video would display duplicate frames in the the Video tag.
• Fixed an issue when managers could review skipped tasks in Quick View.

New features

Image support for Prompts

You can now use image data with Prompts. Previously, only text data was supported.

This new feature will allow you to automate and evaluate labeling workflows for image captioning and classification. For more information, see our Prompts documentation.

Beta features

Use AI to create projects

We’ve trained an AI on our docs to help you create projects faster. If you’d like to give it a try early, send us an email.

Feature updates

Use Taxonomy for labeling

There is a new labeling parameter available for the Taxonomy tag. When set to true, you can apply your Taxonomy classes to different regions in text. For more information, see Taxonomy as a labeling tool.

Bug fixes

• Fixed an issue where the Label Studio version as displayed in the side menu was not formatted properly.
• Fixed an issue where, in some cases, project roles were reset on SAML SSO login.
• Fixed an issue affecting Redis credentials with special characters.
• Fixed an issue where task IDs were being duplicated when importing a large number of tasks through the API.
• Fixed an issue where users were not being redirected to the appropriate page after logging in.

New features

Paginated multi-image labeling

Paginated multi-image labeling allows you to label an album of images within a single task. When enabled, a page navigation tool is available within the labeling interface.

While you can use paginated multi-image labeling with any series of related images, it can also be especially useful for document annotation.

For example, you can pre-process a PDF to convert it into image files, and then use the pagination toolbar to navigate the PDF. For more information, see our Multi-Page Document Annotation template.

To enable this feature, use the valueList parameter on the <Image> tag.

Classification reports for Prompts

When your Prompt includes classification elements, you can now view a report that tells you how often each class was identified. This is available for the following tags:

• Choices
• Labels
• Pairwise
• Rating

Feature updates

• Several usability enhancements for Prompts, such as a descriptive header and a reordered version menu.
• Improved the inter-annotater agreement API so that it is more performant and can better handle a high number of annotators.

Bug fixes

• Fixed an issue where SSO/SAML users were not being redirected back to the originally requested URL.
• Fixed an issue where a timeout on the inter-annotator agreement API would cause missing data in the Annotator Summary table on the Members page.
• Fixed an issue where the default date format used when exporting to CSV was incompatible with Google Sheets.
• Fixed an issue where users were unable to edit meta information that they previously added to bounding box regions.

New features

Set task reservation time

There is a new project setting under Annotation > Task Reservation.

You can use this setting to determine how many minutes a task can be reserved by a user. For more information, see Project settings - Task Reservation.

By default, the task reservation time is set to one day (1440 minutes). This setting is only available when task distribution is set to Auto.

Feature updates

• Updated the placeholder text that users see in the labeling configuration preview.

Bug fixes

• Fixed an issue where commas in comment text breaking were causing errors when exporting to CSV from the Annotator Performance report.
• Fixed an issue where annotators were seeing a tooltip message stating that the project was not ready yet, even though the project had already been completed.
• Fixed an issue that was causing 404 errors in the Activity Log.
• Fixed an issue where users were unable to deselect tools from the toolbar by clicking them a second time.
• Fixed an issue where users were presented with Reviewer actions even if the annotation was still in Draft state.
• Fixed an issue with the Source Storage editor in which some fields were overlapping in the user interface.
• Fixed an issue with the Data Manager filters when the columns are different from those in the labeling config and when $undefined$ is present in the task data.
• Fixed an issue where filter options in the Data Manager would disappear on hover.
• Fixed an issue which caused XML comments to incorrectly be considered in the label config validation.
• Fixed an issue causing an error when marking a comment as read.
• Fixed an issue where an error message would appear when selecting or unselecting the Get the latest news & tips from Heidi option on the Account Settings page.

New features

Flexible label configuration support for Prompts

Previously, the projects that you could use with Prompts were limited to relatively simple labeling configurations (for example, only having one set of Choices or one set of Labels).

With this change, you can now use complex projects with Prompts. For example, project with multiple Choices, Labels, and a combination of both. It also adds support for TextArea and Pairwise control tags.

Also as part of this change, you will no longer be asked to select a project Type when creating a new Prompt.

For more information, see Create a Prompt.

Export information from the annotator performance report

There is a new Export action available from the annotator performance dashboard.

• Report - Download the information in the dashboard as CSV or JSON.
• Timeline - Download a detailed timeline of all the user's annotation actions within the timeframe, including when the began and submitted each annotation.
• Comments Received - Download a CSV file with all of the comments that other users have left on the user's annotations.

Feature updates

Edit regions when classifying video frames

We recently introduced the ability to perform video frame classification with the <TimelineLabels> tag.

You now have the ability to edit the frame spans you select in the timeline editor, making it easier to control which frames you want to label.

Improved usability on project settings pages

There are a number of project settings that are only applicable when auto distribution is enabled for users.

To prevent confusion, settings that are not applicable will be hidden when manual distribution is enabled.

This means the following settings will be hidden when Annotation > Distribute Labeling Tasks is set to Manual:

• Annotation > Task Sampling
• Quality > Overlap of Annotations
• Quality > Low Agreement Strategy

Improved TextArea look and feel

TextArea elements have been updated to reflect the look and feel of other labeling elements.

Improved error messages when using Send Test Request for connected ML backends

When using the Send Test Request action for a connected ML backend model, you will now see more descriptive error messages.

Bug fixes

• Fixed an issue in which in certain scenarios users were unable to receive a password reset email.
• Fixed an issue where project-level roles did not affect role upgrades performed at the Organization level.

New features

Use an LLM to help you draft Prompts

There is a new Enhance Prompt action available when writing a prompt.

You can use this feature to allow an LLM to enhance the prompt you already have, using your initial prompt and the tasks as context. For more information, see Draft and run prompts.

Feature updates

Estimate cost for Prompts

You will now see an estimated cost before running a prompt. This estimate is based on the number of tokens required:

Bug fixes

• Fixed an issue where links were not resolving when using multiple S3 storages.
• Fixed an issue where non-unicode symbols would cause the Activity Log page to not load.
• Fixed an issue that could produce duplicate accounts when synced from SCIM.
• Fixed an issue where instructions were not visible to reviewers in the Review Stream.
• Fixed an issue preventing linking comments to an audio field.
• Fixed an issue preventing linking regions in audio tasks.
• Fixed an issue where deleted annotator users were not available as option when building filters in the Data Manager.

New features

Link comments to fields

You can now link comments to specific regions or fields within an annotation.

This change will help improve clarity between Annotators and Reviewers, enhancing the quality review process.

For more information, see Comments and notifications.

Flexible reject options for reviewers

There is a new option on the Review page of the project settings: Allow reviewer to choose: Requeue or Remove.

When enabled, reviewers will see two reject options for an annotation: Remove (reject and remove the annotation from the queue) and Requeue (reject and then requeue the annotation).

This is useful for situations in which some annotations are incorrect or incomplete, but are acceptable with some fixes. In those cases, it may be more useful to send the task back to the annotator. In other cases, where the annotation is far from correct, it is better to remove it entirely.

For more information, see Project settings - Review.

Custom models for Prompts

You can now add a custom, self-hosted LLM to use with Prompts. This will allow you to use your fine-tuned models with your Prompts workflow.

Custom models must be compatible with OpenAI's JSON mode. For more information, see Model provider API keys.

Version control for Prompts

There is a new Save As option when saving a prompt. This allows you to save named versions of a prompt as you refine it.

You can select between saved versions to compare their metrics. You can also manage older versions by updating them, deleting them, or renaming them.

Feature updates

Enhanced Prompts evaluation metrics

When you run a prompt, you will now see the following metrics:

• Inference cost - The cost to run the prompt evaluation.
• F1 Score - Precision and recall scores for the prompt. (Ground truth data sets only)

For more information, see Draft and run prompts.

Hotkey to show/hide all regions

A new hotkey (Ctrl + h) has been added. Use this shortcut to hide all regions. Or, if no regions are visible, show all regions.

Bug fixes

• Fixed a small UI issue seen when displaying drop-down menus with multiple nested selection options.
• Fixed an issue where users were shown a 500 error when attempting to create a project without first selecting a workspace.
• Fixed an issue where the application would crash when annotators who have also had a project role of Reviewer would navigate to the Data Manager.

New features

Video frame classification

You can now apply labels to video frames. Previously, we only supported per-video classification.

This new feature allows you to apply labels at a per-frame level. You can implement this feature using a new tag: <TimelineLabels>.

For more information, see New! Video Frame Classification.

Named Entity Recognition projects for Prompts

You can now select NER projects when creating a Prompt. Previously, Prompts only supported Text Classification projects.

For more information, see Named entity recognition (NER) in our Prompts documentation.

Feature updates

• When creating regions that have start and end times (such as when annotating sections of an audio track), you will now see the duration of your selection under the Info tab.

• The Projects page header has been updated with a more compact design:
  
  - The search bar, projects drop-down menu, and create actions have all been consolidated onto one line.
  
  - The Use Template action has been moved and is now available as a drop-down option within the Create Project button.
  
  - For better clarity, the Use Template action has been renamed Create from saved template.
  

• You will now see a progress bar when performing searches against the activity log to indicate that the search is still processing.
• For better clarity, the Sandbox workspace has been renamed Personal Sandbox.

Bug fixes

• Fixed a regression issue with BigInteger support in the Data Manager.
• Fixed an issue with the Activity Logs page where some options would become unavailable.

New features

JavaScript for labeling customization

You can now add JavaScript to your Label Studio projects to further customize your labeling experience.

Note that due to security precautions, custom scripts must be enabled for your organization before will see the Scripts option when configuring the labeling interface. Contact your account representative to request this feature.

For more information, see the following resources:

• Custom scripts documentation
• HumanSignal Blog - Transform Your Labeling Workflow with Custom Scripts
• Video demo - Announcing Custom Scripts for Label Studio

Feature updates

You can now use Azure OpenAI when creating Prompts. For more information, see Model provider API keys.

Bug fixes

• Fixed an issue where users were seeing a runtime error when loading the dashboard in situations in which the project’s labeling configuration did not include labels.

New features

Introducing the Prompts tool

The Prompts tool leverages ChatGPT to help you evaluate and refine your LLM prompts. You can also use Prompts to generate predictions for automating your labeling process, and to quickly bootstrap labeling projects.

For more information, see Automate Data Labeling with HumanSignal and our Prompts documentation.

Refreshed Label Studio interface

The Label Studio UI has been upgraded with updated colors and fonts, giving it a sleek new look while maintaining the same intuitive navigation you're familiar with. All Label Studio tools, features, and settings are still in the same place, ensuring a smooth transition.

Feature updates

Improved performance on the Projects list page due to improvement on the API level.

Breaking changes

Fixed an issue with Google Cloud Storage when the connection has the Use pre-signed URLs option disabled. In these situations, Google was sending pre-signed URLs with the format https://storage.googleapis.com rather than sending BLOBs.

With this fix, Google Cloud Storage will begin returning BLOBs/base64 encoded data when Use pre-signed URLs is off. This means that Label Studio will start reading data from Google Cloud Storage buckets, which can result in large amounts of data being sent to your Label Studio instance - potentially affecting performance.

Bug fixes

• Fixed an issue where Redis storage connections were causing errors due to a missing field in the storage form (Storage Title).
• Fixed an issue where annotators were not being prompted to leave a comment when skipping a task, even though the project settings required them to do so.
• Fixed an issue where connected ML backends were unable to return more than one prediction per task.