Edit

Share via


Create a fine-tuning task project

A Conversational Language Understanding (CLU) fine-tuning task is a workspace project where you customize a language model to identify user intent and extract key information (entities) from user input (utterances). In this workspace, you define the intents and entities relevant to your application, label sample user utterances accordingly, and use this labeled data to fine-tune the model. This process tailors the model to better understand the specific needs and nuances of your conversational application. In this guide, we walk you through configuring a fine-tuning workspace in the Azure AI Foundry or using the REST API.

Note

If you already have an Azure AI Language or multi-service resource—whether used on its own or through Language Studio—you can continue to use those existing Language resources within the Azure AI Foundry portal. For more information, see How to use Azure AI services in the Azure AI Foundry portal.

In Azure AI Foundry, you set up a fine-tuning task to serve as your workspace when customizing your CLU model. Previously, a fine-tuning task was referred to as a CLU project. You might encounter both terms used interchangeably in older CLU documentation.

Prerequisites

Note

We highly recommend that you use an Azure AI Foundry resource in the AI Foundry; however, you can also follow these instructions using a Language resource.

Create a CLU fine-tuning task project

To create a CLU fine-tuning task project, you first configure your environment and then create a fine-tuning task, which serves as your workspace for customizing your CLU model.

  1. Navigate to the Azure AI Foundry.

  2. If you aren't already signed in, the portal prompts you to do so with your Azure credentials.

  3. Once signed in, you can create or access your existing projects within Azure AI Foundry.

  4. If you're not already at your project for this task, select it.

  5. Select Fine-tuning from the left navigation panel.

    Screenshot of fine-tuning selector in the Azure AI Foundry.

  6. Select the AI Service fine-tuning tab and then + Fine-tune button.

    Screenshot of fine-tuning button in the Azure AI Foundry.

  7. From Create service fine-tuning window, choose the Conversational language understanding tab then select Next.

    Screenshot of conversational language understanding tab in the Azure AI Foundry.

  8. In Create CLU fine-tuning task window, complete the Name and Language fields. If you're planning to fine-tune a model using the free Standard Training mode, select English for the language field.

  9. Navigate to the Azure AI Foundry.

  10. If you aren't already signed in, the portal prompts you to do so with your Azure credentials.

  11. Once signed in, you can create or access your existing projects within Azure AI Foundry.

  12. If you're not already at your project for this task, select it.

  13. Select Fine-tuning from the left navigation panel.

    Screenshot of fine-tuning selector in the Azure AI Foundry.

  14. Select the AI Service fine-tuning tab and then + Fine-tune button.

    Screenshot of fine-tuning button in the Azure AI Foundry.

  15. From Create service fine-tuning window, choose the Conversational language understanding tab then select Next.

    Screenshot of conversational language understanding tab in the Azure AI Foundry.

  16. In Create CLU fine tuning task window, select your Connected service from the drop-down menu, then complete the Name and Language fields. If you're using the free Standard Training mode, select English for the language field.

  17. Select the Create button. It can take a few minutes for the creating operation to complete.

    Note

    • Standard training enables faster training times and quicker iterations; however it's only available for English.
    • Advanced training includes longer training durations and is supported for English, other languages, and multilingual projects.
    • For more information, see Training modes.
  18. Once the task creation is complete, select the task from the AI Service fine-tuning window to arrive at the Getting started with fine-tuning page.

    Screenshot of the getting started with fine-tuning page in the Azure AI Foundry.

That's it! You can get started on your fine-tuning task project. For more information, see Next steps.

View and manage project details

You can retrieve up-to-date information about your projects, make any necessary changes, and oversee project management tasks efficiently through the Azure AI Foundry or REST API endpoints.

Your Azure AI Foundry project overview page displays information about your fine-tuning task project, including its name, subscription, resource group, and connected resources. You can also access the project's resources in the Azure portal by selecting Manage in Azure portal on the overview page.

  • On the project Home page, information about the project is found in the Project details section.

  • To view project settings, select Management center from the bottom of the left navigation pane, then select one of the following tabs:

    • Overview to view project details.
    • Users to manage users and roles.
    • Models + endpoints to manage deployments of your models and services.
    • Connected resources to manage connected resources for the project.

    Screenshot of the project details list in the Azure AI Foundry.

Import an existing Azure AI project

Importing the configuration file allows you to bring your existing settings directly into the platform, making it easier to set up and customize your service based on your predefined preferences.

To import an existing Azure AI services project with Azure AI Foundry, you need to create a connection to the Azure AI services resource within your Azure AI Foundry project. For more information, see Connect Azure AI Services projects to Azure AI Foundry

Export a fine-tuning project

Exporting your configuration file enables you to save the current state of your project's settings and structure, making it easy to back up or transfer your project as needed.

You can download an Azure Foundry fine fine-tuning task project as a config.json file:

  1. Navigate to your project home page.

  2. At the top of the page, select your project from the right page ribbon area.

  3. Select Download config file.

    Screenshot of project drop-down menu with the download config file hyperlink in the Azure AI Foundry.

Delete a project

Deleting a project ensures that it and all of its associated data are permanently removed from the system.

If you no longer need your project, you can delete it from the Azure AI Foundry.

  1. Navigate to the Azure AI Foundry home page. Initiate the authentication process by signing in, unless you already completed this step and your session is active.

  2. Select the project that you want to delete from the Keep building with Azure AI Foundry

  3. Select Management center.

  4. Select Delete project.

    Screenshot of the Delete project button in the Azure AI Foundry.

To delete the hub along with all its projects:

  1. Navigate to the Overview tab inn the Hub section.

    Screenshot of the hub details list in the Azure AI Foundry.

  2. On the right, select Delete hub.

  3. The link opens the Azure portal for you to delete the hub there.

    Screenshot of the Delete hub button in the Azure AI Foundry.

Next steps

After you create your fine-tuning workspace, start your fine-tuning task by defining your intents and entities and adding them to your schema: