Share via


Microsoft.MachineLearningServices workspaces/endpoints 2024-10-01-preview

Bicep resource definition

The workspaces/endpoints resource type can be deployed with operations that target:

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.MachineLearningServices/workspaces/endpoints resource, add the following Bicep to your template.

resource symbolicname 'Microsoft.MachineLearningServices/workspaces/endpoints@2024-10-01-preview' = {
  parent: resourceSymbolicName
  name: 'string'
  properties: {
    associatedResourceId: 'string'
    deployments: [
      {
        properties: {
          failureReason: 'string'
          provisioningState: 'string'
          type: 'string'
          // For remaining properties, see EndpointDeploymentResourcePropertiesAutoGenerated objects
        }
      }
    ]
    endpointUri: 'string'
    failureReason: 'string'
    location: 'string'
    name: 'string'
    provisioningState: 'string'
    shouldCreateAiServicesEndpoint: bool
    endpointType: 'string'
    // For remaining properties, see EndpointResourcePropertiesAutoGenerated objects
  }
}

EndpointDeploymentResourcePropertiesAutoGenerated objects

Set the type property to specify the type of object.

For Azure.ContentSafety, use:

{
  model: {
    format: 'string'
    name: 'string'
    source: 'string'
    version: 'string'
  }
  raiPolicyName: 'string'
  sku: {
    capacity: int
    family: 'string'
    name: 'string'
    size: 'string'
    tier: 'string'
  }
  type: 'Azure.ContentSafety'
  versionUpgradeOption: 'string'
}

For Azure.OpenAI, use:

{
  model: {
    format: 'string'
    name: 'string'
    source: 'string'
    version: 'string'
  }
  raiPolicyName: 'string'
  sku: {
    capacity: int
    family: 'string'
    name: 'string'
    size: 'string'
    tier: 'string'
  }
  type: 'Azure.OpenAI'
  versionUpgradeOption: 'string'
}

For Azure.Speech, use:

{
  model: {
    format: 'string'
    name: 'string'
    source: 'string'
    version: 'string'
  }
  raiPolicyName: 'string'
  sku: {
    capacity: int
    family: 'string'
    name: 'string'
    size: 'string'
    tier: 'string'
  }
  type: 'Azure.Speech'
  versionUpgradeOption: 'string'
}

For managedOnlineEndpoint, use:

{
  endpointComputeType: 'string'
  model: 'string'
  type: 'managedOnlineEndpoint'
}

EndpointResourcePropertiesAutoGenerated objects

Set the endpointType property to specify the type of object.

For Azure.ContentSafety, use:

{
  endpointType: 'Azure.ContentSafety'
}

For Azure.OpenAI, use:

{
  endpointType: 'Azure.OpenAI'
}

For Azure.Speech, use:

{
  endpointType: 'Azure.Speech'
}

For managedOnlineEndpoint, use:

{
  authMode: 'string'
  compute: 'string'
  description: 'string'
  endpointType: 'managedOnlineEndpoint'
  mirrorTraffic: {
    {customized property}: int
  }
  scoringUri: 'string'
  traffic: {
    {customized property}: int
  }
}

For serverlessEndpoint, use:

{
  authMode: 'string'
  capacityReservation: {
    capacityReservationGroupId: 'string'
    endpointReservedCapacity: int
  }
  contentSafety: {
    contentSafetyStatus: 'string'
  }
  endpointState: 'string'
  endpointType: 'serverlessEndpoint'
  inferenceEndpoint: {}
  marketplaceSubscriptionId: 'string'
  metadata: any(...)
  modelSettings: {
    modelId: 'string'
  }
  offer: {
    offerName: 'string'
    publisher: 'string'
  }
}

Property Values

Microsoft.MachineLearningServices/workspaces/endpoints

Name Description Value
name The resource name string

Constraints:
Pattern = ^[a-zA-Z0-9][a-zA-Z0-9_.-]{2,32}$ (required)
parent In Bicep, you can specify the parent resource for a child resource. You only need to add this property when the child resource is declared outside of the parent resource.

For more information, see Child resource outside parent resource.
Symbolic name for resource of type: workspaces
properties EndpointResourcePropertiesAutoGenerated (required)

CognitiveServicesSku

Name Description Value
capacity int
family string
name string
size string
tier string

ContentSafetyEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.ContentSafety' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

ContentSafetyEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.ContentSafety' (required)

EndpointDeploymentModel

Name Description Value
format Model format string
name Model name. string
source Optional. Deployment model source ARM resource ID. string
version Model version. string

EndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
failureReason The failure reason if the creation failed. string
provisioningState Read-only provision state status property. 'Accepted'
'Canceled'
'Creating'
'Deleting'
'Disabled'
'Failed'
'NotStarted'
'Scaling'
'Succeeded'
'Updating'
type Set to 'Azure.ContentSafety' for type ContentSafetyEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'Azure.OpenAI' for type OpenAIEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'Azure.Speech' for type SpeechEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'managedOnlineEndpoint' for type ManagedOnlineEndpointDeploymentResourcePropertiesAutoGenerated. 'Azure.ContentSafety'
'Azure.OpenAI'
'Azure.Speech'
'managedOnlineEndpoint' (required)

EndpointDeploymentResourcePropertiesBasicResourceAutoGenerated

Name Description Value
properties EndpointDeploymentResourcePropertiesAutoGenerated (required)

EndpointResourcePropertiesAutoGenerated

Name Description Value
associatedResourceId Byo resource id for creating the built-in model service endpoints. string
deployments Deployments info. EndpointDeploymentResourcePropertiesBasicResourceAutoGenerated[]
endpointType Set to 'Azure.ContentSafety' for type ContentSafetyEndpointResourcePropertiesAutoGenerated. Set to 'Azure.OpenAI' for type OpenAIEndpointResourcePropertiesAutoGenerated. Set to 'Azure.Speech' for type SpeechEndpointResourcePropertiesAutoGenerated. Set to 'managedOnlineEndpoint' for type ManagedOnlineEndpointResourcePropertiesAutoGenerated. Set to 'serverlessEndpoint' for type ServerlessEndpointResourcePropertiesAutoGenerated. 'Azure.ContentSafety'
'Azure.OpenAI'
'Azure.Speech'
'managedOnlineEndpoint'
'serverlessEndpoint' (required)
endpointUri Uri of the endpoint. string
failureReason The failure reason if the creation failed. string
location Location of the endpoint.
Since input dto and when parse endpoint resource share the same contract
this Location field is just for parse the endpoint resource info
we won't let customer specify the endpoint resource location since we will create it the same location as workspace
string
name Name of the endpoint. string
provisioningState Read-only provision state status property. 'Accepted'
'Canceled'
'Creating'
'Deleting'
'Disabled'
'Failed'
'NotStarted'
'Scaling'
'Succeeded'
'Updating'
shouldCreateAiServicesEndpoint Whether the proxy (non-byo) endpoint is a regular endpoint or a OneKeyV2 AI services account endpoint. bool

ManagedOnlineEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
endpointComputeType Enum to determine endpoint compute type. 'AzureMLCompute'
'Kubernetes'
'Managed'
model string
type Kind of the deployment. 'managedOnlineEndpoint' (required)

ManagedOnlineEndpointResourcePropertiesAutoGenerated

Name Description Value
authMode Enum to determine endpoint authentication mode. 'AADToken'
'AMLToken'
'Key'
compute string
description string
endpointType Type of the endpoint. 'managedOnlineEndpoint' (required)
mirrorTraffic Dictionary of <integer> ManagedOnlineEndpointResourcePropertiesMirrorTraffic
scoringUri string
traffic Dictionary of <integer> ManagedOnlineEndpointResourcePropertiesTraffic

ManagedOnlineEndpointResourcePropertiesMirrorTraffic

Name Description Value

ManagedOnlineEndpointResourcePropertiesTraffic

Name Description Value

OpenAIEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.OpenAI' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

OpenAIEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.OpenAI' (required)

ServerlessEndpointCapacityReservation

Name Description Value
capacityReservationGroupId string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)
endpointReservedCapacity int

ServerlessEndpointContentSafetyAutoGenerated

Name Description Value
contentSafetyStatus Specifies the status of content safety. 'Disabled'
'Enabled' (required)

ServerlessEndpointInferenceEndpointAutoGenerated

Name Description Value

ServerlessEndpointModelSettings

Name Description Value
modelId string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)

ServerlessEndpointResourcePropertiesAutoGenerated

Name Description Value
authMode 'AAD'
'Key'
'KeyAndAAD'
capacityReservation ServerlessEndpointCapacityReservation
contentSafety ServerlessEndpointContentSafetyAutoGenerated
endpointState State of the Serverless Endpoint. 'Creating'
'CreationFailed'
'Deleting'
'DeletionFailed'
'Online'
'Reinstating'
'Suspended'
'Suspending'
'Unknown'
endpointType Type of the endpoint. 'serverlessEndpoint' (required)
inferenceEndpoint ServerlessEndpointInferenceEndpointAutoGenerated
marketplaceSubscriptionId string
metadata Anything any
modelSettings ServerlessEndpointModelSettings
offer ServerlessOffer

ServerlessOffer

Name Description Value
offerName string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)
publisher string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)

SpeechEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.Speech' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

SpeechEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.Speech' (required)

ARM template resource definition

The workspaces/endpoints resource type can be deployed with operations that target:

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.MachineLearningServices/workspaces/endpoints resource, add the following JSON to your template.

{
  "type": "Microsoft.MachineLearningServices/workspaces/endpoints",
  "apiVersion": "2024-10-01-preview",
  "name": "string",
  "properties": {
    "associatedResourceId": "string",
    "deployments": [
      {
        "properties": {
          "failureReason": "string",
          "provisioningState": "string",
          "type": "string"
          // For remaining properties, see EndpointDeploymentResourcePropertiesAutoGenerated objects
        }
      }
    ],
    "endpointUri": "string",
    "failureReason": "string",
    "location": "string",
    "name": "string",
    "provisioningState": "string",
    "shouldCreateAiServicesEndpoint": "bool",
    "endpointType": "string"
    // For remaining properties, see EndpointResourcePropertiesAutoGenerated objects
  }
}

EndpointDeploymentResourcePropertiesAutoGenerated objects

Set the type property to specify the type of object.

For Azure.ContentSafety, use:

{
  "model": {
    "format": "string",
    "name": "string",
    "source": "string",
    "version": "string"
  },
  "raiPolicyName": "string",
  "sku": {
    "capacity": "int",
    "family": "string",
    "name": "string",
    "size": "string",
    "tier": "string"
  },
  "type": "Azure.ContentSafety",
  "versionUpgradeOption": "string"
}

For Azure.OpenAI, use:

{
  "model": {
    "format": "string",
    "name": "string",
    "source": "string",
    "version": "string"
  },
  "raiPolicyName": "string",
  "sku": {
    "capacity": "int",
    "family": "string",
    "name": "string",
    "size": "string",
    "tier": "string"
  },
  "type": "Azure.OpenAI",
  "versionUpgradeOption": "string"
}

For Azure.Speech, use:

{
  "model": {
    "format": "string",
    "name": "string",
    "source": "string",
    "version": "string"
  },
  "raiPolicyName": "string",
  "sku": {
    "capacity": "int",
    "family": "string",
    "name": "string",
    "size": "string",
    "tier": "string"
  },
  "type": "Azure.Speech",
  "versionUpgradeOption": "string"
}

For managedOnlineEndpoint, use:

{
  "endpointComputeType": "string",
  "model": "string",
  "type": "managedOnlineEndpoint"
}

EndpointResourcePropertiesAutoGenerated objects

Set the endpointType property to specify the type of object.

For Azure.ContentSafety, use:

{
  "endpointType": "Azure.ContentSafety"
}

For Azure.OpenAI, use:

{
  "endpointType": "Azure.OpenAI"
}

For Azure.Speech, use:

{
  "endpointType": "Azure.Speech"
}

For managedOnlineEndpoint, use:

{
  "authMode": "string",
  "compute": "string",
  "description": "string",
  "endpointType": "managedOnlineEndpoint",
  "mirrorTraffic": {
    "{customized property}": "int"
  },
  "scoringUri": "string",
  "traffic": {
    "{customized property}": "int"
  }
}

For serverlessEndpoint, use:

{
  "authMode": "string",
  "capacityReservation": {
    "capacityReservationGroupId": "string",
    "endpointReservedCapacity": "int"
  },
  "contentSafety": {
    "contentSafetyStatus": "string"
  },
  "endpointState": "string",
  "endpointType": "serverlessEndpoint",
  "inferenceEndpoint": {
  },
  "marketplaceSubscriptionId": "string",
  "metadata": {},
  "modelSettings": {
    "modelId": "string"
  },
  "offer": {
    "offerName": "string",
    "publisher": "string"
  }
}

Property Values

Microsoft.MachineLearningServices/workspaces/endpoints

Name Description Value
apiVersion The api version '2024-10-01-preview'
name The resource name string

Constraints:
Pattern = ^[a-zA-Z0-9][a-zA-Z0-9_.-]{2,32}$ (required)
properties EndpointResourcePropertiesAutoGenerated (required)
type The resource type 'Microsoft.MachineLearningServices/workspaces/endpoints'

CognitiveServicesSku

Name Description Value
capacity int
family string
name string
size string
tier string

ContentSafetyEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.ContentSafety' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

ContentSafetyEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.ContentSafety' (required)

EndpointDeploymentModel

Name Description Value
format Model format string
name Model name. string
source Optional. Deployment model source ARM resource ID. string
version Model version. string

EndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
failureReason The failure reason if the creation failed. string
provisioningState Read-only provision state status property. 'Accepted'
'Canceled'
'Creating'
'Deleting'
'Disabled'
'Failed'
'NotStarted'
'Scaling'
'Succeeded'
'Updating'
type Set to 'Azure.ContentSafety' for type ContentSafetyEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'Azure.OpenAI' for type OpenAIEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'Azure.Speech' for type SpeechEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'managedOnlineEndpoint' for type ManagedOnlineEndpointDeploymentResourcePropertiesAutoGenerated. 'Azure.ContentSafety'
'Azure.OpenAI'
'Azure.Speech'
'managedOnlineEndpoint' (required)

EndpointDeploymentResourcePropertiesBasicResourceAutoGenerated

Name Description Value
properties EndpointDeploymentResourcePropertiesAutoGenerated (required)

EndpointResourcePropertiesAutoGenerated

Name Description Value
associatedResourceId Byo resource id for creating the built-in model service endpoints. string
deployments Deployments info. EndpointDeploymentResourcePropertiesBasicResourceAutoGenerated[]
endpointType Set to 'Azure.ContentSafety' for type ContentSafetyEndpointResourcePropertiesAutoGenerated. Set to 'Azure.OpenAI' for type OpenAIEndpointResourcePropertiesAutoGenerated. Set to 'Azure.Speech' for type SpeechEndpointResourcePropertiesAutoGenerated. Set to 'managedOnlineEndpoint' for type ManagedOnlineEndpointResourcePropertiesAutoGenerated. Set to 'serverlessEndpoint' for type ServerlessEndpointResourcePropertiesAutoGenerated. 'Azure.ContentSafety'
'Azure.OpenAI'
'Azure.Speech'
'managedOnlineEndpoint'
'serverlessEndpoint' (required)
endpointUri Uri of the endpoint. string
failureReason The failure reason if the creation failed. string
location Location of the endpoint.
Since input dto and when parse endpoint resource share the same contract
this Location field is just for parse the endpoint resource info
we won't let customer specify the endpoint resource location since we will create it the same location as workspace
string
name Name of the endpoint. string
provisioningState Read-only provision state status property. 'Accepted'
'Canceled'
'Creating'
'Deleting'
'Disabled'
'Failed'
'NotStarted'
'Scaling'
'Succeeded'
'Updating'
shouldCreateAiServicesEndpoint Whether the proxy (non-byo) endpoint is a regular endpoint or a OneKeyV2 AI services account endpoint. bool

ManagedOnlineEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
endpointComputeType Enum to determine endpoint compute type. 'AzureMLCompute'
'Kubernetes'
'Managed'
model string
type Kind of the deployment. 'managedOnlineEndpoint' (required)

ManagedOnlineEndpointResourcePropertiesAutoGenerated

Name Description Value
authMode Enum to determine endpoint authentication mode. 'AADToken'
'AMLToken'
'Key'
compute string
description string
endpointType Type of the endpoint. 'managedOnlineEndpoint' (required)
mirrorTraffic Dictionary of <integer> ManagedOnlineEndpointResourcePropertiesMirrorTraffic
scoringUri string
traffic Dictionary of <integer> ManagedOnlineEndpointResourcePropertiesTraffic

ManagedOnlineEndpointResourcePropertiesMirrorTraffic

Name Description Value

ManagedOnlineEndpointResourcePropertiesTraffic

Name Description Value

OpenAIEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.OpenAI' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

OpenAIEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.OpenAI' (required)

ServerlessEndpointCapacityReservation

Name Description Value
capacityReservationGroupId string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)
endpointReservedCapacity int

ServerlessEndpointContentSafetyAutoGenerated

Name Description Value
contentSafetyStatus Specifies the status of content safety. 'Disabled'
'Enabled' (required)

ServerlessEndpointInferenceEndpointAutoGenerated

Name Description Value

ServerlessEndpointModelSettings

Name Description Value
modelId string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)

ServerlessEndpointResourcePropertiesAutoGenerated

Name Description Value
authMode 'AAD'
'Key'
'KeyAndAAD'
capacityReservation ServerlessEndpointCapacityReservation
contentSafety ServerlessEndpointContentSafetyAutoGenerated
endpointState State of the Serverless Endpoint. 'Creating'
'CreationFailed'
'Deleting'
'DeletionFailed'
'Online'
'Reinstating'
'Suspended'
'Suspending'
'Unknown'
endpointType Type of the endpoint. 'serverlessEndpoint' (required)
inferenceEndpoint ServerlessEndpointInferenceEndpointAutoGenerated
marketplaceSubscriptionId string
metadata Anything any
modelSettings ServerlessEndpointModelSettings
offer ServerlessOffer

ServerlessOffer

Name Description Value
offerName string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)
publisher string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)

SpeechEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.Speech' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

SpeechEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.Speech' (required)

Usage Examples

Terraform (AzAPI provider) resource definition

The workspaces/endpoints resource type can be deployed with operations that target:

  • Resource groups

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.MachineLearningServices/workspaces/endpoints resource, add the following Terraform to your template.

resource "azapi_resource" "symbolicname" {
  type = "Microsoft.MachineLearningServices/workspaces/endpoints@2024-10-01-preview"
  name = "string"
  parent_id = "string"
  body = {
    properties = {
      associatedResourceId = "string"
      deployments = [
        {
          properties = {
            failureReason = "string"
            provisioningState = "string"
            type = "string"
            // For remaining properties, see EndpointDeploymentResourcePropertiesAutoGenerated objects
          }
        }
      ]
      endpointUri = "string"
      failureReason = "string"
      location = "string"
      name = "string"
      provisioningState = "string"
      shouldCreateAiServicesEndpoint = bool
      endpointType = "string"
      // For remaining properties, see EndpointResourcePropertiesAutoGenerated objects
    }
  }
}

EndpointDeploymentResourcePropertiesAutoGenerated objects

Set the type property to specify the type of object.

For Azure.ContentSafety, use:

{
  model = {
    format = "string"
    name = "string"
    source = "string"
    version = "string"
  }
  raiPolicyName = "string"
  sku = {
    capacity = int
    family = "string"
    name = "string"
    size = "string"
    tier = "string"
  }
  type = "Azure.ContentSafety"
  versionUpgradeOption = "string"
}

For Azure.OpenAI, use:

{
  model = {
    format = "string"
    name = "string"
    source = "string"
    version = "string"
  }
  raiPolicyName = "string"
  sku = {
    capacity = int
    family = "string"
    name = "string"
    size = "string"
    tier = "string"
  }
  type = "Azure.OpenAI"
  versionUpgradeOption = "string"
}

For Azure.Speech, use:

{
  model = {
    format = "string"
    name = "string"
    source = "string"
    version = "string"
  }
  raiPolicyName = "string"
  sku = {
    capacity = int
    family = "string"
    name = "string"
    size = "string"
    tier = "string"
  }
  type = "Azure.Speech"
  versionUpgradeOption = "string"
}

For managedOnlineEndpoint, use:

{
  endpointComputeType = "string"
  model = "string"
  type = "managedOnlineEndpoint"
}

EndpointResourcePropertiesAutoGenerated objects

Set the endpointType property to specify the type of object.

For Azure.ContentSafety, use:

{
  endpointType = "Azure.ContentSafety"
}

For Azure.OpenAI, use:

{
  endpointType = "Azure.OpenAI"
}

For Azure.Speech, use:

{
  endpointType = "Azure.Speech"
}

For managedOnlineEndpoint, use:

{
  authMode = "string"
  compute = "string"
  description = "string"
  endpointType = "managedOnlineEndpoint"
  mirrorTraffic = {
    {customized property} = int
  }
  scoringUri = "string"
  traffic = {
    {customized property} = int
  }
}

For serverlessEndpoint, use:

{
  authMode = "string"
  capacityReservation = {
    capacityReservationGroupId = "string"
    endpointReservedCapacity = int
  }
  contentSafety = {
    contentSafetyStatus = "string"
  }
  endpointState = "string"
  endpointType = "serverlessEndpoint"
  inferenceEndpoint = {
  }
  marketplaceSubscriptionId = "string"
  metadata = ?
  modelSettings = {
    modelId = "string"
  }
  offer = {
    offerName = "string"
    publisher = "string"
  }
}

Property Values

Microsoft.MachineLearningServices/workspaces/endpoints

Name Description Value
name The resource name string

Constraints:
Pattern = ^[a-zA-Z0-9][a-zA-Z0-9_.-]{2,32}$ (required)
parent_id The ID of the resource that is the parent for this resource. ID for resource of type: workspaces
properties EndpointResourcePropertiesAutoGenerated (required)
type The resource type "Microsoft.MachineLearningServices/workspaces/endpoints@2024-10-01-preview"

CognitiveServicesSku

Name Description Value
capacity int
family string
name string
size string
tier string

ContentSafetyEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.ContentSafety' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

ContentSafetyEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.ContentSafety' (required)

EndpointDeploymentModel

Name Description Value
format Model format string
name Model name. string
source Optional. Deployment model source ARM resource ID. string
version Model version. string

EndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
failureReason The failure reason if the creation failed. string
provisioningState Read-only provision state status property. 'Accepted'
'Canceled'
'Creating'
'Deleting'
'Disabled'
'Failed'
'NotStarted'
'Scaling'
'Succeeded'
'Updating'
type Set to 'Azure.ContentSafety' for type ContentSafetyEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'Azure.OpenAI' for type OpenAIEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'Azure.Speech' for type SpeechEndpointDeploymentResourcePropertiesAutoGenerated. Set to 'managedOnlineEndpoint' for type ManagedOnlineEndpointDeploymentResourcePropertiesAutoGenerated. 'Azure.ContentSafety'
'Azure.OpenAI'
'Azure.Speech'
'managedOnlineEndpoint' (required)

EndpointDeploymentResourcePropertiesBasicResourceAutoGenerated

Name Description Value
properties EndpointDeploymentResourcePropertiesAutoGenerated (required)

EndpointResourcePropertiesAutoGenerated

Name Description Value
associatedResourceId Byo resource id for creating the built-in model service endpoints. string
deployments Deployments info. EndpointDeploymentResourcePropertiesBasicResourceAutoGenerated[]
endpointType Set to 'Azure.ContentSafety' for type ContentSafetyEndpointResourcePropertiesAutoGenerated. Set to 'Azure.OpenAI' for type OpenAIEndpointResourcePropertiesAutoGenerated. Set to 'Azure.Speech' for type SpeechEndpointResourcePropertiesAutoGenerated. Set to 'managedOnlineEndpoint' for type ManagedOnlineEndpointResourcePropertiesAutoGenerated. Set to 'serverlessEndpoint' for type ServerlessEndpointResourcePropertiesAutoGenerated. 'Azure.ContentSafety'
'Azure.OpenAI'
'Azure.Speech'
'managedOnlineEndpoint'
'serverlessEndpoint' (required)
endpointUri Uri of the endpoint. string
failureReason The failure reason if the creation failed. string
location Location of the endpoint.
Since input dto and when parse endpoint resource share the same contract
this Location field is just for parse the endpoint resource info
we won't let customer specify the endpoint resource location since we will create it the same location as workspace
string
name Name of the endpoint. string
provisioningState Read-only provision state status property. 'Accepted'
'Canceled'
'Creating'
'Deleting'
'Disabled'
'Failed'
'NotStarted'
'Scaling'
'Succeeded'
'Updating'
shouldCreateAiServicesEndpoint Whether the proxy (non-byo) endpoint is a regular endpoint or a OneKeyV2 AI services account endpoint. bool

ManagedOnlineEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
endpointComputeType Enum to determine endpoint compute type. 'AzureMLCompute'
'Kubernetes'
'Managed'
model string
type Kind of the deployment. 'managedOnlineEndpoint' (required)

ManagedOnlineEndpointResourcePropertiesAutoGenerated

Name Description Value
authMode Enum to determine endpoint authentication mode. 'AADToken'
'AMLToken'
'Key'
compute string
description string
endpointType Type of the endpoint. 'managedOnlineEndpoint' (required)
mirrorTraffic Dictionary of <integer> ManagedOnlineEndpointResourcePropertiesMirrorTraffic
scoringUri string
traffic Dictionary of <integer> ManagedOnlineEndpointResourcePropertiesTraffic

ManagedOnlineEndpointResourcePropertiesMirrorTraffic

Name Description Value

ManagedOnlineEndpointResourcePropertiesTraffic

Name Description Value

OpenAIEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.OpenAI' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

OpenAIEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.OpenAI' (required)

ServerlessEndpointCapacityReservation

Name Description Value
capacityReservationGroupId string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)
endpointReservedCapacity int

ServerlessEndpointContentSafetyAutoGenerated

Name Description Value
contentSafetyStatus Specifies the status of content safety. 'Disabled'
'Enabled' (required)

ServerlessEndpointInferenceEndpointAutoGenerated

Name Description Value

ServerlessEndpointModelSettings

Name Description Value
modelId string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)

ServerlessEndpointResourcePropertiesAutoGenerated

Name Description Value
authMode 'AAD'
'Key'
'KeyAndAAD'
capacityReservation ServerlessEndpointCapacityReservation
contentSafety ServerlessEndpointContentSafetyAutoGenerated
endpointState State of the Serverless Endpoint. 'Creating'
'CreationFailed'
'Deleting'
'DeletionFailed'
'Online'
'Reinstating'
'Suspended'
'Suspending'
'Unknown'
endpointType Type of the endpoint. 'serverlessEndpoint' (required)
inferenceEndpoint ServerlessEndpointInferenceEndpointAutoGenerated
marketplaceSubscriptionId string
metadata Anything any
modelSettings ServerlessEndpointModelSettings
offer ServerlessOffer

ServerlessOffer

Name Description Value
offerName string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)
publisher string

Constraints:
Min length = 1
Pattern = [a-zA-Z0-9_] (required)

SpeechEndpointDeploymentResourcePropertiesAutoGenerated

Name Description Value
model Model used for the endpoint deployment. EndpointDeploymentModel (required)
raiPolicyName The name of RAI policy. string
sku CognitiveServicesSku
type Kind of the deployment. 'Azure.Speech' (required)
versionUpgradeOption Deployment model version upgrade option. 'NoAutoUpgrade'
'OnceCurrentVersionExpired'
'OnceNewDefaultVersionAvailable'

SpeechEndpointResourcePropertiesAutoGenerated

Name Description Value
endpointType Type of the endpoint. 'Azure.Speech' (required)