Do Azure-Hosted LLMs Run Locally in IRAP-Compliant Regions (e.g. Australia Central)?

Yar, Sheher 0 Reputation points
2025-07-30T00:13:23.0666667+00:00

Hi team,

We’re exploring options to use LLMs (Large Language Models) in an IRAP PROTECTED workload, integrated with Elastic Observability.

Due to compliance restrictions:

We cannot use public/shared cloud models (like Azure OpenAI in US/EU regions).

We also cannot use on-premise hosting, as Elastic currently has no roadmap for on-prem LLM support.

Key question: Does Microsoft offer any LLM deployment (e.g. Azure OpenAI or other managed options) where the model and inference run locally in IRAP-accredited regions such as Australia Central or Australia Central 2?

We’re trying to confirm if there is any LLM capability hosted entirely within sovereign/DGC environments — or if all current LLM offerings involve cross-region access to models.

Happy to explore Azure ML, AKS, or other options if that's the only way to locally host models ourselves.

Thanks in advance!


Azure AI Language
Azure AI Language
An Azure service that provides natural language capabilities including sentiment analysis, entity extraction, and automated question answering.
{count} votes

1 answer

Sort by: Most helpful
  1. Manas Mohanty 8,150 Reputation points Microsoft External Staff Moderator
    2025-07-30T07:19:07.4233333+00:00

    Hi Yar, Sheher

    Azure OpenAI deployment maintains underlying data in respective regions for Data zone standard or Batch.

    You can also restrain the data to your storage accounts in Australia regions

    Reference - https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/deployment-types#data-zone-standard

    We have support for Australia East which is IRAP-credited but not available in Australia Central

    You can go through model summary table in below document to find supported regions for each Azure OpenAI model

    https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models?tabs=datazone-standard%2Cstandard-chat-completions#model-summary-table-and-region-availability

    (Region support for Azure OpenAI deployment)

    https://learn.microsoft.com/en-us/azure/ai-foundry/agents/concepts/model-region-support (Region support for Azure AI foundry)

    Hope it helps.

    Thank you

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.