Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
This archive page is periodically updated with an archival of previous year's content from What's new in Microsoft Fabric?
To follow the latest in Fabric news and features, see the Microsoft Fabric Blog. Also follow the latest in Power BI at What's new in Power BI?
New to Microsoft Fabric?
This section includes past articles and announcements that are useful to users new to Microsoft Fabric.
- Learning Paths for Fabric
- Get started with Microsoft Fabric
- End-to-end tutorials in Microsoft Fabric
- Definitions of terms used in Microsoft Fabric
| Month | Feature | Learn more |
|---|---|---|
| March 2024 | Microsoft Fabric is now HIPAA compliant | We're excited to announce that Microsoft Fabric, our all-in-one analytics solution for enterprises, has achieved new certifications for HIPAA and ISO 27017, ISO 27018, ISO 27001, ISO 27701. |
| March 2024 | Exam DP-600 is now available | Exam DP-600 is now available, leading to the Microsoft Certified: Fabric Analytics Engineer Associate certification. The Fabric Career Hub can help you learn quickly and get certified. |
| March 2024 | Fabric Copilot Pricing: An End-to-End example | Copilot in Fabric begins billing on March 1, 2024 as part of your existing Power BI Premium or Fabric Capacity. Learn how Fabric Copilot usage is calculated. |
| January 2024 | Microsoft Fabric Copilot for Data Science and Data Engineering | Copilot for Data Science and Data Engineering is now available worldwide. What can Copilot for Data Science and Data Engineering do for you? |
Generally available features
The following table lists the features of Microsoft Fabric that have transitioned from preview to general availability (GA).
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Terraform provider GA | The Terraform Provider for Microsoft Fabric is now generally available, enabling seamless infrastructure management and automation. For more information, use cases, and benefits, see Terraform Provider for Microsoft Fabric (Generally Available). |
| February 2025 | REST APIs for Fabric Data Factory pipelines | The Fabric data pipeline public REST API enables you to extend the built-in capability in Fabric to create, read, update, delete, and list pipelines. |
| February 2025 | Copy job | The Copy job in Data Factory has advantages over the Copy activity. For more information, see What is the Copy Job in Microsoft Fabric. For a tutorial, see Learn how to create a Copy job in Data Factory for Microsoft Fabric. |
| February 2025 | Nested Common Table Expressions (CTEs) (GA) | Fabric Data Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs as generally available features now. For more information, see nested common table expressions (CTE) in Fabric data warehousing (Transact-SQL). |
| January 2025 | Real-time intelligence ALM and REST API GA | Application Lifecycle Management (ALM) and Fabric REST APIs are now generally available for all RTI items: Eventstream, Eventhouse, KQL Database, Realtime dashboard, Query set and Data Activator. ALM includes both deployment pipelines and Git integration. REST APIs allow you to programmatically create / read / update / delete items. |
| January 2025 | Warehouse restore points and restore in place | You can now create restore points and perform an in-place restore of a warehouse to a past point in time. Restore in-place is an essential part of data warehouse recovery, which allows to restore the data warehouse to a prior known reliable state by replacing or over-writing the existing data warehouse from which the restore point was created. |
| December 2024 | Folder in Workspace | As an organizational unit, the workspace folder addresses this pain point by providing a hierarchical structure for organizing and managing your items. This feature is now generally available, and includes new filter features. For more information, see Create folders in workspaces. |
| November 2024 | Workspace monitoring | Workspace monitoring is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring. |
| November 2024 | OneLake external data sharing (GA) | OneLake external data sharing makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant. |
| November 2024 | GraphQL API in Microsoft Fabric GA | The API for GraphQL, now generally available, is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL? |
| November 2024 | Real-Time Intelligence: now Generally Available | We're excited to announce that Real-Time Intelligence is now generally available (GA). This includes the Real-Time hub, enhanced Eventstream, Eventhouse, Real-Time Dashboards, and Activator. For more information, see What is Real-Time Intelligence? |
| November 2024 | Fabric workload dev kit (GA) | The Microsoft Fabric workload development kit is now generally available. This robust developer toolkit is for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs. |
| November 2024 | Mirroring for Azure SQL Database GA | With Azure SQL Database mirroring in Fabric, you can easily replicate data from Azure SQL Database into OneLake in Microsoft Fabric. |
| November 2024 | Real-Time hub | Real-Time hub is now generally available. For more information, see Introduction to Fabric Real-Time hub. |
| October 2024 | Notebook Git integration | Notebook Git integration now supports persisting the mapping relationship of the attached Environment when syncing to new workspace. For more information, see Notebook source control and deployment |
| October 2024 | Notebook in Deployment Pipeline | Now you can also use notebooks to deploy your code across different environments, such as development, test, and production. You can also use deployment rules to customize the behavior of your notebooks when they're deployed, such as changing the default Lakehouse of a Notebook. Get started with deployment pipelines, and Notebook shows up in the deployment content automatically. |
| September 2024 | Mirroring for Snowflake | With Mirroring for Snowflake in Fabric, you can easily bring your Snowflake data into OneLake. For more information, see Mirroring Snowflake. |
| September 2024 | Copilot for Data Factory | Copilot for Data Factory is now generally available and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory overview. |
| September 2024 | Fast Copy in Dataflow Gen2 | The Fast copy feature in Dataflows Gen2 is now generally available. For more information, read Announcing the General Availability of Fast Copy in Dataflows Gen2. |
| September 2024 | Fabric Pipeline Integration in On-premises Data Gateway GA | On-premises connectivity for Data pipelines in Microsoft Fabric is now generally available. Learn How to access on-premises data sources in Data Factory for Microsoft Fabric. |
| September 2024 | Data Wrangler for Spark DataFrames | Data Wrangler on Spark DataFrames. A notebook-based tool for exploratory data analysis, Data Wrangler works for both pandas DataFrames and Spark DataFrames and arrives at general availability with new usability improvements. |
| September 2024 | Fabric Runtime 1.3 | Fabric Runtime 1.3 (GA) includes Apache Spark 3.5, Delta Lake 3.1, R 4.4.1, Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. For more information, see Fabric Runtime 1.3 is Generally Available!. |
| September 2024 | OneLake Shortcuts API | REST APIs for OneLake Shortcuts allow programmatic creation and management of shortcuts, now generally available. You can now programmatically create, read, and delete OneLake shortcuts. For example, see Use OneLake shortcuts REST APIs. |
| September 2024 | GitHub integration for source control | Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see What is Microsoft Fabric Git integration? |
| September 2024 | OneLake shortcuts to Google Cloud Storage | Create a Google Cloud Storage (GCS) shortcut to connect to your existing data through a single unified name space without having to copy or move data. For more information, see Google Cloud Storage shortcuts shortcuts generally available. |
| September 2024 | OneLake shortcuts to S3-compatible data sources | Create an S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data. For more information, see S3 compatible shortcuts shortcuts generally available. |
| July 2024 | Update records in a KQL Database preview | The .update command is now generally available. Learn more about how to Update records in a Kusto database. |
| July 2024 | Warehouse queries with time travel (GA) | Warehouse in Microsoft Fabric offers the capability to query the historical data as it existed in the past at the statement level, now generally available. The ability to query data from a specific timestamp is known in the data warehousing industry as time travel. |
| June 2024 | OneLake availability of Eventhouse in Delta Lake format | As part of the One logical copy promise, we're excited to announce that OneLake availability of Eventhouse in Delta Lake format is Generally Available. |
| May 2024 | Microsoft Fabric Private Links | Azure Private Link for Microsoft Fabric secures access to your sensitive data in Microsoft Fabric by providing network isolation and applying required controls on your inbound network traffic. For more information, see Announcing General Availability of Fabric Private Links. |
| May 2024 | Trusted workspace access | Trusted workspace access in OneLake shortcuts is now generally available. You can now create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts using Trusted workspace access (preview) in your Fabric Data Pipelines. Use the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. Trusted workspace access also enables secure and seamless access to ADLS Gen2 storage accounts from OneLake shortcuts in Fabric. |
| May 2024 | Managed private endpoints | Managed private endpoints for Microsoft Fabric allow secure connections over managed virtual networks to data sources that are behind a firewall or not accessible from the public internet. For more information, see Announcing General Availability of Fabric Private Links, Trusted Workspace Access, and Managed Private Endpoints. |
| May 2024 | Eventhouse | Eventhouse is a new, dynamic workspace hosting multiple KQL databases, generally available as part of Fabric Real-Time Intelligence. An Eventhouse offers a robust solution for managing and analyzing substantial volumes of real-time data. Get started with a guide to Create and manage an Eventhouse. |
| May 2024 | Data Engineering: Environment | The Environment in Fabric is now generally available. The Environment is a centralized item that allows you to configure all the required settings for running a Spark job in one place. At GA, we added support for Git, deployment pipelines, REST APIs, resource folders, and sharing. |
| May 2024 | Microsoft Fabric Core REST APIs | Microsoft Fabric Core APIs are now generally available. The Fabric user APIs are a major enabler for both enterprises and partners to use Microsoft Fabric as they enable end-to-end fully automated interaction with the service, enable integration of Microsoft Fabric into external web applications, and generally enable customers and partners to scale their solutions more easily. |
| May 2024 | Power Query Dataflow Gen2 SDK for VS Code | The Power Query SDK is now generally available in Visual Studio Code! To get started with the Power Query SDK in Visual Studio Code, install it from the Visual Studio Code Marketplace. |
| April 2024 | Semantic Link | Semantic links are now generally available! The package comes with our default VHD, and you can now use Semantic link in Fabric right away without any pip installation. |
| March 2024 | VNet Gateways in Dataflow Gen2 | VNet Data Gateway support for Dataflows Gen2 in Fabric is now generally available. The VNet data gateway helps to connect from Fabric Dataflows Gen2 to Azure data services within a VNet, without the need of an on-premises data gateway. |
Community
This section summarizes previous Microsoft Fabric community opportunities for prospective and current influencers and MVPs. To learn about the Microsoft MVP Award and to find MVPs, see mvp.microsoft.com.
| Month | Feature | Learn more |
|---|---|---|
| February 2025 | Hack Together: The Microsoft Data + AI Kenya Hack | To join the Hack Together: The Microsoft Data + AI Kenya Hack from March 12th to April 11th, form a team of 3 members and register at https://aka.ms/data-ai-hack-kenya/register. |
| December 2024 | Announcing the winners of the Microsoft Fabric and AI Learning Hackathon! | See the winners of the Microsoft Fabric Focused Hackathon event, where we partnered with DevPost to challenge the world to build the next wave of innovative AI powered data analytics applications with Microsoft Fabric! |
| October 2024 | Fabric Influencers Spotlight October 2024 | Check out Microsoft MVPs & Fabric Super Users doing amazing work in October 2024 on all aspects of Microsoft Fabric. |
| October 2024 | Microsoft Fabric and AI Learning Hackathon: Copilot in Fabric | Part of the Microsoft Fabric and AI Learning Hackathon, read this guide of various capabilities that Copilot offers in Microsoft Fabric, empowering you to enhance productivity and streamline your workflows. |
| October 2024 | Get certified in Microsoft Fabric—for free! | For a limited time, the Microsoft Fabric Community team is offering 5,000 free DP-600 exam vouchers to eligible Fabric Community members. Complete your exam by the end of the year and join the ranks of certified experts. |
| October 2024 | DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric (beta) | The new Microsoft Certified: Fabric Data Engineer Associate certification helps demonstrate your skills with data ingestion, transformation, administration, monitoring, and performance optimization in Fabric. To learn more, see DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric (beta). |
| October 2024 | FabCon Europe 2024 | Read a recap of Europe's first Fabric Community Conference and a Recap of Data Factory announcements. |
| October 2024 | Fabric Influencers Spotlight September 2024 | The Fabric Influencers Spotlight September 2024 shines a bright light on the places on the internet where Microsoft MVPs & Fabric Super Users are doing some amazing work on all aspects of Microsoft Fabric. |
| September 2024 | Announcing: The Microsoft Fabric & AI Learning Hackathon | Get ready for the Microsoft Fabric & AI Learning Hackathon! We're calling all Data/AI Enthusiasts and Data/AI practitioners to join us for another exciting opportunity to upskill and build the next generation of Data + AI solutions with Microsoft Fabric! The Hackathon is open for a seven-week submission period and offers a total of $10,000 in prizes! |
| August 2024 | Fabric Influencers Spotlight August 2024 | The Fabric Influencers Spotlight August 2024 highlights and amplifies blog posts, videos, presentations, and other content related to Microsoft Fabric from members of Microsoft MVPs & Fabric Super Users from the Fabric community. |
| August 2024 | Winners of the Fabric Community Sticker Challenge | Congratulations to the winners of the Fabric Community Sticker Challenge! |
| July 2024 | Fabric Influencers Spotlight | Introducing the new Fabric Influencers Spotlight series of articles to highlight and amplify blog posts, videos, presentations, and other content related to Microsoft Fabric. Read blogs from Microsoft MVPs and Fabric Super Users from the Fabric community. |
| June 2024 | Solved Fabric Community posts are now available in the Fabric Help Pane | You can now find solved posts from Fabric Community discussions in the Fabric Help Pane. |
| May 2024 | Announcing Microsoft Fabric Community Conference Europe | Announcing the Microsoft Fabric Community Conference Europe on September 24, 2024. Register today! |
| May 2024 | Register for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge | Starting May 21, 2024, sign up for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge and prepare for Exam DP-600 and upskill to the Fabric Analytics Engineer Associate certification. |
| March 2024 | Exam DP-600 is now available | Exam DP-600 is now available, leading to the Microsoft Certified: Fabric Analytics Engineer Associate certification. The Fabric Career Hub can help you learn quickly and get certified. |
| March 2024 | Microsoft Fabric Community Conference | Join us in Las Vegas March 26-28, 2024 for the first annual Microsoft Fabric Community Conference. See firsthand how Microsoft Fabric and the rest of the data and AI products at Microsoft can help your organization prepare for the era of AI. Register today using code MSCUST for an exclusive discount! |
| March 2024 | Announcing the winners of "HackTogether: The Microsoft Fabric Global AI Hack" | We received 50 Hackathon project submissions from over 100 registrants, participating from every corner of the world. Our judges were blown away by the breadth, depth, and overall quality of submissions. Meet the winners of the Fabric Global AI Hack! |
| January 2024 | Announcing Fabric Career Hub | The new Fabric Career Hub is your one-stop-shop for professional growth! We've created a comprehensive learning journey with the best free on-demand and live training, plus exam discounts. |
| January 2024 | Hack Together: The Microsoft Fabric Global AI Hack | Hack Together is a global online hackathon that runs from February 15 to March 4, 2024. Join us for Hack Together: The Microsoft Fabric Global AI Hack, a virtual event where you can learn, experiment, and hack together with the new Copilot and AI features in Microsoft Fabric! For more information, see Microsoft Fabric Global AI Hack. |
Fabric samples and guidance
This section summarizes archived guidance and sample project resources for Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2024 | Protect PII information in your Microsoft Fabric Lakehouse with Responsible AI | One possible way to use Azure AI to identify and extract personally identifiable information (PII) in Microsoft Fabric is to use Azure AI Language to detect and categorize PII entities in text data, such as names, addresses, emails, phone numbers, social security numbers, etc. |
| February 2024 | Building Common Data Architectures with OneLake in Microsoft Fabric | Read more about common data architecture patterns and how they can be secured with Microsoft Fabric, and the basic building blocks of security for OneLake. |
| January 2024 | New Fabric certification and Fabric Career Hub | Beta availability of Microsoft Certification Exam DP-600: Implementing Analytics Solutions with Microsoft Fabric is available for a limited time. Passing this exam earns the Microsoft Certified: Fabric Analytics Engineer Associate certification. |
Microsoft Copilot in Microsoft Fabric
This section summarizes archived announcements about Copilot in Fabric.
| Month | Feature | Learn more |
|---|---|---|
| February 2025 | Enhanced conversation with Microsoft Fabric Copilot (Preview) | We're introducing improvements to AI functionalities in Microsoft Fabric, including a new way to store chat prompts and history, improved accuracy of responses, and better context knowledge retention. |
| October 2024 | Microsoft Fabric and AI Learning Hackathon: Copilot in Fabric | Part of the Microsoft Fabric and AI Learning Hackathon, read this guide of various capabilities that Copilot offers in Microsoft Fabric, empowering you to enhance productivity and streamline your workflows. |
| October 2024 | Use Azure OpenAI to turn whiteboard sketches into data pipelines | Read this blog to learn how to turn whiteboard sketches into data pipelines, using the GPT-4o model through Azure OpenAI Service. |
| September 2024 | Creating a real time dashboard by Copilot | Copilot can review a table and automatically create a dashboard with insights and a profile of the data with a sample. |
| September 2024 | Copilot in Dataflow Gen2 GA | Copilot for Data Factory is now generally available and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory overview. |
| September 2024 | Copilot for Data Warehouse | Copilot for Data Warehouse is now available, offering the Copilot chat pane, quick actions, and code completions. For more information and sample scenarios, see Announcing the Preview of Copilot for Data Warehouse in Microsoft Fabric. |
| June 2024 | Copilot privacy and security | For more information on the privacy and security of Copilot in Microsoft Fabric, and for detail information on each workload, see Privacy, security, and responsible use for Copilot in Microsoft Fabric (preview). |
| May 2024 | The AI and Copilot setting automatically delegated to capacity admins | In the tenant admin portal, you can delegate the enablement of AI and Copilot features to Capacity administrators. This AI and Copilot setting is automatically delegated to capacity administrators and tenant administrators won't be able to turn off the delegation. |
| February 2024 | Fabric Change the Game: How easy is it to use Copilot in Microsoft Fabric | This blog post shows how simple is to enable Copilot, a generative AI that brings new ways to transform and analyze data, generate insights, and create visualizations and reports in Microsoft Fabric. |
| February 2024 | Copilot for Data Factory in Microsoft Fabric | Copilot for Data Factory in Microsoft Fabric is now available in preview and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory. |
| January 2024 | Microsoft Fabric Copilot for Data Science and Data Engineering | Copilot for Data Science and Data Engineering is now available worldwide. What can Copilot for Data Science and Data Engineering do for you? |
| January 2024 | How to enable Copilot in Fabric for Everyone | Follow this guide to get Copilot in Fabric enabled for everyone in your organization. For more information, see Overview of Copilot for Microsoft Fabric (preview). |
| January 2024 | Copilot in Fabric is available worldwide | Copilot in Fabric is now available to all customers, including Copilot for Power BI, Data Factory, and Data Science & Data Engineering. Read more in our Overview on Copilot in Fabric. |
Data Factory in Microsoft Fabric
This section summarizes archived new features and capabilities of Data Factory in Microsoft Fabric. Follow issues and feedback through the Data Factory Community Forum.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Fabric Data Factory and Roadmap | Discover the latest updates and future plans for Fabric Data Factory, including new features for data integration and orchestration. For more information, see What's New with Fabric Data Factory and Roadmap. |
| March 2025 | REST APIs for Fabric Data Factory pipelines | The Fabric data pipeline public REST API enables you to extend the built-in capability in Fabric to create, read, update, delete, and list pipelines. |
| March 2025 | Copy job (preview) | The Copy job in Data Factory has advantages over the Copy activity. For more information, see What is the Copy Job in Microsoft Fabric. For a tutorial, see Learn how to create a Copy job in Data Factory for Microsoft Fabric. |
| March 2025 | Copy Job enhancements | Learn more about three new user experience improvements in the Data Factory Copy Job. |
| January 2025 | Dataflow Gen2 CI/CD support (preview) | CI/CD and Git integration are now supported for Dataflow Gen2, as a preview feature. For more information, see Dataflow Gen2 CI/CD support. |
| December 2024 | Data Factory Announcements at Ignite 2024 Recap | A couple of weeks ago we had such an exciting week for Fabric during the Ignite Conference, filled with several product announcements and sneak previews of upcoming new features for Data Factory in Fabric. |
| November 2024 | REST APIs for connections and gateways (preview) | REST APIs for connections and gateways are now in preview. These new APIs allow developers to programmatically manage and interact with connections and gateways within Fabric. |
| November 2024 | Iceberg format via Azure Data Lake Storage Gen2 Connector in Data pipeline | Fabric Data Factory now supports writing data in Iceberg format via Azure Data Lake Storage Gen2 Connector in Data pipeline. For more information, see Iceberg format for Data Factory in Microsoft Fabric. |
| November 2024 | Data Factory Copy Job – CI/CD now available | CI/CD for Copy job (preview) in Data Factory in Microsoft Fabric is now available. Copy Job now supports Git Integration and Deployment Pipeline. |
| November 2024 | Semantic model refresh activity (preview) | Use the Semantic model refresh activity to refresh a Power BI Dataset (Preview), the most effective way to refresh your Fabric semantic models. For more information, see New Features for Fabric Data Factory Pipelines Announced at Ignite. |
| November 2024 | New connectors for Fabric SQL database | In the Data Factory, both data pipeline and Dataflow Gen2 now natively support the SQL database in Fabric (Preview) connector as source and destination. More connector updates for MariaDB, Snowflake, Dataverse, and PostgreSQL also announced. |
| November 2024 | OneLake catalog | OneLake data hub has been rebranded as the OneLake catalog in Modern Get Data. When you use Get data inside Pipeline, Copy job, Mirroring and Dataflow Gen2, you'll find the OneLake data hub has been renamed to OneLake catalog. |
| November 2024 | Data pipeline capabilities in Copilot for Data Factory (preview) | The new Data pipeline capabilities in Copilot for Data Factory are now available in preview. These features function as an AI expert to help users build, troubleshoot, and maintain data pipelines. |
| November 2024 | Legacy Timestamp Support in Native Execution Engine for Fabric Runtime 1.3 | The recent update to Native Execution Engine on Fabric Runtime 1.3 brings support for legacy timestamp handling, allowing seamless processing of timestamp data created by different Spark versions. Read to learn why legacy timestamp support matters. |
| November 2024 | Dataflow Gen2 CI/CD, GIT source control integration and Public APIs support are now in preview | With this new set of features, you can now seamlessly integrate your dataflow with your existing CI/CD pipelines and version control of your workspace in Fabric. This integration allows for better collaboration, versioning, and automation of your deployment process across dev, test, and production environments. For more information, see Dataflow Gen2 with CI/CD and Git integration support (preview). |
| October 2024 | New Features and Enhancements for Virtual Network Data Gateway | We're excited to announce several powerful updates to the Virtual Network (VNET) Data Gateway, designed to further enhance performance and improve the overall user experience. |
| October 2024 | Recap of Data Factory Announcements at Fabric Community Conference Europe | Read a recap of Data Factory announcements from Fabric Community Conference Europe 2024. |
| September 2024 | Copilot in Dataflow Gen2 GA | Copilot for Data Factory is now generally available and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory overview. |
| September 2024 | Fast Copy in Dataflow Gen2 GA | The Fast copy in Dataflows Gen2 is now generally available. For more information, read Announcing the General Availability of Fast Copy in Dataflows Gen2. |
| September 2024 | Incremental refresh for Dataflow Gen2 (preview) | Incremental refresh in Dataflow Gen2 (Preview) is designed to optimize data ingestion and transformation, particularly as your data continues to expand. For more information, see Announcing Preview: Incremental Refresh in Dataflow Gen2. |
| September 2024 | Certified connector updates | Updated Dataflow Gen2 connectors in Microsoft Fabric have been released, as well as an updated Data pipeline connectors for Salesforce and Vertica. For more information, see the Certified connector updates. |
| September 2024 | Fabric Pipeline Integration in On-premises Data Gateway GA | On-premises connectivity for Data pipelines in Microsoft Fabric is now generally available. Learn How to access on-premises data sources in Data Factory for Microsoft Fabric. |
| September 2024 | Invoke remote pipeline (preview) in Data pipeline | You can now use the Invoke Pipeline (preview) activity to call pipelines from Azure Data Factory or Synapse Analytics pipelines. This feature allows you to utilize your existing ADF or Synapse pipelines inside of a Fabric pipeline by calling it inline through this new Invoke Pipeline activity. |
| September 2024 | Spark Job environment parameters | You can now reuse existing Spark sessions with Session tags. In the Fabric Spark Notebook activity, tag your Spark session, then reuse the existing session using that same tag. |
| September 2024 | Azure Data Factory item in Fabric (preview) | You can now bring your existing Azure Data Factory (ADF) to your Fabric workspace. This new preview capability allows you to connect to your existing Azure Data Factory from your Fabric workspace. Select "Create Azure Data Factory" inside of your Fabric Data Factory workspace, and you can manage your Azure data factories directly from the Fabric workspace. |
| September 2024 | Copy job (preview) | The Copy job (preview) has advantages over the legacy Copy activity. For more information, see Announcing Preview: Copy Job in Microsoft Fabric. For a tutorial, see Learn how to create a Copy job (preview) in Data Factory for Microsoft Fabric. |
| September 2024 | Lakehouse Connector in Fabric Data Factory introduces Schema Support | Fabric Lakehouse supports the creation of custom schemas. When reading from a Lakehouse table with the Lakehouse Connector in Fabric Data Factory, custom schema information is now automatically included. |
| September 2024 | Storage Integration Support in Snowflake Connector for Fabric Data Factory | You can now connect Snowflake with external storage solutions (such as Azure Blob Storage) using a secure and centralized approach. For more information, see Snowflake SQL storage integration. |
| September 2024 | New Data Factory Connectors Released in Q3 2024 | New Data Factory Connectors include Salesforce, Azure MySQL Database, and Azure Cosmos DB for MongoDB. |
| August 2024 | Certified connector updates | Updated Dataflow Gen2 connectors have been released, as well as two new Data pipeline connectors for Salesforce and Vertica. For more information, see the August 2024 Certified connector updates. |
| August 2024 | Data Warehouse Connector Supports TLS 1.3 | The Data Warehouse connector now supports TLS 1.3, the latest version of the Transport Layer Security protocol. |
| August 2024 | Connect to your Azure Resources by Modern Get Data Experience in Data pipeline | You can easily browse and connect to your Azure resources automatically with the modern data experience of Data Pipeline. |
| July 2024 | Use existing connections from the OneLake Data hub integration | You can now select any existing connections from OneLake Datahub, not just your recent and favorite ones. This makes it easier to access your data sources from the homepage of modern get data in data pipeline. For more information, see Modern Get Data experience. |
| July 2024 | Snowflake storage integration | Connect and integrate Snowflake's storage integration to streamline data workflows and optimize performance across all staging scenarios, without the need to bring external storage to stage your dataset. For more information, see Snowflake connector. |
| July 2024 | Edit JSON code for Data pipelines | You can now edit the JSON behind your Data Factory pipelines in Fabric. When you design low-code pipeline workflows, directly editing the JSON code behind your visual pipeline canvas can increase your flexibility and improve your market time. |
| July 2024 | Dataflow Gen2 certified connector updates | New and updated Dataflow Gen2 connectors have been released, including two new connectors in Fabric Data Factory data pipeline: Azure MySQL Database Connector and Azure Cosmos DB for MongoDB Connector. For more information, see the July 2024 Certified connector updates. |
| July 2024 | Support for editing Navigation steps | Introducing a new experience to edit navigation steps within Dataflow, to connect to a different object, inside of the Applied steps section of the Query settings pane. For more information, see Editing Navigation steps. |
| July 2024 | Global view in Manage connections | The new Global view in Manage connections allows you to see all the available connections in your Fabric environment so you can modify them or delete them without ever having to leave the Dataflow experience. For more information, see Global view in Manage connections. |
| July 2024 | Fast Copy with On-premises Data Gateway Support in Dataflow Gen2 | Fast Copy (preview) in Dataflow Gen2 now supports on-premises data stores using a gateway to access on-premises stores like SQL Server with Fast Copy in Dataflow Gen2. |
| July 2024 | Fabric API for GraphQL (preview) pricing | API for GraphQL in Fabric starts billing on July 12, 2024, as part of your existing Power BI Premium or Fabric Capacity. Use the Fabric Capacity Metrics app to track capacity usage for API for GraphQL operations, under the name "Query". |
| June 2024 | Dataflow Gen2 certified connector updates | New and updated Dataflow Gen2 connectors have been released. For more information, see the June 2024 Certified connector updates. |
| June 2024 | New data pipeline connector updates | More connectors are now available for data pipeline. For more information, see the June 2024 Fabric update. |
| June 2024 | Lakehouse schemas feature | The Lakehouse schemas feature (preview) introduces data pipeline support for reading the schema info from Lakehouse tables and supports writing data into tables under specified schemas. Lakehouse schemas allow you to group your tables together for better data discovery, access control, and more. |
| June 2024 | Move Data Across Workspace via Data pipeline Modern Get Data Experience | You can now move data among Lakehouses, warehouses, etc. across different workspaces. In Pipeline Modern Get Data, select a Fabric item from another workspace under Explorer on the left side of the OneLake data hub. |
| June 2024 | Create a new Warehouse as destination in Data pipeline | You can now create a new Warehouse as a destination in Data Pipeline, instead of only selecting an existing one. |
| May 2024 | Data Factory Announcements at Microsoft Build Recap | Don't miss any of the Data Factory in Fabric announcements, here's a recap of all new features in Data Factory in Fabric from Build 2024. |
| May 2024 | New certified connectors | The Power Query SDK and Power Query Connector Certification process has introduced several new Power Query connectors, including connectors for Oracle database, MySQL, Oracle Cloud Storage, Azure AI, Azure Files, Dynamics AX, Google Bigquery, Snowflake ADBC, and more coming soon. |
| May 2024 | API for GraphQL in Microsoft Fabric (preview) | The new API for GraphQL is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL? |
| May 2024 | Power Query Dataflow Gen2 SDK for VS Code GA | The Power Query SDK is now generally available in Visual Studio Code! To get started with the Power Query SDK in Visual Studio Code, install it from the Visual Studio Code Marketplace. |
| May 2024 | Refresh the Refresh History Dialog | The Refresh History details popup window now has a Refresh button. |
| May 2024 | New and updated certified connectors | The Power Query SDK and Power Query Connector Certification process has introduced four new and updated Power Query connectors. |
| May 2024 | Data workflows in Data Factory preview | Data workflows (preview) in Data Factory, powered by Apache Airflow, offer seamless authoring, scheduling, and monitoring experience for Python-based data processes defined as Directed Acyclic Graphs (DAGs). For more information, see Quickstart: Create a Data workflow. |
| May 2024 | Trusted Workspace Access in Fabric Data Pipelines preview | Use the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. You can now create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts using Trusted workspace access (preview) in your Fabric Data Pipelines. |
| May 2024 | Blob storage Event Triggers for Data Pipelines preview | Azure Blob storage event triggers (preview) in Fabric Data Factory Data Pipelines use Fabric Reflex alerts and eventstreams to create event subscriptions to your Azure storage accounts. |
| May 2024 | Azure HDInsight activity for data pipelines | The Azure HDInsight activity allows you to execute Hive queries, invoke a MapReduce program, execute Pig queries, execute a Spark program, or a Hadoop Stream program. |
| May 2024 | Copy data assistant | Start using the Modern Get Data experience by selecting Copy data assistant in the Pipeline landing page or Use copy assistant in the Copy data drop down. You can easily connect to recently used Fabric items and provides an intuitive way to read sources from sample data and new connections. |
| May 2024 | Edit the Destination Table Column Type when Copying Data | You can edit destination table column types when copying data for a new or autocreated destination table for many data stores. For more information, see Configure Lakehouse in a copy activity. |
| April 2024 | Spark job definition activity | With the new Spark job definition activity, you'll be able to run a Spark job definition in your pipeline. |
| April 2024 | Fabric Warehouse in ADF copy activity | You can now connect to your Fabric Warehouse from an Azure Data Factory/Fabric Warehouse pipeline. You can find this new connector when creating a new source or sink destination in your copy activity, in the Lookup activity, Stored Procedure activity, Script activity, and Get Metadata activity. |
| April 2024 | Edit column type to destination table support added to Fabric Warehouse and other SQL data stores | When moving data from any supported data sources into Fabric Warehouse or other SQL data stores (SQL Server, Azure SQL Database, Azure SQL Managed Instance, or Azure Synapse Analytics) via data pipelines, users can now specify the data type for each column. |
| April 2024 | Performance improvements when writing data to SFTP | The SFTP connector has been improved to offer better performance when writing to SFTP as destination. |
| April 2024 | Service Principal Name authentication kind support for On-Premises and virtual network data gateways | Azure Service Principals (SPN) are now supported for on-premises data gateways and virtual network data gateways. Learn how to use the service principal authentication kind in Azure Data Lake Storage, Dataverse, Azure SQL Database, Web connector, and more. |
| April 2024 | New and updated Certified connectors | The Power Query SDK and Power Query Connector Certification process has introduced 11 new and updated custom Power Query connectors. |
| April 2024 | New Expression Builder Experience | A new experience in the Script activity in Fabric Data Factory pipelines to make it even easier to build expressions using the pipeline expression language. |
| April 2024 | Data Factory Increases Maximum Activities Per Pipeline to 80 | We have doubled the limit on number of activities you can define in a pipeline from 40 to 80. |
| April 2024 | REST APIs for Fabric Data Factory pipelines preview | The REST APIs for Fabric Data Factory Pipelines are now in preview. REST APIs for Data Factory pipelines enable you to extend the built-in capability in Fabric to create, read, update, delete, and list pipelines. |
| March 2024 | Fast copy in Dataflows Gen2 | With Fast copy, you can ingest terabytes of data with the easy experience of dataflows, but with the scalable backend of Pipeline's Copy activity. |
| March 2024 | Integrating On-Premises Data into Microsoft Fabric Using Data Pipelines in Data Factory preview | With the on-premises Data Gateway (preview), customers can connect to on-premises data sources using dataflows and data pipelines with Data Factory. For more information, see How to access on-premises data sources in Data Factory for Microsoft Fabric. |
| March 2024 | CI/CD for Fabric Data Pipelines preview | Git Integration and integration with built-in Deployment Pipelines to Data Factory data pipelines is now in preview. For more information, see Data Factory Adds CI/CD to Fabric Data Pipelines. |
| March 2024 | Browse Azure resources with Get Data | Learn how to browse and connect to all your Azure resources with the 'browse Azure' functionality in Get Data. You can browse Azure resources then connect to Synapse, blob storage, or ADLS Gen2 resources easily. |
| March 2024 | Dataflow Gen2 Support for VNet Gateways now generally available | VNet Data Gateway support for Dataflows Gen2 in Fabric is now generally available. The VNet data gateway helps to connect from Fabric Dataflows Gen2 to Azure data services within a VNet, without the need of an on-premises data gateway. |
| March 2024 | Privacy levels support in Dataflows | You can now set privacy levels for your connections in your Dataflow Gen2. Privacy levels are critical to configure correctly so that sensitive data is only viewed by authorized users. |
| March 2024 | Copy data to S3 Compatible via Fabric Data Factory Data Pipeline | Copying data to S3 Compatible is now available in Data pipeline of Fabric Data Factory! You can use Copy assistant and Copy activity in your Data pipeline to finish this data movement. |
| February 2024 | Dataflows Gen2 data destinations and managed settings | New features for Dataflows Gen2 include destinations, managed settings, and advanced topics. |
| February 2024 | Copilot for Data Factory in Microsoft Fabric | Copilot for Data Factory in Microsoft Fabric is now available in preview and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory. |
| February 2024 | Certified Connector updates | The Power Query SDK enables you to create new connectors for both Power BI and Dataflow. New certified Power Query connectors are available to the list of Certified Connectors in Power Query. |
| February 2024 | Data pipeline connector updates | New connectors are available in your Data Factory data pipelines, including S3 compatible and Google Cloud Storage data sources. For more information, see Data pipeline connectors in Microsoft Fabric. |
| January 2024 | Automate Fabric Data Warehouse Queries and Commands with Data Factory | In Fabric Data Factory, there are many ways to query data, retrieve data, and execute commands from your warehouse using pipeline activities that can then be easily automated. |
| January 2024 | Use Fabric Data Factory Data Pipelines to Orchestrate Notebook-based Workflows | Guidance and good practices when building Fabric Spark Notebook workflows using Data Factory in Fabric with data pipelines. |
Data Factory in Microsoft Fabric samples and guidance
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Build RAG Data pipeline from Azure Blob Storage to SQL Database in minutes | This blog post provides step-by-step instructions for creating a Retrieval Augmented Generation (RAG) pipeline to prepare your data for AI integration using SQL database in Microsoft Fabric. |
| January 2025 | Enhancing data quality with Copilot for Data Factory | Read this blog for a guide on using Copilot for Data Factory to clean and transform data. |
| November 2024 | Boosting Data Ingestion in Data Factory: Continuous Innovations in Performance Optimization | Here's a closer look at how recent advancements are transforming data ingestion in Data Factory. |
| November 2024 | Copy Job upsert to SQL & overwrite to Fabric Lakehouse | The Copy Job simplifies your data ingestion with non-compromising experience from any source to any destination. By default, Copy Job appends data to your destination so that you never miss any change history. However, you can also customize the write behavior to upsert data on Azure SQL Database or SQL Server and overwrite data on Fabric Lakehouse tables, giving you full flexibility to match your needs. |
| September 2024 | Integrate your SAP data into Microsoft Fabric | Learn more about an overview of SAP data options in Microsoft Fabric, along with some guidance on the respective use cases. |
| July 2024 | Connect to your Azure Resources from Fabric with the Data Pipeline Modern Get Data Experience | Learn how to connect to your Azure resources automatically with the modern get data experience of Data Pipelines. |
| July 2024 | Fabric Data Pipelines – Advanced Scheduling Techniques (Part 2: Run a Pipeline on a Specific Day) | This blog provides a tutorial on the ability to schedule a Pipeline on a specific day of the month, including both the start of the month along with the last day of the month. |
| June 2024 | A Data Factory Pipeline Navigator mind map | The ultimate Data Factory Pipeline Mind Map helps you navigate Data Factory pipelines on your Data Factory journey to build a successful Data Integration project. |
| May 2024 | Semantic model refresh activity | Learn how to use the much-requested Semantic model refresh activity in Data pipelines and how you can now create a complete end-to-end solution that spans the entire pipeline lifecycle. |
| February 2024 | Fabric Data Pipelines – Advanced Scheduling Techniques | This blog series covers Advanced Scheduling techniques in Microsoft Fabric Data Pipelines. |
Fabric Data Engineering
This section summarizes archived new features and capabilities of data engineering, including Data Factory in Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Enhancing AI productivity in Fabric Notebooks | The latest Copilot updates improve productivity with in-cell interactions, better code generation, and seamless integration with Fabric. For more information, see What's New in Copilot updates for Fabric notebooks. |
| March 2025 | Autoscale billing for Spark | The new autoscale billing model offer greater flexibility and cost efficiency for Spark workloads. For more information, see Introducing Autoscale Billing for Spark in Microsoft Fabric. |
| February 2025 | T-SQL notebook enhancements | The T-SQL notebook now includes more T-SQL code snippets, easy open within Excel, traceability of the warehouse, and CI/CD support. For more information, see T-SQL notebook enhancements. |
| February 2025 | Centralized data governance in the OneLake catalog (preview) | A new centralized data governance experience in the OneLake catalog is in preview. Data owners can view aggregated insights on the items they created, consider improving their governance by taking recommended actions, and access more information along with all available tools in Fabric. |
| February 2025 | Managed private endpoint and private link support for Native Execution Engine in Spark | Private Links and Managed Private Endpoints are now supported for Native Execution Engine. Learn more about the Native execution engine for Fabric Spark. |
| February 2025 | Capacity settings include option to Disable Starter Pool | New controls in Data Engineering/Science Capacity settings include the option to Disable Starter Pool for workspaces, to help capacity admins have better compute restrictions on workspaces attached to their Fabric Capacity. |
| February 2025 | Monitoring for high concurrency in T-SQL notebooks | New features like log segmentation and auto-mapping of jobs, stages, and tasks in Notebooks allow for better tracking and troubleshooting of high concurrency Notebook executions. |
| February 2025 | Enhancements to support additional notebook run scenarios | Support for notebook runs triggered by NotebookUtils, snapshots for running notebooks, and Enhanced visibility into parallel notebook runs have been introduced. |
| February 2025 | Fabric Spark Resource Analysis | The Fabric Spark Resource Utilization Analysis feature provides in-depth insights into your Apache Spark applications within Microsoft Fabric. For more information, see Monitor Apache Spark applications resource utilization. |
| February 2025 | AI functions (preview) | AI functions for data engineering with GenAI are now in preview. With AI functions, you can harness the power of GenAI for summarization, classification, text generation, and so much more—all with a single line of code. |
| February 2025 | Fabric Spark connector for Fabric Data Warehouse in Spark runtime (preview) | The Spark connector for Data Warehouse enables a Spark developer or a data scientist to access and work on data from a warehouse or SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. For more information, see Spark Connector for Fabric Data Warehouse - Preview. |
| February 2025 | ArcGIS GeoAnalytics for Microsoft Fabric Spark (preview) | Microsoft and Esri have partnered to bring spatial analytics into Microsoft Fabric. To learn more about ArcGIS integration within Microsoft Fabric Spark, see ArcGIS GeoAnalytics for Microsoft Fabric (preview) and ArcGIS in Fabric integrations. |
| February 2025 | What's new in OneLake catalog: Data governance and more | Read more about recent OneLake improvements involving the Catalog, data governance, personalized insights and actions, and more. |
| January 2025 | Simplified enablement and transition to Runtime 1.3 from Runtime 1.2 | We recommend upgrading to Runtime 1.3 to maintain support, as native acceleration will soon be unavailable on Runtime 1.2. Now, activating Native Execution Engine on Runtime 1.3 is as easy as a switch. You'll find the new toggle button in the Acceleration tab within your environment settings. |
| January 2025 | Notebook and Spark Job definition execution with service principal | You can now run a Notebook/Spark Job Definition execution under the credentials of a service principal. Use the Fabric Job Scheduler API with a service principal's access token, to run the Spark Job within the security context of that service principal. |
| January 2025 | Building Apps with Microsoft Fabric API for GraphQL | Microsoft Fabric has an API for GraphQL to build your data applications, enabling you to pull data from sources such as Data Warehouses, Lakehouse, Mirrored Databases, and DataMart in Microsoft Fabric. |
| January 2025 | Efficient log management with Microsoft Fabric | For a tutorial and walkthrough of efficient log files collection processing and analysis with Real-Time Intelligence, read this new blog post on Efficient log management with Microsoft Fabric. |
| January 2025 | Folder security within a shortcut in OneLake | Now you can define security on any subfolder within the shortcut root. For more information and an example, see Define security on folders within a shortcut using OneLake data access roles. |
| December 2024 | REST API for Livy (preview) | The Fabric Livy endpoint lets users submit and execute their Spark code on the Spark compute within a designated Fabric workspace, eliminating the need to create a Notebook or Spark Job Definition items. The Livy API offers the ability to customize the execution environment through its integration with the Environment. |
| December 2024 | Notebook version history (preview) | Fabric notebook version history provides robust built-in version control capabilities, including automatic and manual checkpoints, tracked changes, version comparisons, and previous version restore. For more information, see Notebook version history. |
| December 2024 | Python Notebook (preview) | Python Notebooks are for BI Developers and Data Scientists working with smaller datasets using Python as their primary language. To get started, see Use Python experience on Notebook. |
| November 2024 | Workspace monitoring (preview) | Workspace monitoring is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring. |
| November 2024 | The new OneLake catalog | The OneLake catalog is the next evolution of the OneLake data hub. For more information about the new catalog, Discover and explore Fabric items in the OneLake catalog. |
| November 2024 | OneLake external data sharing (GA) | OneLake external data sharing, now generally available, makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant. |
| November 2024 | Purview Data Loss Prevention policies now support the restrict access action for semantic models | Restricting access based on sensitive content for semantic models, now in preview, helps you to automatically detect sensitive information as it is uploaded into Fabric lakehouses and semantic models. |
| November 2024 | Iceberg data in OneLake using Snowflake and shortcuts (preview) | You can now consume Iceberg-formatted data across Microsoft Fabric with no data movement or duplication, plus Snowflake has added the ability to write Iceberg tables directly to OneLake. For more information, see Use Iceberg tables with OneLake. |
| November 2024 | Notebook display chart upgrade | The new and improved chart view brings multiple new capabilities to the notebook display. To access the new chart view just open your Fabric notebook and run the display(df) statement. |
| November 2024 | Mirrored databases in Spark Notebooks | Mirrored databases in Spark Notebooks allow you to seamlessly explore and run read-only queries on your open-format tables just like Lakehouses, all while taking full advantage of our advanced analytics engines—without the need to migrate any of your data into Fabric. |
| November 2024 | Jar libraries | Java Archive (JAR) files are a popular packaging format used in the Java ecosystem, and are now supported in Fabric Environments. |
| November 2024 | Legacy Timestamp Support in Native Execution Engine for Fabric Runtime 1.3 | The recent update to Native Execution Engine on Fabric Runtime 1.3 brings support for legacy timestamp handling, allowing seamless processing of timestamp data created by different Spark versions. Read to learn why legacy timestamp support matters. |
| October 2024 | Native Execution Engine available at no additional cost | The Native Execution Engine is now available at no additional cost. The Native Execution Engine now supports Fabric Runtime 1.3, which includes Apache Spark 3.5 and Delta Lake 3.2. This upgrade enhances Microsoft Fabric's Data Engineering and Data Science workflows, offering boosts in performance and flexibility. |
| October 2024 | Use OneLake shortcuts to access data across capacities: Even when the producing capacity is paused | Learn how OneLake capacity consumption works when accessing data through a shortcut, particularly across capacities. |
| October 2024 | Purview Data Loss Prevention policies have been extended to Fabric lakehouses | Extending Microsoft Purview's Data Loss Prevention (DLP) policies into Fabric lakehouses is now in preview. |
| October 2024 | API for GraphQL support for Service Principal Names (SPNs) | Service Principal Names (SPN) support for API for GraphQL offers organizations looking to integrate their apps with API for GraphQL in Microsoft Fabric tie seamlessly with their enterprise identity and access management systems. For more information, see Service Principal Names (SPNs) in Fabric API for GraphQL. |
| October 2024 | Automatic code generation in API for GraphQL | Fabric API for GraphQL now adds the ability to automatically generate Python and Node.js code based on GraphQL queries tested in the API Explorer. |
| October 2024 | Notebook Git integration GA | Notebook Git integration now supports persisting the mapping relationship of the attached Environment when syncing to new workspace. For more information, see Notebook source control and deployment |
| October 2024 | Notebook in deployment pipeline GA | Now you can also use notebooks to deploy your code across different environments, such as development, test, and production. You can also use deployment rules to customize the behavior of your notebooks when they're deployed, such as changing the default Lakehouse of a Notebook. Get started with deployment pipelines, and Notebook shows up in the deployment content automatically. |
| October 2024 | Notebook in Org APP | The Notebook feature is now supported in Org APP. You can easily embed Notebook code and markdown cells, visuals, tables, charts, and widgets in OrgAPP, as a practical storytelling tool. |
| October 2024 | Notebook onboarding tour | The new Fabric Notebook Onboarding Tour is now available. This guided tour is designed to help you get started with the essential Notebook features and learn the new capabilities. |
| October 2024 | Notebook mode switcher | The Notebook mode switcher provides flexible access modes (Develop, Run Only, Edit, View) for your notebooks, which can help you easily manage the permissions to the notebook and the corresponding view. |
| October 2024 | Free selection support on display() table view | The free selection function on the rich dataframe preview in the notebook can improve the data analysis experience. To see the new features, read Free selection support on display() table view. |
| October 2024 | Filter, sort and search your Lakehouse objects | Sorting, Filtering, and Searching capabilities make data exploration and analysis more efficient by allowing you to quickly retrieve the information you need based on specific criteria, right within the Lakehouse environment. |
| September 2024 | Fabric Runtime 1.3 GA | Fabric Runtime 1.3 (GA), now generally available, includes Apache Spark 3.5, Delta Lake 3.1, R 4.4.1, Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. For more information, see Fabric Runtime 1.3 is Generally Available!. |
| September 2024 | Native Execution Engine on Runtime 1.3 (preview) | Native execution engine for Fabric Spark for Fabric Runtime 1.3 is now available in preview, offering superior query performance across data processing, ETL, data science, and interactive queries. No code changes are required to speed up the execution of your Apache Spark jobs when using the Native Execution Engine. |
| September 2024 | High concurrency mode for Notebooks in Pipelines (preview) | High concurrency mode for Notebooks in Pipelines enables users to share Spark sessions across multiple notebooks within a pipeline. With high concurrency mode, users can trigger pipeline jobs, and these jobs are automatically packed into existing high concurrency sessions. |
| September 2024 | Reserve maximum cores for jobs (preview) | A new workspace-level setting allows you to reserve maximum cores for your active jobs for Spark workloads. For more information, see High concurrency mode in Apache Spark for Fabric. |
| September 2024 | Session Expiry Control in Workspace Settings for Notebook Interactive Runs (preview) | A new session expiry control in Data Engineering/Science workspace settings allows you to set the maximum expiration time limit for notebook interactive sessions. By default, sessions expire after 20 minutes, but you can now customize the maximum expiration duration. |
| September 2024 | Fabric Spark Diagnostic Emitter (preview) | The Fabric Apache Spark Diagnostic Emitter (preview) allows Apache Spark users to collect logs, event logs, and metrics from their Spark applications and send them to various destinations, including Azure Event Hubs, Azure Storage, and Azure Log Analytics. |
| September 2024 | Environment integration with Data Engineering VS Code extension | You can now create, configure, and use an environment in Fabric in VS Code with the Data Engineering VS Code extension. |
| September 2024 | Notebook debug within vscode.dev (preview) | You can now place breakpoints and debug your Notebook code with the Synapse VS Code - Remote extension in vscode.dev. This update first starts with the Fabric Runtime 1.3. |
| September 2024 | Invoke Fabric User Data Functions in Notebook | You can now invoke User Defined Functions (UDFs) in your PySpark code directly from Microsoft Fabric Notebooks or Spark jobs. With NotebookUtils integration, invoking UDFs is as simple as writing a few lines of code. |
| September 2024 | Functions Hub | The new Functions Hub provides a single location to view, access, and manage your User Data Functions. |
| September 2024 | Support for spaces in Lakehouse Delta table names | You can now create and query Delta tables with spaces in their names, such as "Sales by Region" or "Customer Feedback". All Fabric Runtimes and Spark authoring experiences support table names with spaces. |
| September 2024 | Enable/Disable Functionality in API for GraphQL | The Enable/Disable feature for queries and mutations in GraphQL API provides administrators and developers with granular control over API access and usage. |
| September 2024 | Public REST API of Livy endpoint | The Fabric Livy endpoint lets users submit and execute their Spark code on the Spark compute within a designated Fabric workspace, eliminating the need to create any Notebook or Spark Job Definition. |
| September 2024 | OneLake SAS (preview) | Support for OneLake SAS is now in preview. This functionality allows applications to request a User Delegation Key backed by Microsoft Entra ID, and then use this key to construct a short-lived, user-delegated OneLake SAS token. This token can be handed off to provide delegated access to another tool, node, or user, ensuring secure and controlled access. |
| September 2024 | Access Databricks Unity Catalog tables from Fabric (preview) | A mirrored Azure Databricks Unity Catalog in Fabric allows you to read data managed by Unity Catalog from Fabric workloads from the Lakehouse. In Fabric, you can now create a new data item called "Mirrored Azure Databricks Catalog". For more information, see Databricks Unity Catalog tables available in Microsoft Fabric. |
| September 2024 | T-SQL support in Fabric notebooks | The T-SQL notebook feature in Microsoft Fabric lets you write and run T-SQL code within a notebook. You can use them to manage complex queries and write better markdown documentation. It also allows direct execution of T-SQL on connected warehouse or SQL analytics endpoint. To learn more, see T-SQL support in Microsoft Fabric notebooks. |
| September 2024 | OneLake shortcuts to Google Cloud Storage | Now a generally available feature, Create a Google Cloud Storage (GCS) shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
| September 2024 | OneLake shortcuts to S3-compatible data sources | Now a generally available feature, Create an S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
| August 2024 | MsSparkUtils upgrade to NotebookUtils | The library MsSparkUtils has been rebranded as NotebookUtils. While NotebookUtils is backward compatible with MsSparkUtils, new features will only be added to the NotebookUtils namespace. For more information, see NotebookUtils (former MSSparkUtils) for Fabric. |
| August 2024 | Import Notebook UX improvement | The Import Notebook feature user interface has been enhanced - you can now effortlessly import notebooks, reports, or paginated reports using the unified entry in the workspace toolbar. |
| August 2024 | Lifecycle of Apache Spark runtimes in Fabric | The Lifecycle of Apache Spark runtimes in Fabric document details the release cadence and versioning for the Azure-integrated platform based on Azure Spark. For more information, see the Fabric runtime lifecycle blog post. |
| July 2024 | MSSparkUtils API | The mssparkutils.runtime.context is a new API that provides context information of the current live session, including the notebook name, default lakehouse, workspace info, if it's a pipeline run, etc. For more information, see Microsoft Spark Utilities (MSSparkUtils) for Fabric. |
| July 2024 | Environment Resources folder | The new Environment Resources Folder is a shared repository designed to streamline collaboration across multiple notebooks. |
| June 2024 | Fabric Spark connector for Fabric Synapse Data Warehouse in Spark runtime (preview) | The Fabric Spark connector for Synapse Data Warehouse (preview) enables a Spark developer or a data scientist to access and work on data from a warehouse or SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. |
| June 2024 | External data sharing public API preview | REST APIs for OneLake external data sharing are now available in preview. Users can now scale their data sharing use cases by automating the creation of shares with the public API. |
| June 2024 | Capacity pools preview | Capacity administrators can now create custom pools (preview) based on their workload requirements, providing granular control over compute resources. Custom pools for Data Engineering and Data Science can be set as Spark Pool options within Workspace Spark Settings and environment items. |
| June 2024 | Native Execution Engine for Apache Spark | The Native Execution Engine for Apache Spark on Fabric Data Engineering and Data Science for Fabric Runtime 1.2 is now in preview. For more information, see Native execution engine for Fabric Spark. |
| June 2024 | OneLake data access roles API | Following the release of OneLake data access roles in preview, new APIs are available for managing data access roles. These APIs can be used to programmatically manage granular data access for your lakehouses. |
| May 2024 | Runtime 1.3 (Apache Spark 3.5, Delta Lake 3.1, R 4.3.3, Python 3.11) (preview) | The enhancements in Fabric Runtime 1.3 include the incorporation of Delta Lake 3.1, compatibility with Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. Additionally, Fabric Runtime now enriches the data science experience by supporting the R language and integrating Copilot. |
| May 2024 | Spark Run Series Analysis and Autotune feature preview | The Spark Monitoring Run Series Analysis features allow you to analyze the run duration trend and performance comparison for Pipeline Spark activity recurring run instances and repetitive Spark run activities, from the same Notebook or Spark Job Definition. |
| May 2024 | OneLake shortcuts to on-premises and network-restricted data sources (preview) | Connect to on-premises data sources with a Fabric on-premises data gateway on a machine in your environment, with networking visibility of your S3 compatible, Amazon S3, or Google Cloud Storage data source. Then, you create your shortcut and select that gateway. For more information, see Create shortcuts to on-premises data. |
| May 2024 | Comment @tagging in Notebook | Notebook now supports the ability to tag others in comments, just like the familiar functionality of using Office products. |
| May 2024 | Notebook ribbon upgrades | New features in the Fabric notebook ribbon including the Session connect control and Data Wrangler button on the Home tab, High concurrency sessions, new View session information control including the session timeout. |
| May 2024 | Data Engineering: Environment GA | The Environment in Fabric is now generally available. The Environment is a centralized item that allows you to configure all the required settings for running a Spark job in one place. At GA, we added support for Git, deployment pipelines, REST APIs, resource folders, and sharing. |
| May 2024 | Public API for Workspace Data Engineering/Science | REST API support for Fabric Data Engineering/Science workspace settings allows users to create/manage their Spark compute, select the default runtime/default environment, enable or disable high concurrency mode, or ML autologging. |
| April 2024 | Fabric Spark Optimistic Job Admission | Fabric Spark Optimistic Job Admission reduces the frequency of throttling errors (HTTP 430: Spark Capacity Limit Exceeded Response) and improves the job admission experience for our customers, especially during peak usage hours. |
| April 2024 | Single Node support for starter pools | The Single Node support for starter pools feature lets you set your starter pool to max one node and get super-fast session start times for your Spark sessions. |
| April 2024 | Container Image for Synapse VS Code | To simplify the development process, we have released a container image for Synapse VS Code that contains all the necessary dependencies for the extension. |
| April 2024 | Git integration with Spark Job definition | Git integration with Spark Job definitions allows you to check in the changes of your Spark Job Definitions into a Git repository, which will include the source code of the Spark jobs and other item properties. |
| April 2024 | New Revamped Object Explorer experience in the notebook | The new Object Explorer experience improves flexibility and discoverability of data sources in the explorer and improve the discoverability of Resource folders. |
| April 2024 | %Run your scripts in Notebook | Now you can use %run magic command to run your Python scripts and SQL scripts in Notebook resources folder, just like Jupyter notebook %run command. |
| April 2024 | OneLake shortcuts to S3-compatible data sources preview | OneLake shortcuts to S3-compatible data sources are now in preview. Create an Amazon S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
| April 2024 | OneLake shortcuts to Google Cloud Storage preview | OneLake shortcuts to Google Cloud Storage are now in preview. Create a Google Cloud Storage shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
| April 2024 | OneLake data access roles | OneLake data access roles for lakehouse are in preview. Role permissions and user/group assignments can be easily updated through a new folder security user interface. |
| March 2024 | New validation enhancement for "Load to table" | The new validation enhancement to the "Load to table" feature help mitigate any validation issues and make your data loading experience smoother and faster. |
| March 2024 | Queuing for Notebook Jobs | Now with Job Queueing for Notebook Jobs, jobs that are triggered by pipelines or job scheduler will be added to a queue and will be retried automatically when the capacity frees up. For more information, see Job queueing in Microsoft Fabric Spark. |
| March 2024 | Autotune Query Tuning feature for Apache Spark | The Autotune Query Tuning feature for Apache Spark is now available. Autotune leverages historical data from your Spark SQL queries and machine learning algorithms to automatically fine-tune your configurations, ensuring faster execution times and enhanced efficiency. |
| March 2024 | OneLake File Explorer: Editing via Excel | With our latest release v1.0.11.0 of file explorer, we're excited to announce that you can now update your files directly using Excel, mirroring the user-friendly experience available in OneDrive. |
| February 2024 | Trusted workspace access (preview) for OneLake Shortcuts | Trusted workspace access (preview) enables secure and seamless access to ADLS Gen2 storage accounts from OneLake shortcuts in Fabric. For more information, see Trusted workspace access (preview). |
| February 2024 | Reduce egress costs with S3 shortcuts in OneLake | Learn how OneLake shortcuts to S3 now support caching, which can greatly reduce egress costs. Use the new Enable Cache for S3 Shortcuts setting with an S3 shortcut. |
| February 2024 | OneLake Shortcuts API | New REST APIs for OneLake Shortcuts allow programmatic creation and management of shortcuts, currently in preview. You can now programmatically create, read, and delete OneLake shortcuts. For example, see Use OneLake shortcuts REST APIs. |
| February 2024 | Browse code snippet | The new Browse code snippet notebook feature allows you to easily access and insert code snippets for commonly used code snippets with multiple supported languages. |
| February 2024 | Configure session timeout | Notebooks now support configuring session timeout for the current live session. It can help you avoid wasting resources or losing context due to timeout. You can specify the maximum duration of your spark sessions, from minutes to hours, and also get alerts before the session expires and extend it. |
| February 2024 | Fabric notebook status bar upgrade | The new Fabric Notebook status bar has three persisted info buttons: session status, save status, and cell selection status. Plus, context features include info on the git connection state, a shortcut to extend session timeout, and a failed cell navigator. |
| January 2024 | Microsoft Fabric Copilot for Data Science and Data Engineering | Copilot for Data Science and Data Engineering is now available worldwide. What can Copilot for Data Science and Data Engineering do for you? |
| January 2024 | Newest version of OneLake File Explorer includes Excel Integration | With the newest version of OneLake file explorer (v1.0.11.0) we bring a few updates to enhance your experience with OneLake, including Excel Integration. |
Fabric Data Engineering samples and guidance
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Simplify Data Transformation and Management with Copilot for Data Factory | Discover how Copilot for Data Factory streamlines data transformation and management, enhancing efficiency and productivity. Learn more about Simplify Data Transformation and Management with Copilot for Data Factory. |
| March 2025 | Virtualize your Cloudera/Hadoop data estate into Fabric OneLake with Apache Ozone | Learn more about a sample architecture using Microsoft Fabric OneLake shortcuts to virtualize data from Cloudera/Apache Ozone, using the OneLake S3 Compatible Shortcut. |
| March 2025 | Unlock the power of your Apache Iceberg data in OneLake | It's easy to get started with OneLake's Iceberg table format support. Learn how to bring your Apache Iceberg data to Fabric. |
| February 2025 | New lakehouse samples | Two familiar Lakehouse samples, WideWorldImporters and NYC Taxi, are designed to support deeper analysis and flexibility for both schema-enabled and non-schema Lakehouses. |
| February 2025 | Build a python app with Fabric API for GraphQL | Fabric API for GraphQL brings GraphQL experience within Fabric to securely and efficiently access the data in Fabric items such as databases or warehouses. Learn how to build a Python application using Flask framework to connect to Fabric SQL database and query data. |
| February 2025 | Streamline Data Engineering & Data Science with Copilot in Fabric | Contoso Retailers, a fictitious company, wants to learn how they can unlock the full potential of their data science and data engineering efforts with Copilot for Data Science and Data Engineering using Fabric. |
| February 2025 | Private ADLS Gen2 access made easy with OneLake Shortcuts: a step-by-step guide | How can you use your existing ADLS Gen2 data lake with private storage accounts? The solution is Trusted Workspace Access, which allows secure shortcuts to data in ADLS Gen2 even when protected by a firewall or when public access is entirely disabled. |
| January 2025 | Create a shortcut to a VPC-protected Google Cloud Storage bucket | Follow this guide to create a OneLake shortcut to a VPC-protected Google Cloud Storage (GCS) bucket. |
| January 2025 | Best practices for Fabric API for GraphQL | The Microsoft Fabric API for GraphQL is a handy service that quickly allows you to set up a GraphQL API to pull data from places like warehouses, the lakehouse, and mirrored databases. Learn best practices when building applications using Fabric API for GraphQL. |
| December 2024 | Troubleshooting Fabric Spark application without production workspace access | You have Fabric Spark Notebooks deployed in a production workspace, but you don't have direct access to it. The production support team reports that a Fabric Spark job has failed in the production workspace, and you need to analyze the logs to troubleshoot the issue. To troubleshoot Spark applications, Spark engineers typically use the Spark UI, which provides details of Jobs, Stages, Storage, Environment, Executors, and SQL. |
| October 2024 | Optimizing Spark Compute for Medallion Architectures in Microsoft Fabric | Learn how to optimize Spark Compute for Medallion architecture: a popular data engineering approach that emphasizes modularity. It organizes the data platform into three distinct layers: Bronze, Silver, and Gold. |
| August 2024 | Build a custom Sparklens JAR | In this blog, learn how to build the sparklens JAR for Spark 3.X, which can be used in Microsoft Fabric. |
| July 2024 | Create a shortcut to a VPC-protected S3 bucket | Learn how to create a shortcut to a VPC-protected S3 bucket, using the on-premises data gateway and AWS Virtual Private Cloud (VPC). |
| July 2024 | Move Your Data Across Workspaces Using Modern Get Data of Fabric Data Pipeline | The new modern get data experience of data pipeline now supports copying to Lakehouse and warehouse across different workspaces with an intuitive experience. |
| June 2024 | Demystifying Data Ingestion in Fabric: Fundamental Components for Ingesting Data into a Fabric Lakehouse using Fabric Data Pipelines | Learn about a batch data Ingestion framework based on experience working with different customers while building a lakehouse in Fabric. |
| June 2024 | Boost performance and save costs with Fast Copy in Dataflows Gen2 | Learn how the Fast Copy feature helps to enhance the performance and cost-efficiency of your Dataflows Gen2. |
| May 2024 | Copy Data from Lakehouse in another Workspace using Data pipeline | Learn how to copy data between Lakehouse that cross different workspaces via Data pipeline. |
| May 2024 | Profiling Microsoft Fabric Spark Notebooks with Sparklens | In this blog, you will learn how to leverage Sparklens, an open-source Spark profiling tool, to profile Microsoft Fabric Spark Notebooks and improve the performance of your spark code. |
| March 2024 | Bridging Fabric Lakehouses: Delta Change Data Feed for Seamless ETL | Learn how to use the Delta Change Data Feed to facilitate seamless data synchronization across different lakehouses in your medallion architecture. |
| January 2024 | Use Fabric Data Factory Data Pipelines to Orchestrate Notebook-based Workflows | Guidance and good practices when building Fabric Spark Notebook workflows using Data Factory in Fabric with data pipelines. |
Fabric Data Science
This section summarizes archived improvements and features for the Data Science experience in Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Enhancing AI productivity in Fabric Notebooks | The latest Copilot updates improve productivity with in-cell interactions, better code generation, and seamless integration with Fabric. For more information, see What's New in Copilot updates for Fabric notebooks. |
| February 2025 | Capacity settings include option to Disable Starter Pool | New controls in Data Engineering/Science Capacity settings include the option to Disable Starter Pool for workspaces, to help capacity admins have better compute restrictions on workspaces attached to their Fabric Capacity. |
| February 2025 | AI functions (preview) | AI functions for data engineering with GenAI are now in preview. With AI functions, you can harness the power of GenAI for summarization, classification, text generation, and so much more—all with a single line of code. |
| February 2025 | ArcGIS GeoAnalytics for Microsoft Fabric Spark (preview) | Microsoft and Esri have partnered to bring spatial analytics into Microsoft Fabric. To learn more about ArcGIS integration within Microsoft Fabric Spark, see ArcGIS GeoAnalytics for Microsoft Fabric (preview) and ArcGIS in Fabric integrations. |
| February 2025 | Fabric Catalyst Portal | The Fabric Catalyst Portal is collaborative knowledge hub designed to empower our partners with best practices, technical guidance, and real-world insights to accelerate Microsoft Fabric adoption. Registration for Microsoft partners is open. The first guidance is focused on Real-Time Intelligence. |
| January 2025 | Building Apps with Microsoft Fabric API for GraphQL | Microsoft Fabric has an API for GraphQL to build your data applications, enabling you to pull data from sources such as Data Warehouses, Lakehouse, Mirrored Databases, and DataMart in Microsoft Fabric. |
| December 2024 | Notebook version history | Fabric notebook version history provides robust built-in version control capabilities, including automatic and manual checkpoints, tracked changes, version comparisons, and previous version restore. For more information, see Notebook version history. |
| December 2024 | Python Notebook (preview) | Python Notebooks are for BI Developers and Data Scientists working with smaller datasets using Python as their primary language. To get started, see Use Python experience on Notebook. |
| November 2024 | Low code AutoML user experience in Fabric (preview) | AutoML, or Automated Machine Learning, is a process that automates the time-consuming and complex tasks of developing machine learning models. The new low code AutoML experience supports a variety of tasks, including regression, forecasting, classification, and multi-class classification. To get started, Create models with Automated ML (preview). |
| October 2024 | Enhancing Open Source: Fabric's Contributions to FLAML for Scalable AutoML | We have focused on enhancing FLAML's capabilities for Spark workloads. We've contributed several new Spark and non-Spark estimators to the FLAML project. Try these out with AutoML in Fabric (preview). |
| September 2024 | Data Wrangler for Spark DataFrames GA | Data Wrangler is now generally available. A notebook-based tool for exploratory data analysis, Data Wrangler works for both pandas DataFrames and Spark DataFrames and arrives at general availability with new usability improvements. |
| September 2024 | Session Expiry Control in Workspace Settings for Notebook Interactive Runs (preview) | A new session expiry control in Data Engineering/Science workspace settings allows you to set the maximum expiration time limit for notebook interactive sessions. By default, sessions expire after 20 minutes, but you can now customize the maximum expiration duration. |
| September 2024 | File editor in Notebook | The file editor feature in Fabric Notebook allows users to view and edit files directly within the notebook's resource folder and environment resource folder in notebook. Supported file types include CSV, TXT, HTML, YML, PY, SQL, and more. |
| August 2024 | Apply MLFlow tags on ML experiment runs and model versions | You can now apply MLflow tags directly on ML experiment runs and ML model versions from the user interface. |
| August 2024 | Track related ML Experiment runs in your Spark Application | You can now use an enhancement to the Monitoring Hub to track related ML experiment runs within Spark applications. You can also integrate Experiment items into the Monitoring Hub. |
| August 2024 | Use PREDICT with Fabric AutoML models | You can now move from training with AutoML to making predictions by using the built-in Fabric PREDICT UI and code-first APIs for batch predictions. For more information, see Machine learning model scoring with PREDICT in Microsoft Fabric. |
| July 2024 | Semantic link preinstalled | Semantic Link in now included in the default runtime. If you use Fabric with Spark 3.4 or later, semantic link is already in the default runtime, and you don't need to install it. |
| July 2024 | Semantic Link Labs | Semantic Link Labs is a library of helpful python solutions for use in Microsoft Fabric notebooks. Semantic Link Labs helps Power BI developers and admins easily automate previously complicated tasks, as well as make semantic model optimization tooling more easily accessible within the Fabric ecosystem. For Semantic Link Labs documentation, see semantic-link-labs documentation. For more information and to see it in action, read the Semantic Link Labs announcement blog. |
| June 2024 | Capacity pools preview | Capacity administrators can now create custom pools (preview) based on their workload requirements, providing granular control over compute resources. Custom pools for Data Engineering and Data Science can be set as Spark Pool options within Workspace Spark Settings and environment items. |
| June 2024 | Native Execution Engine for Apache Spark | The Native Execution Engine for Apache Spark on Fabric Data Engineering and Data Science for Fabric Runtime 1.2 is now in preview. For more information, see Native execution engine for Fabric Spark. |
| June 2024 | Demystifying Data Ingestion in Fabric: Fundamental Components for Ingesting Data into a Fabric Lakehouse using Fabric Data Pipelines | Learn about a batch data Ingestion framework based on experience working with different customers while building a lakehouse in Fabric. |
| June 2024 | Boost performance and save costs with Fast Copy in Dataflows Gen2 | Learn how the Fast Copy feature helps to enhance the performance and cost-efficiency of your Dataflows Gen2. |
| May 2024 | Public API for Workspace Data Engineering/Science | REST API support for Fabric Data Engineering/Science workspace settings allows users to create/manage their Spark compute, select the default runtime/default environment, enable or disable high concurrency mode, or ML autologging. |
| April 2024 | Semantic Link GA | Semantic links are now generally available! The package comes with our default VHD. You can now use Semantic link in Fabric right away without any pip installation. |
| April 2024 | Capacity level delegation for AI and Copilot | Tenant admins can now enable AI and Copilot in Fabric for the entire organization, certain security groups, or for a specific Capacity. |
| March 2024 | EU customers can use AI and Copilot without cross-geo setting | Since mid-March EU customers can use AI and Copilot without turning on the cross-geo setting, and their AI and Copilot requests will be processed within EUDB. |
| March 2024 | Code-First Hyperparameter Tuning preview | FLAML is now integrated for hyperparameter tuning, currently a preview feature. Fabric's flaml.tune feature streamlines this process, offering a cost-effective and efficient approach to hyperparameter tuning. |
| March 2024 | Code-First AutoML preview | With the new AutoML feature, you can automate your machine learning workflow and get the best results with less effort. AutoML, or Automated Machine Learning, is a set of techniques and tools that can automatically train and optimize machine learning models for any given data and task type. |
| March 2024 | Compare Nested Runs | Parent and child runs in the Run List View for ML Experiments introduces a hierarchical structure, allowing users to effortlessly view various parent and child runs within a single view and seamlessly interact with them to visually compare results. |
| March 2024 | Support for Mandatory MIP Label Enforcement | ML Model and Experiment items in Fabric now offer enhanced support for Microsoft Information Protection (MIP) labels. |
| January 2024 | Microsoft Fabric Copilot for Data Science and Data Engineering | Copilot for Data Science and Data Engineering is now available worldwide. What can Copilot for Data Science and Data Engineering do for you? |
Fabric Data Science samples and guidance
| Month | Feature | Learn more |
|---|---|---|
| February 2025 | Streamline Data Engineering & Data Science with Copilot in Fabric | Contoso Retailers, a fictitious company, wants to learn how they can unlock the full potential of their data science and data engineering efforts with Copilot for Data Science and Data Engineering using Fabric. |
| September 2024 | Using Microsoft Fabric for Generative AI: A Guide to Building and Improving RAG Systems | This tutorial includes three main notebooks, each covering a crucial aspect of building and optimizing RAG systems in Microsoft Fabric. |
| June 2024 | Building Custom AI Applications with Microsoft Fabric: Implementing Retrieval Augmented Generation for Enhanced Language Models | This guide walks you through implementing a RAG (Retrieval Augmented Generation) system in Microsoft Fabric using Azure OpenAI and Azure AI Search. |
| March 2024 | New AI Samples | New AutoML sample, Model Tuning, and Semantic Link samples appear in the Quick Tutorial category of the Data Science samples on Microsoft Fabric. |
SQL database in Microsoft Fabric (Preview)
This section summarizes archived improvements and features for SQL database in Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Backup storage billing | Starting April 1, backup storage billing begins for SQL database in Microsoft Fabric. For more information, see Backup Storage Billing for SQL Database in Microsoft Fabric. |
| March 2025 | SQL database enabled by default on March 28 | SQL database in Fabric will be enabled for all users in your tenant on March 28. For more information and potential opt-out, see default checkbox changes on tenant settings for SQL database in Fabric. |
| February 2025 | Approximate or fuzzy string matching (preview) | Check if two strings are similar, and calculate the difference between two strings. Use this capability to identify strings that might be different because of character corruption. What is fuzzy string matching? |
| February 2025 | DATEADD number allows bigint (preview) | For DATEADD (datepart , number , date ), number can be expressed as a bigint. For more information, see DATEADD (Transact-SQL). |
| February 2025 | Regular expression functions (preview) | Regular expression (REGEX) functions return text based on values in a search pattern. For more information, see Regular expressions. |
| January 2025 | SQL database support for tenant level private links (preview) | You can use tenant level private links to provide secure access for data traffic in Microsoft Fabric, including SQL database (in preview). For more information, see Set up and use private links and Blog: Tenant Level Private Link (Preview). |
| January 2025 | SQL databases billing begins | After February 1, 2025, compute and data storage for SQL database are charged to your Fabric capacity. Additionally, backup billing will start after April 1, 2025. For more information, see Activation of billing for SQL database in Fabric. |
| January 2025 | Ask the Experts – Fabric Databases – Livestream January 29! | Join us for a live Q&A session on the new Fabric Databases experience! Our product engineering team will answer your top questions in real time. |
| December 2024 | Copilot for SQL database | Learn more about the Copilot integration for Query Editor. Copilot for SQL database in Fabric as an AI-powered assistant designed to support you regardless of your SQL expertise or role. |
| November 2024 | New connectors for Fabric SQL database | In the Data Factory, both data pipeline and Dataflow Gen2 now natively support the Fabric SQL database connector as source and destination with the SQL database connector (Preview). For more information, see Fabric SQL Database Connector. |
| November 2024 | Fabric SQL database (Preview) | SQL database in Microsoft Fabric is a developer-friendly transactional database, based on Azure SQL Database, that allow you to easily create your operational database in Fabric. A SQL database in Fabric uses the SQL Database Engine as Azure SQL Database. Review a Decision Guide for SQL databases. For more on this announcement, read the SQL database in Fabric announcement blog. |
SQL database in Microsoft Fabric (Preview) samples and guidance
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Build RAG Data pipeline from Azure Blob Storage to SQL Database in minutes | This blog post provides step-by-step instructions for creating a Retrieval Augmented Generation (RAG) pipeline to prepare your data for AI integration using SQL database in Microsoft Fabric. |
| February 2025 | Build a python app with Fabric API for GraphQL | Fabric API for GraphQL brings GraphQL experience within Fabric to securely and efficiently access the data in Fabric items like databases or warehouses. Learn how to build a Python application using Flask framework to connect to Fabric SQL database and query data. |
| February 2025 | Why SQL database in Fabric is the best choice for low-code/no-code Developers | In this blog post, we'll explore why SQL database in Fabric is uniquely suited for low-code/no-code developers. |
| February 2025 | Govern your data in SQL database in Microsoft Fabric with protection policies in Microsoft Purview | Microsoft Purview's protection policies help you safeguard sensitive data in Microsoft Fabric items, including SQL databases. Learn how Purview policies override Microsoft Fabric item permissions for users, apps, and groups, limiting their actions within the database. |
| February 2025 | ICYMI: Ask the Expert – Fabric Databases | Here's a few great questions and answers about SQL database in Fabric from a recent Ask the Expert session on Microsoft Reactor. |
| January 2025 | Manage access in SQL database with SQL native authorization controls | A follow-up to Learn how to manage Microsoft Fabric access controls in SQL database, learn how to manage access for your SQL database with SQL native access controls. SQL database in Microsoft Fabric supports two different sets of authorization controls, Microsoft Fabric access controls and SQL native access controls. |
| January 2025 | Monitor SQL Database usage and consumption by using capacity metrics app | Learn how the capacity metrics app can be used for monitoring usage and consumption of SQL databases in Fabric. |
| January 2025 | Performance Dashboard tutorial | For a complete walkthrough of performance troubleshooting in SQL database in Microsoft Fabric with the Performance Dashboard, see Speed up your SQL databases with the Performance Dashboard. |
| January 2025 | Manage access for SQL databases in Microsoft Fabric with workspace roles and item permissions | SQL database (preview) supports two different sets of controls that allow you to manage access for your databases: Microsoft Fabric access controls and SQL native access controls. Learn how to manage Microsoft Fabric access controls in SQL database. |
| December 2024 | Source control integration for SQL database | SQL database in Fabric has a tightly integrated and fully extensible DevOps feature set, including a source control integration for GitHub and Azure DevOps. Learn how to use the Fabric web-based development environment with the git repository directly through a streamlined source control panel. |
| December 2024 | Tour the Query Editor in SQL database in Microsoft Fabric | Whether you're a seasoned data professional or a developer new to SQL, the query editor offers features that cater to all skill levels. For more information, see Query with the SQL query editor. |
| November 2024 | Building a Smart Chatbot with SQL database in Microsoft Fabric, LangChain and Chainlit | Imagine you're the founder of Contoso, a rapidly growing e-commerce startup. As your online store grows, you realize that many customer inquiries are about basic product information: price, availability, and specific features. To automate these routine questions, you decide to build a chatbot with SQL database in Microsoft Fabric, LangChain, and Chainlit. |
| November 2024 | Learning pathways for SQL database | For those curious about where to learn more and how to try out this new offering, read more about the upcoming episodes of SQL database in Microsoft Fabric: Learn Together. |
| November 2024 | Data Exposed: Announcing SQL database in Microsoft Fabric preview | Watch a Data Exposed video introducing on the SQL database in Microsoft Fabric public preview. |
| November 2024 | Guided application tutorial in Fabric SQL database | The tutorial provides a comprehensive guide to utilizing the SQL database in Fabric. This tutorial is tailored to help you navigate through the process of database creation, setting up database objects, exploring autonomous features, and combining and visualizing data. Additionally, learn how to create a GraphQL endpoint, which serves as a modern approach to connecting and querying your data efficiently. |
| November 2024 | Get started with Fabric SQL database | Guided how-to documents on how to do basic tasks in SQL database in Fabric start with Enable SQL database in Fabric using Admin Portal tenant settings. |
Fabric Data Warehouse
This section summarizes archived improvements and features for Data Warehouse in Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Migration Assistant for Fabric Data Warehouse (preview) | The new Migration Assistant simplifies the process of migrating from Azure Synapse Analytics to Fabric Data Warehouse. For more information, see Public Preview of Migration Assistant for Fabric Data Warehouse. |
| March 2025 | Hints support | Fabric Data Warehouse now supports some T-SQL Query and Join hints. For more information, see What are hints? |
| February 2025 | T-SQL notebook enhancements | The T-SQL notebook now includes more T-SQL code snippets, easy open within Excel, traceability of the warehouse, and CI/CD support. For more information, see T-SQL notebook enhancements. |
| February 2025 | COLLATE support | The T-SQL COLLATE clause is now supported. For more information, see COLLATE (Transact-SQL). |
| February 2025 | Copilot for Data Warehouse Chat (Preview) | You will now see a Copilot button in the ribbon starts a chat with Copilot for acceleration with any data warehousing task. For more information, see How to: Use the Copilot chat pane for Fabric Data Warehouse. |
| February 2025 | Nested Common Table Expressions (CTEs) (GA) | Fabric Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs as generally available features now. For more information, see nested common table expressions (CTE) in Fabric data warehousing (Transact-SQL). |
| February 2025 | Fabric Spark connector for Fabric Data Warehouse in Spark runtime (preview) | The Spark connector for Data Warehouse enables a Spark developer or a data scientist to access and work on data from a warehouse or SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. For more information, see Spark Connector for Fabric Data Warehouse - Preview. |
| February 2025 | OPENROWSET and BULK INSERT support (preview) | The T-SQL OPENROWSET(BULK) function is now available in Fabric warehouse as a preview feature. For more information and examples, see Browse file content using OPENROWSET function (Preview). For more information, see BULK INSERT statement in Fabric Data Warehouse and Fabric OPENROWSET preview. |
| January 2025 | COPY INTO operations with row count check | The COPY INTO now allows you to control the behavior of your data ingestion jobs by checking if the count of columns in the source data matches the count of columns on your target table, with the MATCH_COLUMN_COUNT argument. |
| January 2025 | Default schema in a warehouse | You can now change the default schema for users in Fabric Data Warehouse, using the ALTER USER statement, ensuring that every user has a predefined schema context when they connect to the database. |
| January 2025 | Data Insights now includes Data Scanned and CPU time analytics | New columns are available in the queryinsights.exec_requests_history system view to determine if large data scans are contributing to slower query execution. For more information, see Query insights in Fabric data warehousing. |
| January 2025 | JSON Aggregate support (preview) | Fabric warehouses now support JSON aggregate functions in preview, JSON_ARRAYAGG and JSON_OBJECTAGG. |
| January 2025 | SET SHOWPLAN_XML support | The SET SHOWPLAN_XML T-SQL syntax is now supported as a preview feature in Fabric Data Warehouse and SQL analytics endpoint. For more information, see SHOWPLAN_XML in Fabric Data Warehouse (preview). |
| January 2025 | Service principal support | Service principal (SPN) support Fabric warehouse items allows developers and administrators to automate processes, streamline operations, and increase security for their data workflows. For more information, see Service principal support for Fabric Data Warehouse. |
| January 2025 | Warehouse restore points and restore in place | You can now create restore points and perform an in-place restore of a warehouse to a past point in time. Restore in-place is an essential part of data warehouse recovery, which allows to restore the data warehouse to a prior known reliable state by replacing or over-writing the existing data warehouse from which the restore point was created. |
| January 2025 | COPY INTO operations with granular permissions | Enhancements to the COPY INTO T-SQL command in Fabric Data Warehouse introduce granular SQL controls. For more information, see Enhancing COPY INTO operations with Granular Permissions. |
| December 2024 | What's new in the Fabric SQL analytics endpoint? | There are several updates to improve both functionality and user experience with the SQL analytics endpoint, including metadata sync, last successful update, improved error propagation, and more. |
| November 2024 | Open mirroring (Preview) | Open mirroring enables any application to write change data directly into a mirrored database in Fabric, based on the open mirroring public APIs and approach. Open mirroring is designed to be extensible, customizable, and open. It's a powerful feature that extends mirroring in Fabric based on open Delta Lake table format. To get started, see Tutorial: Configure Microsoft Fabric open mirrored databases. |
| November 2024 | Fabric Mirroring for Azure SQL Managed Instance (Preview) | Fabric Database mirroring is now able to mirror Azure SQL Managed Instance databases. |
| November 2024 | Mirroring for Azure SQL Database GA | With Azure SQL Database mirroring in Fabric, you can easily bring your database into OneLake in Microsoft Fabric. |
| October 2024 | Case insensitive collation support | By default, the collation of a warehouse is case sensitive (CS) with 'Latin1_General_100_BIN2_UTF8'. You can now Create a warehouse with case-insensitive (CI) collation. |
| October 2024 | varchar(max) and varbinary(max) support in preview | Support for the varchar(max) and varbinary(max) in data types in Fabric Data Warehouse is now in preview. For more information, see Announcing public preview of VARCHAR(MAX) and VARBINARY(MAX) types in Fabric Data Warehouse. |
| October 2024 | Concurrency performance improvements | We have recently optimized our task scheduling algorithm in our distributed query processing engine (DQP) to reduce contention when the workspace is under moderate to heavy concurrency. In testing we have observed that this optimization makes significant performance improvements in querying workloads. |
| October 2024 | JSON support enhancements | JSON functionalities in warehouse and SQL analytics endpoints for Lakehouse and mirrored databases have been improved. For details see, JSON support enhancements. |
| October 2024 | Nested Common Table Expressions (CTEs) (preview) | Fabric Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs. While CTEs are generally available in Microsoft Fabric, nested common table expressions (CTE) in Fabric data warehousing (Transact-SQL) are currently a preview feature. |
| September 2024 | Mirroring for Snowflake GA | With Mirroring for Snowflake in Fabric, you can easily bring your Snowflake data into OneLake in Microsoft Fabric. For more information, see Mirroring Snowflake. |
| September 2024 | Copilot for Data Warehouse | Copilot for Data Warehouse (preview) is now updated and available as a preview feature, offering the Copilot chat pane, quick actions, and code completions. |
| September 2024 | Delta column mapping in the SQL analytics endpoint | SQL analytics endpoint now supports Delta tables with column mapping enabled. For more information, see Delta column mapping and Limitations of the SQL analytics endpoint. This feature is currently in preview. |
| September 2024 | Lakehouse schemas in SQL analytics endpoint | Lakehouse schemas allow delta tables in schemas to be queried in the SQL analytics endpoint. For more information, see Lakehouse schemas feature (preview). |
| September 2024 | Fabric Spark connector for Fabric Data Warehouse new features (preview) | The Fabric Spark connector for Fabric Data Warehouse (preview) now supports custom or pass-through queries, PySpark, and Fabric Runtime 1.3 (Spark 3.5). |
| September 2024 | New editor improvements | Editor improvements for Warehouse and SQL analytics endpoint items improve the consistency and efficiency. For more information, see New editor improvements. |
| September 2024 | T-SQL support in Fabric notebooks (preview) | The T-SQL notebook feature in Microsoft Fabric (preview) lets you write and run T-SQL code within a notebook. You can use them to manage complex queries and write better markdown documentation. It also allows direct execution of T-SQL on connected warehouse or SQL analytics endpoint. To learn more, see T-SQL support in Microsoft Fabric notebooks. |
| September 2024 | Nested Common Table Expressions (CTEs) (preview) | Fabric Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs. While CTEs are generally available in Microsoft Fabric, nested common table expressions (CTE) in warehouse are currently a preview feature. |
| September 2024 | Mirrored Azure Databricks (Preview) | A mirrored Azure Databricks Unity Catalog in Fabric allows you to read data managed by Unity Catalog from Fabric workloads from the Lakehouse. For more information, see Databricks Unity Catalog tables available in Microsoft Fabric. |
| August 2024 | Mirroring integration with modern get data experience | You can now use the Modern Get Data experience to choose from all the available mirrored databases in OneLake. |
| August 2024 | T-SQL DDL support in Azure SQL Database mirrored database | You can now run DDL operations on a Azure SQL Database mirrored database such as Drop Table, Rename Table, and Rename Column. |
| August 2024 | Delta Lake log publishing pause and resume | You can now pause and resume the publishing of Delta Lake Logs for Warehouses. For more information, see Delta Lake logs in Warehouse in Microsoft Fabric. |
| August 2024 | Managing V-Order behavior of Fabric Warehouses | You can now manage V-Order behavior at the warehouse level. For more information, see Understand V-Order for Microsoft Fabric Warehouse. |
| August 2024 | TRUNCATE T-SQL support | The TRUNCATE T-SQL command is now supported in Warehouse tables. |
| July 2024 | ALTER TABLE and nullable column support | We've added T-SQL ALTER TABLE support for some operations, as well as nullable column support to tables in the warehouse. For more information, see ALTER TABLE (Transact-SQL). |
| July 2024 | Warehouse queries with time travel (GA) | Warehouse in Microsoft Fabric offers the capability to query the historical data as it existed in the past at the statement level, now generally available. The ability to query data from a specific timestamp is known in the data warehousing industry as time travel. |
| July 2024 | Restore warehouse experience in the Fabric portal | You can now create restore points and perform a restore in-place of a warehouse item. For more information, see Seamless Data Recovery through Warehouse restoration. |
| July 2024 | Warehouse source control (preview) | Using Git integration and/or deployment pipelines with your warehouse, you can manage development and deployment of versioned warehouse objects. You can use SQL Database Projects extension available inside of Azure Data Studio and Visual Studio Code. For more information on warehouse source control, see CI/CD with Warehouses in Microsoft Fabric. |
| July 2024 | Time travel and clone table retention window expanded | The retention period for time travel queries and clone table is now 30 days. |
| June 2024 | Restore in place portal experience | You can now create user-created restore points in your warehouse via the Fabric portal. For more information, see Restore in-place of a warehouse in Microsoft Fabric. |
| June 2024 | Fabric Spark connector for Fabric Data Warehouse in Spark runtime (preview) | The Fabric Spark connector for Fabric Data Warehouse (preview) enables a Spark developer or a data scientist to access and work on data from Fabric DW and SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. |
| May 2024 | Monitor Warehouse tools | You can Monitor Fabric Data Warehouse activity with a variety of tools, including: Billing and utilization reporting in Fabric Data Warehouse, monitor connections, sessions, and requests using DMVs, Query insights, and now Query activity. For more information, read Query activity: A one-stop view to monitor your running and completed T-SQL queries. |
| May 2024 | Copilot for Data Warehouse | Copilot for Data Warehouse (preview) is now available in limited preview, offering the Copilot chat pane, quick actions, and code completions. |
| May 2024 | Warehouse queries with time travel (preview) | Warehouse in Microsoft Fabric offers the capability to query the historical data as it existed in the past at the statement level, currently in preview. The ability to query data from a specific timestamp is known in the data warehousing industry as time travel. |
| May 2024 | COPY INTO enhancements | COPY INTO now supports Microsoft Entra ID authentication and access to firewall protected storage via the trusted workspace functionality. For more information, see COPY INTO enhancements and COPY INTO (Transact-SQL). |
| April 2024 | Fabric Warehouse in ADF copy activity | You can now connect to your Fabric Warehouse from an Azure Data Factory/Synapse pipeline. You can find this new connector when creating a new source or sink destination in your copy activity, in the Lookup activity, Stored Procedure activity, Script activity, and Get Metadata activity. |
| April 2024 | Git integration | Git integration for the Warehouse allows you to check in the changes of your Warehouse to an Azure DevOps Git repository as a SQL database project. |
| April 2024 | Partition elimination | Partition elimination is a performance improvement for tables with a large number of files. The SQL analytics endpoint of a Lakehouse uses partition elimination to read data from only those partitions that are relevant to the query. Recent improvements boosted performance even more when queries are aimed at a few partitions in a table that has many files. |
| March 2024 | Mirroring in Microsoft Fabric preview | With Mirroring in Fabric, you can easily bring your databases into OneLake in Microsoft Fabric, enabling seamless zero-ETL, near real-time insights on your data – and unlocking warehousing, BI, AI, and more. For more information, see What is Mirroring in Fabric?. |
| March 2024 | Cold cache performance improvements | Fabric stores data in Delta tables and when the data is not cached, it needs to transcode data from parquet file format structures to in-memory structures for query processing. Recent cold cache performance improvements further optimize transcoding and we observed up to 9% faster queries in our tests when data is not previously cached. |
| March 2024 | Extract and publish a SQL database project directly through the DW editor | The SQL Database Projects extension creates a SQL project (.sqlproj) file, a local representation of SQL objects that comprise the schema for a single database, such as tables, stored procedures, or functions. You can now extract and publish a SQL database project directly through the DW editor. |
| March 2024 | Change owner of Warehouse item | The new Takeover API allows you to change the warehouse owner from the current owner to a new owner, which can be an SPN or an Organizational Account. |
| March 2024 | Clone table RLS and CLS | A cloned table now inherits the row-level security (RLS) and dynamic data masking from the source of the clone table. |
| February 2024 | Experience performance improvements | Recent connectivity and performance enhancements include an improved experience for creating warehouses, T-SQL execution, automatic metadata discovery, and error messaging. |
Fabric Data Warehouse samples and guidance
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | DacFx Integration for Warehouse ALM | Simplify your warehouse ALM with DacFx integration in Git and deployment pipelines for Fabric Warehouse (preview). For more information, see Simplify your Warehouse ALM with DacFx integration in Git and Deployment Pipelines. |
| March 2025 | Spatial queries samples in a warehouse | Fabric Data Warehouse supports two primary spatial data types, geometry and geography. Learn more about the spatial capabilities in Fabric Data Warehouse. |
| February 2025 | Build a python app with Fabric API for GraphQL | Fabric API for GraphQL brings GraphQL experience within Fabric to securely and efficiently access the data in Fabric items like databases or warehouses. Learn how to build a Python application using Flask framework to connect to Fabric SQL database and query data. |
| January 2025 | Best practices for Fabric API for GraphQL | The Microsoft Fabric API for GraphQL is a handy service that quickly allows you to set up a GraphQL API to pull data from places like warehouses, the lakehouse, and mirrored databases. Learn best practices when building applications using Fabric API for GraphQL. |
| December 2024 | Microsoft Fabric API for GraphQL™ for Azure Cosmos DB Mirroring | Learn how to integrate Azure Cosmos DB and the Microsoft Fabric API for GraphQL™ to build near real-time analytical applications. For more information on how to leverage Fabric API for GraphQL in your applications, see Connect applications to Fabric API for GraphQL. |
| November 2024 | SQL to Microsoft Fabric Migration: Beginner-Friendly Strategies for a Smooth Transition | Learn more about migrating your SQL database to Microsoft Fabric, a unified platform that brings your data and analytics together effortlessly. |
| October 2024 | Ensuring Data Continuity in Fabric Warehouse: Best Practices for Every Scenario | Dive deep into the common recovery scenarios and features that help enable seamless end-to-end data recovery and discuss best practices to ensure data resilience. |
| August 2024 | Mirroring SQL Server database to Fabric | While SQL Server isn't currently supported for Fabric mirrored databases, learn how to extend Fabric mirroring to an on-premises SQL Server database as a source, using a combination of SQL Server Transactional replication and Fabric Mirroring. |
| July 2024 | Microsoft Entra authentication for Fabric Data Warehouse | For sample connection strings and more information on using Microsoft Entra as an alternative to SQL Authentication, see Microsoft Entra authentication as an alternative to SQL authentication. |
| June 2024 | Mastering Enterprise T-SQL ETL/ELT: A Guide with Data Warehouse and Fabric Pipelines | Learn about foundational elements of an enterprise-scale ETL/ELT framework using Fabric Pipelines and a Data Warehouse for performing our transformations in T-SQL. Additionally, we will examine a dynamic SQL script designed to incrementally process tables throughout your enterprise. |
| April 2024 | Fabric Change the Game: Azure SQL Database mirror into Microsoft Fabric | A step-by-step guide to mirror your Azure SQL Database into Microsoft Fabric. |
| February 2024 | Mapping Azure Synapse dedicated SQL pools to Fabric data warehouse compute | Read for guidance on mapping Data Warehouse Units (DWU) from Azure Synapse Analytics dedicated SQL pool to an approximate equivalent number of Fabric Capacity Units (CU). |
| January 2024 | Automate Fabric Data Warehouse Queries and Commands with Data Factory | In Fabric Data Factory, there are many ways to query data, retrieve data, and execute commands from your warehouse using pipeline activities that can then be easily automated. |
Fabric Mirroring
This section summarizes archived improvements and features for Mirroring in Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Mirroring CI/CD | CI/CD for Mirroring is now generally available. You can integrate Git for source control and utilize ALM Deployment Pipelines, streamlining the deployment process and ensuring seamless updates to mirrored databases. |
| March 2025 | Open Mirroring UI enhancements and CSV support | The release of support for CSV formats for Open Mirroring allows you to upload CSV files in addition to parquet files when using the API or user experience. For more information, see Open Mirroring UI enhancements and CSV support. |
| March 2025 | Mirroring updates to support firewalls, CI/CD, and more | Discover the many enhancements recently introduced to Fabric Mirroring. Database Mirroring now supports firewall connectivity for Azure SQL Database with on-premises Data Gateway. |
| March 2025 | Mirrored PostgreSQL Flexible Server (preview) | Fabric Database Mirroring now supports replication of your Azure Database for PostgreSQL Flexible Server as a preview feature. You can continuously replicate data in near real-time from your Flexible Server instance to Fabric OneLake. For more information, see Mirroring Azure Database for PostgreSQL flexible server. |
| February 2025 | Support for storage accounts behind a firewall for Mirrored Azure Databricks catalog items (Preview) | Storage accounts behind a firewall for Mirrored Azure Databricks catalog items are now supported as a preview feature. You can securely access Unity Catalog data even when it's stored in ADLS accounts protected by a firewall. |
| February 2025 | Open Mirroring for SAP sources – dab and Simplement | With open mirroring, data replication is an extensible platform that partners and customers can use to plug in their own data integration capabilities. Once data is brought in through open mirroring, it can be used in all Fabric workloads. Two partners have now taken the next step in integrating with open mirroring, and are ready to onboard customers. |
| January 2025 | Mirroring CI/CD (preview) | Mirroring now supports CI/CD as a preview feature. You can integrate Git for source control and utilize ALM Deployment Pipelines, streamlining the deployment process and ensuring seamless updates to mirrored databases. |
| January 2025 | Source schema support in Mirroring in Fabric | Mirroring in Fabric now supports replicating the source schema hierarchy. For more information, see Mirroring now supports replicating source schemas. |
| January 2025 | Delta column mapping support for Mirroring | Mirroring in Fabric now supports Delta column mapping. Column mapping is a feature of Delta tables that allows users to include spaces and special characters such as '``,``;``{``}``(``)``\n``\t``=``.``' in column names. For more information, see Delta column mapping support. |
Real-Time Intelligence in Microsoft Fabric
This section summarizes archived improvements and features for Real-Time Intelligence in Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Solace PubSub+ Connector | Seamlessly connect Fabric Eventstream with Solace PubSub+ (preview). For more information and steps to get started, see New Solace PubSub+ Connector: seamlessly connect Fabric Eventstream with Solace PubSub+ (preview). |
| March 2025 | Unlock the power of Real-time Intelligence in the Era of AI | Read more about why Fabric Real-Time Intelligence is a game-changer. |
| March 2025 | New sources for Fabric event streams | The following new event sources are supported for Fabric event streams: MQTT, Real-time weather, Azure Data Explorer, Solace PubSub+, Azure Event Grid namespace. The following event sets are added as sample data sources: Buses, S&P 500 companies stocks. |
| February 2025 | Configure latency of Eventhouse OneLake | Eventhouse's adaptive mechanism can delay writing operations if there isn't enough data to create optimal Parquet files. This delay is now configurable. For more information, see Eventhouse OneLake Availability. |
| February 2025 | Real-Time Dashboard & Power BI templates for Eventhouse Monitoring | Real-Time Dashboard and Power BI Templates designed to provide an out-of-the-box graphical management experience. With these templates you can easily monitor your query performance and data ingestions. You can enable workspace monitoring, download the templates, and view a demo in the fabric-toolbox GitHub repository. |
| February 2025 | New Real-Time Dashboard customization features | New customization features give real-time dashboard authors and viewers more control over visuals, layout, and performance, including more control, better usability, and improved performance. |
| February 2025 | New and improved Data Source Tree in KQL Queryset | The enhanced Data Source Tree now shows all other data sources previously connected in your Queryset, including Fabric (Eventhouse/KQL database) and Azure sources (Azure Data Explorer, Application Insights, Log Analytics clusters). |
| February 2025 | Data exploration is now available for raw KQL table data | We've made it even easier to explore your data – no code required – with the Explore Data feature, now available in additional places across the user interface. |
| February 2025 | Eventhouse OneLake availability migration | A system migration for OneLake Availability is occurring starting April 9, 2025. This won't have any effect on accessing the data within your Eventhouse, it will only affect the delta parquet files made available via the OneLake Availability feature. |
| January 2025 | Real-time intelligence ALM and REST API GA | Application Lifecycle Management (ALM) and Fabric REST APIs are now generally available for all RTI items: Eventstream, Eventhouse, KQL Database, Realtime dashboard, Query set and Data Activator. ALM includes both deployment pipelines and Git integration. REST APIs allow you to programmatically create / read / update / delete items. |
| December 2024 | Eventhouse Monitoring (preview) | Eventhouse monitoring in preview offers multiple events and metrics that are automatically routed and stored in Workspace Monitoring. For more information, see Manage and monitor an eventhouse. |
| December 2024 | All Real-Time Intelligence items supported for ALM and REST API | Fabric Real-Time Intelligence items (Eventstream, Eventhouse, KQL Database, Realtime Dashboard, Query set & Activator) support Application Lifecycle Management (ALM) and REST API capabilities. |
| December 2024 | Eventhouse Query Acceleration for OneLake Shortcuts (Preview) | Query Acceleration for OneLake Shortcuts in Eventhouse speeds up ad hoc queries over data in OneLake. OneLake shortcuts are references from an Eventhouse that point to internal Fabric or external sources. Previously, queries run over OneLake shortcuts were less performant than on data that is ingested directly to Eventhouses due to various factors. |
| November 2024 | New event categories in Fabric Real-Time Hub | New event categories in Real-Time Hub include: OneLake events, Job events, and Capacity utilization events. These new event categories are currently in preview. For more information, see Unlocking the power of Real-Time Data with OneLake Events. |
| November 2024 | Eventstream processing and routing events to Activator (preview) | Now, Eventstream supports processing and transforming events with business requirements before routing the events to the destination: Activator. When these transformed events reach Activator, you can establish rules or conditions for your alerts to monitor the events. |
| November 2024 | REST APIs for Fabric Eventstream | With the Eventstream REST API, you can now programmatically create, manage, and update Eventstream items. For more information, see Fabric REST APIs for Eventstream. |
| November 2024 | Real-Time Intelligence: now Generally Available | We're excited to announce that Real-Time Intelligence is now generally available (GA). This includes the Real-Time hub, enhanced Eventstream, Eventhouse, Real-Time Dashboards, and Activator. For more information, see What is Real-Time Intelligence? |
| November 2024 | Real-Time hub | Real-Time hub is now generally available. For more information, see Introduction to Fabric Real-Time hub. |
| November 2024 | Eventstream support for Azure Service Bus and Activator | Eventstreams support Azure Service Bus source (preview) and Fabric activator destination (preview) now, and they are in preview. The following connectors are generally available now: PostgreSQL Database (DB) Change Data Capture (CDC), MySQL DB CDC, Cosmos DB CDC, Azure SQL DB CDC, Azure SQL Managed Instance DB CDC, SQL Server on virtual machine DB CDC, Google Pub/Sub, Amazon Kinesis Data Streams, Apache Kafka, Confluent Cloud Kafka, and Amazon Managed Streaming for Apache Kafka. Eventstreams support Git Integration and Deployment Pipeline by integrating with Git and deployment pipelines. |
| October 2024 | Secure Data Streaming with Managed Private Endpoints in Eventstream (Preview) | By creating a Fabric Managed Private Endpoint, you can securely connect Eventstream to your Azure services, such as Azure Event Hubs or IoT Hub, within a private network or behind a firewall. For more information, see Secure Data Streaming with Managed Private Endpoints in Eventstream (Preview). |
| October 2024 | Usage reporting for Activator is now live | The Activator team has rolled out usage reporting to help you better understand your capacity consumption and future charges. When you look at the Capacity metrics app compute page you'll now see operations for the reflex items included. |
| October 2024 | Real-Time Dashboards and underlying KQL databases access separation (preview) | With separate permissions for dashboards and underlying data, administrators now have the flexibility to allow users to view dashboards without giving access to the raw data. |
| October 2024 | Real-Time Dashboards Integration with GitHub | Fabric's Git integration is now available for Real-Time Dashboards. For more information, see What is Microsoft Fabric Git integration? |
| October 2024 | Quickly visualize query results in KQL Queryset | You can now graphically visualize KQL Queryset results instantly and effortlessly and control the formatting without the need for re-run queries – all using a familiar UI. |
| October 2024 | Pin query to dashboard | You can now save the outcome of any query written in KQL Queryset directly to a new or existing Real-Time Dashboard. |
| September 2024 | Terraform Provider for Fabric (preview) | The Terraform Provider for Microsoft Fabric is now in preview. The Terraform Provider for Microsoft Fabric supports the creation and management of many Fabric resources. For more information, see Announcing the new Terraform Provider for Microsoft Fabric. |
| September 2024 | Announcing Service Principal support for Fabric APIs | You can now use service principal to access Fabric APIs. Service principal is a security identity that you can create in Microsoft Entra and assign permissions to it in Microsoft Entra and other Microsoft services, such as Microsoft Fabric. |
| September 2024 | Tag your data to enrich item curation and discovery | Tags (preview) help admins categorize and organize data, enhancing the searchability of your data and boosting success rates and efficiency for end users. |
| September 2024 | Trusted workspace access and Managed private endpoints in any Fabric capacity | Trusted workspace access and Managed private endpoints are available in any Fabric capacity. Previously, trusted workspace access and Managed private endpoints were available only in F64 or higher capacities. Managed Private endpoints are now available in Trial capacities. |
| September 2024 | Multitenant organization (MTO) (preview) | Fabric now supports Microsoft Entra ID Multitenant Organizations (MTO). The multitenant organizations capability in Microsoft Entra ID synchronizes users across multiple tenants, adding them as users of type external member. For more information, see Distribute Power BI content to external guest users with Microsoft Entra B2B. |
| September 2024 | Microsoft Fabric Achieves HITRUST CSF Certification | Microsoft Fabric is now certified for the HITRUST Common Security Framework (CSF) v11.0.1. |
| September 2024 | Creating a real time dashboard by Copilot | Copilot can review a table and automatically create a dashboard with insights and a profile of the data with a sample. |
| September 2024 | New Real-Time hub and KQL Database user experiences | The new user experience features new Real-Time hub navigation, a My Streams page, an enhanced database page experience, and more. |
| September 2024 | Eventhouse as a new Destination in Eventstream | Eventhouses, equipped with KQL Databases, can handle and analyze large volumes of data. With the Eventhouse destination in Eventstream, you can efficiently process and route data streams into an Eventhouse and analyze the data in near real-time using KQL. |
| September 2024 | Managed private endpoints for Eventstream | With a managed private endpoints for Fabric, you can now establish a private connection between your Azure services, such as Azure Event Hubs, and Fabric Eventstream. For more information, see Eventstream integration with managed private endpoint. |
| September 2024 | Activator alerts on KQL Querysets | Now you can set up Activator (preview) alerts directly on your KQL queries in KQL querysets. For more information and samples, see Create Activator alerts from a KQL Queryset. |
| September 2024 | Real-Time Dashboards continuous or 10s refresh rate | The dashboard auto refresh feature now supports continuous and 10 second refresh rates, in addition to the existing options. This upgrade, addressing a popular customer request, allows both editors and viewers to set near real-time and real-time data updates. |
| September 2024 | Multivariate anomaly detection | A new workflow for multivariate anomaly detection of time series data is based on the algorithm that is used in the AI Anomaly Detector service (which is being retired as a standalone service). For a tutorial, see Multivariate Anomaly Detection. |
| September 2024 | Real-Time Intelligence Copilot conversational mode | The Copilot assistant, which translates natural language into KQL, now supports conversational mode, allowing you to ask follow-up questions that build on previous queries within the chat. |
| September 2024 | New connectors and UI in Real-Time hub | Four new connectors released on September 24, 2024: Apache Kafka, Amazon Managed Streaming for Apache Kafka, Azure SQL Managed Instance CDC, SQL Server on VM DB CDC. The tabs in the main page of Real-Time hub are replaced with menu items on the left navigation menu. For more information, see Get started with Fabric Real-Time hub. You can connect to Azure streaming sources using private endpoints now. |
| September 2024 | Announcement: Eventhouse Standard Storage billing | Starting the week of September 16 you will start seeing billable consumption of the OneLake Storage Data Stored meter from the Eventhouse and KQL Database items. |
| August 2024 | Fabric Real-Time hub Teaching Bubbles | New teaching bubbles provide a step-by-step guide through its major functionalities. These interactive guides allow you to seamlessly navigate each tab of the Real-Time hub. For more information, see Fabric Real-Time hub Teaching Bubble. |
| August 2024 | KQL Queryset REST API support | The new Fabric Queryset REST APIs allow you to create/update/delete KQL Querysets in Fabric, and programmatically manage them without manual intervention. For more information, see KQL Queryset REST API support. |
| July 2024 | Update records in a KQL Database preview | The .update command is now generally available. Learn more about how to Update records in a Kusto database. |
| July 2024 | Real-Time Dashboards 1s and 10s refresh rate | Real-time Dashboards now support ultra-low refresh rates of just 1 or 10 seconds. For more information, see Create a Real-Time Dashboard (preview). |
| June 2024 | Graph Semantics in Eventhouse | Graph Semantics in Eventhouse allows users to model their data as graphs and perform advanced graph queries and analytics using the Kusto Query Language (KQL). |
| June 2024 | Set alerts on Real-time Dashboards with Fabric Activator triggers | Real-Time Dashboard visuals now support alerts, to extend monitoring support with Activator. With integration with Activator, you'll receive timely alerts as your key metrics change in real-time. |
| June 2024 | OneLake availability of Eventhouse in Delta Lake format GA | As part of the One logical copy promise, we're excited to announce that OneLake availability of Eventhouse in Delta Lake format is Generally Available. |
| June 2024 | Real-Time Dashboards | Real-Time Dashboards interact with data dynamically and in real time. Real-Time Dashboards natively visualize data stored in Eventhouses. Real-time Dashboards support ultra-low refresh rates of just 1 or 10 seconds. For more information, see Visualize and Explore Data with Real-Time Dashboards. |
| May 2024 | Eventhouse GA | Eventhouse is a new, dynamic workspace hosting multiple KQL databases, generally available as part of Fabric Real-Time Intelligence. An Eventhouse offers a robust solution for managing and analyzing substantial volumes of real-time data. Get started with a guide to Create and manage an Eventhouse. |
| May 2024 | Copilot for Real-Time Intelligence | Copilot for Real-Time Intelligence is now in preview! For those who are already fans of KQL or newcomers exploring its potential, Copilot can help you get started, and navigate data with ease. |
| May 2024 | Automating Fabric items with Real-Time Intelligence | Learn how to interact with data pipelines, notebooks, spark jobs in a more event-driven way. |
| May 2024 | Real-Time Intelligence | This month includes the announcement of Real-Time Intelligence, the next evolution of Real-Time Analytics and Activator. |
| May 2024 | Real-Time Intelligence new preview features | At Build 2024, a dozen new features and capabilities were announced for Real-Time Intelligence, organized into categories of Ingest & Process, Analyze & Transform, and Visualize & Act. |
| May 2024 | Real-Time hub preview | Real-Time hub is single, tenant-wide, unified, logical place for streaming data-in-motion. It enables you to easily discover, ingest, manage, and consume data-in-motion from a wide variety of sources. It lists all the streams and Kusto Query Language (KQL) tables that you can directly act on. It also gives you an easy way to ingest streaming data from Microsoft products and Fabric events. For more information, see Real-Time hub overview. |
| May 2024 | Get Events preview | The Get Events experience allows users to connect to a wide range of sources directly from Real-Time hub, Eventstreams, Eventhouse, and Activator. Using Get Events, bring streaming data from Microsoft sources directly into Fabric with a first-class experience. |
| May 2024 | Enhanced Eventstream capabilities preview | With enhanced Eventstream capabilities, you can now stream data not only from Microsoft sources but also from other platforms like Google Cloud, Amazon Kinesis, Database change data capture streams, and more, using our new messaging connectors. |
| May 2024 | Eventstreams - enhanced capabilities preview | The preview of enhanced capabilities supports many new sources - Google Cloud Pub/Sub, Amazon Kinesis Data Streams, Confluent Cloud Kafka, Azure SQL Database Change Data Capture (CDC), PostgreSQL Database CDC, MySQL Database CDC, Azure Cosmos DB CDC, Azure Blob Storage events, and Fabric workspace item events, and a new Stream destination. It supports two distinct modes, Edit mode and Live view, in the visual designer. It also supports routing based on content in data streams. For more information, see What is Fabric eventstreams. |
| April 2024 | Kusto Cache consumption preview | The preview of Kusto Cache consumption means that you will start seeing billable consumption of the OneLake Cache Data Stored meter from the KQL Database and Eventhouse items. For more information, see KQL Database consumption. |
| April 2024 | Pause and Resume in Eventstream preview | The Pause and Resume feature enables you to pause data streaming from various sources and destinations within Eventstream. You can then resume data streaming seamlessly from the paused time or a customized time, ensuring no data loss. |
| March 2024 | New Expressions "Changes by", "Increases by", and "Decreases by" | In Activator, when setting conditions on a trigger, we've added syntax to allows you to detect when there's been a change in your data by absolute number or percentage. See New Expressions "Changes by", "Increases by", and "Decreases by". |
| March 2024 | Fabric Real-Time Intelligence Integrates with Newly Announced Database Watcher for Azure SQL | Users of Azure SQL can use the Database Watcher monitoring solution with Microsoft Fabric. Database Watcher for Azure SQL (preview) provides advanced monitoring capabilities, and can integrate with Eventhouse KQL database. |
| March 2024 | Update records in a KQL Database preview | The .update command is now available, as a preview feature. Learn more about how to Update records in a Kusto database. |
| March 2024 | Query Azure Data Explorer data from Queryset | Connecting to and using data in Azure Data explorer cluster from Fabric's KQL Queryset is now available. |
| February 2024 | Eventhouse Overview: Handling Real-Time Data with Microsoft Fabric | Eventhouse (preview) is a dynamic workspace hosting multiple KQL databases, part of Fabric Real-Time Intelligence. An Eventhouse offers a robust solution for managing and analyzing substantial volumes of real-time data. Get started with a guide to Create and manage an Eventhouse. |
| February 2024 | KQL DB shortcut to Delta Lake tables support name-based column mapping | KQL DB now supports reading Delta tables with column name mappings. The column mapping feature allows Delta table columns and the underlying Parquet file columns to use different names. This enables Delta schema evolution operations such on a Delta table without the need to rewrite the underlying Parquet files and allows users to name Delta table columns by using characters that aren't allowed by Parquet. |
| February 2024 | KQL DB shortcut to Delta Lake tables support deletion vectors | KQL DB can now read delta tables with deletion vectors, resolving the current table state by applying the deletions noted by deletion vectors to the most recent table version. |
| February 2024 | Get Data in KQL DB now supports processing events before ingestion via Eventstream | The Process event before ingestion in Eventstream option enables you to process the data before it's ingested into the destination table. By selecting this option, the get data process seamlessly continues in Eventstream, with the destination table and data source details automatically populated. |
| February 2024 | KQL DB now supports data ingestion using Apache Flink | Using the open-source Flink connector, you can send data from Flink to your table. Using Azure Data Explorer and Apache Flink, you can build fast and scalable applications targeting data driven scenarios. |
| February 2024 | Route data from Splunk Universal Forwarder to KQL DB using Kusto Splunk Universal Connector | You can now use the Kusto Splunk Universal Connector to send data from Splunk Universal Forwarder to a table in your KQL DB. |
Real-Time Intelligence samples and guidance
| Month | Feature | Learn more |
|---|---|---|
| February 2025 | Operational Reporting with Microsoft Fabric Real-Time Intelligence | This architecture blog details how you can report faster than a typical modern data warehouse with Fabric Real-Time Intelligence. |
| February 2025 | Real-Time Intelligence End-to-End Sample | As a demonstration of an RTI end-to-end scenario, we've created Fabric Notebook that can deploy this in a matter of minutes. For more information, see RTI End-to-End Sample. |
| February 2025 | Template dashboards for Workspace Monitoring | Ready-to-use Power BI and real-time dashboard template reports are available for workspace monitoring in Microsoft Fabric. |
| January 2025 | Efficient log management with Microsoft Fabric | For a tutorial and walkthrough of efficient log files collection processing and analysis with Real-Time Intelligence, read this new blog post on Efficient log management with Microsoft Fabric. |
| December 2024 | Automate Real-Time Intelligence Eventstream deployment using PowerShell | Learn how to build a PowerShell script to automate the deployment of Eventstream with the definition of source, processing, and destination into a workspace in Microsoft Fabric. |
| December 2024 | Monitor Fabric Spark applications using Fabric Real-Time Intelligence | Learn how to build a centralized Spark monitoring solution, leveraging Fabric Real-Time Intelligence. To do this, integrate a Fabric Spark data emitter directly with Fabric Eventstream and Eventhouse to build a centralized Spark monitoring solution. |
| December 2024 | Easily recreate your ADX dashboards as Real-Time Dashboards | You can bring ADX dashboards into Microsoft Fabric without relocating your data. Learn how to create Real-Time Dashboards as copies of your ADX dashboards in Fabric. |
| December 2024 | Enhance fraud detection with Activator | Activator allows you to monitor events, detect certain conditions on your data and act on them by sending alerts. Learn how to implement a system that sends teams or email alerts when a transaction is flagged as potentially fraudulent. |
| December 2024 | Manual Migration needed for Activator preview items | If you created an item while Activator was in preview, you'll need to manually migrate these items to GA to get access to all the new features. |
| December 2024 | Understanding Real-Time Intelligence usage reporting and billing | Learn about Real-Time Intelligence Eventstream, Eventhouse, storage, Fabric Events and Activator consumption utilization, capacity meters, and costs. |
| August 2024 | Advanced Time Series Anomaly Detector in Fabric | Read an example using the time-series-anomaly-detector in Fabric to upload stocks change table to Fabric, train the multivariate anomaly detection model in a Python notebook using Spark engine, and predict anomalies by applying the trained model to new data using Eventhouse (Kusto) engine. |
| August 2024 | Acting on Real-Time data using custom actions with Activator | Learn how to monitor and acting on data is to use Activator, which is a no-code experience in Microsoft Fabric for taking action automatically when the condition of the package temperature is detected in the data. |
| July 2024 | Build real-time order notifications with Eventstream's CDC connector | Read about a a real-life example of how an online store used Eventstream's CDC connector from Azure SQL Database. |
| July 2024 | Automating Real-Time Intelligence Eventhouse deployment using PowerShell | Let's build a PowerShell script to automate the deployment of Eventhouse, KQL Database, Tables, Functions, and Materialized Views into a workspace in Microsoft Fabric. |
| June 2024 | Power BI Admin portal Usage metrics dashboard retirement | Effective July 2024, the Power BI Admin portal Usage metrics dashboard is removed. Comparable insights are now supported out-of-the-box through the Admin monitoring workspace (preview). The Admin monitoring workspace provides several Power BI reports and semantic models, including the Feature Usage and Adoption report which focuses on Fabric tenant inventory and audit activity monitoring. |
| May 2024 | Alerting and acting on data from the Real-Time hub | Microsoft Fabric's new Real-Time hub and Activator provide a no-code experience for automatically taking actions when patterns or conditions are detected in changing data and is embedded around the Real-Time hub to make creating alerts always accessible. |
| May 2024 | Using APIs with Fabric Real-Time Intelligence: Eventhouse and KQL DB | Learn how to create/update/delete items in Fabric with the KQL APIs, accessing the data plane of a resource. |
| May 2024 | Connect and stream events with the Get events experience | The Get events experience streamlines the process of browsing and searching for sources and streams. |
| May 2024 | Acquiring Real-Time Data from New Sources with Enhanced Eventstream | Learn how to connect to new sources in Eventstream. Start by creating an eventstream and choosing "Enhanced Capabilities (preview)". |
| March 2024 | Browse Azure resources with Get Data | Learn how to browse and connect to all your Azure resources with the 'browse Azure' functionality in Get Data. You can browse Azure resources then connect to Synapse, blob storage, or ADLS Gen2 resources easily. |
Microsoft Fabric platform features
Archived news and feature announcements about the Microsoft Fabric platform experience.
| Month | Feature | Learn more |
|---|---|---|
| March 2025 | Terraform provider GA | The Terraform Provider for Microsoft Fabric is now generally available, enabling seamless infrastructure management and automation. For more information, use cases, and benefits, see Terraform Provider for Microsoft Fabric (Generally Available). |
| March 2025 | Load Fabric OneLake Data in Excel | Easily load Fabric OneLake data into Excel with integrated OneLake catalog and modern Get Data experience (preview). For more information and steps to get started, see OneLake catalog and Get Data are integrated into Excel for Windows. |
| March 2025 | Empowering agentic AI | Integrating Fabric with Azure AI Foundry enables businesses to create custom conversational AI agents leveraging domain expertise. For more information, see Empowering Agentic AI by Integrating Fabric with Azure AI Foundry. |
| March 2025 | External data sharing enhancements | External data sharing enables Fabric users to seamlessly share data across tenant boundaries while maintaining a single logical copy. Learn about service principal support for the external data sharing API and upcoming improvements. |
| February 2025 | Capacities Management APIs | Learn more about a new set of ARM APIs for comprehensive management of Fabric capacities. |
| February 2025 | Cross-region deployments | Fabric Deployment pipelines APIs now include a new feature for managing cross-region deployments. |
| February 2025 | Admin API updates and upcoming definition changes | SPN/MI support for Admin APIs and new GET/POST Admin APIs have been announced, among other changes and performance updates to Fabric Admin APIs. |
| February 2025 | TLS deprecation for Fabric | Fabric Platform support for Transport Layer Security (TLS) 1.1 and earlier versions will end on July 31, 2025. For more information, see Deprecating TLS 1.0 and 1.1 in Power BI. |
| February 2025 | Microsoft Fabric Quotas | Microsoft Fabric Quotas are a new feature designed to control resource governance for the acquisition of your Microsoft Fabric capacities. Fabric quotas aimed at helping customers ensure that Fabric resources are used efficiently and help manage the overall performance and reliability of the Azure platform while preventing misuse. |
| February 2025 | Fabric Catalyst Portal | The Fabric Catalyst Portal is collaborative knowledge hub designed to empower our partners with best practices, technical guidance, and real-world insights to accelerate Microsoft Fabric adoption. Registration for Microsoft partners is open. The first guidance is focused on Real-Time Intelligence. |
| February 2025 | How can I decide which protection method to use to protect my sensitive data in Fabric? | Learn more about when to use Purview DLP restrict access vs. Purview Protection Policies? Learn more about different protection options in Fabric. |
| February 2025 | Understanding GraphQL API error handling | Learn more about error handling in GraphQL and some best practices for managing errors effectively. |
| February 2025 | Billing for Workspace monitoring | Workspace Monitoring (preview) is an observability feature within Fabric that enables monitoring capabilities. For more information, see Announcing preview of workspace monitoring. Billing for this feature starts March 10, 2025. |
| January 2025 | Building Apps with Microsoft Fabric API for GraphQL | Microsoft Fabric has an API for GraphQL to build your data applications, enabling you to pull data from sources such as Data Warehouses, Lakehouse, Mirrored Databases, and DataMart in Microsoft Fabric. |
| January 2025 | Power BI Embedded with Direct Lake Mode (Preview) | Power BI Embedded with Direct Lake Mode is designed to enhance how developers and Independent Software Vendors (ISVs) provide embedded analytics in their applications. For more information, see Introducing Power BI Embedded with Direct Lake Mode (Preview). |
| January 2025 | Fabric Copilot capacity: Democratizing AI usage in Microsoft Fabric | Fabric Copilot capacity us a new billing feature designed to enhance your experience with Microsoft Fabric. With Fabric Copilot capacities, capacity admins can give Copilot access to end users directly, rather than requiring creators to move their content into a specific workspace or link a specific capacity. |
| January 2025 | Efficient log management with Microsoft Fabric | For a tutorial and walkthrough of efficient log files collection processing and analysis with Real-Time Intelligence, read this new blog post on Efficient log management with Microsoft Fabric. |
| January 2025 | Surge protection (preview) | With surge protection (preview), capacity admins can set limits on background usage within a capacity. Learn more about surge protection to help protect capacities from excess usage by background workloads. |
| December 2024 | Microsoft Fabric approved as a Service within the FedRAMP High Authorization for Azure Commercial | Microsoft Fabric is now included within the US Federal Risk and Authorization Management Program (FedRAMP) High Authorization for Azure Commercial. This Provisional Authorization to Operate (P-ATO) within the existing FedRAMP High Azure Commercial environment was approved by the FedRAMP Joint Authorization Board (JAB). |
| December 2024 | Folder in Workspace | As an organizational unit, the workspace folder addresses this pain point by providing a hierarchical structure for organizing and managing your items. This feature is now generally available, and includes new filter features. For more information, see Create folders in workspaces. |
| November 2024 | Workspace monitoring (preview) | Workspace monitoring (preview) is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring. |
| November 2024 | OneLake external data sharing (GA) | External data sharing in Microsoft Fabric, now generally available, makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant. |
| November 2024 | GraphQL API in Microsoft Fabric GA | The API for GraphQL, now generally available, is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL? |
| November 2024 | The new OneLake catalog | The OneLake catalog is the next evolution of the OneLake data hub. For more information about the new catalog, Discover and explore Fabric items in the OneLake catalog. |
| November 2024 | Fabric workload dev kit (GA) | The Microsoft Fabric workload development kit is now generally available. This robust developer toolkit is for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs. |
| November 2024 | Domains in Fabric – new enhancements | Review new features and use cases for Domains in Fabric, including Best practices for planning and creating domains in Microsoft Fabric. |
| October 2024 | New Item panel in Workspace | Previously, by selecting +New in the workspace, you can access a dropdown menu with some pre-defined item types to get started. Now, the +New item button shows item types listed in a panel, categorized by tasks. |
| October 2024 | Enhanced Tenant Setting Delegation for Export Controls | Delegation of export settings is now available to workspaces via domain. This new capability provides more granular control over data export permissions, addressing the specific needs of tenant, domain, and workspace administrators. |
| October 2024 | APIs for Managed Private Endpoint are now available | REST APIs for managed Private Endpoints are available. You can now create, delete, get, and list Managed private endpoints via APIs. |
| October 2024 | Important billing updates coming to Copilot and AI in Fabric | Upcoming pricing and billing updates to make Copilot and AI features in Fabric more accessible and cost-effective. |
| August 2024 | OneLake data access role improvements | Based on key feedback, we've updated data access roles with a user interface redesign. For more information, see Get started with OneLake data access roles (preview). |
| August 2024 | Workspace filter improvement to support nested folders | We have upgraded the filter experience to support filtering through the entire workspace or through a specific folder with all its nested folders. |
| August 2024 | Announcing the availability of Trusted workspace access and Managed private endpoints in any Fabric capacity | Use Trusted workspace access and Managed Private endpoints in Fabric with any F capacity and enjoy the benefits of secure and optimized data access and connectivity. |
| July 2024 | SOC certification compliance | We are excited to announce that Microsoft Fabric, our all-in-one analytics solution for enterprises, is now System and Organization Controls (SOC) 1 Type II, SOC 2 Type II, and SOC 3 compliant. |
| July 2024 | Microsoft Fabric .NET SDK | We are excited to announce the very first release of the Microsoft Fabric .NET SDK! For more information on the REST API documentation, see Microsoft Fabric REST API documentation. |
| May 2024 | Microsoft Fabric Private Links GA | Azure Private Link for Microsoft Fabric secures access to your sensitive data in Microsoft Fabric by providing network isolation and applying required controls on your inbound network traffic. For more information, see Announcing General Availability of Fabric Private Links. |
| May 2024 | Trusted workspace access GA | Trusted workspace access in OneLake shortcuts is now generally available. You can now create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts using Trusted workspace access (preview) in your Fabric Data Pipelines. Use the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. Trusted workspace access also enables secure and seamless access to ADLS Gen2 storage accounts from OneLake shortcuts in Fabric. |
| May 2024 | Fabric APIs walkthrough | Learn about using REST APIs in Fabric, including creating workspaces, adding permission, dropping, creating, executing data pipelines, and how to pause/resume Fabric activities using the management API. |
| May 2024 | Managed private endpoints GA | Managed private endpoints for Microsoft Fabric allow secure connections over managed virtual networks to data sources that are behind a firewall or not accessible from the public internet. For more information, see Announcing General Availability of Fabric Private Links, Trusted Workspace Access, and Managed Private Endpoints. |
| May 2024 | Fabric UX System | The Fabric UX System represents a leap forward in design consistency and extensibility for Microsoft Fabric. |
| May 2024 | Microsoft Fabric Core REST APIs | Microsoft Fabric Core APIs are now generally available. The Fabric user APIs are a major enabler for both enterprises and partners to use Microsoft Fabric as they enable end-to-end fully automated interaction with the service, enable integration of Microsoft Fabric into external web applications, and generally enable customers and partners to scale their solutions more easily. |
| May 2024 | Microsoft Fabric Admin APIs preview | Fabric Admin APIs are designed to streamline administrative tasks. Now, you can manage both Power BI and the new Fabric items (previously referred to as artifacts) using the same set of APIs. Before this enhancement, you had to navigate using two different APIs—one for Power BI items and another for new Fabric items. |
| May 2024 | Fabric workload dev kit (preview) | The Microsoft Fabric workload development kit extends to additional workloads and offers a robust developer toolkit for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs. |
| May 2024 | Introducing external data sharing (preview) | External Data Sharing (preview) is a new feature that makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant. |
| May 2024 | Task flows in Microsoft Fabric (preview) | The preview of task flows in Microsoft Fabric is enabled for all Microsoft Fabric users. With Fabric task flows, when designing a data project, you no longer need to use a whiteboard to sketch out the different parts of the project and their interrelationships. Instead, you can use a task flow to build and bring this key information into the project itself. |
| May 2024 | Power BI: Subscriptions, licenses, and trials | Information on Power BI implementation planning and key considerations for planning subscriptions, licenses, and trials for Power BI and Fabric. |
| May 2024 | Register for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge | Starting May 21, 2024, sign up for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge and prepare for Exam DP-600 and upskill to the Fabric Analytics Engineer Associate certification. |
| March 2024 | Microsoft Fabric is now HIPAA compliant | We are excited to announce that Microsoft Fabric, our all-in-one analytics solution for enterprises, has achieved new certifications for HIPAA and ISO 27017, ISO 27018, ISO 27001, ISO 27701. |
| March 2024 | Folder in Workspace preview | As an organizational unit in the workspace, folder addresses this pain point by providing a hierarchical structure for organizing and managing your items. For more information, see Create folders in workspaces (preview). |
| March 2024 | Fabric Copilot Pricing: An End-to-End example | Copilot in Fabric begins billing on March 1, 2024 as part of your existing Power BI Premium or Fabric Capacity. Learn how Fabric Copilot usage is calculated. |
| March 2024 | Capacity Platform Updates for Pause/Resume, Capacity Metrics, virtualized items and workspaces for Copilot, and VNET Gateways | The Fabric Capacity Platform now supports usage reporting for Pause/Resume, virtualized items and workspaces supporting Copilot, Capacity Metrics, and VNET Gateway. For more information, read Capacity Platform Updates for Pause Resume and Capacity Metrics for Copilot and VNET Gateways. |
| February 2024 | Managed private endpoints for Microsoft Fabric (Preview) | Managed private endpoints for Microsoft Fabric (preview) allow secure connections to data sources that are behind a firewall or not accessible from the public internet. Workspaces with managed private endpoints have network isolation through a managed virtual network created by Microsoft Fabric. For more information, see Introducing Managed private endpoints for Microsoft Fabric preview. |
| February 2024 | Azure Private Link Support for Microsoft Fabric (Preview) | Azure Private Link for Microsoft Fabric secures access to your sensitive data in Microsoft Fabric by providing network isolation and applying required controls on your inbound network traffic. For more information, see Announcing Azure Private Link Support for Microsoft Fabric in Preview. |
| February 2024 | Domains in OneLake (preview) | Domains in OneLake help you organize your data into a logical data mesh, allowing federated governance and optimizing for business needs. You can now create sub domains, default domains for users, and move workspaces between domains. For more information, see Fabric domains. |
| February 2024 | Customizable Fabric navigation bar | You can now customize your preferred entry points in the navigation bar, including pinning common entry points and unpinning rarely used options. |
| February 2024 | Persistent filters in workspace | You can now save selected filters in workspace list view, and they'll be automatically applied the next time you open the workspace. |
Continuous Integration/Continuous Delivery (CI/CD) in Microsoft Fabric
This section includes guidance and documentation updates on development process, tools, and versioning in the Microsoft Fabric workspace.
| Month | Feature | Learn more |
|---|---|---|
| February 2025 | Fabric CI/CD Python library Deployment Tool | The Fabric CI/CD Python library fabric-cicd is an open-source solution based on our experience using Fabric as the backbone of our platform. |
| November 2024 | Microsoft Fabric REST APIs Integration with GitHub | These APIs enable you to automate Git integration tasks, such as connecting to GitHub, retrieving connection details, committing changes to your connected GitHub repository, updating from the repository, and more. For more information, see Automate Git integration by using APIs and code samples. |
| November 2024 | Data Factory Copy Job – CI/CD now available | CI/CD for Copy job (preview) in Data Factory in Microsoft Fabric is now available. Copy Job now supports Git Integration and Deployment Pipeline. |
| July 2024 | GitHub integration for source control (preview) | Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see Get started with Git integration (preview). |
| July 2024 | Microsoft Fabric .NET SDK | We are excited to announce the very first release of the Microsoft Fabric .NET SDK! For more information on the REST API documentation, see Microsoft Fabric REST API documentation. |
| June 2024 | Introducing New Branching Capabilities in Fabric Git Integration | New branching capabilities in Fabric Git integration include a redesigned Source Control pane, the ability to quickly create a new connected workspace and branch, and contextual related branches to find content related to the current workspace. |
| May 2024 | Deployment pipelines APIs for CI/CD | Fabric deployment pipelines APIs have been introduced, starting with the 'Deploy' API, which will allow you to deploy the entire workspace, or only selected items. |
| May 2024 | New items in Fabric CI/CD | Data pipelines, Warehouse, Spark, and Spark jobs are now available for CI/CD in git integration and deployment pipelines. |
| April 2024 | Introducing Trusted Workspace Access in Fabric Data Pipelines | Create data pipelines in Fabric to access your firewall-enabled ADLS Gen2 storage accounts with ease and security. This feature leverages the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. |
| March 2024 | CI/CD for Fabric Data Pipelines preview | Git Integration and integration with built-in Deployment Pipelines to Data Factory data pipelines is now in preview. For more information, see Data Factory Adds CI/CD to Fabric Data Pipelines. |
| March 2024 | System file updates for Git integration | The automatically generated system files item.metadata.json and item.config.json have been consolidated into a single system file .platform. For more information, see Automatically generated system files. |
| February 2024 | REST APIs for Fabric Git integration | REST APIs for Fabric Git integration enable seamless incorporation of Fabric Git integration into your team's end-to-end CI/CD pipeline, eliminating the need for manual triggering of actions from Fabric. |
| February 2024 | Delegation for Git integration settings | To enable more control over Git related settings, a tenant admin can now delegate these settings to both capacity admins and workspace admins via the What is the admin portal? |
Continuous Integration/Continuous Delivery (CI/CD) samples
| Month | Feature | Learn more |
|---|---|---|
| September 2024 | GitHub integration for source control | Now generally available, Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see What is Microsoft Fabric Git integration? |
| September 2024 | New Deployment Pipelines design | A new and improved design for the Deployment Pipeline introduces a range of changes, additions, and improvements designed to elevate your deployment process. Read more about What's changed in deployment pipelines. |
| August 2024 | Exploration of Microsoft Fabric's CI/CD Features | A guided tour of Microsoft Fabric's CI/CD features for data pipelines, lakehouse, notebooks, reports, and semantic models. |
| June 2024 | Getting started with development in isolation using a Private Workspace | In this walkthrough, we'll talk about how to set up git for a private workspace from a main branch, which is connected to a shared dev team workspace and then how to commit changes from the private workspace into the main branch of the shared workspace. |
| March 2024 | Microsoft Fabric Lifecycle Management – Getting started with Git Integration and Deployment Pipelines | Learn the essentials of Lifecycle Management through a demo scenario, and explore what Lifecycle Management is, and what it means in Fabric. |
Fabric and Microsoft 365
This section includes articles and announcements about Microsoft Fabric integration with Microsoft Graph and Microsoft 365.
| Month | Feature | Learn more |
|---|---|---|
| March 2024 | Analyze Dataverse tables from Microsoft Fabric | When creating a shortcut within Fabric, you will now see an option for Dataverse. When you choose this shortcut type and specify your Dataverse environment details, you can quickly see and work with the tables from that environment. |
Migration
This section includes guidance and documentation updates on migration to Microsoft Fabric.
| Month | Feature | Learn more |
|---|---|---|
| February 2024 | Mapping Azure Synapse dedicated SQL pools to Fabric data warehouse compute | Read for guidance on mapping Data Warehouse Units (DWU) from Azure Synapse Analytics dedicated SQL pool to an approximate equivalent number of Fabric Capacity Units (CU). |
Monitor
This section includes guidance and documentation updates on monitoring your Microsoft Fabric capacity and utilization, including the Monitoring hub.
| Month | Feature | Learn more |
|---|---|---|
| March 2024 | Capacity Metrics support for Pause and Resume | Fabric Capacity Metrics has been updated with new system events and reconciliation logic to simplify analysis of paused capacities. Fabric Pause and Resume is a capacity management feature that lets you pause F SKU capacities to manage costs. When your capacity isn't operational, you can pause it to enable cost savings and then later, when you want to resume work on your capacity you can reactivate it. |
Related content
- Modernization Best Practices and Reusable Assets Blog
- Azure Data Explorer Blog
- Get started with Microsoft Fabric
- Microsoft Training Learning Paths for Fabric
- End-to-end tutorials in Microsoft Fabric
- Fabric Known Issues
- Microsoft Fabric Blog
- Microsoft Fabric terminology
- What's new in Power BI?
- What's new in Microsoft Fabric?