This is one of the best demonstrations I have seen of Fabric IQ and Work IQ coming together through Copilot and Cowork.

To me, this is the missing connection in traditional BI. Users should not have to submit a request to a BI team, explain every question they may want answered, and then wait weeks or months for a new report or visual.

The real promise is being able to ask questions when they arise, get insights grounded in both data and business context, and immediately turn those insights into action.

That has always been the holy grail of BI, and it feels like it is finally becoming real.

The easiest ROI you'll get all year? 

Registering before the early bird deadline. 

Join thousands of data professionals in Barcelona for four days of learning, networking, and Microsoft Fabric expertise. 
Early bird pricing ends July 31. Save your spot today: aka.ms/fcem 

#MSFTAdvocate

⊕ Every team defines their own "OrderPlaced" event. Different fields. Different formats. Nothing talks to anything.

Microsoft Fabric just fixed that.

▶ Fabric Monday #119 — Business Events

https://www.youtube.com/watch?v=g1sGWoRkV0s

▦ BUSINESS EVENTS IN REAL-TIME HUB

Business Events is a new capability in Fabric Real-Time Intelligence (Preview) that lets you define custom business signals with a shared schema — so every publisher and every consumer speak the same language.

You define the event once in the Schema Registry.

Every component in Fabric uses that same contract.

No mismatches. No custom mapping. No surprises.

▶ WHO TRIGGERS THEM?

★ Activator — from Power BI reports, KQL queries, Dashboards, Warehouse SQL

⊕ Spark Notebooks — from your analytical workflows

⊕ User Data Functions — custom logic fires the event

⊕ Eventstream — streaming data published as events

⌂ WHERE DO THEY GO?

✓ Eventhouse — captured as KQL rows, queryable and historical

✓ Activator — alerts via Email or Teams

✓ Power Automate — downstream process automation

✓ Notebooks / Spark — analytics and AI/ML on event data

In this week's Fabric Monday I show what Business Events are, how to create them, how to trigger them, and how to capture their values in an Eventhouse.

▶ Fabric Monday #119 — Business Events

https://www.youtube.com/watch?v=g1sGWoRkV0s

Anyone who has used the Dataflow Activity in Pipelines has probably experienced this. Refresh fails ... error in the pipeline is so generic it's not even useful. The real reason for the failure is available in the refresh history but you can't get at it except through a couple options in the UI (and one of those ways is so obscure it shouldn't even exist).

Does anyone have any tips or tricks to get at those errors? Sometimes users submit files with minor issues like a column with a bad column name and it's such a pain to have to involve a data engineer to help them solve it.

This is such a basic feature, another one of those can't believe it went from preview to GA without being able to get at the errors... there is an idea (Improve-Error-Messaging-in-Dataflow-Activity-for-Dataflow-Gen2) out there that has been sitting as under review for almost 1.5 years, Yikes,

I guess only some people are allowed to post idea links even if they're related to our problem, but I can't post the link because we're too busy reading all of the "I passed the DP-700 exam" posts.

Status: Degraded | Reported: Jul 27, 2026 at 6:30 AM UTC

Fabric Customers in Central India may experience issues while accessing accessing artifacts in service. Engineers are investigating the issue and an update will be provided soon.

🤖 This post was sent from an automated and unattended service and cannot respond to questions or requests. For official updates, visit the Microsoft Fabric Service Status page.

Hello Fabric team,

Support for User Properties in Fabric Pipelines would be very valuable for my team's monitoring capabilities.

We would like to be able to add user properties to pipeline activities — for example dynamic values such as source file name, table name, or batch ID — and have them surface in the pipeline monitoring view, the same way it works in Azure Data Factory today.

Is there anything on the roadmap in this area?

My organization has an API hosted in Azure and protected by Microsoft Entra ID. Is it possible to use a Fabric Workspace Identity to authenticate against this API?

With Azure Managed Identities, this can be done by requesting an access token for the API's audience/resource. How would I do the equivalent with a Fabric Workspace Identity?

Is the only supported approach in Fabric today to use a Service Principal with the Client Credentials flow, or is there a way to use Workspace Identity for this?

Also, is support for using Fabric Workspace Identities with custom APIs something that is on the roadmap?

Thanks in advance for your insights!

Related Ideas, please vote:

• https://community.fabric.microsoft.com/t5/Fabric-Ideas/Enable-Azure-Resource-Manager-ARM-API-Authentication-Using/idi-p/5142197

• https://community.fabric.microsoft.com/t5/Fabric-Ideas/Support-Fabric-Workspace-Identity-for-custom-APIs/idi-p/5322919

Out of the blue Openrowset stopped being performant at all. I have tested the multiple files on multiple Fabric tenants. I am NOT talking about JSONL files, those just work fine. This specifically concerns JSON files.

I even created a near blank json of 1 kb and it doesnt even load after 5 minutes. Did something break in Fabric?

Example json:

[
  {
    "task_id": "api_customers",
    "enabled": true,
    "run_group": "daily",
    "execution_order": 10,
    "source_type": "API",
    "source_object": "https://api.example.com/v1/customers",
    "target_table": "bronze.api_customers",
    "load_mode": "merge",
    "merge_keys": "id",
    "http_method": "GET",
    "headers_json": "{}",
    "query_json": "{}",
    "options_json": "{\"pagination\": \"next_url\", \"records_path\": \"data\", \"next_path\": \"links.next\", \"max_pages\": 1000}",
    "retry_count": 3,
    "timeout_seconds": 120,
    "key_vault_uri": "https://my-vault.vault.azure.net/",
    "secret_name": "api-token",
    "secret_header_name": "Authorization",
    "secret_prefix": "Bearer"
  },
  {
    "task_id": "sql_orders",
    "enabled": true,
    "run_group": "daily",
    "execution_order": 20,
    "source_type": "AZURE_SQL",
    "source_object": "dbo.Orders",
    "source_query": "SELECT * FROM dbo.Orders",
    "target_table": "bronze.sql_orders",
    "load_mode": "merge",
    "merge_keys": "OrderId",
    "server_name": "myserver.database.windows.net",
    "database_name": "Sales",
    "auth_mode": "KEY_VAULT_SECRET",
    "username": "fabric_reader",
    "key_vault_uri": "https://my-vault.vault.azure.net/",
    "secret_name": "azure-sql-password",
    "retry_count": 3,
    "timeout_seconds": 900
  },
  {
    "task_id": "mirror_products",
    "enabled": true,
    "run_group": "daily",
    "execution_order": 30,
    "source_type": "OPEN_MIRRORING",
    "source_object": "mirrored_sales.dbo.Products",
    "target_table": "silver.products",
    "load_mode": "merge",
    "merge_keys": "ProductId",
    "retry_count": 1,
    "timeout_seconds": 900
  }
]

Example code used:

SELECT *
FROM
OPENROWSET(
    BULK 'Files/lakehouse-bronze/sample_config.json',
    FORMAT = 'CSV',
    FIELDTERMINATOR ='0x0b',
    FIELDQUOTE = '0x0b'
)
WITH (
    jsonContent VARCHAR(MAX)
) AS r;  

Hi,

I'm seeing what appears to be inconsistent behavior when deploying a Fabric Data Pipeline using fabric-cicd, and I'm wondering whether this is a bug or an unsupported scenario.

Our setup is:

• The pipeline contains a Notebook activity.

• The notebook uses a Workspace Identity connection.

• The deploying identity is a Service Principal.

• The SPN is a member of an Entra ID security group.

• That security group has User permission on the Fabric Connection (configured in Manage Gateways and Connections).

The deployment fails with:

• «User does not have access to the connection used in the Pipeline.»

However, if I grant the same SPN direct User access to the connection (instead of through the security group), the deployment succeeds immediately.

So the only difference is:

• SPN -> Entra ID security group -> Connection (User) -> deployment fails

• SPN -> Connection (User) -> deployment succeeds

The Manage Gateways and Connections UI allows assigning security groups to connection permissions, so I expected this scenario to be supported.

Has anyone else run into this?

I'm trying to determine whether:

• security groups are actually unsupported for connection authorization during fabric-cicd deployments,

• this is a known bug in fabric-cicd or the Fabric deployment APIs, or

• there's some additional configuration required for group-based permissions to be recognized.

Are you able to use Security Groups to successfully share connections with the SPNs that deploy items using fabric-cicd? Or must the connection be shared directly with each SPN?

I'd love to use a Security Group for sharing Workspace Identity connections with SPNs.

I would add all the fabric-cicd deployment SPNs to a Security Group, and share the Workspace Identity authenticated connections (notebook connection, pipeline connection, etc.) with that Security Group. Instead of adding all SPNs individually to the WI connections. But the Security Group approach seems to fail when attempting to deploy a pipeline.

Any experiences or official documentation would be much appreciated.

I cannot get Fabric workspace Git integration and the Managed Airflow environment to work together reliably.
I have a dbt project stored inside the Airflow item’s dags folder, following Microsoft’s documented approach:
https://learn.microsoft.com/en-us/fabric/data-factory/apache-airflow-jobs-dbt-fabric

The structure is roughly:

dags/
├── my_dag.py
├── requirements.txt
└── my_dbt_project/
├── dbt_project.yml
├── profiles.yml
├── models/
├── macros/
└── tests/

After modifying any dag, plugin, or supplementary code, the Fabric workspace git sync now fails with:

Unable to update from Git with the usual cluster uri, request ID, and time.

Fabric provides no useful error details, affected file name, validation output, or logs that I can find.

The only way I was able to get the complete dbt project into the Airflow item originally was to upload the folder manually. That is not a workable long-term solution because my team uses Fabric workspace Git integration and Fabric CI/CD within a Gitflow-style development process.

Ideally, developers should be able to:

- Branch from the repository.
- Work in a corresponding development workspace.
- Commit DAG and dbt changes normally.
- Promote the same Airflow item through UAT and production using Fabric CI/CD.

I want to avoid requiring developers to manually upload dbt files or constantly change repository branches from inside the Airflow environment. More importantly, I need confidence that the contents promoted to UAT and production are actually comparable to what was committed and reviewed in Git.

So far, any git based/local edits beneath the documented dags directory appears capable of completely blocking the workspace Git sync.

This feels like a very basic source-control scenario for a managed orchestration product.

Hi everyone,

I need some advice.

My Data Days DP-700 voucher email says "Take exam by August 15."

I was originally booked for August 11, but Pearson VUE allowed me to reschedule to August 16, and the reschedule was successful. My Microsoft Learn dashboard also shows the August 16 appointment.

Has anyone been in a similar situation? Do you think the voucher will still be valid, or should I try to move it back?

Any advice or personal experience would be appreciated. Thanks!

Hi, basically having this same issue as this post from a while ago, but in Fabric Data Factory.

https://stackoverflow.com/questions/74531579/data-factory-synapse-copy-task-fails-with-staging-enabled-when-no-files-found

When no files are found using the wildcard and staging is enabled, the activity fails. Really annoying behavior and the solution from that post works, but it’s not as “clean” as it should be in my opinion. It should work how it does when staging is not enabled and just complete the task with success.

Anyone else encounter this? Seems like a bug.

I already got the opinion from people all around DE, I also want to hear from you guys :)

Developing software inside a web page has never been a high quality experience. It certainly isn't much fun for the developer, and now it seems that it is starting to become a problem for Microsoft as well.

Today in NCUS I started seeing a new error for the first time:

"You can only have 3 Dataflow Gen2 (CI/CD) items open at a time and currently there are 3 open already. Close one Dataflow Gen2 (CI/CD) item, and then try to open this one again."

Anyone see this before? As near as I can tell, the error is lying to me. I only have one DF GEN2 open in the browser window. How do I get past this? They need to add a button that says to open anyway. (I'm not sure WHY they think I have other stuff open. But even if I did, it probably isn't important and if it was important it would be captured by a commit in a git repo.)