735 questions with Azure Event Hubs tags

Sort by: Updated
Updated Created Answers
1 answer One of the answers was accepted by the question author.

About Event Hubs TU's and Hubs

Hi, I was wondering how Hubs map to TU's in an Event Hubs Namespace. Let's supose I have two Hubs in the namespace, and namespace with two TU's Does it implies that each Hub has one TU's? or how is the mapping? Regards

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-08-11T14:55:58.9433333+00:00
Jona 885 Reputation points
accepted 2025-08-11T19:00:20.4133333+00:00
Jona 885 Reputation points
1 answer

Can I connect to event hub with SCRAM_SHA_256? (Java)

Hi, with a producer config like: bootstrap.servers=example.servicebus.windows.net:9093 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-256 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-08-08T09:12:39.0966667+00:00
max allan 0 Reputation points
commented 2025-08-11T11:50:57.6733333+00:00
Venkat Reddy Navari 5,330 Reputation points Microsoft External Staff Moderator
0 answers

I am attempting to setup azure event hubs and using my E5 license, but am getting the error message below.

I am attempting to setup azure event hubs and using my E5 license, but am getting the error message below. In order to export Sign-in data, your organization needs Azure AD P1 or P2 license. If you don't have a P1 or P2, start a free trial.

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-08-06T17:43:08.6633333+00:00
Affinitas Technology Solutions 0 Reputation points
commented 2025-08-07T17:42:22.0933333+00:00
Smaran Thoomu 28,310 Reputation points Microsoft External Staff Moderator
1 answer

Offset Alignment Between DB2 Snapshot and Kafka Catch-Up Phase

In our current CDC-based migration project, we are moving data from on-prem IBM DB2 to Azure SQL Hyperscale using a hybrid approach that involves: A FlashCopy-based historical snapshot A bounded CDC Catch-Up phase (Kafka) Followed by real-time CDC…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-31T08:37:47.2766667+00:00
Janice Chi 580 Reputation points
commented 2025-08-05T17:16:22.08+00:00
Smaran Thoomu 28,310 Reputation points Microsoft External Staff Moderator
1 answer

Real-time Reconciliation Between Live DB2 and Azure SQL in CDC Streaming

Question: We’re ingesting CDC data from IBM DB2 into Azure SQL Hyperscale via Kafka + Databricks Structured Streaming. Our challenge is reconciling live DB2 tables with their corresponding Hyperscale rows. Since DB2 is a live system, a row may be…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-31T08:06:28.55+00:00
Janice Chi 580 Reputation points
commented 2025-08-04T12:03:29.75+00:00
Smaran Thoomu 28,310 Reputation points Microsoft External Staff Moderator
1 answer

Kafka offset window from DB2 snapshot timestamp for commit-aware CDC Catch-Up

Question: In our CDC ingestion pipeline, IBM CDC pushes change data from DB2 to Kafka, and we initiate the Catch-Up phase by aligning with the DB2 snapshot timestamp. To ensure accurate commit-aware reconciliation, we need to extract a precise Kafka…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-31T14:34:36.3866667+00:00
Janice Chi 580 Reputation points
commented 2025-08-04T10:43:51.3233333+00:00
Venkat Reddy Navari 5,330 Reputation points Microsoft External Staff Moderator
2 answers

MULTIJSON data format missing when creating a Data Explorer data connection in the Azure Portal

When creating a data connection from ADX/Kusto to EventHub, I would like to choose the MULTIJSON data format. If I recall correctly, this option was available in the Azure Portal, but there is only the JSON format now (see screenshot). The docs still…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
585 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2023-11-01T20:42:29.5433333+00:00
Anonymous
commented 2025-08-01T19:13:35.1833333+00:00
Morais, Nelson 5 Reputation points
1 answer One of the answers was accepted by the question author.

About Event Hubs Autoinflate

Hi, I'm testing de Auto Inflate feature of EVent Hubs. I sending workloads to Event Hubs via REST API to saturate it and see the inflation process. Docs tell me that logs expresses the reason why and when inflation takes…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-30T16:06:05.9466667+00:00
Jona 885 Reputation points
accepted 2025-08-01T14:42:35.0933333+00:00
Jona 885 Reputation points
2 answers

Connect to eventhub using Managed service identity (MSI) from Azure synapse analytics

I am trying to write the data to azure eventhubs from the azure synapse analytics notebook in scala using Managed service identity (MSI). Can you please help me with code for that. Note that i was able to successfully connect using the SAS key.

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,422 questions
asked 2024-07-24T00:29:21.13+00:00
Dheeraj Kumar Reddy Jogi 21 Reputation points Microsoft Employee
commented 2025-08-01T11:27:50.22+00:00
Narendra Bestha 0 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

Azure Event Hub - amqp:connection:forced - The connection was closed by container because it did not have any active links in the past 60000 milliseconds

Hi, I'm facing a trouble with the Azure Event hub SDK for python. I'm running an Event hub client producer that streams data this way, in buffer mode this way: async def on_error(events, partition_id, error): logger.error(f"Error sending…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-29T20:27:09.4266667+00:00
Augusto Piva 55 Reputation points
accepted 2025-07-31T10:51:43.7566667+00:00
Augusto Piva 55 Reputation points
1 answer

EventHub Consumer Callback Not Triggered for Existing Messages Without New Arrivals

I'm experiencing an issue with Azure EventHub Python consumer where the on_event callback is not triggered for existing messages unless new messages arrive during the consumer session. Technical Details Service: Azure Event Hubs SDK: azure-eventhub…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-25T07:06:58.9266667+00:00
Amine HAJ KHLIFA 0 Reputation points
commented 2025-07-31T06:55:43.33+00:00
Pratyush Vashistha 975 Reputation points Microsoft External Staff Moderator
1 answer

Kafka CDC Topic Does Not Include Primary Key or Full Row

In our current Azure migration project, we are processing CDC events from IBM DB2 into Kafka using IBM CDC engine. However, for certain DB2 tables: There is no primary key defined in the source table. Kafka CDC topics do not include a full-row image —…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-27T16:00:22.3566667+00:00
Janice Chi 580 Reputation points
answered 2025-07-28T03:34:42.09+00:00
Venkat Reddy Navari 5,330 Reputation points Microsoft External Staff Moderator
1 answer

How to get real-time data from a SQL Server running on a Self-Hosted VM?

I have a SQL server running on a VM (which is Self-hosted and not managed by any cloud). Database and table which I want to use have CDC enabled on them. I want to have those tables data into KQL DB as real-time only. No batch or incremental load. I…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-06-03T08:25:46.22+00:00
Agrawal, Pranjal 0 Reputation points
commented 2025-07-02T10:49:11.0066667+00:00
Smaran Thoomu 28,310 Reputation points Microsoft External Staff Moderator
1 answer

Graph Api create subscription returns Status Code: BadRequest; Reason: The value 'https://outlook.office365.com/api/v2.0/Users('Sandbox%40company.com')/Events' of parameter 'Resource' is invalid.]\n\nPOST

In our java springboot app we use dependency https://mvnrepository.com/artifact/com.microsoft.graph/microsoft-graph/5.72.0 When we try to create eventhub subscription for meeting room via that API we are getting…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-06-27T14:12:45.7933333+00:00
Mikhail 1 Reputation point
answered 2025-07-03T16:11:46.8366667+00:00
Mikhail 1 Reputation point
1 answer

Azure Function (Python) with Event Hub trigger: is there a maximum input batch size beyond configuration settings?

I'm using an Azure Function App in Python with an Event Hub trigger and have set cardinality=many to receive events in a batch. For sending to Event Hub, I'm aware there's a hard limit on the batch size (e.g., based on total message size). But for…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-04T06:48:49.21+00:00
Wessel Vonk 45 Reputation points
commented 2025-07-09T18:32:38.9+00:00
Venkat Reddy Navari 5,330 Reputation points Microsoft External Staff Moderator
1 answer

Event Hub Trigger in Python Function: limits on total payload despite high batch size?

I'm using an Azure Function in Python with an Event Hub trigger and have configured maxEventBatchSize to a high value (e.g., 3000–5000). I understand that each individual outbound Event Hub Batch has a maximum size of 1 MB. My question is about inbound…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-07T08:54:53.7333333+00:00
Wessel Vonk 45 Reputation points
commented 2025-07-09T07:49:45.4533333+00:00
Smaran Thoomu 28,310 Reputation points Microsoft External Staff Moderator
1 answer

How can I increase Event Hubs number in Event Hubs Namespace beyond 10 without going into premium??

Due to architectural requirements, we would need to increase the number of event hubs in a namespace from 10 to 20. Switching to Premium is not being considered due to high cost (x100 in terms of monthly billing). Of course, two Event Hubs is also on the…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-10T16:19:21.3833333+00:00
Iñigo Martinez Lasala 0 Reputation points
commented 2025-07-11T18:41:39.6066667+00:00
Venkat Reddy Navari 5,330 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Find who is sending messages to my azure event hub

Hi Team, Wanted to understand where my event hub is being referenced and send/receive messages from other sources. i tried namespace name with code and configs and logs but could not find who is sending or receiving messages to my event hub. I could see…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-15T05:31:14.6533333+00:00
Seenuvasan Manoharan (Infosys Ltd) 20 Reputation points Microsoft External Staff
accepted 2025-07-17T05:22:34.96+00:00
Seenuvasan Manoharan (Infosys Ltd) 20 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

Query Regarding claiming discount for Exam

Hi, I recently completed my two days virtual training of AI Fundamentals and now trying to register myself for AI 900 certification exam. I suppose to get 50% discount since I actively attended two days virtual training session but exam portal still…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-16T18:12:44.8933333+00:00
Haris Ahmed 20 Reputation points
accepted 2025-07-17T23:21:08.59+00:00
Haris Ahmed 20 Reputation points
1 answer One of the answers was accepted by the question author.

As per Eventhub when firewall is set to disable public access, then eventhub ndpoint should not be accessible in public

As per Azure documentation when Eventhub is set to disable public access in EH firewall, then the endpoint should not be reachable or respond to pings or telnet from public internet. However I tried atleast with two eventhubs by disabling the public…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
735 questions
asked 2025-07-25T10:44:11.9666667+00:00
Vishnu Mullenkandy 40 Reputation points
commented 2025-07-25T14:30:23.8433333+00:00
Vishnu Mullenkandy 40 Reputation points