Hi @Guusje
Will the PARTITION BY PartitionId statement still ensure parallel processing (and make sure that input partition = output partition) for compatibility level 1.2 when we don't specify a partition key column?
Yes, in compatibility level 1.2, PARTITION BY PartitionId still ensures partition-aware parallel processing and maintains partition affinity between input and output, even if you don't specify a partition key column. As long as all inputs and the output Event Hub have the same number of partitions, and PartitionId is used consistently in the query, messages from input partition X will be routed to output partition X.
https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parallelization
is it a problem that we use compatibility level 1.2?
No, it's not an issue. Compatibility level 1.2 fully supports PARTITION BY PartitionId for enabling partition-aware parallelism. In fact, this level brings performance enhancements and continues to support partitioned processing when implemented properly.
https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-compatibility-level
In the documentation I read that PARTITION BY PartitionId is required for compatibility <1.2, however, does this still work for 1.2 or do we then need to set an partition key column?
PARTITION BY PartitionId still works as expected in compatibility level 1.2. You are not required to set a partition key column unless you want to partition by a custom key.Using PartitionId in your query ensures the system maintains partition alignment between input and output when the partition counts match.
Hope this helps. Do let us know if you any further queries.
If this answers your query, do click Accept Answer
and Yes
for was this answer helpful. And, if you have any further query do let us know.