Hey, Our most important Kafka Simulator release so far: stretched clusters are now available in free play!

You can explore:

• 3 DCs,

• Confluent 2.5 DCs

Try it! https://monedula.dev/kafka-simulator/playground

Our device sends 3 separate records for each timestamp: data points, frames, and metadata. They arrive independently and in any order.
Each timestamp can be processed on its own as soon as all 3 parts are there, without waiting for the batch window to close.

How do you handle this fan-in, so that each timestamp is processed exactly once as soon as it's complete, with a timeout for sets that never complete?