Azure Real-Time and Batch Analytics Flashcards

What is the purpose of a partition key in Azure Event Hubs?

Answer: To route related events to the same partition, preserving order for that key

A partition key hashes to a specific partition, ensuring all events with the same key land in the same partition and are processed in order.

Which Azure HDInsight cluster type is optimized for real-time stream processing and message queuing?

Answer: Kafka

HDInsight Kafka provides a managed Apache Kafka cluster optimized for high-throughput, fault-tolerant real-time message streaming.

In Azure Stream Analytics, what does the WITH clause allow you to do?

Answer: Define named subqueries (CTEs) for reuse within the main query

The WITH clause in Stream Analytics defines named common table expressions (CTEs) that can be referenced multiple times in the main query to avoid duplication.

What is the purpose of Streaming Units (SUs) in Azure Stream Analytics?

Answer: They represent the compute resources (CPU and memory) allocated to a Stream Analytics job

Streaming Units represent the combined CPU and memory resources allocated to a Stream Analytics job, and scaling SUs increases processing throughput.

In Azure Databricks Structured Streaming, what does the checkpoint location do?

Answer: Tracks progress of a streaming query so it can resume from where it left off after a restart

The checkpoint location stores the streaming query's offset progress and state so it can recover and continue processing from the last committed offset after failure or restart.

What Azure service would you use to apply machine learning models to streaming data in real time without writing custom code?

Answer: Azure Stream Analytics with Azure Machine Learning integration

Azure Stream Analytics supports calling Azure Machine Learning web service endpoints directly within a streaming query to score events in real time.