Spark Streaming Flashcards
6 cards from real Apache Spark practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 6 Spark Streaming flashcards as text
What is the fundamental abstraction in Spark Structured Streaming?
Answer: Unbounded DataFrame/Dataset
Structured Streaming treats a live data stream as an unbounded table (DataFrame/Dataset) that is continuously appended.
What is a DStream in Spark Streaming?
Answer: A sequence of RDDs representing a continuous stream of data
A DStream (Discretized Stream) is a continuous sequence of RDDs, each representing data from a time interval.
Which output mode in Structured Streaming writes only new rows added to the result table since the last trigger?
Answer: Append
Append mode writes only new rows appended to the result table since the last trigger to the sink.
What is a watermark in Spark Structured Streaming?
Answer: A threshold defining the maximum allowed lateness for event-time data
A watermark specifies how late event-time data can be and still be included in the computation, allowing Spark to drop old state.
Which of the following is a valid trigger for Structured Streaming in Spark?
Answer: ProcessingTime trigger
ProcessingTime trigger runs micro-batches at a specified interval, e.g., Trigger.ProcessingTime('10 seconds').
In Spark Structured Streaming, which sink writes results to an in-memory table for interactive querying?
Answer: memory
The memory sink stores the output in-memory as a named table, suitable for testing and interactive queries.