← All Apache Spark Flashcard Decks

Spark Streaming Flashcards

6 cards from real Apache Spark practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.

Read the first 6 Spark Streaming flashcards as text
  1. What is the fundamental abstraction in Spark Structured Streaming?

    Answer: Unbounded DataFrame/Dataset

    Structured Streaming treats a live data stream as an unbounded table (DataFrame/Dataset) that is continuously appended.

  2. What is a DStream in Spark Streaming?

    Answer: A sequence of RDDs representing a continuous stream of data

    A DStream (Discretized Stream) is a continuous sequence of RDDs, each representing data from a time interval.

  3. Which output mode in Structured Streaming writes only new rows added to the result table since the last trigger?

    Answer: Append

    Append mode writes only new rows appended to the result table since the last trigger to the sink.

  4. What is a watermark in Spark Structured Streaming?

    Answer: A threshold defining the maximum allowed lateness for event-time data

    A watermark specifies how late event-time data can be and still be included in the computation, allowing Spark to drop old state.

  5. Which of the following is a valid trigger for Structured Streaming in Spark?

    Answer: ProcessingTime trigger

    ProcessingTime trigger runs micro-batches at a specified interval, e.g., Trigger.ProcessingTime('10 seconds').

  6. In Spark Structured Streaming, which sink writes results to an in-memory table for interactive querying?

    Answer: memory

    The memory sink stores the output in-memory as a named table, suitable for testing and interactive queries.