Apache Spark Spark Streaming

Question 1

What is the fundamental abstraction in Spark Structured Streaming?

Accepted Answer

Unbounded DataFrame/Dataset

Answer

DStream

Answer

RDD

Answer

StreamRDD

Question 2

What is a DStream in Spark Streaming?

Accepted Answer

A sequence of RDDs representing a continuous stream of data

Answer

A distributed stream of DataFrames

Answer

A real-time SQL query engine

Answer

A fault-tolerant message queue

Question 3

Which output mode in Structured Streaming writes only new rows added to the result table since the last trigger?

Accepted Answer

Append

Answer

Complete

Answer

Update

Answer

Incremental

Question 4

What is a watermark in Spark Structured Streaming?

Accepted Answer

A threshold defining the maximum allowed lateness for event-time data

Answer

A checkpoint marker for fault recovery

Answer

A memory limit for streaming aggregations

Answer

A trigger interval for micro-batch processing

Question 5

Which of the following is a valid trigger for Structured Streaming in Spark?

Accepted Answer

ProcessingTime trigger

Answer

EventTime trigger

Answer

BatchSize trigger

Answer

RowCount trigger

Question 6

In Spark Structured Streaming, which sink writes results to an in-memory table for interactive querying?

Accepted Answer

memory

Answer

console

Answer

file

Answer

foreach