What is the primary advantage of using Auto Loader over `spark.read` for cloud storage ingestion?
-
A
It supports more file formats than spark.read
-
B
It automatically identifies and processes only new files incrementally
-
C
It provides faster read speeds for all existing files
-
D
It automatically compresses ingested data before writing