pyspark.sql.streaming.
StreamingQueryManager
A class to manage all the StreamingQuery StreamingQueries active.
StreamingQuery
New in version 2.0.0.
Notes
This API is evolving.
Methods
addListener(listener)
addListener
Register a StreamingQueryListener to receive up-calls for life cycle events of StreamingQuery.
StreamingQueryListener
awaitAnyTermination([timeout])
awaitAnyTermination
Wait until any of the queries on the associated SparkSession has terminated since the creation of the context, or since resetTerminated() was called.
resetTerminated()
get(id)
get
Returns an active query from this SparkSession.
SparkSession
removeListener(listener)
removeListener
Deregister a StreamingQueryListener.
resetTerminated
Forget about past terminated queries so that awaitAnyTermination() can be used again to wait for new terminations.
awaitAnyTermination()
Attributes
active
Returns a list of active queries associated with this SparkSession