pyspark.sql.SparkSession.newSession

SparkSession.newSession() → pyspark.sql.session.SparkSession

Returns a new SparkSession as new session, that has separate SQLConf, registered temporary views and UDFs, but shared SparkContext and table cache.

New in version 2.0.0.

Returns

SparkSession

Spark session if an active session exists for the current thread

Examples

>>> spark.newSession()
<...SparkSession object ...>

pyspark.sql.SparkSession.getActiveSession pyspark.sql.SparkSession.range