pyspark.streaming.DStream.join

DStream.join(other: pyspark.streaming.dstream.DStream[Tuple[K, U]], numPartitions: Optional[int] = None) → pyspark.streaming.dstream.DStream[Tuple[K, Tuple[V, U]]]

Return a new DStream by applying ‘join’ between RDDs of this DStream and other DStream.

Hash partitioning is used to generate the RDDs with numPartitions partitions.

pyspark.streaming.DStream.groupByKeyAndWindow pyspark.streaming.DStream.leftOuterJoin