pyspark.streaming.DStream.mapPartitions

DStream.mapPartitions(f, preservesPartitioning=False)

Return a new DStream in which each RDD is generated by applying mapPartitions() to each RDDs of this DStream.

pyspark.streaming.DStream.map pyspark.streaming.DStream.mapPartitionsWithIndex