Spark Commands I can never rememberΒΆ

  • How to create a Spark Dataframe :

d = [{'name': 'Alice', 'age':20 },{'name': 'Bob', 'age':25 }]
spark.createDataFrame(d).show()