Have you tried something like this:
myDataFrame.limit(10).toPandas()
See here and here. According to here you’d need Pandas installed and available. However, I’m unsure though what kernel they are referring to since the first SO post just says Jupyter or if pyspark and the spark kernel are different?