Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You can configure Spark to use arrow for passing data between Java and Python via spark.sql.execution.arrow.pyspark.enabled but yes, Spark uses Java datatypes internally.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: