Skip to content
Blame Permalink
  • Josh Rosen's avatar
    1381fc72
    Switch from MUTF8 to UTF8 in PySpark serializers. · 1381fc72
    Josh Rosen authored 
    This fixes SPARK-1043, a bug introduced in 0.9.0
where PySpark couldn't serialize strings > 64kB.

This fix was written by @tyro89 and @bouk in #512.
This commit squashes and rebases their pull request
in order to fix some merge conflicts.
    1381fc72
    Switch from MUTF8 to UTF8 in PySpark serializers.
    Josh Rosen authored 
    This fixes SPARK-1043, a bug introduced in 0.9.0
where PySpark couldn't serialize strings > 64kB.

This fix was written by @tyro89 and @bouk in #512.
This commit squashes and rebases their pull request
in order to fix some merge conflicts.