Skip to content
Snippets Groups Projects
  • Josh Rosen's avatar
    1381fc72
    Switch from MUTF8 to UTF8 in PySpark serializers. · 1381fc72
    Josh Rosen authored
    This fixes SPARK-1043, a bug introduced in 0.9.0
    where PySpark couldn't serialize strings > 64kB.
    
    This fix was written by @tyro89 and @bouk in #512.
    This commit squashes and rebases their pull request
    in order to fix some merge conflicts.
    1381fc72
    History
    Switch from MUTF8 to UTF8 in PySpark serializers.
    Josh Rosen authored
    This fixes SPARK-1043, a bug introduced in 0.9.0
    where PySpark couldn't serialize strings > 64kB.
    
    This fix was written by @tyro89 and @bouk in #512.
    This commit squashes and rebases their pull request
    in order to fix some merge conflicts.