-
- Downloads
Remove reflection, hard-code StorageLevels
The sc.StorageLevel -> StorageLevel pathway is a bit janky, but otherwise the shell would have to call a private method of SparkContext. Having StorageLevel available in sc also doesn't seem like the end of the world. There may be a better solution, though. As for creating the StorageLevel object itself, this seems to be the best way in Python 2 for creating singleton, enum-like objects: http://stackoverflow.com/questions/36932/how-can-i-represent-an-enum-in-python
Showing
- core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala 0 additions, 11 deletions...rc/main/scala/org/apache/spark/api/python/PythonRDD.scala
- python/pyspark/context.py 24 additions, 22 deletionspython/pyspark/context.py
- python/pyspark/shell.py 2 additions, 2 deletionspython/pyspark/shell.py
Loading
Please register or sign in to comment