diff --git a/docs/configuration.md b/docs/configuration.md index 4729f1b0404c18e50f1ce564b2d2878a2fe7ed7d..a9753925407d7a6b04198f21febef2b3c22a6fc2 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1137,6 +1137,15 @@ Apart from these, the following properties are also available, and may be useful mapping has high overhead for blocks close to or below the page size of the operating system. </td> </tr> +<tr> + <td><code>spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version</code></td> + <td>1</td> + <td> + The file output committer algorithm version, valid algorithm version number: 1 or 2. + Version 2 may have better performance, but version 1 may handle failures better in certain situations, + as per <a href="https://issues.apache.org/jira/browse/MAPREDUCE-4815">MAPREDUCE-4815</a>. + </td> +</tr> </table> ### Networking