2020-06-23 21:50:51
apache
PUBLISHED
In Apache Spark 2.4.5 and earlier, a standalone resource managers master may be configured to require authentication (spark.authenticate) via a shared secret. When enabled, however, a specially-crafted RPC to the master can succeed in starting an applications resources on the Spark cluster, even without the shared key. This can be leveraged to execute shell commands on the host machine. This does not affect Spark clusters using other resource managers (YARN, Mesos, etc).