I'm wondering is there any way for spark-submit to temporarily change yarn job's configuration?
The question is because our Spark over yarn cluster's history server only allows admin to access, which is not convenience for user to retrieve their own job's log. I learned "mapreduce.job.acl-view-job" in mapreduce-default.xml can changes specific job's ACL. As I'm using spark-submit to launch job, and "--conf" is reserved for spark itself's, but how can I set yarn's configuration from command line along with application?
