Azure Synapse Spark Pool Submission Failure with error message “SparkJobDefinitionActionFailed”

0
votes

I am following the tutorials below and try to submit a Spark Job using the Spark engine in Azure Synapse.

The submission failed with following error:

Error:
{
  "code": "SparkJobDefinitionActionFailed",
  "message": "Spark job batch request for workspace contosows, spark compute contosospark with session id null failed with a system error. Please try again",
  "target": null,
  "details": null,
  "error": null
}

Can anyone give some guidance/suggestions on how to resolve it?

More information about my setups.

  1. Region: Southeast Asia for both Azure Synapse workspace + ADLS Gen2
  2. I grant myself Both Storage Blob Data Owner and Storage Blob Data Contributor roles as suggested.
  3. Tutorials used:

Thanks!

1
azureapache-sparkazure-synapse
Are you still facing the issue ? Are yoiu using the Python / Scala part ? – HimanshuSinha-msft
If it is useful for you, could you please accept it as an answer? It may help more people who have similar issue. – CHEEKATLAPRADEEP-MSFT

1 Answers

0
votes

After investigation, the product group deployed a hotfix to fix this problem.

Now you can submit the Spark job without any issues. Please do let me known, if you are experiencing this issue anymore.