Help Center/ MapReduce Service/ Troubleshooting/ Using Spark/ Incorrect Parameter Format Is Displayed When a Spark Task Is Submitted
Updated on 2024-12-18 GMT+08:00
View PDF

Incorrect Parameter Format Is Displayed When a Spark Task Is Submitted

Symptom

A user fails to submit a cluster task using Spark and a message is displayed indicating that the parameter format is incorrect.

Cause Analysis

  • The command executed contains invalid characters.
  • The owner and owner group of the uploaded JAR package are incorrect.

Procedure

  1. Run ./bin/spark-submit --class cn.interf.Test --master yarn-client Client installation directory/Spark/spark1-1.0-SNAPSHOT.jar; to check whether invalid characters are imported.
  2. If they are imported, modify the invalid characters and run the command again.
  3. After the command is executed again, other errors occur. Both the owner and the owner group of the JAR package are root.
  4. Change the owner and the owner group of the JAR package to omm:wheel.
Parent topic: Using Spark