Saturday, 15 May 2010

spark submit add multiple jars in classpath -


I am trying to run a spark program where I have multiple jar files, if I had only one jar I'm not capable. I have tried the following which I want to add both jar files in one place but it shows a dependency error

  spark-deposit \ --class "max" maxjar.jar Book1.csv test \ --driver-class-path / usr / lib /spark/assembly/lib/hive-common-0.13.1-did= 5.3.0.jar  

I How can I add a jar file that is in the same directory?

I want to add /usr/lib/spark/assembly/lib/hive-serde.jar .

Use the - jar parameter to spark those jars (comma separated) ) With the executor.


No comments:

Post a Comment