I want to use my spark shell with daily cron. The script that I need to run with a shell is written in Scala. Also, I need this as soon as possible (that is, after loading the shell and every time I quit, because I have to run a lot of scripts). How can this be done?
Spark-Shell is an interactive environment, as asked for wasteful jobs It does not mean to run though it is technically possible to do this.
Perhaps a better option would be to exclude an application that runs the "fat JR" file running on RAPL and cron calling java -cp ... my.pkg.main
No comments:
Post a Comment