Java – Run MapReduce jobs periodically without Oozie?

Run MapReduce jobs periodically without Oozie?… here is a solution to the problem.

Run MapReduce jobs periodically without Oozie?

I have a mapreduce job as a “jar” that should be run daily. Also, I need to run this jar from a remote Java application. How do I schedule it: i.e., I just want to run jobs every day from my remote Java application.

I’ve read about Oozie, but I don’t think it’s suitable to put here.

Solution

Take a look at Quartz.It enables you to run standalone Java programs or in web or application containers such as JBoss or Apache Tomcat. In particular, the integration with Spring and Spring batch is good.

Quartz can be configured outside of Java code – in XML, the syntax is exactly the same as in crontab. So, I found it very convenient.

Some examples can be found here and here .

Related Problems and Solutions