The outputs of multiple subsequent runs of a workflow become the input to the next workflow. It is also necessary to connect workflow jobs that run regularly, but at different time intervals. In the future, the model can be extended to support additional event types. A predicate can reference to data, time and/or external events. The workflow job is started after the predicate is satisfied. And, in some cases, they can be triggered by an external event.Įxpressing the condition(s) that trigger a workflow job can be modeled as a predicate that has to be satisfied. Oozie, Hadoop Workflow Systemĭefines a workflow system that runs such jobs.Ĭommonly, workflow jobs are run based on regular time intervals and/or data availability. Multiple of these jobs can be combined to form a workflow job. Users typically run map-reduce, hadoop-streaming, hdfs and/or Pig jobs on the grid.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |