Oozie coordinator having multiple workflows

I have three XML Workflow files like WF1 WF2 WF3. Can I link all these workflows into one coordinator for the next steps? WF1 is time dependent. WF2 is file dependent. WF3 has nothing to do with anything.

+3


source to share


3 answers


You cannot link all three workflows into one coordinator.

Instead, you can link all three workflows in a separate xml (parent) file of the workflow using the "subworkflow" concept in oozie. (All three workflow files WF1, WF2, WF3 are referred to as sub workflows in this parent workflow file)



Then you can use the coordinator xml file to schedule the parent workflow file to link all three workflow files.

Link: https://bhatnagarankitblog.wordpress.com/2013/11/09/multiple-executions/

+6


source


Unfortunately, one oozie coordinator can only have one activity / workflow. It is defined in the xml schema: Oozie 4.01 CoordinatorFunctionalSpec.html # Oozie_Coordinator_Schema_0.4

<xs:complexType name="COORDINATOR-APP">
  <xs:sequence>
    ...
    <xs:element name="action" type="coordinator:ACTION" minOccurs="1" maxOccurs="1" />
    ...
</xs:complexType>
      

Run codeHide result




However, as the requester pointed out in the comments section, Oozie does provide a way to consolidate the coordinator's jobs. Please note that the dependency between jobs should be user managed as the referenced document:

Bundle is a higher level oozie abstraction that will launch a set of coordinator apps. The user will be able to start / stop / pause / resume / repeat at the beam level, which provides easier and more responsive control.

More specifically, the oozie Bundle system allows the user to define and execute multiple coordinator applications, often referred to as pipeline data. There is no explicit dependency between the bundled app coordinator. However, the user can use the application coordinator data dependency to create implicit data in the application pipeline.

+4


source


No, you cannot link all three workflows in one coordinator, but you can create a separate coordinator for each workflow and link them using a package.

To find out more, link vacancies

+1


source







All Articles