Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Job Dependencies #148

Open
shunte88 opened this issue Mar 14, 2017 · 2 comments
Open

Job Dependencies #148

shunte88 opened this issue Mar 14, 2017 · 2 comments

Comments

@shunte88
Copy link

With all of the scheduling engines I've come across if I have a list of dependencies then all of these dependencies should be met for a job to execute.

I setup a job with 3 parent dependencies expecting the job to execute when all three hard run to success

What occurred was the initial job ran to success and the job executed
It also executed following parent two
And again following parent three

Well I suppose that's one use case, and I can see uses for that if I had granular jobs with distinct functions that I could mix and match

I guess my line of thinking was flavored by working with several enterprise scheduler where if I'd a list of jobs to follow this was out of the box a hard dependency; most of these enterprise level scheduler give the flexibility for defining other levels, MUST, REQUIRES, FOLLOWS, NEEDS, etc that further refine these dependencies on both jobs and resources.

So, it looks like a list of dependencies in the Kala world is not a hard requirement list, the sibling job will execute following each parent specified

Rather than relying on the assumed logic that all parents MUST complete in a given scheduled process in order to achieve the end goal the jobs should be chained and the sibling job should follow the penultimate job in the chain.

Or better still an attribute could be surfaced that adds a simple bool switch to specify all_parents_required; all parent dependencies are required for a sibling job to execute

Could this functionality be added?

@LordBrain
Copy link

I could really use something like this as well. I want to trigger a child job after all the of the parents repeat runs are complete as well.

Are these on the radar at all?

@gwoo
Copy link
Contributor

gwoo commented Dec 19, 2017

We could add this feature. First would be to create a test case that clearly represents the goal. Then we can work on adding the functionality to solve it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants