Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Figures pipeline can break on missing course #448

Open
johnbaldwin opened this issue Mar 9, 2022 · 0 comments
Open

Figures pipeline can break on missing course #448

johnbaldwin opened this issue Mar 9, 2022 · 0 comments
Assignees
Labels

Comments

@johnbaldwin
Copy link
Contributor

If a course's Mongo content is deleted or moved but the CourseOverview still exists then Figures will still try to process the data. The bulk progress collection call to CourseGradeFactory() will fail, breaking the pipeline execution.

Some initial thoughts on what the solution could looks like

  • Figures should catch the error, report the error, and move to the next course
  • The behavior should probably be the same for standalone and multisite Open edX deployments
  • We need to decide what default and optional alerting looks like
  • We may want to enhance Figures metrics to have a meta model for the course with
    • a JSON field to track pipeline errors (minimal data, basic facts, failure on course C for date D) in addition to reporting the error in logging
    • A field to say to process the course or skip the course for metrics collection
  • Perhaps instead of storing pipeline error facts in a course meta model, store in the CourseDailyMetrics model for the failure for the day
@johnbaldwin johnbaldwin self-assigned this Mar 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant