Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Add Production Configuration doc #220

Merged
merged 10 commits into from
Jun 4, 2024

Conversation

bmtcril
Copy link
Contributor

@bmtcril bmtcril commented May 9, 2024

Adds some information about the choices and configuration options for Aspects

@bmtcril bmtcril requested review from pomegranited and Ian2012 May 9, 2024 19:38
@bmtcril bmtcril force-pushed the bmtcril/production_configuration branch from 69acdb0 to e0f54a3 Compare May 9, 2024 19:40
Setting up Ralph
################

You can deploy `Ralph via Helm chart`_. If you are using a pipeline that involves the Ralph learning record store (Celery or an event bus), you will want to run at least two Ralph servers for fault tolerance. Generally it consumes few resources and is quite stable. If you find that response times from Ralph are high it is usually because there are too many small ClickHouse inserts and you should turn on batching or increase your batch size.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once this PR is released, we can implement the HPA strategy with a single filter. The values can be used similarly to what the official helmChart recommends: https://github.com/openfun/ralph/blob/main/src/helm/ralph/values.yaml#L76-L81


By default Superset is set to share the Open edX MySQL database and redis servers to save resources. Traditionally services like Aspects are fairly low traffic and this may be acceptable for a production environment, but you may wish to consider setting up separate instances for separation of resources and performance... especially for large sites.

Superset is a Flask application and can be load balanced if need be. Superset also uses Celery workers for asynchronous tasks. You may wish to run more than one of these, though Aspects does not currently make heavy use of them.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will add autoscaling here too, in Superset and Superset workers

Copy link
Contributor

@Ian2012 Ian2012 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a few changes and I've leave some recommendations and updates.

@bmtcril bmtcril force-pushed the bmtcril/production_configuration branch from 1d23d83 to 2749044 Compare May 30, 2024 20:44
@bmtcril bmtcril requested a review from saraburns1 May 30, 2024 20:45
Copy link
Contributor

@pomegranited pomegranited left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 This reads well, and covers sufficient info for now. Thanks @bmtcril !

I put some formatting recommendations and fixes for reference links in #223 , feel free to merge if you're happy with them.

  • I tested this by reading the rendered docs.
  • I read through the code and text
  • I checked for accessibility issues N/A
  • Includes documentation
  • User-facing strings are extracted for translation N/A

docs/concepts/data_lifecycle_policy.rst Outdated Show resolved Hide resolved
docs/how-tos/production_configuration.rst Outdated Show resolved Hide resolved
docs/how-tos/production_configuration.rst Outdated Show resolved Hide resolved
docs/how-tos/production_configuration.rst Outdated Show resolved Hide resolved
bmtcril and others added 3 commits June 4, 2024 10:02
…ation

docs: formatting fixes for Production Deployments
Co-authored-by: Jillian <[email protected]>
@bmtcril bmtcril merged commit 8287d69 into main Jun 4, 2024
3 checks passed
@bmtcril bmtcril deleted the bmtcril/production_configuration branch June 4, 2024 19:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants