Numerical Optimization Dashboard

This is an interactive educational dashboard that applies different numerical optimization algorithms to solve a simple linear regression problem. The regression problem fits a line to some toy data for the purpose of illustration. The dashboard allows the user to try different numerical optimization algorithms, tune its hyperparameters, and see the effects of his choices using different useful visualizations and animations that illustrate the effect of the user's choices on the loss function value, the learned parameters values, and the regression line throughout the training process.

Check out the dashboard here: https://numerical-optimization-dashboard.onrender.com/

Demo:

Dashboard.webm

Algorithms covered:

1. Batch Gradient Descent
2. Momentum-based Gradient Descent
3. Nestrov Accelearted Gradient (NAG)
4. Adaptive Gradient (AdaGrad)
5. Root Mean Squared Propagation (RMSProp)
6. Adaptive Moment Estimation (ADAM)

Libraries used:

• Numpy
• Pandas
• Plotly
• Plotly Dash