Support for horizontal scaling and autoscaling

[alphadose]

Currently, SWS deploys application containers to only 1 server. But we also want the functionality to deploy same application containers to multiple servers and load balance requests across them. So we want 3 features:-

1. Deploy containers to multiple servers during application creation based on user input in request JSON. For Ex:- curl -X POST "URL" {"instances" : 3}
2. Increase the number of container instances i.e deploying containers for already running applications after user intervention or scaling up on demand. For Ex:- curl -X PUT "URL" {"instances" : 4}
3. Deploy containers to multiple servers without user intervention for already running applications if the requests to a single container exceeds a certain threshold i.e autoscaling

[vrongmeal]

@alphadose Please provide a description for this. I wasn't present in the meeting.

[alphadose]

@vrongmeal done

[sukhman-sukh]

I was working on the issue and have a question.
What should I keep as a threshold (which resources and at what values) for auto-scaling?