5

To make a scale-able architecture with docker containers is a very attractive solutions to deal with scale-ability issue. We can auto scale docker containers in Amazon Elastic Beanstalk environment or in a vendor specific pass environments.

What is the best way to make your own scale-able docker architecture on commodity cloud servers such as Digital Ocean or Rackspace that will auto provisions containers based on loads.

rayhan
  • 616
  • 2
  • 9
  • 24
  • This seems overly broad. There is no "best" way to make a scalable Docker architecture. There are solutions out there. You should review them and see what fits best for your scenario. Can you be more specific about what you are trying to do on this nefarious "scalable Docker architecture running on commodity cloud servers"? – Andy Shinn Feb 18 '16 at 04:53
  • Lets say, I have a worker container which connect to job queue and do the processing. Now based on the load, it may scale to multiple container on the same digital ocean droplet, but also can provision new digital ocean droplets and scale up and down. It may be on other cloud environment too like Rackspace. I'm not sure it may need to call Digital ocean API to provision new droplets for scaling. @AndyShinn – rayhan Feb 20 '16 at 15:47

1 Answers1

4

The most known solution for managing scaling a docker-based infrastructure are:

This article mentions:

In terms of scale, only Mesos has been proven to support large-scale systems of hundreds or thousands of nodes. However, when looking at small clusters of, say, less than a dozen nodes, Mesos may be an overly complex solution.

As mentioned here:

Almost everything we can do with Docker we can do with Swarm as well only on a much larger scale. There’s nothing new to do, no configurations to be duplicated and nothing new to learn.

https://i2.wp.com/blog.docker.com/media/2015/11/image00.png?w=1887

So start with Docker Swarm first, and if particular needs arise, look for the other solutions.

See:

VonC
  • 1,042,979
  • 435
  • 3,649
  • 4,283
  • A quick question, can docker swarm provision new server or only work in one machine with multiple containers? – rayhan Feb 20 '16 at 15:49