[ann] Subway - how to scale out any Cloud Foundry service


Dr Nic Williams
 

Quicky links:

* https://github.com/cloudfoundry-community/cf-subway
*
https://blog.starkandwayne.com/2015/09/21/how-to-scale-out-any-cloud-foundry-service/

We've been using Ferdy's Docker BOSH release since he created it, and have
published new docker images, new wrapper BOSH releases and more. But it
still doesn't scale horizontally (yes it has docker swarm support but no
that can't do persistent storage on volumes).

So we created Subway - a broker that allows you to run a fleet of
single-server service brokers such as Docker BOSH release, or
cf-redis-boshrelease.

I'll write up/create a video soon to walk-thru upgrading your existing
in-production single-server services to use Subway.

Have fun!

Nic


--
Dr Nic Williams
Stark & Wayne LLC - consultancy for Cloud Foundry users
http://drnicwilliams.com
http://starkandwayne.com
cell +1 (415) 860-2185
twitter @drnic


Alexander Lomov <alexander.lomov@...>
 

Thank you for the nice idea.

I have the following questions on the topic:


1. As far as I can see, Subway broker is not designed to be run as multiple instances (for instance to provide redundancy). Do you think of some kind of distributed locks to allow Subway service broker to be run in parallel?
2. Do you plan adding some kind of strategies to bind subway with BOSH and deploy additional single node services in case if all existing are busy?

I guess this functionality can be too much for an simple app that can be deployed to CF. Still they could be implemented as options.

Thank you,
Alex L.

On Sep 22, 2015, at 2:27 AM, Dr Nic Williams <drnic(a)starkandwayne.com<mailto:drnic(a)starkandwayne.com>> wrote:

Quicky links:

* https://github.com/cloudfoundry-community/cf-subway
* https://blog.starkandwayne.com/2015/09/21/how-to-scale-out-any-cloud-foundry-service/

We've been using Ferdy's Docker BOSH release since he created it, and have published new docker images, new wrapper BOSH releases and more. But it still doesn't scale horizontally (yes it has docker swarm support but no that can't do persistent storage on volumes).

So we created Subway - a broker that allows you to run a fleet of single-server service brokers such as Docker BOSH release, or cf-redis-boshrelease.

I'll write up/create a video soon to walk-thru upgrading your existing in-production single-server services to use Subway.

Have fun!

Nic


--
Dr Nic Williams
Stark & Wayne LLC - consultancy for Cloud Foundry users
http://drnicwilliams.com<http://drnicwilliams.com/>
http://starkandwayne.com<http://starkandwayne.com/>
cell +1 (415) 860-2185
twitter @drnic


Dr Nic Williams
 

Subway is now also available as a bosh release; and works nicely collocated on a now-scalable bosh deployment https://blog.starkandwayne.com/2015/09/29/deploying-subway-broker-with-bosh/

On Mon, Sep 21, 2015 at 4:27 PM, Dr Nic Williams <drnic(a)starkandwayne.com>
wrote:

Quicky links:
* https://github.com/cloudfoundry-community/cf-subway
*
https://blog.starkandwayne.com/2015/09/21/how-to-scale-out-any-cloud-foundry-service/
We've been using Ferdy's Docker BOSH release since he created it, and have
published new docker images, new wrapper BOSH releases and more. But it
still doesn't scale horizontally (yes it has docker swarm support but no
that can't do persistent storage on volumes).
So we created Subway - a broker that allows you to run a fleet of
single-server service brokers such as Docker BOSH release, or
cf-redis-boshrelease.
I'll write up/create a video soon to walk-thru upgrading your existing
in-production single-server services to use Subway.
Have fun!
Nic
--
Dr Nic Williams
Stark & Wayne LLC - consultancy for Cloud Foundry users
http://drnicwilliams.com
http://starkandwayne.com
cell +1 (415) 860-2185
twitter @drnic


Alexander Lomov <alexander.lomov@...>
 

Great! That’s an interesting thing to look at.

On Sep 29, 2015, at 8:35 PM, Dr Nic Williams <drnic(a)starkandwayne.com<mailto:drnic(a)starkandwayne.com>> wrote:

Subway is now also available as a bosh release; and works nicely collocated on a now-scalable bosh deployment https://blog.starkandwayne.com/2015/09/29/deploying-subway-broker-with-bosh/





On Mon, Sep 21, 2015 at 4:27 PM, Dr Nic Williams <drnic(a)starkandwayne.com<mailto:drnic(a)starkandwayne.com>> wrote:

Quicky links:

* https://github.com/cloudfoundry-community/cf-subway
* https://blog.starkandwayne.com/2015/09/21/how-to-scale-out-any-cloud-foundry-service/

We've been using Ferdy's Docker BOSH release since he created it, and have published new docker images, new wrapper BOSH releases and more. But it still doesn't scale horizontally (yes it has docker swarm support but no that can't do persistent storage on volumes).

So we created Subway - a broker that allows you to run a fleet of single-server service brokers such as Docker BOSH release, or cf-redis-boshrelease.

I'll write up/create a video soon to walk-thru upgrading your existing in-production single-server services to use Subway.

Have fun!

Nic


--
Dr Nic Williams
Stark & Wayne LLC - consultancy for Cloud Foundry users
http://drnicwilliams.com<http://drnicwilliams.com/>
http://starkandwayne.com<http://starkandwayne.com/>
cell +1 (415) 860-2185
twitter @drnic