Reg the serial property
Nithiyasri Gnanasekaran -X (ngnanase - TECH MAHINDRA LIM@Cisco) <ngnanase at cisco.com...>
Hi Amit
We are able to combine following cloud foundry jobs into one VM and deploy. The global default setting is serial:true Curious to confirm, In this scenario, what is the order of the template jobs being created? Will it serially create the template jobs one by one from the beginning? Here I have arranged the templates reading your answer in the below link https://lists.cloudfoundry.org/archives/list/cf-dev(a)lists.cloudfoundry.org/thread/GQR3FGZGBPPZS56ZYALBYX6WGUVTY24Y/ Thanks for your detailed answer in this link. Templates: - name: etcd release: cf - name: etcd_metrics_server release: cf - name: nats release: cf - name: nats_stream_forwarder release: cf - name: collector release: cf - name: postgres release: cf - name: uaa release: cf - name: cloud_controller_clock release: cf - name: consul_agent release: cf - name: go-buildpack release: cf - name: binary-buildpack release: cf - name: nodejs-buildpack release: cf - name: ruby-buildpack release: cf - name: php-buildpack release: cf - name: python-buildpack release: cf - name: staticfile-buildpack release: cf - name: cloud_controller_ng release: cf - name: statsd-injector release: cf - name: blobstore release: cf - name: route_registrar release: cf - name: metron_agent release: cf update: {} regards Nithiyasri
|
|
Re: add Diego into our monitoring system
Liu Rui
Thanks for all comments which are very helpful.
We are now able to get the metrics through nozzle connecting to traffic controller. I have 2 questions: 1) If we just want to have those metrics, we still have to collect all logging data through the Loggregator system. It is a huge network overhead for our system because our CF system is very large. 2) We will migrate to CF release 233 soon. And the /varz support for HM9000 will be sunset. Do we have the corresponding metrics of statistics flowing through the Loggregator system? Do we have some document for that?
|
|
Re: add Diego into our monitoring system
Liu Rui
Thanks for all comments which are very helpful.
We are now able to get the metrics through nozzle connecting to traffic controller. I have 2 questions: 1) If we just want to have those metrics, we still have to collect all logging data through the Loggregator system. It is a huge network overhead for our system because our CF system is large. 2) We will migrate to CF release 233 soon. And the /varz support for HM9000 will be sunset. Do we have the corresponding metrics of statistics flowing through the Loggregator system? Do we have some document for that?
|
|
Re: "Can't find property `[etcd.cluster]' when deploy cfv233
王小锋 <zzuwxf at gmail.com...>
Please ignore this thread, I just figure out the problem.
toggle quoted messageShow quoted text
2016-03-25 13:13 GMT+08:00 王小锋 <zzuwxf(a)gmail.com>:
Hi, there
|
|
"Can't find property `[etcd.cluster]' when deploy cfv233
王小锋 <zzuwxf at gmail.com...>
Hi, there
I am trying to deploy cf deployment 233, and use script to generate deployment manifest, but failed with the following error, I am not sure what "value" should be given to property "cluster", your help is greatly appreciated!! thanks. Started preparing configuration > Binding configuration. Failed: Error filling in template `etcd_bosh_utils.sh.erb' for `etcd_z1/0' (line 33: Can't find property `["etcd.cluster"]') (00:00:01) *Error 100: Error filling in template `etcd_bosh_utils.sh.erb' for `etcd_z1/0' (line 33: Can't find property `["etcd.cluster"]')* Task 38 error The corresponding etcd job looks like: - instances: 1 name: etcd_z1 networks: - name: cf1 static_ips: - 10.10.16.20 persistent_disk: 10024 properties: metron_agent: zone: z1 resource_pool: medium_z1 templates: - name: etcd release: cf - name: etcd_metrics_server release: cf - name: metron_agent release: cf update: max_in_flight: 1 serial: true
|
|
Re: Upcoming extraction of cflinuxfs2 rootfs release from diego-release
And here is the README!
toggle quoted messageShow quoted text
https://github.com/bgandon/rootfses-boshrelease/blob/master/README.md <https://github.com/bgandon/rootfses-boshrelease/blob/master/README.md> I took the chance of upgrading to cflinuxfs2 v1.48.0 to document how people can do that themselves. That’s a pretty comprehensive 15-steps workflow! /Benjamin
Le 25 mars 2016 à 00:47, Benjamin Gandon <benjamin(a)gandon.org> a écrit :
|
|
Re: CC BUILDPACK_SET App Usage Events
Matthew Sykes <matthew.sykes@...>
Can you explain how staging tasks will be recorded? We have already seen a
number of custom buildpacks that use the 15 minutes of staging time in interesting ways that consume significant resources. This is mitigated today by the fact that the staging only occurs when the app transitions from stopped to started so only the staging instance can execute; during that period the desired state of the application is `started` so it's billable time. While I'm happy we won't be stopping apps when a new version is pushed, I do think providers need a way to track the additional resource consumption of staging to avoid misuse and abuse - especially given staging tasks are typically executed with memory and disk limits that exceed those associated with an app instance. Thanks. On Thu, Mar 24, 2016 at 5:20 PM, Nicholas Calugar <ncalugar(a)pivotal.io> wrote: Hi Matthew, -- Matthew Sykes matthew.sykes(a)gmail.com
|
|
Re: Announcement: BOSH for Windows
Gwenn Etourneau
That's a really good news.
toggle quoted messageShow quoted text
Do you have any bosh-release example for windows ?? Thanks
On Fri, Mar 25, 2016 at 1:18 AM, Mike Youngstrom <youngm(a)gmail.com> wrote:
This is great!
|
|
Re: Proposal to Change CATs Ownership
Matthew Sykes <matthew.sykes@...>
This has as much to do with finding the "right" place for the CATS as it
toggle quoted messageShow quoted text
does anything else. The CATS are the end-to-end acceptance tests that are associated with what used to be called `cf-release` - the thing that (before we spread our bits across 20+ releases) actually represented what Cloud Foundry was. Not only does it reflect the target environment, it tries to ensure that the primary developer experience, the cf cli, continues to function correctly. Now that all of the things that used to be part of the coherent, versioned, collection of components have been spread to the wind, it's probably best to make the CATS an independent release too. Basically, I also believe that it's inappropriate to pull them into the CAPI releases; they have as much to do with the CLI, Diego, LAM, and Routing teams as they do with CAPI.
On Thu, Mar 24, 2016 at 11:48 AM, Utako Ueda <uueda(a)pivotal.io> wrote:
To address your concerns, Mike: --
Matthew Sykes matthew.sykes(a)gmail.com
|
|
Re: CC BUILDPACK_SET App Usage Events
Nicholas Calugar
Hi Piotr,
toggle quoted messageShow quoted text
You are correct, the next start would simply contain the new buildpack used to stage the droplet. Thanks for the feedback on the new event, as long as everyone is ok with DROPLET_CHANGED, I'll add that to the story. Thanks, Nick
On Thu, Mar 24, 2016 at 4:40 PM Piotr Przybylski <piotrp(a)us.ibm.com> wrote:
Hi Nick,
|
|
Re: Upcoming extraction of cflinuxfs2 rootfs release from diego-release
Ok sorry for the delay, I was listening and chatting with Josh here at Paris Spring Meetup. That was really cool.
toggle quoted messageShow quoted text
Anyway, here it is : <https://github.com/bgandon/rootfses-boshrelease <https://github.com/bgandon/rootfses-boshrelease>> Here is what I did : 1. Patch Diego deployment manifests with the deployment-samples/diego-manifests.yml.patch <https://github.com/bgandon/rootfses-boshrelease/blob/master/deployment-samples/diego-manifests.yml.patch> 2. Add the deployment-samples/property-overrides.yml <https://github.com/bgandon/rootfses-boshrelease/blob/master/deployment-samples/property-overrides.yml> to the Diego deployment 3. If needed, customize the deployment-samples/rootfses-properties.yml <https://github.com/bgandon/rootfses-boshrelease/blob/master/deployment-samples/rootfses-properties.yml> 4. Create the release tarball and upload it to the director bosh create release --final --name rootfses --version 1.43.0 bosh upload release 5. Deploy And it worked like a charm. I shall add a README soon with those instructions. Have fun! /Benjamin
Le 24 mars 2016 à 19:28, Eric Malm <emalm(a)pivotal.io> a écrit :
|
|
Re: 答复: Re: Incubation request: App Auto-Scaling service
Mike Youngstrom <youngm@...>
Great! I'd love a mysql backend for this service.
toggle quoted messageShow quoted text
Mike
On Thu, Mar 24, 2016 at 1:16 PM, Yang Bo <boyang9527(a)hotmail.com> wrote:
I guess no. We are working on a bosh release, but only for single node
|
|
Re: 答复: Re: Incubation request: App Auto-Scaling service
Marco Nicosia
On Thu, Mar 24, 2016 at 12:16 PM, Yang Bo <boyang9527(a)hotmail.com> wrote:
I guess no. We are working on a bosh release, but only for single nodeI'm sure there are many strong opinions about which is the best way to go, MySQL or Postgres. But I suppose it's OK for me to mention that the CF Foundation project, cf-mysql <https://github.com/cloudfoundry/cf-mysql-release>, has an HA-cluster option out of the box. :) -- Marco Nicosia Product Manager Pivotal Software, Inc. ------------------------------ *发件人:* Mike Youngstrom <youngm(a)gmail.com>
|
|
Re: CC BUILDPACK_SET App Usage Events
Piotr Przybylski <piotrp@...>
Hi Nick,
toggle quoted messageShow quoted text
If the STARTED event would guarantee to always include buildpack name and guid, then BUILDPACK_SET seems redundant and could be omitted. If the droplet change in running application is possible, we would like to know that - so the new event would be needed. And if the droplet changes in the stopped app, the next start would simply contain new buildpack guid/name - correct ? Thank you, Piotr Piotr Przybylski / IBM Bluemix From: Nicholas Calugar <ncalugar(a)pivotal.io> To: "Discussions about Cloud Foundry projects and the system overall." <cf-dev(a)lists.cloudfoundry.org> Date: 03/24/2016 02:21 PM Subject: [cf-dev] Re: Re: CC BUILDPACK_SET App Usage Events Hi Matthew, Thanks for the response. When we start an app in V3, we will always know the buildpack because we are starting the app's current droplet. The droplet was staged with a particular buildpack, so we can record the buildpack in the STARTED app usage event. As promised, a couple follow up questions: If we record the buildpack_guid in the STARTED event, can we omit the BUILDPACK_SET event in V3? Currently, a V3 app must be stopped to change the current droplet. We have an upcoming story [1] to enable changing the droplet on a running application. Would we want to add something like a DROPLET_CHANGED app usage event to indicate a running app is now using a different buildpack? Thanks, -Nick Nicholas Calugar CAPI Product Manager Pivotal Software, Inc. [1] https://www.pivotaltracker.com/story/show/111166678
On Wed, Mar 23, 2016 at 7:34 PM Matthew Sykes <matthew.sykes(a)gmail.com>
wrote: The buildpack set event was implemented to enable usage based billing for buildpack applications where the rates differed by the buildpack used to stage the application. When staging an application in /v2, if a buildpack is not specified, we don't know which buildpack will stage the application until after the detect phase of staging has occurred. That means at the time the usage event was captured for the transition to start, the buildpack was unavailable. The buildpack set event makes that information available to billing systems after staging completes. On Tue, Mar 22, 2016 at 8:03 PM, Nicholas Calugar <ncalugar(a)pivotal.io> wrote: Hi CF-Dev, We are continuing work on the Cloud Controller V3 API and had a question about a particular App Usage Event we write as part of V2, the BUILDPACK_SET event. The test[1] around this indicates that we write the app usage event when staging completes and the app is still started. In V2, apps, packages, and droplets are very tightly coupled, so writing this event here makes sense. In V3, apps, packages, and droplets are first class resources and we don't stage apps, we stage packages to create droplets. Furthermore, staging with a particular buildpack does not affect the app until the droplet is assigned to the app as the current droplet and the current droplet can be changed to any valid droplet for the app. Staging completion and the app being started no longer seem to correlate to the buildpack being "set". With the above differences, we are hoping to understand the use-case around the BUILDPACK_SET event so we can correctly preserve the desired behavior for V3. I'll likely have follow up questions, but the first thing I'd like to know is what BUILDPACK_SET indicates to downstream billing engines. Thanks, -Nick Nicholas Calugar CAPI Product Manager Pivotal Software, Inc. [1] https://github.com/cloudfoundry/cloud_controller_ng/blob/45b311f18d8ad1184dcb647081b19eca6f1eaf83/spec/unit/models/runtime/app_spec.rb#L1345-L1369 -- Matthew Sykes matthew.sykes(a)gmail.com
|
|
Re: CC BUILDPACK_SET App Usage Events
Nicholas Calugar
Hi Matthew,
Thanks for the response. When we start an app in V3, we will always know the buildpack because we are starting the app's current droplet. The droplet was staged with a particular buildpack, so we can record the buildpack in the STARTED app usage event. As promised, a couple follow up questions: If we record the buildpack_guid in the STARTED event, can we omit the BUILDPACK_SET event in V3? Currently, a V3 app must be stopped to change the current droplet. We have an upcoming story [1] to enable changing the droplet on a running application. Would we want to add something like a DROPLET_CHANGED app usage event to indicate a running app is now using a different buildpack? Thanks, -Nick Nicholas Calugar CAPI Product Manager Pivotal Software, Inc. [1] https://www.pivotaltracker.com/story/show/111166678 On Wed, Mar 23, 2016 at 7:34 PM Matthew Sykes <matthew.sykes(a)gmail.com> wrote: The buildpack set event was implemented to enable usage based billing for
|
|
答复: Re: Incubation request: App Auto-Scaling service
Yang Bo
I guess no. We are working on a bosh release, but only for single node couch as the first step.
toggle quoted messageShow quoted text
We have plan to implement a database layer with MySQL or Postgres. ________________________________ 发件人: Mike Youngstrom <youngm(a)gmail.com> 发送时间: 2016年3月24日 16:25 收件人: Discussions about Cloud Foundry projects and the system overall. 主题: [cf-dev] Re: Incubation request: App Auto-Scaling service Is anyone aware of a good CouchDB Bosh release? Mike
On Mon, Mar 21, 2016 at 2:54 PM, Koper, Dies <diesk(a)fast.au.fujitsu.com<mailto:diesk(a)fast.au.fujitsu.com>> wrote:
Hi Shannon, Our App Auto-Scaling proposal has received overwhelming support from the community, and we have received and addressed various feedback. Now, Fujitsu and IBM would like to put the proposal forward to the Services PMC as an incubation project. Project name: App Auto-Scaling Project proposal: https://docs.google.com/document/d/1HHhj9ZK-trI_VVDR34bwOnWem83UAq5_Pjr9imRTazY/edit?usp=sharing Proposed Project Lead: Michael Fraenkel (IBM) Proposed Scope: Please refer to the Goals and Non-goals sections in the proposal Development Operating Model: Distributed Committer Model Technical Approach: Please refer to the Deliverables section in the proposal Initial team committed: 7 engineers: 2 from Fujitsu, 2 from SAP, 3 from IBM (not including the Lead) As functionally IBM’s recently open sourced app auto-scaling solution (see https://lists.cloudfoundry.org/archives/list/cf-dev(a)lists.cloudfoundry.org/message/QRBQKDDG7PWS6EMEBWI4ARFQ3OGSSSWB) seems a good match to our proposal, the team will look at using that code. Michael can be contacted to answer any IP concerns about this code. Please let me know if you have any questions. Regards, Dies Koper Fujitsu From: Koper, Dies [mailto:diesk(a)fast.au.fujitsu.com<mailto:diesk(a)fast.au.fujitsu.com>] Sent: Friday, February 19, 2016 11:53 AM To: cf-dev(a)lists.cloudfoundry.org<mailto:cf-dev(a)lists.cloudfoundry.org> Subject: [cf-dev] Proposal: App Auto-Scaling service Dear community, We have relaunched this initiative and put together a proposal for an App Auto-Scaling service, ready for your review: https://docs.google.com/document/d/1HHhj9ZK-trI_VVDR34bwOnWem83UAq5_Pjr9imRTazY/edit?usp=sharing The proposal includes feedback from SAP, as well as some of the suggestions you have shared with me. The intent is to start with a MVP, really a minimal yet useful solution, that can serve as a foundation to build upon to address the various problems raised. We welcome your feedback, as well as your participation in this exciting project! Regards, Dies Koper Fujitsu
|
|
npm install zmq fails during cf push
av V
Steps to reproduce:
1.) Create an empty folder. 2.) Add this package.json file. { "name": "zmq-test", "version": "1.0.0", "description": "", "main": "index.js", "scripts": { "start": "node index.js" }, "author": "", "license": "", "dependencies": { "zmq": "2.8.0" }, "engines": { "node": "0.10.33" } } 3.) Add this index.js file. var zmq = require('zmq'); var http = require('http'); http.createServer(function (req, res) { res.writeHead(200, {'Content-Type': 'text/plain'}); for (var env in process.env) { res.write(env + '=' + process.env[env] + '\n'); } res.end(); }).listen(process.env.PORT || 3000); 4.) Run npm install. That should build the library locally. 5.) Push the application to a CF When the application starts, I get the below error Prebuild detected (node_modules already exists) Rebuilding any native modules > zmq(a)2.8.0 install /tmp/staged/app/node_modules/zmq > node-gyp rebuild make: Entering directory `/tmp/staged/app/node_modules/zmq/build' CXX(target) Release/obj.target/zmq/binding.o ../binding.cc:28:17: fatal error: zmq.h: No such file or directory #include <zmq.h> ^ compilation terminated. make: *** [Release/obj.target/zmq/binding.o] Error 1 make: Leaving directory `/tmp/staged/app/node_modules/zmq/build' gyp ERR! build error gyp ERR! stack Error: `make` failed with exit code: 2 gyp ERR! stack at ChildProcess.onExit (/tmp/staged/app/.heroku/node/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:276:23) gyp ERR! stack at ChildProcess.emit (events.js:98:17) gyp ERR! stack at Process.ChildProcess._handle.onexit (child_process.js:820:12) gyp ERR! System Linux 3.19.0-49-generic gyp ERR! command "node" "/tmp/staged/app/.heroku/node/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild" gyp ERR! cwd /tmp/staged/app/node_modules/zmq gyp ERR! node -v v0.10.33 gyp ERR! node-gyp -v v3.3.1 gyp ERR! not ok npm ERR! Linux 3.19.0-49-generic npm ERR! argv "node" "/tmp/staged/app/.heroku/node/bin/npm" "rebuild" npm ERR! node v0.10.33 npm ERR! npm v1.4.28 npm ERR! code ELIFECYCLE npm ERR! zmq(a)2.14.0 install: `node-gyp rebuild` npm ERR! Exit status 1 npm ERR! npm ERR! Failed at the zmq(a)2.8.0 install script 'node-gyp rebuild'. npm ERR! Make sure you have the latest version of node.js and npm installed. npm ERR! If you do, this is most likely a problem with the zmq package, npm ERR! not with npm itself. npm ERR! Tell the author that this fails on your system: npm ERR! node-gyp rebuild npm ERR! You can get information on how to open an issue for this project with: npm ERR! npm bugs zmq npm ERR! Or if that isn't available, you can get their info via: npm ERR! npm owner ls zmq npm ERR! There is likely additional logging output above. npm ERR! Please include the following file with any support request: npm ERR! /tmp/staged/app/npm-debug.log -----> Build failed We're sorry this build is failing! You can troubleshoot common issues here: https://devcenter.heroku.com/articles/troubleshooting-node-deploys Some possible problems: - node_modules checked into source control https://docs.npmjs.com/misc/faq#should-i-check-my-node-modules-folder-into-git Love, Heroku Staging failed: Buildpack compilation step failed
|
|
Re: Upcoming extraction of cflinuxfs2 rootfs release from diego-release
Eric Malm <emalm@...>
Thanks, Benjamin! The Buildpacks team just started the extraction story (
https://www.pivotaltracker.com/story/show/115888335) yesterday and is continuing it today, so now would be an ideal time for you to weigh in with your extraction efforts. Best, Eric On Thu, Mar 24, 2016 at 3:29 AM, Benjamin Gandon <benjamin(a)gandon.org> wrote: Hi Eric,
|
|
Re: Incubation request: App Auto-Scaling service
Mike Youngstrom <youngm@...>
Is anyone aware of a good CouchDB Bosh release?
Mike On Mon, Mar 21, 2016 at 2:54 PM, Koper, Dies <diesk(a)fast.au.fujitsu.com> wrote: Hi Shannon,
|
|
Re: Announcement: BOSH for Windows
Mike Youngstrom <youngm@...>
This is great!
toggle quoted messageShow quoted text
Mike
On Thu, Mar 24, 2016 at 9:06 AM, Steven Benario <sbenario(a)pivotal.io> wrote:
Hello everyone,
|
|