cloudfoundry file descriptor limit is too small
peter huang
Hi, All,
My cloudfoundry version is 225, when i run some java spring-boot program in the cf, sometime it will throw the "too many files open" exception, i know it is about the file limit. So i login to the runner, and use `ulimit -n` to see, they are 1024, but i found in the warden .\cf-release-225\jobs\dea_next\templates\dea_ctl.erb it call `ulimit -n 4096`, looks like it doesn't work. and in .\cf-release-225\packages\dea_next\dea_next\vendor\cache\warden-181b550918c8\warden\spec\container\linux_spec.rb Line 1418: response = client.run(:handle => handle, :script => "ulimit -n", :rlimits => rlimits) no sure it will overwrite the exist one(i don't know ruby) my question is, does they some way to expand the size of limit ? or we need to upgrade the cloudfoundry? Thanks, Peter
|
|
Runtime PMC - Persi Project Lead
Dieu Cao <dcao@...>
Hello all,
Ted Young, the Project Lead for the Persi team within the Runtime PMC, last day at Pivotal was this past week. We wish him all the best in his future endeavors and thank him for his time with us. Dell would like to nominate Julian Hjortshoj for the Project Lead for the Persi team. Julian joined the Diego Persistence team as a software developer in April. During his 25-odd year career making software he has served in various technical leadership roles (manager, project lead, architect). Prior to joining CF, Julian worked for the ECM division of Dell/EMC as the application/ui architect for a suite of Cloud Foundry deployed content management applications. If there are any questions/objections to this appointment, please send that to me by end of day October 27, 2016. -Dieu Cao Runtime PMC Lead
|
|
Contribute mongodb 3.X bosh release
Lynn Lin
All,
Previously we from DELL-EMC use MongoDB service 2.X from this project under cloudfoundry community https://github.com/cloudfoundry-community/cf-services-contrib-release . Months ago we want to use mongoDB 3.X which improves performance a lot however we don’t find the available mongoDB 3.X under cloudfoundy github so our team developed MongoDB 3.X bosh release and provide additional cluster support compared to https://github.com/cloudfoundry-community/cf-services-contrib-release . This version is deployed to production site and running for quite a while , it looks stable . Who should we contact to start conversation to see how we can contribute back for this bosh mongoDB 3.X release if it is worth Thanks Lynn Lin
|
|
Re: CF environmental variables - org is missing
Vinod Singh <vinoddandy@...>
Hi Jaison,
toggle quoted messageShow quoted text
If CF team can include app_name+space+org in Loggregator logs, that would solve many of our use cases. The current application id is created at runtime and external systems finding difficult to segregate message based on application id. Do we have any blog item to include app_name in loggregator messages ? Regards, Vinod
On Tue, Oct 18, 2016 at 8:03 AM, Peter Dotchev <dotchev(a)gmail.com> wrote:
Hi Jason,
|
|
cf-release Submodule Path Recursion Error (and fix!)
Chunyi Lyu <clyu@...>
We've seen an issue with ./scripts/update in cf-release. If you have a
sufficiently old version of `cf-release`, and then you try to run the update script, you'll get an error that looks like this: ``` Failed to recurse into submodule path 'src/consul-release' ``` Here are the steps to reproduce: - `git clone https://github.com/cloudfoundry/cf-release` - `git checkout 58f89c63b1cd673df34ca98302e4573ed60c1bf3` - `git submodule update --init --recursive` - `git checkout develop` - `./scripts/update` You should see the error at this point. If you hit this, we've got three fixes for you. First and potentially simplest, just run one more git submodule sync --recursive && ./scripts/update after the failure. If that doesn't work, you can either delete and re-clone cf-release from scratch, or go edit your git modules: Edit `git/modules/src/consul-release/modules/src/confab/vendor/ github.com/hashicorp/serf/config`, so that it's remote url points to ` https://github.com/cloudfoundry-incubator/serf` instead of ` https://github.com/hashicorp/serf`. Hopefully this won't have inconvenienced too many of you! Regards- -Jesse Alford && Chunyi Lyu CF Release Integration Team
|
|
Re: How to run cronjobs with Application
Anuj Jain <anuj17280@...>
Thanks Nick I will try it
toggle quoted messageShow quoted text
On 19 Oct 2016 8:21 a.m., "Nicholas Calugar" <ncalugar(a)pivotal.io> wrote:
Hi Anuj,
|
|
Re: How to run cronjobs with Application
Nicholas Calugar
Hi Anuj,
toggle quoted messageShow quoted text
For scheduling, you might want to look into the Advanced Python Scheduler [1]. You would push the scheduler as a separate app to Cloud Foundry. You could also experiment with V3 Tasks that we are close to releasing. You can think of Tasks as commands to run against your app code that only take up resources while executing. As of CF-245, you can push an application and then run a task against it. There’s currently only support via curl [2], but we are working on supporting this via CLI. [1] http://apscheduler.readthedocs.io/en/3.0/ [2] http://v3-apidocs.cloudfoundry.org/version/release-candidate/#push-v2-app-and-run-a-v3-task Thanks, Nick -- Nicholas Calugar
On October 18, 2016 at 8:03:38 AM, Anuj Jain (anuj17280(a)gmail.com) wrote:
Hi, We have an application (lets say django app) - which we deployed on Cloud Foundry - now there are few commands which we want to run periodically (cron jobs) - what is the best way to handle this with Cloud Foundry. Thanks - Anuj
|
|
Contribute mongodb 3.X bosh release
Lin, Lynn <Lynn.X.Lin@...>
All,
Previously we use MongoDB service 2.X from this project under cloudfoundry community https://github.com/cloudfoundry-community/cf-services-contrib-release . Months ago we want to use mongoDB 3.X which improves performance a lot however we don't find the available mongoDB 3.X under cloudfoundy github so peter,huang (cc'ed) developed MongoDB 3.X bosh release and provide additional cluster support compared to https://github.com/cloudfoundry-community/cf-services-contrib-release . This version is deployed to production site and running for quite a while , it looks stable . Who should we contact to start conversation to see how we can contribute back for this bosh mongoDB 3.X release if it is worth Thanks Lynn
|
|
Re: UAA Standalone Deployment
Sree Tummidi
Hi Abhishek,
toggle quoted messageShow quoted text
As part of Pivotal deployments UAA is being used to secure both the platform and Apps running on the platform. Our hosted Cloud Foundry deployment (aka Pivotal Web Services) is running on AWS has two UAA instances handling a load of 20-30 requests per second per instance. You need to scale the UAA instances depending on your concurrency requirements. Thanks, Sree Tummidi Staff Product Manager Identity - Pivotal Cloud Foundry
On Tue, Oct 18, 2016 at 3:21 PM, Siva Balan <mailsiva(a)gmail.com> wrote:
Hi Abhishek,
|
|
Re: UAA Standalone Deployment
Siva Balan <mailsiva@...>
Hi Abhishek,
toggle quoted messageShow quoted text
Yes, you should be able to use UAA outside of CF and integrate it with any IdP of your choice. At GE we have UAA deployed on CF and our performance numbers are CF based. The numbers should not be very different on a non-CF env. Attached pdf should give you some performance numbers from our tests -Siva
On Tue, Oct 18, 2016 at 3:04 PM, Sree Tummidi <stummidi(a)pivotal.io> wrote:
+ Siva & Ilya from GE
|
|
Re: UAA Standalone Deployment
Sree Tummidi
+ Siva & Ilya from GE
Can you please help. Thanks, Sree Tummidi Staff Product Manager Identity - Pivotal Cloud Foundry On Tue, Oct 18, 2016 at 11:43 AM, abhishek jain <intelccdodemo(a)gmail.com> wrote: Hi
|
|
UAA Standalone Deployment
abhishek jain <intelccdodemo@...>
Hi
Can we use UAA outside cloud foundry as standalone service with LDAP or any other social networking provider ? Where can i find performance bench marking related statistics on UAA service ? Thank you
|
|
NOTICE: Default version of Go in the Go Buildpack will change to 1.7.x after 2016-11-18
Stephen Levine
Hi All,
The version of Go in the Go Buildpack will change from version 1.6.3 to the latest 1.7.x version (currently 1.7.2) in the first release of the Go Buildpack after November 18, 2016. If you would like to continue using Go 1.6.3, please set the $GOVERSION environment variable in your app, or use your choice of Go dependency management utility to lock your version of Go to 1.6.3. For more information, refer to the documentation: http://docs.cloudfoundry.org/buildpacks/go/ Thank you, Stephen Levine CF Buildpacks PM
|
|
How to run cronjobs with Application
Anuj Jain <anuj17280@...>
Hi,
We have an application (lets say django app) - which we deployed on Cloud Foundry - now there are few commands which we want to run periodically (cron jobs) - what is the best way to handle this with Cloud Foundry. Thanks - Anuj
|
|
Re: CF environmental variables - org is missing
Peter Dotchev <dotchev@...>
Hi Jason,
toggle quoted messageShow quoted text
For example, when connecting to the database we set the client application name on the connection. If the db becomes heavily loaded, the db admin can check the expensive statements view and see which applications generate them. Also for end to end tracing when a transaction goes through multiple components, we have to record each involved component name. So we need an application name that is human readable and unique. Best regards, Petar
On Tue, Oct 18, 2016 at 12:39 AM, Jason Sherron <jsherron(a)pivotal.io> wrote:
Hi Peter,
|
|
Re: Garden-RunC is 1.0! (& ACTION REQUIRED: End-of-life for garden-linux)
Dieu Cao <dcao@...>
Congrats to the Garden teams! Super excited about this step forward!
-Dieu On Mon, Oct 17, 2016 at 8:46 PM, Dr Nic Williams <drnicwilliams(a)gmail.com> wrote: Lovely. All our bosh-lites are upgraded and happy to be running another
|
|
Re: Garden-RunC is 1.0! (& ACTION REQUIRED: End-of-life for garden-linux)
Dr Nic Williams <drnicwilliams@...>
Lovely. All our bosh-lites are upgraded and happy to be running another v1+ release!
toggle quoted messageShow quoted text
On Tue, Oct 18, 2016 at 10:23 AM +1100, "Christopher B Ferris" <chrisfer(a)us.ibm.com> wrote:
Congrats! Cheers, Christopher Ferris IBM Distinguished Engineer, CTO Open Technology IBM Cloud, Open Technologies email: chrisfer(a)us.ibm.com twitter: @christo4ferris blog: https://developer.ibm.com/opentech/author/chrisfer/ phone: +1 508 667 0402 On Oct 18, 2016, at 1:27 AM, Julz Friedman <julz.friedman(a)gmail.com> wrote: Hi cf-dev, This is a very exciting email to write! I'm extremely proud to announce that garden-runC, the new cloud foundry container runtime for Linux, based on the OCI specification and its reference implementation “runC”, is now 1.0! ACTION REQUIRED: Given that garden-runc is now ready to use and fully compatible with garden-linux, we intend to end-of-life garden-linux immediately. More details on this and an explanation for the accelerated timescale are at the bottom of this email. About garden-runc: At this point garden-runC has been successfully running 100% of the production traffic on PWS for around a month (it has been running a smaller portion of the load for a longer time as we gained confidence). The Diego team has been testing with and listing compatible releases of both g-l and g-r for several months. It has also been the only supported linux backend for concourse for several months, thereby being used in a broad range of environments and deployment scenarios. In all cases it has held up remarkably well. Given this I'm happy to recommend people move over to garden-runC as soon as possible (diego’s manifest generation scripts should make this extremely simple -- just pass the `-g` flag to diego manifest generation -- but please note you MUST recreate any cells that previously ran garden-linux as part of the transition or you WILL have problems. An easy way to do this is to combine the transition to garden-runc with a stemcell deploy). As well as being based on open standards and using a low-level container runtime developed with a large community and many eyeballs, garden-runC has some other significant benefits: AppArmor is configured and enforced by default and out of the box for all unprivileged containers. Seccomp whitelisting is used to restrict the set of system calls a container can access, hugely reducing the surface area for break-out exploits. Again this is set up out of the box, you don't need to do anything. We've been able to simplify and modularise the garden code base extensively as part of this transition, allowing pluggable networking and rootfs management. This enables (and will be required by) the fast-developing container-to-container networking work and the new “grootfs” OCI-compliant rootfs downloader Garden-runC uses the exact same low-level container execution code as docker/k8s for running containers, so when you run container images you know they run identically in CF as elsewhere I'm immensely proud of the cross-foundation team that has delivered this, including engineers from Pivotal, IBM and SAP. GARDEN-LINUX END OF LIFE: 28/10/2016 - ACTION REQUIRED: Now that garden-runC is ready we’re extremely keen to avoid maintaining two code-bases for any longer than necessary, so we would like to move everyone to garden-runC immediately, with the next Diego-release update (as mentioned above, apart from the need to recreate the cells this is a 1-1 transition). Doing this on an accelerated timescale is particularly important because we have encountered a regression in the 4.4 kernel that causes problems during container destruction for garden-linux. We are working to track this down, but it is proving extremely difficult to rectify or work around. If anyone intends to use stemcells with 4.4 kernels, until we identify a fix, they should immediately move to garden-runC to avoid issues. If anyone has huge problems moving off garden-linux now please reach out to me asap and we’ll see what we can do, otherwise I will suggest diego stop supporting generating manifests for garden-linux with the next release, and will propose moving garden-linux to the attic shortly after that. Either way, we will no longer be developing new features for garden-linux or accepting pull requests from this point. Unless anyone has a strong reason otherwise (if so please do say!), we will end support for garden-linux 28/10/2016. Thanks all very much, and again a huge thanks to the garden team! Julz FriedmanGarden Core PM
|
|
Re: Helping with Stack Overflow activity on Cloud Foundry and BOSH
Sree Tummidi
Thank you Amit !
Thanks, Sree Tummidi Staff Product Manager Identity - Pivotal Cloud Foundry On Mon, Oct 17, 2016 at 5:20 PM, Etourneau Gwenn <gwenn.etourneau(a)gmail.com> wrote: Thanks. Will check this out
|
|
Re: Helping with Stack Overflow activity on Cloud Foundry and BOSH
Etourneau Gwenn
Thanks. Will check this out
toggle quoted messageShow quoted text
2016-10-18 7:43 GMT+09:00 Amit Gupta <agupta(a)pivotal.io>:
Hey folks,
|
|
Re: Garden-RunC is 1.0! (& ACTION REQUIRED: End-of-life for garden-linux)
Christopher B Ferris <chrisfer@...>
Congrats!
toggle quoted messageShow quoted text
Cheers, Christopher Ferris IBM Distinguished Engineer, CTO Open Technology IBM Cloud, Open Technologies email: chrisfer(a)us.ibm.com twitter: @christo4ferris blog: https://developer.ibm.com/opentech/author/chrisfer/ phone: +1 508 667 0402
On Oct 18, 2016, at 1:27 AM, Julz Friedman <julz.friedman(a)gmail.com> wrote:
|
|