Utilities PMC - 2015-09-09 Notes
Mike Dalessio
Hello CF Community,
Apologies for the lapse in sending timely Utilities PMC notes (see comments below). These notes are permanently available at: https://github.com/cloudfoundry/pmc-notes/blob/master/Utilities/2015-09-09-utilities.md -mike --- # Utilities PMC Notes 2015-09-09 ## Table of Contents 1. Update on "Offline" PMC Discussion 2. CLI 3. Java Utilities ## Update on "Offline" PMC Discussions In the previous PMC meeting, held on 2015-07-28, the Utilities PMC agreed to tentatively stop conducting regular synchronous meetings, and instead move to an "offline" model where discussions and, if necessary, voting would be conducted on the public cf-dev@ mailing list. As part of this change, the PMC Lead (that's me!) committed to sending regular status updates to the mailing list in lieu of meeting notes. In this aspect, I failed over the last month, and I apologize for the resulting lack of transparency. Going forward, I'll return to a two-week cycle of email updates for this PMC. Please reach out to me or Chip if you have concerns over continuing the "offline" model for the Utilities PMC. ## CLI [CLI v6.12.3][] was released on August 31st, which notably includes many community PRs and remove of codegangsta in preparation for an epic to revamp `cf help`. [CLI v6.12.3]: https://github.com/cloudfoundry/cli/releases/tag/v6.12.3 CLI has scheduled an inception on 2015-09-09 in San Francisco, Greg Oehmen will be sending out details later this week. ## Java Utilities Work continues on moving the Eclipse tools for Cloud Foundry to the Eclipse Foundation. Immediate goal is inclusion in the Luna SR1 release. The team is planning an inception for "v2" of `cf-java-client`. Immediate goals will include support for CCv3 and to improve upon decisions made during the initial implementation. We expect the inception planning process to take some time, while some high-level design work is done to build abstractions on top of a large number of API endpoints. |
|
Re: UAA restart invalidates a valid token
Filip Hanik
After the fix, having override: true should not revoke the tokens. If it
toggle quoted message
Show quoted text
still does, then it's a bug and we would like to know. thanks On Wed, Sep 9, 2015 at 8:37 AM, Kayode Odeyemi <dreyemi(a)gmail.com> wrote:
Awesome. |
|
Re: UAA restart invalidates a valid token
Paul Bakare
Awesome.
toggle quoted message
Show quoted text
option 2 is definitely the cause of the problem. Thank you very much. On Wed, Sep 9, 2015 at 4:32 PM, Filip Hanik <fhanik(a)pivotal.io> wrote:
We introduced a feature called 'revokable tokens'. A token would |
|
Buildpacks PMC - 2015-09-09 Notes
Mike Dalessio
Hello CF community,
Apologies for the lapse in sending timely Buildpacks PMC notes (see comments below). These notes are permanently available at: https://github.com/cloudfoundry/pmc-notes/blob/master/Buildpacks/2015-09-09-buildpacks.md -mike ----- # Buildpacks PMC Notes as of 2015-09-09 ## Table of Contents 1. Update on "Offline" PMC Discussion 2. Update on Stacks 3. Update on Buildpacks 1. General 2. go-buildpack 3. php-buildpack 4. ruby-buildpack 5. java-buildpack 4. Post-mortem on java-buildpack Certificate Expiration Incident ## Update on "Offline" PMC Discussions In the previous PMC meeting, held on 2015-07-27, the Buildpacks PMC agreed to tentatively stop conducting regular synchronous meetings, and instead move to an "offline" model where discussions and, if necessary, voting would be conducted on the public cf-dev@ mailing list. As part of this change, the PMC Lead (that's me!) committed to sending regular status updates to the mailing list in lieu of meeting notes. In this aspect, I failed over the last month, and I apologize for the resulting lack of transparency. Going forward, I'll return to a two-week cycle of email updates for this PMC. Please reach out to me or Chip if you have concerns over continuing the "offline" model for the Buildpacks PMC. ## Update on Stacks [cflinuxfs2 v1.2.0][] through [cflinuxfs2 v1.7.0][] were released ([all cflinuxfs2 releases][]), reflecting the team's focus on regular releases and short turnaround times for CVEs. [cflinuxfs2 v1.2.0]: https://github.com/cloudfoundry/stacks/releases/tag/1.2.0 [cflinuxfs2 v1.7.0]: https://github.com/cloudfoundry/stacks/releases/tag/1.7.0 [all cflinuxfs2 releases]: https://github.com/cloudfoundry/stacks/releases One notable addition to the rootfs is the utility [jq][]. `jq` is commonly vendored in custom buildpacks to parse CF environment variables (such as `VCAP_SERVICES`). It's also used in the `go` buildpack to parse `Godeps.json`. Adding `jq` to the rootfs is intended for use by future buildpacks, to obviate the need to vendor a binary version of it. [jq]: https://stedolan.github.io/jq/ Another notable change was introduced in [cflinuxfs2 v1.4.0][], which makes it incompatible with Warden from cf212 and earlier. This change was unfortunately necessary to support Garden and Diego. The release notes contain instructions on how to modify Warden and cf-release if you need to backport later rootfses into earlier cf-releases. [cflinuxfs2 v1.4.0]: https://github.com/cloudfoundry/stacks/releases/tag/1.4.0 ## Update on Buildpacks ### General Research continues on how to improve the state of extensibility for Buildpacks. Tracker stories and their results are available in the ["architecture" epic][]. ["architecture" epic]: https://www.pivotaltracker.com/epic/show/1898760 ### go-buildpack [go-buildpack v1.6.0][] and [go-buildpack v1.5.0][] were released. These versions notably add support for golang 1.5.1, remove support for golang 1.1.x, update [godep][], and remove the vendored python interpreter. [go-buildpack v1.6.0]: https://github.com/cloudfoundry/go-buildpack/releases/tag/v1.6.0 [go-buildpack v1.5.0]: https://github.com/cloudfoundry/go-buildpack/releases/tag/v1.5.0 [godep]: https://github.com/tools/godep ### php-buildpack [php-buildpack 4.1.2][] was released. This version notably makes a non-backwards compatible change to composer detection, updates nginx to 1.9.3, and bumps the supported PHP versions to 5.6.12, 5.5.28 and 5.4.44. [php-buildpack 4.1.2]: https://github.com/cloudfoundry/php-buildpack/releases/tag/v4.1.2 We expect to release 4.1.3 this week with further updates to supported PHP versions and nginx version. A short survey was sent to cf-dev@ this week to evaluate whether, and how, to support HHVM going forward. Please respond if you're a PHP user. ([survey link][]) [survey link]: https://docs.google.com/forms/d/1WBupympWFRMQnoGZAgQLKmUZugreVldj3xDhyn9kpWM/viewform?usp=send_form Finally, a note that PHP 5.4.x will reach End Of Life on 2015-09-14 (that's next week). Beginning with php-buildpack v4.1.3, deprecation warnings will be emitted upon staging apps that use PHP 5.4. We intend to remove PHP 5.4.x support from the php-buildpack within a month after EOL. ### ruby-buildpack [ruby-buildpack v1.6.2][] through [ruby-buildpack v1.6.7][] were released. Notably, these versions add support for JRuby 9.0.1.0 and 1.7.22, Ruby 2.2.3, 2.1.7 and 2.0.0-p647, openjdk 1.8.0_51, and sets the default Ruby version to 2.2.3. [ruby-buildpack v1.6.7]: https://github.com/cloudfoundry/ruby-buildpack/releases/tag/v1.6.7 [ruby-buildpack v1.6.2]: https://github.com/cloudfoundry/ruby-buildpack/releases/tag/v1.6.2 ### java-buildpack [java-buildpack v3.1.1][] was released on July 30th, which updates dependencies. The java-buildpack team has also committed changes to `master` to add zero-touch support for Safenet Luna HSMs, and to make a number of improvements to the Java memory calculator. [java-buildpack v3.1.1]: https://github.com/cloudfoundry/java-buildpack/releases/tag/v3.1.1 ## Post-mortem on java-buildpack Certificate Expiration Incident On 2015-08-31, between 1300 UTC and 1554 UTC, applications failed to stage that rely on an "online" (or "uncached") version of the java-buildpack, or an "online" version of the ruby-buildpack who are using JRuby. The root cause of this incident was the expiration of the SSL certificate for `download.run.pivotal.io`, which is a domain used to front the artifacts downloaded by the java-buildpack. Two aspects of this incident were focused on during a post-mortem on 2015-09-09, to which Chip and Sam were invited. 1. __The certificate was allowed to expire__ 2. __An open-source buildpack is relying on a Pivotal-managed domain and SSL certificate__ The first aspect resulted in Pivotal-internal action items to centralize cert management and to require an escalation policy for each cert. These are perhaps uninteresting to most readers, but I'm happy to provide more detail on request. The second aspect is being addressed in part by [this Tracker story][] to move to a Foundation-managed domain and cert. [this Tracker story]: https://www.pivotaltracker.com/n/projects/788065/stories/102935172 Ben Hale and I will be working with Chip and the Foundation to remove the dependency on this domain as quickly as we can; and Pivotal is committing to maintaining that domain and cert so existing buildpacks will continue to work until users are migrated to updated versions. One open question that was raised during the post-mortem: How can we better communicate urgent issues like this to the CF community? The cf-dev@ list tends to be a bit noisy, and isn't commonly used for urgent communications. If anyone has ideas for how we can better respond as a community, I'd love to hear your ideas. |
|
Re: UAA restart invalidates a valid token
Filip Hanik
We introduced a feature called 'revokable tokens'. A token would
toggle quoted message
Show quoted text
automatically be revoked if a client changed it's secret. All tokens issued previously would be automatically revoked. In earlier versions of the UAA, if you have clients in your manifest, and override flag set to true, even though the secret didn't change in the manifest, the hashed secret was regenerated and thus this would expire all the tokens. you have a couple of different options 1. Update your UAA - this was fixed in https://www.pivotaltracker.com/n/projects/997278/stories/97682912 2. Set override to false for your boot strapped clients and users On Wed, Sep 9, 2015 at 8:22 AM, Kayode Odeyemi <dreyemi(a)gmail.com> wrote:
Hi, |
|
UAA restart invalidates a valid token
Paul Bakare
Hi,
What could cause a valid token to become invalid on UAA restart? I've noticed this overtime, that a token (of client_credentials grant type) which has a validity of 315360000 and has been used for authentication and authorization of users and resource servers, suddenly returns invalid_token when validated after a UAA restart. { "error": "invalid_token", "error_description": "eyJhbGciOiJIUzI1NiJ9.eyJqdGkiOiI2M2JlZjY0Yi0yZDgzLTRhOTEtOGRlOS00NjI1YWM1N2NiNjMiLCJzdWIiOiJ1c2VyYWNjb3VudCIsImF1dGhvcml0aWVzIjpbImNsaWVudHMucmVhZCIsInNjaW0udXNlcmlkcyIsImNsaWVudHMuc2VjcmV0IiwidWFhLnJlc291cmNlIiwic2NpbS5tZSIsIm9wZW5pZCIsInVhYS5hZG1pbiIsInNjaW0ucmVhZCIsInBhc3N3b3JkLndyaXRlIiwiY2xvdWRfY29udHJvbGxlci5yZWFkIiwiY2xvdWRfY29udHJvbGxlci53cml0ZSIsIm9hdXRoLmFwcHJvdmFscyIsImNsaWVudHMud3JpdGUiLCJzY2ltLndyaXRlIl0sInNjb3BlIjpbImNsaWVudHMucmVhZCIsInNjaW0udXNlcmlkcyIsImNsaWVudHMuc2VjcmV0IiwidWFhLnJlc291cmNlIiwic2NpbS5tZSIsIm9wZW5pZCIsInVhYS5hZG1pbiIsInNjaW0ucmVhZCIsInBhc3N3b3JkLndyaXRlIiwiY2xvdWRfY29udHJvbGxlci5yZWFkIiwiY2xvdWRfY29udHJvbGxlci53cml0ZSIsIm9hdXRoLmFwcHJvdmFscyIsImNsaWVudHMud3JpdGUiLCJzY2ltLndyaXRlIl0sImNsaWVudF9pZCI6InVzZXJhY2NvdW50IiwiY2lkIjoidXNlcmFjY291bnQiLCJhenAiOiJ1c2VyYWNjb3VudCIsImdyYW50X3R5cGUiOiJjbGllbnRfY3JlZGVudGlhbHMiLCJyZXZfc2lnIjoiNWQ4Yjg5NGUiLCJpYXQiOjE0NDEzNTk0NzUsImV4cCI6MTc1NjcxOTQ3NSwiaXNzIjoiaHR0cDovL2xvY2FsaG9zdDo4MDgwL3VhYS9vYXV0aC90b2tlbiIsInppZCI6InVhYSIsImF1ZCI6WyJ1c2VyYWNjb3VudCIsImNsaWVudHMiLCJzY2ltIiwidWFhIiwib3BlbmlkIiwicGFzc3dvcmQiLCJjbG91ZF9jb250cm9sbGVyIiwib2F1dGgiXX0.qnOvyxBNKkDADZ2ODyQfZ98nj7cqoSGMIouduERU3Vg" } Any ideas please? |
|
Re: Application only starts when a bogus service is attached
Fabien LEBRERE
Hi Amit,
Sorry, you right. In fact, I'm an user of the CF' Ramon installation ;) Daniel has solve my problems with the last link (JAVA_OPTS "-Djava.security.egd=file:///dev/urandom"). Cheers Fabien |
|
Re: When will dea be replaced by diego?
Layne Peng
Thanks Matthew. Very detail reply. :) It seems the all-in-one release won't come out soon.
|
|
Re: How to deploy a Web application using HTTPs
Juan Antonio Breña Moral <bren at juanantonio.info...>
Hi James,
Yes, you have reason, I returned to test: https://nodejsssl.MY_IP.xip.io/ and I see the sreeen where Chrome advise the user about a NET::ERR_CERT_AUTHORITY_INVALID so, the node application is running: https://raw.githubusercontent.com/jabrena/CloudFoundryLab/master/Node_HelloWorld_ssl/docs/firstScreen.png but if you click to continue, I receive this message: 404 Not Found: Requested route ('nodejsssl.MY_IP.xip.io') does not exist. My question is CF could fix this issue to deploy applications which it runs with https protocol. Juan Antonio |
|
Re: Placement Pools
Dieu Cao <dcao@...>
Yes, there are some differences in the approach from that document.
toggle quoted message
Show quoted text
-Dieu On Sat, Sep 5, 2015 at 2:21 PM, Noburou TANIGUCHI <dev(a)nota.m001.jp> wrote:
I'll take on getting the proposal for isolation groups shared withcf-dev,hopefully, in the next couple of weeks.Great! |
|
Re: v3 cc api style guide feedback requested
Dieu Cao <dcao@...>
Hi Guillaume,
toggle quoted message
Show quoted text
Just to ensure that it will be addressed, could you add it as github issues on the repo? Hoping to do another pass at the remaining open issues later this week. -Dieu On Mon, Sep 7, 2015 at 2:09 PM, Guillaume Berche <bercheg(a)gmail.com> wrote:
Thanks for sharing this great spec. |
|
Re: When will dea be replaced by diego?
Thanks a lot Matthew and Amit, the document can now be publicly
toggle quoted message
Show quoted text
accessed/commented. Guillaume. On Tue, Sep 8, 2015 at 4:09 PM, Amit Gupta <agupta(a)pivotal.io> wrote:
Done, anyone with the link should be able to comment now. |
|
Re: CAB September Call on 9/9/2015 @ 8a PDT
Amit Kumar Gupta
Hi all,
toggle quoted message
Show quoted text
I will not be able to attend the CAB meeting tomorrow, but I have added my notes to the agenda doc. MEGA has been/will be working on a bunch of exciting things, and I welcome questions/comments via email, either through the cf-dev mailing list or directly. Best, Amit, CF Release Integration team (MEGA) PM On Tue, Sep 8, 2015 at 8:19 AM, Michael Maximilien <maxim(a)us.ibm.com> wrote:
Final reminder for the CAB call tomorrow. See you at Pivotal SF and talk |
|
Re: So many hard-coded dropsonde destinations to metrons
Noburou TANIGUCHI
We're happy to see it.
Thanks a lot, Warren. Warren Fernandes wrote The LAMB team added a chore to discuss how we can better manage a ----- I'm not a ... noburou taniguchi -- View this message in context: http://cf-dev.70369.x6.nabble.com/So-many-hard-coded-dropsonde-destinations-to-metrons-tp1474p1565.html Sent from the CF Dev mailing list archive at Nabble.com. |
|
Re: Application only starts when a bogus service is attached
Amit Gupta
Hi all,
Ramon, Fabien, are you both working on the same problem or is Fabien's response to Daniel separate from Ramon's original question? I couldn't understand Fabien's response. Did Daniel's help provide a satisfactory solution to the problem, or are you still using a workaround (whether it's binding a bogus service, or some other workaround)? Thanks, Amit, OSS Release Integration PM |
|
Re: feedback request: extracting a common route-registrar job
Dieu Cao <dcao@...>
Agree with Zach, that for the CAPI team we would prefer to just wait for
toggle quoted message
Show quoted text
the routing-api to be ready before prioritizing work to change the way CC registers its routes. Dieu On Tuesday, September 8, 2015, Amit Gupta <agupta(a)pivotal.io> wrote:
Hey all, |
|
Relation between Network property in Resource pool block and Network property in Actual Job block
Ronak Banka
Hello All,
I have a resource pool , let say small_z1 - name: small_z1 network: cf1 stemcell: stemcell-xyz cloud_properties: instance_type: m1.small availability_zone: zone1 and a Job , router having two networks assigned to it - name: router instances: 1 networks: - name: router_internal default: [dns, gateway] static_ips: - xy.xy.xy.xy - name: router_external static_ips: - yz.yz.yz.yz gateway: yy.yy.yy.yy networks: apps: router_internal management: router_internal resource_pool: small_z1 With these properties there are no issues anywhere. what is the network property in resource pool responsible for, if the created job networks and not linked to the one in pool?? Regards, Ronak -- View this message in context: http://cf-dev.70369.x6.nabble.com/Relation-between-Network-property-in-Resource-pool-block-and-Network-property-in-Actual-Job-block-tp1562.html Sent from the CF Dev mailing list archive at Nabble.com. |
|
Re: Any word on a large install version of CF on OpenStack?
Amit Kumar Gupta
Hi Michael,
toggle quoted message
Show quoted text
What do you consider "large"? In principle, nothing is stopping you from deploying a large cf deployment to your own OpenStack environment. When you say "seeing a large install version of CF on OpenStack," whom would you like to see produce this large install? There are several large CF-on-OpenStack installs out there in the wild, but are you specifically waiting on one from Stark & Wayne? Best, Amit On Tue, Sep 8, 2015 at 2:55 PM, Michael Minges <mminges(a)ecsteam.com> wrote:
Curious whether there is any word on a possible time frame of seeing a |
|
Re: feedback request: extracting a common route-registrar job
Amit Kumar Gupta
Hey all,
toggle quoted message
Show quoted text
The router already has some health check behaviour -- you can naively register routes with it and it's smart about knowing whether to actually route traffic or not. I'd like to understand what the specific use cases are that would require a route-registration job to support additional custom health check logic provided by the various colocated jobs. Here's the set of things that are being done/need to be done for this track of work: 1. extract route-registration process from UAA job in cf-release into its own job in cf-release (note that the new uaa-release doesn't have this process) [story done, needs acceptance] 2. use this route-registration job colocated with UAA in the cf manifests. [story done, needs acceptance] 3. use this route-registration job colocated with CC, HM9k, and doppler in the cf manifests. [stories in flight] 4. discover additional requirements for a generic route-registration job to be useful [this email thread] 5. implement features in route-registration job to satisfy requirements 6. wait for consul to be declared stable, and enable the routing-api as a default part of cf deployments [next couple final versions of cf-release will validate consul] 7. all things doing route-registration should use routing-api 8. extract route-registration job out of cf-release (and put it where?) in order to make it usable by other things like Gemfire, MySQL, Riak, etc. 9. discover more additional requirements for a generic route-registration job to be useful 10. implement more features in route-registration job to satisfy requirements 11. implement more features in routing-api to satisfy requirements This isn't necessarily an ordered list, however we want to extract and start using the route-registration stuff early to discover requirements, and whether it's even a feasible idea, rather than waiting on consul and routing-api to validate it. A nice additional consequence of doing this extraction early is that once we want to switch over to routing-api, it only needs to be done in one place. Jens, Here is a story in the Routing backlog to enable the routing-api to support sticky-session route registrations: https://www.pivotaltracker.com/story/show/100327146 Best, Amit On Tue, Sep 8, 2015 at 3:43 PM, Lyle Franklin <lfranklin(a)pivotal.io> wrote:
The mysql and riak services register routes with this guy: |
|
Re: feedback request: extracting a common route-registrar job
Lyle Franklin
The mysql and riak services register routes with this guy:
toggle quoted message
Show quoted text
https://github.com/cloudfoundry-incubator/route-registrar. At a glance, the option to run a healthcheck script to determine whether the service was healthy would be our only real requirement in addition to the routing API interaction. We'd love to be guinea pigs for any extracted library. - Lyle On Tue, Sep 8, 2015 at 1:38 PM, Zach Robinson <zrobinson(a)pivotal.io> wrote:
i think it's a great idea, but I would wait until the routing api goes |
|