[INFO] Bi-Weekly Runtime PMC Notes 2017-09-20
Dieu Cao <dcao@...>
Hello all,
The Runtime PMC meets on a bi-weekly basis to share current status with each other and notes are hosted in a repo here [1] You'll find update notes there dating back to 2015! Copying the updates from this weeks meeting [2] below to increase visibility into current tracks of work and I plan to continue this with future bi-weekly updates. Would appreciate feedback on whether this is useful, spammy, or other suggestions/comments. -Dieu CF Runtime PMC Lead [1] https://github.com/cloudfoundry/pmc-notes/tree/master/Runtime [2] https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md ----- Runtime PMC Meeting 2017-09-20 <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#agenda> Agenda - Announcements - PMC Lifecycle Activities - Backlog Review <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#announcements> Announcements <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#pmc-lifecycle-activities>PMC Lifecycle Activities <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#discussion> Discussion - Discussed inclusion of CFF Roadmap section at the end of these notes that each PM will be responsible for keeping up to date for the week. - Agreed to try it with the next bi-weekly PMC notes <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#backlog-reviews>Backlog Reviews <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#cli---dies-köper>CLI - Dies Köper - Released cf CLI 6.31.0 with Docker image support in the app manifest. (Release notes <https://github.com/cloudfoundry/cli/releases/tag/v6.31.0>) - Planning to release late this week/early next week our experimental V3 commands (for multiple processes, granular push control and multiple buildpack support). (Draft release notes <https://www.pivotaltracker.com/story/show/149541909>) - Continuing work on V3 commands (v3-env, v3-unset-env) and preparation for v3-ssh - Expecting subsequent releases to apply user feedback, as well as taking advantage of post-GA CC V3 API improvements. - Progress on push refactor: - Exploring calling back to old push implementation for outstanding features so we can start releasing it for user evaluation (and in particular, consumption by CATS and other test sets). Outstanding push features include app manifest with global attributes, "inherit" or route attributes other than "routes", as well as route related flags (-d, --hostname, ...). (Draft release notes <https://www.pivotaltracker.com/story/show/151113529>) - Further out: - Authentication with client id & secret (no user) - TCP port range support for router groups. (Draft release notes <https://www.pivotaltracker.com/story/show/143621081>) - Droplet upload - Service instance sharing - Last login time displayed on login <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#garden---julz-friedman>Garden - Julz Friedman - Let's get ready to rootless: rootless garden work complete, going to attempt to enable feature flag on PWS and - if stable - will start transitioning to this as new default. - OCI phase one: still blocked on groot, hopefully unblocked tomorrow then ready to be enabled experimentally. - Sidecar containers: design document circulating, intend to incept on this in next 2-3 weeks (taking the space opened up by completion of rootless track) - Umask-hardened stemcell compatibility: current release makes garden compatible with umask-hardened stemcell, next garden release makes garden fully take advantage of new umask hardening rules <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#grootfs---george-lestaris>GrootFS - George Lestaris <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#past-couple-of-weeks>Past couple of weeks - Rootless: Still wrapping up some rough edges with rootless. - Few things came up (thankfully) by having Garden fully integrate with rootless GrootFS. - Exploring the removal of the BTRFS driver from GrootFS. - OCI Buildpacks: Spiking and working on integration with the blobstore to have GrootFS download the droplets (part of OCI Buildpacks phase 1). - Cache Management: Added some cache management metrics. - grootfs create returns a partial OCI runtime spec JSON. This is part of our last iteration on the Garden - Image Plugin interface. <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#next-couple-of-weeks>Next couple of weeks - Cache Management: We had a feature kickoff with the team today. We should be able to complete the work for the new cache management configuration in the next couple of weeks. - OCI Buildpacks / Rootless: Last (rootless) story is currently in-flight. We should be cutting a release after that. No new work on these tracks is expected. <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#garden-windows---colin-jackson>Garden-Windows - Colin Jackson - PR to cf-deployment for experimental windows 2016 opsfile. - Found a technical difficulty with mounting SMB shares onto the host and then through to Windows Server Containers. Exploring alternative solutions. - Started work on backporting the buildpackapplifecycle to work on the windows2012R2 stack for multi-buildpack support and credhub ref resolution. <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#diego---eric-malm>Diego - Eric Malm - Running a Consul-independent environment in Diego CI: BOSH DNS, no Consul service registrations or locks - Integrated option to use BOSH Process Manager to containerize Diego jobs - Integrated latest Loggregator client as part of v2 adoption - Fixed bug preventing Tasks from completing with Envoy present - Upcoming: - Start implementing APIs for rolling updates of LRPs - Investigate rebalancing strategies for "boulder" app instance placement <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#routing---shannon-coen>Routing - Shannon Coen - Continuing support for TLS to backends and validation of app identity - Working with Infrastructure team to enable config of IaaS networking, firewall rules, and load balancers for dedicated routing to isolation segments, using bbl <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#infrastructure---evan-farrar>Infrastructure - Evan Farrar <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#consul-release> consul-release - consul clients will not fail if the servers are scaled to zero to support migration to BOSH DNS <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#etcd-release> etcd-release - no changes <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#bosh-bootloader-aka-bbl> bosh-bootloader (a.k.a bbl) - Exposing the terraform internals of BBL a little more - Exposing more control over the bosh create-env, ops files, cloud configs, etc - Azure load balancers in flight - Setting up an openstack env <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#release-integration---david-sabeti>Release Integration - David Sabeti <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#cf-release> cf-release - Upcoming release will include cf-syslog-drain-release <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#cf-deployment> cf-deployment - IaaS compatibility validated for vSphere and Azure - cf-deployment has some early validation for BOSH DNS - TCP Router deployed in cf-deployment by default <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#cf-deployment-concourse-tasks> cf-deployment-concourse-tasks - Tasks are compatible with BOSH directors that include CredHub <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#uptimer> uptimer - Improvements to logic for measuring log uptime when cells are draining <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#cf-acceptance-tests> cf-acceptance-tests - Most widely-used app in CATs has been replaced with a Golang application to reduce test flakiness - ASG tests updated to be able to pass on Azure <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#cf-smoke-tests> cf-smoke-tests - No update <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#nats-release> nats-release - No update <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#postgres-release---valeria-perticara>postgres-release - Valeria Perticara <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#postgres-release> postgres-release - Fixing bug found during DB minor upgrade - Investigating an issue with monit when start phase is long (due to upgrade) - Reinforcing client authentication configuration by optionally disable the trust authentication for local connections - Spiking on providing some hooks <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#haproxy---geoff-franks>HAProxy - Geoff Franks - Bugfix for the newly added cert_chain + private_key configuration logic related to newlines, to make life easier for operators - The TCP backends now consume the health_check_http link property, failing back to values configured in the manifest (like other tcp backend link properties). - New release forthcoming to support mutual TLS on frontend + backend connections <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#mysql---marco-nicosia>MySQL - Marco Nicosia <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#loggregator---adam-hevenor>Loggregator - Adam Hevenor - Renamed scalable syslog to cf-sylog-drain release and posted to bosh.io - Cut several releases to allow for inclusion of cf-syslog-drain into cf-release - Finalized several updates with our go-loggregator client - one of these broke container metrics for users running cf app - additional test coverage has been added to CATs for this - Investigated the use of BOSH DNS instead of CONSUL - Removing UDP from Doppler notice. - Removing rsyslog configuration from Metron delayed. Upcoming: - Experimental feature: container metrics in syslog drains. - Defining an event type for Loggregator v2 Operator/Developer Feedback: - We are seeking feedback about potential large feature narratives. Please get in touch if you have particular pain points or ideas. We are looking for opreator feedback. <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#uaa---sree-tummidi>UAA - Sree Tummidi - UAA 4.6.0 released. Detail here <https://github.com/cloudfoundry/uaa/releases/tag/4.6.0> - UAA Docs are live @ http://docs.cloudfoundry.org/uaa/index.html - In Progress - Performance & Scaling Metrics - Multifactor Auth with Google Authenticator - Read Only Mode for UAA API <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#capi---zach-robinson>CAPI - Zach Robinson - Working on support for service brokers that use Credhub to store service bindings and service keys - Working on scripts to provide BBR functionality for CCDB <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#services-api---matthew-mcneeney>Services API - Matthew McNeeney - Designed a number of CC API endpoint options for service instance sharing and discussing with CAPI team which one to proceed with - Changed service broker catalog validation logic to stop requiring "type": "object" and $schema fields to improve support for service authors wanting to use draft 6 of JSON schema (instead of the recommended draft 4) - Added a context object to the request made to service brokers to create new service bindings (contains platform-specific information - space_guid and organization_guid) - Updated CC API documentation to include schemas <https://github.com/cloudfoundry/cloud_controller_ng/pull/890> changes <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#permissions---chris-brown>Permissions - Chris Brown - Added a feature flag to CC which causes it to use perm - Send all of the new role assignments to perm (un-assignments not done yet!) - Investigated the cf-mgmt tool which customers are using at the moment Next steps: - Send all un-assignments to perm too - Persist the assignments in perm - Migrate existing assignments to perm in the background <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#persi---julian-hjortshoj>PERSI - Julian Hjortshoj - 95% complete on BBR changes (blocked on CAPI for final commits) - First pass of POC level Container Storage Interface implementation is done and passing our acceptance tests end-to-end - Microsoft has completed legal review of their CIFS/SMB volume release for Azure and is ready to donate that to CFF. We will work with them to get it into the cloudfoundry org and tested in a CI pipeline here. We will also look at making a separate broker for mounting existing shares (like we have for NFS) <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#container-networking---usha-ramachandran>Container Networking - Usha Ramachandran - Working on a technical design document for polyglot service discovery - Spike on using BOSH DNS for service discovery - Added support for rootless mode and completed transitioning tests to use the CLI instead of plugin <https://github.com/cloudfoundry/pmc-notes/blob/master/Runtime/2017/2017-09-20-runtime.md#bits-service---simon-moser>Bits-Service - Simon Moser |
|