New Feature Proposals #loggregator
The Loggregator team is planning work on two new feature epics and would love your feedback and input on either. Feel free to comment here or in the documents.
Problem Summary - Noisy Neighbors
Currently if a single application produces logs fast enough, and consistently enough it can exhaust resource throughout the Loggregator system and cause other application logs, or component metrics to be dropped. There is not specific monitoring tools for identifying this occurrence, and isolating the application can be challenging and impactful to operators.
Problem Summary - Scaling Limitations from Persistance Architecture
Deployments with large number of dopplers experience latent and incomplete responses when executing the command cf logs --recent. This is because the implementation of recent logs collects all logs for a particular app across each of the dopplers, and reassembles them to construct the response. This same architecture applies to container metrics so this latency affects the cf push in addition to cf logs recent. It also effectively limits the upper limit of the number of dopplers a deployment could handle.