Proposal to move Loggregator to new shared-nothing architecture


Jesse Weaver
 

Hello, all,

We propose a new shared-nothing architecture to improve the scalability of syslog drains and to enable whole-platform syslog egress. This allows Loggregator to scale to more drains and logs/metrics per second, moves us to a community-standard log format, and improves the resource efficiency of log and metric egress.

Please see our proposal at https://docs.google.com/document/d/1_Ve4wAkeCC0fIJ1TiAWSfxzNp5zB_Ndoq5UmfUNJtgs/edit?usp=sharing . If you have any feedback, please comment on that document.

Thanks,
The Loggregator Team