Logging, storing, correlating

Some thoughts on a scalable logging infrastructure with all the bells and whistles

Posted by Emre Bastuz on February 1, 2012

In 2011 / 2012 Mario and me created a presentation to sum up our ideas on a scalable logging infrastructure.

The PDF is available at Logging Storing Correlating.pdf

Some updated view on the topic from a fresh perspective in 2015: While it was cool to learn about technologies like "Flume" or "Cassandra", the described overall setup would have been far too complex to maintain in a productive environment.

I believe that with currently available applications like Logstash, Elasticsearch and Kibana, there are technologies out there that are easier to deploy and to maintain.