Towards a scalable management collector

We introduce OmniDisco, our solution to the problem of efficiently collecting, processing and storing massive amounts of monitoring data from a large number of managed devices. OmniDisco defines a modular distributed architecture exhibiting excellent scalability and speed characteristics for data collection from a large number of managed devices. OmniDisco also offers a production-ready extensible software package following our architecture to implement a scalable cloud-ready SNMP [1] collector able to gather and push large amounts of data to distributed data stores such as ElasticSearch [2] clusters. Our performance measurements indicate that OmniDisco can be scaled to collect and process data from large groups of devices, keeping the required collection time relatively stable.