Monitoring, rig interface and service discovery

[dolftax]

• Elastic Search for storing time series data
• Fluentd as collector which runs on all nodes
• Agents would write user specific information to fluentd via its HTTP API
• Rig would serve both agent and clients via HTTP API
• JWT used for authentication
• Agent writes its machine/application metadata to etcd
• etcd for service discovery
• Periodic crunching of user specific data from Elastic Search and write to postgres
• Self signed certificates on nodes for TLS
• Kibana for visualization

[kaustavdm]

This is in response to #11 to build a stack for realtime monitoring.

[dolftax]

Stale.