Skip to content

paulpc/azure-logstash

Repository files navigation

Create a load balanced logstash 'cluster' in Azure

This template allows you to create n Virtual Machines under a Public Load balancer and configure log balancing rules based on the default ports:

  • 5044 for beats
  • 5514 for json over TLS
  • 6514, 6515 for syslog over TLS (you will probably need more)

*** remember this is going over the public internet, so, you know, don't event clear text ***

SSH access to the machines will happen jus to the first VM over port 22 - you should use another server as your jump server and set up the keys.

This template also deploys a Storage Account, Virtual Network, Public IP address, Availability Set and Network Interfaces.

The script will prepares the machines with openjdk, logstash 5.6.x and deploy the default configuration file that takes the abovementioned log sources and pushes them to kafka. For this reason, make sure you are deploying to a VNET with Kafka access. I am using the [fields][logsource] property for defining the log source, but you are welcome to use another. For beats, i set it in the beats config file, for JSON, in the source system, and then for the syslog stuff i have to use separate ports to differentiate and then append the property.

About

load balanced logstash deployment in azure

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages