Cluster Kafka

The "kafka" cluster module connects to a single Kafka cluster and continuously retrieves information about the topics in the cluster. The offsets for each partition (and therefore the topic list and partition counts) are sent to the Storage subsystem for use in group status evaluations.

Configuration

The subheading must be a unique name, such as [cluster.myclustername]. The "myclustername" part is the name by which this cluster will be referred to in other parts of the configuration, as well as in HTTP requests and notifications.

[cluster.myclustername]
class-name="kakfa"
servers=[ "kafka01.example.com:10251", "kafka02.example.com:10251", "kafka03.example.com:10251" ]
client-profile="profile-name"
topic-refresh=120
offset-refresh=30

Key	Value Type	Required	Default Value	Description
class-name	string	yes	(empty)	This is the name of the cluster module type. For this module, it must be "kafka"
servers	list of hostname:port	yes	(none)	A list of strings in the form "hostname:port" that point to the servers in the Kafak cluster. At least one is required.
client-profile	string	no	(empty)	The name of a configured client-profile section. If no profile is specified, a default configuration for the client will be used.
topic-refresh	integer	no	60	How often to refresh the list of all topics in the cluster, in seconds.
offset-refresh	integer	no	10	How often to refresh the broker offset for each partition, in seconds.