Skip to content

craigbr/ansible-monasca-schema

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

#Monasca-Schema Adds schema to mysql and influxdb, creates db users and creates kafka topics.

Tags

These tags can be used to specify just sections of the role

  • kafka_topics
  • mysql_schema
  • influxdb_schema
  • winchester_schema
  • migration

##Requirements The monasca services for mysql, influxdb and kafka must be up and running. Influxdb must be version 0.9+.

  • zookeeper_hosts - comma separated list of host:port pairs.
  • influxdb_url - URL of the influxdb server
  • mon_influxdb_users - dictionary of user/password pairs
    mon_influxdb_users:
      - username: monasca-api
        password: some-password
  • mon_mysql_users - Array of entries with a username and password, for example:
    mon_mysql_users:
      - username: monasca-api
        password: some-password

By default, the creation of the kafka topics assume multiple kafka servers. If there is only one, then kafka_replicas should be set to 1. The default is 3.

The number of partitions for the kafka topics can be controlled with:

  • kafka_events_partitions - number of partitions for the various events topics, the default is 12
  • kafka_metrics_partitions - number of partitions for the metrics topic, the default is 64
  • kafka_retry_notifications_partitions - This should be the number of systems running the Notification Engine, the default is 3

If the kafka topics have been created, neither the number of partitions nor the number of replicas will not be changed even if the above parameters are changed and the role run again.

##Optional Vertica Parameters

  • vertica_resource_pools_limits - Array of entries with name, maxmemorysize and optional memorysize for limiting memory usage of vertica_resource_pools
    vertica_resource_pools_limits:
        - name: wosdata
          memorysize: 125M
          maxmemorysize: 250M
  • vertica_max_client_sessions - The max number of allowed client sessions. Default is 50

Migration

Migration requires given databases engine to be running. Following variables must be set prior to migration:

  • [required] migration_pack - Array of file names (without sql extension) under files/migration/{db_mode},
  • [optional] migration_pack_dir_dest - remote location where migration scripts are copied into and executed from. By default it is equal to {{database_root_dir}}/migration.
  • [optional] migration_pack_dir_src - local location where migration pack are copied from. By default it points to migration directory under files.

db_mode takes different values for following variables being set to true:

  • mysql_schema_enabled - mode is mysql

Single migration only

Migration can not be run multiple times. This means that once migration scripts have been copied to remote host and applied for given database, another migration run will not modify the database again. In order to re-run migration all files under migration_pack_dir_dest must be deleted.

Supported databases

  • MySQL

TODO

  • The notification engine user could be given readonly access to the db but in the current setup there is no way to specify that so it gets full access like the rest of the users.

Running with Vertica

  • To run with vertica make sure that vertica is up and running via the Vertica Role
  • Change the variable database_type in defaults to vertica.
  • Add in the users you want for your vertica database to the defaults.
  • If running in a cluster set the variable vertica_cluster to a comma separated list of the group of nodes you want apart of the cluster
  • A cron job is created to delete partitions of data from vertica. It is default to delete anything more than 30 days old. If you want to set it to something else set vertica_retention_period in your call (in days) to the playbook.

For Example:

vertica_cluster: "10.10.10.1,10.10.10.2,10.10.10.3"
database_type: vertica
vertica_users:
  - username: monitor
    password: password
    role: monitor
  - username: mon_api
    password: password
    role: monasca_api
  - username: mon_persister
    password: password
    role: monasca_persister

##Example Playbook

hosts: group
sudo: yes
roles:
  - {role: monasca-schema, tags: [monasca-schema]}

##License Apache

##Author Information Tim Kuhlman Monasca Team email [email protected]

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 76.4%
  • Shell 23.6%