Changelog
4e99e75 Fix goreleaser environment variables
9ecea95 Feat: Split clean and task features.
5bfbf6c Warning envsubst is required for some scripts
ae81013 Add license headers
c42895d Fix typo
55513df Add periodic health checks
39c3f12 Set max retries to 1 in agent's client
96994f1 Set SilenceUsage at Root cmd level
941a913 Remove unused dependency
144ed31 Update licenses in NOTICE file
bca61c9 Remove all code references to Badger
f5d71e5 Move up client configuration
4c5ae44 Fix: delete old condition from deployment process
67bf1c4 Change auditor's client config.
af25d17 Add more comments
57d474b Merge pull request #104 from gdiazlo/agents_platform
04ce872 Fix RocksDB cache level size
85b4389 Fix: use metrics counters
8fb9d65 Fix: prometheus agent metrics port
d08fad8 register taskFactory metrics in agent metrics server if it present
8f967d0 Fix: server and agents deployment on AWS without config file
ec66aac AWS deploy: add panel with disk throughput in grafana dashboard
3348034 increase timeout in endpoint test
8e1e874 Update tests to reflect latest changes
a089e95 Handle cancel function in metrics server shutdown
87a9b0f remove old e2d code
c8a5544 AWS deploy: add panel with disk throughput in grafana dashboard
f973299 Add var to allow cflags usage in go runs inside the script
b004e3c Remove unneeded debug messages
e3ca384 Configure QED client for monitor agent needs
5a400d2 Fix default endpoint in client config
e3c511b Fix version checking in balloon consistency query
db80337 remove old agents code
d63a6c1 Increase batch size to 500, as the qed log performance has increased.
4f3ad48 REmove old test_service e2e implementation
cf1b2a0 Check for tasks errors in batchProcessor
397d95d Add error to message bus publish api
9161b1f Update comments
42a152f Add default configurations for simple implementations of notifier, store and taskmanager
d36dc3d Update start scripts with new options
e86fec6 MOve test_service to notifierstore in testutils
2a5a133 Update startup scripts to support new cli options
dfc0417 Move test service to tests folder
d6a8b68 Add publisher agent
2a256fd Mark event as required option for qed client add subcommand
8c11b0a Remove old files
59df917 Add documentation to config options for the cli
940a34b Comment old testing code until it is refactored with the new gossip api
542d9f0 Remove metadata from BatchSnapshots as it is now in gossip.Message
4810039 Change internal server error by bad request errors.
066b569 Server start() does not block. Use stop() to shutitdown
8729a04 Include sender into the server package.
58844f9 Objects with start / stop should not block
6ec665d Update scripts to launch qed components
40d10bb Redesign cli flag parsing. Use new library to generate options from config objects
8a610d9 Redesign gossip package to refine the API
eb4da9b Refactor of agents: new snapshot sore client, task manager, and agent api
ac07447 Fix version metric.
4d95a59 Remove DiscoveryTimeout config option.
feb5da1 Add discovery tests
da04138 Add protocol for /info/shards endpoint
8dee396 Enable AttemptToReviveEndpoints option in agent and riot clients
372ec41 Add log_stream_name sufix terrraform workspace
1e16a79 Profiler now creates a result dir per IP addr
032a44e AWS deploy: organize RocksDB dashboard a bit better
be92e87 AWS deploy: update grafana QED dashboard
b777d3c AWS deploy: make a couple of dashboards dynamic
eb249d6 AWS deploy: add dashboard with RocksDB tables
8552870 AWS deploy: fix metric names in grafana panels
9b0d567 tests/start_profiler: enable custom IP profiling
4dda40c Ability to enable/disable profiling in AWS installation
f59e064 Profiling now listen at :6060
5a0b48e Ease requirements for profiling
fd426ab Merge pull request #102 from aalda/metrics
3d571ac Use String() for default table
3d2625d Fix metrics registering
82f9617 Remove unused metric
5bf1c05 Register all pending metrics
4adc086 Fix previous definitions
1d61f47 Declare metrics at raft balloon level
79ae579 Move balloon metrics to corresponding package
1652a0c Remove unused metric definitions
5b85e8a Move history tree metrics to the corresponding package
3c3a77a Fix metrics
0aca63e Move test metrics server to testutil package
8a53278 Expose per storage table metrics
9178532 Export DB properties
f72e430 AWS deploy: add storage metrics to graphana dashboards
b85daa7 AWS deploy: set graphTooltip to 2 in all occurrences for consistency
d94a90b Improve deploy to enable custom resource targets
6c972e0 Add parallel test for raft node
e711d8c Enable profiling
101eb15 Feat: Change QED instance types to z1d.xlarge
eec548e Merge pull request #101 from suizman/master
a9d8564 Add Riot support for list of QED IP addr
7669721 Expose block cache usage
e843593 Unfix max open files
9042614 Activate partitioned index filters.
66df51e Fix help message in metric
b502bd0 Add benchmark for FSM apply method
f7a4b63 Reduce write buffer size and number for hyper column family
fb625ff Add decisions comments
78526b3 Increase block cache size to 8GB
9de65e2 Enable caching filter and indexes in block cache
d44935d Update use_cases.md
c1e7e6b Feat: update QED instance sizes
6163dfe Merge pull request #98 from aalda/agents_queue
33035b4 Move agents queue from FSM to RaftBalloon
f8a8bae Remove max_total_wal_size option
126eead Fix: qed_server_instances metric didn't show up. Dashboards improved.
9ac5a54 Set max WAL size for both rocksdb instances.
a941df5 AWS deploy: add more block Cache metrics to graphana dashboard
21a7e39 Merge pull request #97 from aalda/remove_index
e563f63 Feat: create QED isolated AWS deployments using terraform workspaces
0593929 Remove index table.
218289f Add riot openapi description
2bfcb14 test:start_server empty ip addr in params cause failures
b07a7d6 Refactor: place images into docs folder.
f6721a1 Restart QED service when config changes
bc3d1c2 Change read preference in agents.
1e2e68b Improve Ansible provision
fea7722 Fix agents config to use list of QEDUrls
fd1c0ad Set deploy riot to 1000M requests by default
e044788 Ignore modules dir changes
ee53275 Separate server metrics from default definitions
09efd47 Fix metrics registry in agents
9a6a9d9 Add more rocksdb metrics
06a1490 Feat: New metric in grafana dashboard - snapshot stored
cbe4d45 Fix: Dashboards wrong time range and refresh rate
28916f3 Feat: Add tags to keep VMs running.
c39064e Feat: Enable grafana systemd.
30240fe Fix metrics test
73cb1a0 Reset RocksDB stats after getting ticker
43ba855 Tune rocksdb options for every column family
4bd229f Feat: New storage dashboard
a48dea7 Fix deploy template pub_urls
f0fdbdb Fix test scripts for QED & QED Agents
d2b4e30 Add auditor specific config in deploy on AWS
90d56e5 Feat: Add storage metrics
cbc8d4b Refactor: naming in prometheus config and QED dashboard
55a1cfa Doc: refactor documentation
a23acfe add license headers
8d33e7a refactor: deploy process to use systemd
f682fee Add atomic flushes to rocksdb bindings
968442b Merge pull request #87 from aalda/column_families
d4a05f8 Remove repeated method
6e31394 Tune some rocksdb options per column family
248a2d7 Replace storage prefixes with tables
956cd55 Support for cross-compiling in provisioning files.
c80a4a5 Include clean script for c-deps
def4f8a Add Dockerfile to enable cross-compiling in MacOS.
85fca47 Add introductory documentation
7bf60f6 Remove tampering code
ebd1127 Integrate prometheus metrics with rocksdb
05b4135 Use pointers instead values to avoid locks copies
3d908d9 Merge pull request #85 from aalda/rocks_stats
6cae8c3 Fix rocksdb include path for CXXFLAGS
1da0db6 Configure azure pipelines to fail tests task on test failures
12c6586 Add missing godocs
ce186ff Add cgo bindings for RocksDB statistics
d3a6963 Fix typo in provisions
1ea7ad3 Configure metrics param for provision and config.example.yml
daa0759 Merge pull request #83 from gdiazlo/agents
5bee53e Remove sleeps and use client retries to handle the e2e async tests
840006a Register metrics in server start and move sender metrics to sender file
84d7a7f Refactor: generalize metrics, integrating server and agents metrics API. Sender and qed server share the same metrics server.
984e60d Fix: typo on log message
bf96bcd Fix: merge with client changes
11422e2 Add some scripts to use qed on development
57b4e88 Remove unneeded tests, while the agents functions get redefined
06b3e0d Add a retrier function to reduce the numhber of sleeps in the code
7ba2a45 Fix: change debug message without the use of deleted function
52b1900 Simplify sender, removing uneeded code. Make it send snaposhots as soon as they are enqueued
a6d896a Add metrics address configuration option to agents
a50f92f Add metrics server to be included on each agent, including methods to stop, start and register metrics
6842d8f Use freecache as storage to evict old items on long tests
233b329 Add metrics to each processor
c328890 Delete metrics and include each metric on the corresponding agent
17b699c Change processor interface to include register metrics method, so processors get their cusrtom metrics registered into the agent server
494ac97 Add alerts and metrics urls as separate options to the different agents
cdb526f Add metric server and remove queue code, refactor sendQueue to send a single batch
a59d02e Add metrics url parameter to agents, because now the metrics server resides in the agent code and not in the processor
4ee600e Change function call so it does not look like an struct
6cbe080 wip: change alertsUrl endPoint in commands and tests
baa047d Add alertsUrl as an standalone endpoint
a3b276f Update configuration options, make agent and config non public atributes, clean up design, implement out queue as a timedout channel, simplify stop code
e861b74 Add new metric to count total snapshots put in test_service
ed8434f Add deduplication of batches in gossip agents, to avoid excessive gossiping.
8677dbf Pass batch by reference to processors
b833486 Clean processor messages
5929023 Add timeout queue and process interval durations to configuration
5fb2735 Remove obsolete tests
9292f74 Free rocksdb slices in order to avoid memory leaks
b9cd8d2 Merge pull request #84 from aalda/raft_rocks
73caf94 Fix copyright year in headers
ca8fdad Integrate new raft-rocksdb store
f8719f3 Implement a new raft store using RocksDB
8cae646 Merge branch 'update-copyright-year-range'
bef04e7 legal headers - copyright: extend time range to include current year
6bfb663 NOTICE: remove "and onwards" from copyright statement for consistency
fd7e7b2 LICENSE: remove obsolete copyright sign from copyright statement
5b33bb5 LICENSE: add line feed at the end of file
7ce78c4 LICENSE: remove trailing whitespace
a459909 Merge branch 'prometheus-setup'
25045fd AWS deploy: remove trailing whitespace
9d98fcf AWS deploy: prometheus restarts upon config updates
f16bab3 AWS deploy: prometheus is now installed as a service proper
f594e71 Merge pull request #82 from aalda/new_client
150c99e Configure riot port for external usage
a4591c8 Riot mark as required kind only if APIMode is unset
6531835 Fix retrier nil pointer dereference
eed371b Integrate new client in riot
93a2429 Fix ping method
24300ba Fix some log messages
b1dc866 Fix infinite recursion in client discovery
3f2cfbe Implement a more advanced client.
166c172 Adding apikey to riot start script
cbad9db Add riot conf in deployment scripts
6265d93 Unify testCases in membership and incremental
5f5459e AWS deploy: fix missing terminfo entries
d9fd34f Merge pull request #81 from iknite/new-riot
eb603af Adding tests for balloon changes
3d29308 Fix range for memberships and incrementals
e607b09 Cleanup riot
63ef719 Cleanup lint errors
4aaf38b Fix panic when asking for wrong membership digest from the future
4487821 New Riot
b9debac Remove metrics from client
bc7e488 Switch new riot to old one
dfb3954 Delete old riot
2951295 Merge pull request #80 from aalda/rocksdb
0fbf825 Force azure pipelines to fail on a single error
1887231 add tee to show construction logs on pipeline console
07a50a9 change covermode in go tests run
2dfc339 pipeline: disable go modules for code coverage tools
a7cf69b fix syntax error in pipeline step
180f444 Add code coverage and publish it in azure pipelines
520a84b Add pthread to the linker to build under ubuntu VM
e303a6b add working directory to rocksdb construction step
a1dce44 Fix azure pipeline syntax error in yaml
a47b531 Revert "Update README with new building instructions"
12c161f Enable PR building on all branches by default
522c3ed Update README with new building instructions
f4f7fdf update azure pipeline
8f31c44 Use rocksdb as default storage engine
e26eda1 Add protobuf to dependencies
7fa84a2 Implement snapshot storage api in rocksdb and badger, and update raftwall to use it for backup and restore
c1dd7fe Make getAlerts to unmarshal json, and skip failing tests waiting for agents work
08ffccf Use rocksdb when testing
3a4d0ee Use rocksdb when testing api
dc377ff Implement backup and load methods
b627664 Fix rocksdb flags to work on darwin
505004b Remove unneeded dependencies
97b0216 Implement rocksdb basic storage
05bfa8f clean up build deps
e7838e2 Fix buildeps
cb933b1 Fix typo on c-deps library path for LDFLAGS
e22dbf2 wip: rocksdb binding ld options
1abf0b6 Add c-deps as submodules
f230aa9 build rocksdb using static_lib target
6e23cdb Remove snappy from git modules
692b20d Add procedure to use static libraries when building rocksdb bindings
5af4c89 Add base skeleton for rocksdb bindings
9a6e508 Add snappy c dependency
e2496e0 Use http instead of ssh in git submodule url
f083b37 Set rocksdb submodule to release v5.18.3
0e02418 Add rocksdb submodule
cdaf43e AWS deploy: drop duplicated code (by me!)
5f77424 AWS deploy: use latest grafana & prometheus releases
eeb2b5a AWS deploy: rename id_rsa_free{,.pub} to id_rsa-qed{,.pub}
7b073d8 Merge branch 'vpc-flow'
e5e0244 AWS deploy: enable VPC Flow
858e7aa Merge branch 'no-default-vpc'
ccc0e2e tests/AWS deploy: don't use default VPC
33bc6d5 AWS deploy: don't use default VPC
a701e12 AWS deploy: usage.md: add note on a fix for terraform issues
d39e511 AWS deploy: copy qed binary to all instances
01ca187 AWS deploy: disable stacking in panel
8eddb31 Fix: query membership proof should return a proof when no event is present
d02f039 Include QED private IPs in terrraform output
df622b7 Make CLI client more interactive
ffd039f AWS deploy: fix usage notes
887db73 e2e test service: fix array bounds comparison
7f6e235 Decrease sender TTL from 2 to 1 to reduce pressure on the storage
82380e2 Fix auditor step in agent tests
ac4870a Remove unused property
7466657 Fix balloon proofs verify
d172e13 Fix: index out of range getting non stored version
7aa821a Dump storage to .log file
28f361c Increase agents size RAM
2391107 Add more agents in default configuration
1ec311c Fix wait_for for ports in ansible
c03b925 Fix typo NewTamperingApi > NewTamperingAPI
914c538 Fix membership actual query version
9647abb Remove unused value option in add command
6d52272 Fix: change version handling in query membership
9af6ac7 Coalesce if bool + if !bool into an if - else structure
8232b61 Merge pull request #79 from gdiazlo/qedgossip
59dadd9 Start two qeds in an xterm on hold
436be7e Add name to gossip agent when started from server
b7f8aa4 REmove commented code
3f0bb62 Use config and remove unused code
733065d Different node names for each agent
a471714 e2e tests: fix race condition upon testing agents
3e7b0f3 Refactor e2e tests to check api and metrics port
1a4f1b9 Improve tampering log.Info alert
fc66637 Enable profiling at cmd level
f7a99ea Merge pull request #78 from gdiazlo/agents
22522f8 remove unused file
41faa09 update go modules
5d1aaf2 Fix testJoin setting up bindAddr
c607cc1 Remove bindaddr default value from config
458d05b Fix log messages
253618f Fix: remove unused graph var
f4c1343 Add TTL to task retry, remove some debug logs
134c0b3 Add timedout channel send, change ttl
430e337 Remove debug log
49fca49 Remove debug and send task without pointer because its an interface
0caf105 Initialize the first segment on store creation
6475fe3 update go modules
52f1d67 remove unused variable
d7e9a5a clean some dependencies
43e36db remove fastcache
d665abd wip: agents clean up
7159599 refactor: agents to use the same task interface, increase channel size in main agent
8e0c5e5 Fix: dot not use 0.0.0.0 ad listen address by default. Use 127.0.0.1
fd0fb61 Fix: use Debug instead of info when printing messages bound to very common activities
dd4ce1f AWS deploy: simplify legend for Membership panel
ea92130 auditor: Type Switching error to discent between connection errors and tampering
a7b9e9d feat: enable tampering server by default
0d02a0d Merge branch 'fix-monitor-alert-flooding'
018ba66 feat: AWS deploy: represent metric for monitor get incremental errs
bc21782 fix: AWS deploy: monitor.go: don't flood storage with alerts when error in getting proofs
eed61d2 Advertise qed ips to agents and don't wait for ports internally
329a81f auditor.go: don't flood storage with alerts when error in getting proofs
220433c Implement a more performant in-memory snapshot store
e98d77d Setup correct level of verbosity in servers
e1dcd46 fix: AWS deploy: fix misnomers in panels
48bb811 AWS deploy: change instance types from t3. to m5.*
651c604 AWS deploy: don't force filesystem creation of external volume
32c2e62 Clean test service
7386665 Allow easy space reclamation for Badger Store
b31a51d Add retries to wait_for ssh:22 in ansible
2c49657 Merge branch 'fix-grafana-panel'
bd1caee fix: AWS deploy: fix networking panel y-axis range
2faad60 Merge branch 'fix-prometheus'
eeee46d feat: AWS deploy: grafana: normalize disk and RAM scales
e734ece feat: AWS deploy: add tag to prometheus tasks for ease of selection
608fb27 feat: AWS deploy: gather host metrics from the agents
839925e Merge branch 'plain-map-to-sync-map'
5b26fe5 test service: replace plain Go map with sync.Map
7735678 test_service: Sort imports and vars
14fd097 Metrics: Add client metrics
81799e4 Metrics: fix Api to API typo
b0d25d7 AWS deploy: use t3.large for storage, and agents
0ce6ffb Merge branch 'ansible-fix'
e3fb90e Remove SIGKILL stop to allow graceful shutdowns
5f8b9bd Increase ulimit in current shell execution for qed start command
5990a25 Remove wait for raft port in qed initializaition
02c32a9 Allow idempotency of qed provisioning
833d915 Add wait for ssh:22 in all machines to run terraform and ansible sequentially
881bf51 Add default paramters in provision.sh
2aca257 Add fixes for ansible
712d488 Merge branch 'add-ebs-volume'
8ab7fbb AWS deploy: add big (hence fast) EBS volume to QED servers
79f1d25 AWS deploy: split qed terraform module in two (qed, agent)
93f58ad AWS deploy: filter all .tf files through terraform fmt
f49efdf Fix wrong indentation in ansible template
b3a5ceb Remove jinja whitespace cleanup
f30ab62 Fix undeclared variable in ansible
8196100 Fix wrong indentation in templates
ba181bf Merge branch 'shared-crosshairs-and-tooltips'
89dbb64 AWS deploy: drop empty panels refs from QED.json to enable shared crosshairs
8cbad04 AWS deploy: enable shared crosshairs and tooltips
34f4986 AWS deploy: disable https until we have the certs ready
23cacf9 Qed sender: add exponential backoff in sender due to i/o timeouts in AWS
feeb677 Add draw rate script
756680b AWS deploy: fix typo in comment
b5e9b89 Install bzr on builder vm
bc4b031 QED Azure pipeline
99ce570 Clean metrics
4b0c2ab Add hyper add metrics
0541fec Add rebuild pruning tests
f07dbd1 Merge pull request #75 from gdiazlo/clean_tests
44280e1 Fix scenario code in client test
bf17b3d Close balloon store when everything else is closed
1abc18c Make temp dirs for each server using standard library
0bad501 Try to force to free memory on test to use low specs testing machines
21b4f30 Improve shutdown/close code
45b8d80 Change curls for Go http client, and check http status code
14f46ae Put badger in LSM mode
2e56eeb Revert "AWS deploy: use plain http when connecting to the qed cluster"
229b4ba Merge pull request #74 from aalda/flatten_history
bba3ff3 AWS deploy: use plain http when connecting to the qed cluster
4db5fcd Flatten history tree package
88836c6 Delete .travis.yml
78c3808 Update README.md
9665b08 Update README.md
b6a1ee4 Set up CI with Azure Pipelines
e4810fa Manual tests: small cleanup
ef27fb1 AWS deploy: copy ca.crt to all
d94e8ba manual tests: Add documentation for TLS export
6741b66 Make history tree thread-safe
a4d04a9 Merge pull request #72 from aalda/flatten_hyper
7916680 Fix method names
6a8838b Flatten hyper tree package
9b16e9e AWS deploy: ensure stderr is redirected to log file
5fcc55d AWS deploy: use a single monitor instance for now
1f885ec Add yaml for codecov
91b12cb Merge pull request #71 from aalda/separated_trees
2657014 Change raft port in all raftballoon tests
b7b694f Change metrics server port in all agents
d79c9c9 Add delays to all e2e tests
98e69b0 Add delay to agent tests
5c60658 Lock hyper tree when closing
71e0e03 Change after function in e2e tests to make agents to leave before closing
deec0c9 Fix all integration problems with new balloon version
395915b Rename hyper2 package to hyper
a32d4be Implement hyper cache rebuild
61d1279 Remove unnecessary conditions
2f41332 Remove FixedBytes method in hyper position
17e27a9 Rename hyper pruning package
03693e2 Complete hyper tree tests
d6d3d3d Add hyper proof tests
427e071 Implement hyper verification pruner
ad84405 Fix hyper search tests
ab1d01d Fix position tests
e875cb8 Add more insert tests
17cc74d Add another hyper tree implementation using a stack of operations
3bf8fae Fix version bytes length
3855655 Fix position test
1854a26 Add functions to add padding to byte slices
425e1c2 Add first version of new hyper batch tree
364c83b Add test util for position
f0effb9 Fix new history tree version
6aa6af5 Add new pruners implementation
6445c72 Separate history tree from hyper tree
57ace16 Add metrics, profiling and charts to new riot
8296a96 ansible: use explicit fact gathering for simplicity
3dc1299 ansible.cfg: fix section for pipelining setting
6d23a86 Use Amazon Linux 2 AMIs (systemd-based)
ba86c97 Tweak pull_requests.md procedure a little bit.
5cb857f Add Pull Request documentation
bd98a7c Merge pull request #68 from jllucas/client
afb3f59 Fix wrong join port
140a492 WIP fix rebase errors
e8a4a1c Add retries when checking topology.
c7b019b Add exponentialBackoff selecting endpoints via RoundRobin.
0b41e5b Refactor HTTPClient constructor parameters
78868e6 Client can now connect to qed cluster-leader being topology-aware.
a56e376 Change /info endpoint to /info/shards
77ac9a0 Fix some default options
d156026 Merge 'connect client to all cluster servers' into already implemented TLS feature
78da9d6 Minor changes in tests
75b5df1 Fix test cluster
acf201b Info endpoint in server. Client test for connecting to leader server.
31dc27f Change leader endpoint to info. Fix typo errors.
ef23483 WIP
0a392b6 Remove specialized Level type due to cobra
e0552d5 Wait until all merges are done
eab43e1 Use correct log level instead of fmt prints
792ea13 Sync hashicorp modules verbosity with logger verbosity
58f9a6e Enable pipelining in ansible.cfg
7f0d6aa Remove test sleep
e44a81d Fix closing batchSenders
ba3b106 Ensure all instances get an appropiate iam_instance_profile
66840dc Improve awslogs Ansible template
99ebb80 Add missing trailing newline to yaml file
a8c3953 Ensure AWS CloudWatch service is restarted upon updating config
c48dae7 Add missing general section to awslogs.conf.j2 template
870664a Fix spurious line in awscli.conf.j2 template
aed587a Cleanup go.sum for travis
838755d Cleanup go.mod unneeded modules
a71c05d Move temporal refactor of riot to avoid conflicts in tests
9d2af0e Fix 'missing api-key header' bug in auditor/monitor-to-qed queries.
9b0daf9 Revert TOFIX, since its not necessary
d699e9e provision.sh: locate terraform-inventory using which
cd97e81 Fix missing quotes bash array expansion
d66bfe5 Move grafana dashboard definitions and data sources to ansible subtree
94d452f Whitelist Ansible task config.yml in gitignore
1715290 Fix typo
df4845c Remove unused function
b8033c5 Improve QED dashboard.
930cbd5 Update ignore file
d9e9996 Start first QED Cluster then Agents..
f822e11 add license headers
e0d6896 Fix prometheus star script
1d28779 Remove terraform prometheus template config
f8585d5 Full provision refactor
282d1ce New provision code with Ansible
892f346 Fine tune agents. WIP: api-key in cmd>client.go>doReq
f9eb3ad Fix agents config and add awslogs stream config
d66c35e Improve sender parallelism.
87dd8de Add port 8888 to terraform network def
c112c41 Increase number of senders.
afb8444 Fix: remove iam_profile reference in terraform
d50a062 tests/riot.go add delay param
02d6b39 Add count support qed terraform module
f7d7681 Force kill qed and agents in test scripts
d3ce718 Improve QED dashboard
8fbe0d7 Improve QED dashboard
58cd7a5 Add Api to riot
aca281d Expose config values for mergo
ad9933a Refactor config params
c07f5a8 Improve QED dashboard
b087eb4 Improve error messages
2618bf4 Fix: do not prompt client help on server side error
9677076 Fix: agents config and qed gossip advertise
2ec809a Set raft self IP
a63b904 Fix typo error in membership message output
3e15bf1 Change test_service metric name
ae6299a Improve QED dashboard, and add metrics
9e161d5 Add new riot command structure
2bf693b Improve error messages
936dbd4 Fix: inmemory-storage deployment
7f6d34c Add metrics to snapshot/alerts store.
8032e29 tests/start_server: include TLS support
c88ba61 Change auditor instance size in AWS
6026e41 Fix: deploy modules and print outputs
0fa0261 Update QED and Host dashboards
3b92847 Add agents to aws deployment
3132c93 Add ssl support riot.go
563616f Generate riot output and set build ARCH
4a56ab0 Add agent metrics.
4d48028 Fix provisional code for agent metrics
75ffedf Fix wrong port conf
efb1377 Add missing files
42ade82 Doc: basic usage deploy/aws
febffef Add grafana dashboards.
3af05fc Fix demo tests
7a63448 Fix join typo
67dad84 Fix prometheus user-data
43197d0 Export GOOS an GOARCH to the ENV
db8ec56 Fix: grafana install configuration
0dda304 Fix ports on tests/e2e
4df5959 Fix grafana config
b9e09a4 Typo: prometheus metrics
b4c7ac0 Add metrics description.
6a44ce7 Fix: prometheus and node_exporter installation
9393af9 Fix terraform file provisioning
d0a9444 Hack cmd/agents to nest thrid level command only once
13993a1 Add S3 bucket encryptation
019bf72 Fix typo
c3dad63 Improve gitignore for data submodules
886ea79 Fix gitignore binary file
fc8765f Use QEDUrl en monitorConfig
1f972fd Force OS and ARCH for deploy build
e13709f Move config terraform bucket to config.tf file
5f30503 Add Grafana in Prometheus VM.
e7e97a6 Store terraform state in S3
ff71620 Change VM names and instance types from T2 to T3.
f738bc2 Open metrics and node-exporter ports in Qed sec.group.
e8ee12e Fix unknown rule in security_group module
0297c07 Fix missing module/qed due to .gitignore misconfiguration
f9bd2de Force metrics enabled
dd2ead7 Fix start/stop test servers
ed2db1f Refactor agents endpoints 9300->8300, 9200->8200, 9100->8100
27cc343 Refactor port for gossip-addr 9100->8400
10aafcf Refactor port for raft-addr 9000->8500
fd08649 Refactor port for metrics-addr 9990->8600
2809170 Refactor port for http-addr 8090->8700
ae0a409 Refactor port for http-addr 8080->8800
9f0d6f8 Allow metrics configuration
e6b7dec Add sample timed summary
c3e9a18 Fix type of counter metrics
69e0d20 Fix typo in comment
74f758a Add health-check endpoint counter
0897e99 Use prometheus.Gatherers to avoid duplicating std collectors
05f3728 Add collectors for process go's garbage collector
420ebee WIP: Make prometheus handler great again
c45832f Fix metrics.go to use non-default Prometheus registry
a649f2f Add a prometheus registry to the Server struct
76d1d4d Drop RCrowleys sample metrics
4f0ae78 Drop dependency on github.com/deathowl/go-metrics-prometheus
324c321 Improve metrics definition inside metrics package.
9af664c Place metrics in specific metrics package.
4c045b2 Add Prometheus Gauge with timer
bb9ab67 Try a Prometheus histogram
275b69d Export Prometheus metrics as well as Crowley's
c74224e Export metrics for prometheus on localhost:9990/metrics
3b4f382 Add prometheus module and config
a034cf3 Fix: ip typo in config example file
8d90941 Configure agents correctly
ee472c6 Fix typo
e0ac88f Fix malformed yaml files
1b5232a Refactor config idempotency
2993ea6 Add deployment infra
ace29e4 Normalize config params
9f2ee3b Fix: add missing SSL config to e2e setup
145fa1c Add serverInfo handler
3cb2606 Add viper to allow config files
9753845 Remove duplicated code
7d7ac62 tests/e2e: add test to verify that the profiling server is up
fade03e server/server.go: fix newHTTPServer() to accept a nil http.ServeMux
bb28636 Complete ca information
117b287 Finish TLS configuration and tests
4655319 WIP client
99761c7 Make TLS configurable
3c07dd8 Server TLS setup
4cc00cb Fix go-vet issue with agent code
5b7dcb1 Add return to response error check condition.
10ae548 Modify Go version in travis. Keep checking value/reference params.
fdce2bb Refactor publisher, monitor and auditor reference/value params
c288741 Pass struct copy instead of reference.
29a911f Derefernce MembershipTasks for sendAlert goroutine
6e4f989 Remove goroutine from sending alert function
b50864f Fix agents tests 3rd scenario race condition.
0e77f3d Fix race condition in e2e agent tests
c55e1b3 Add tamper history capabilities
2b5e1cd Standarize some variable names and log formats
9fc78bc Add tamper test with auditor alert
7be3930 Add 1 event. Check that it has been published without alerts
16be795 Create auditor test. Now it fails.
b675ab6 Tests: signed snapshot publishing works
a5bb017 Refactor server/agents ports
72931cc Fix batchSender behaviour
b71e16c WIP: Improve tamper e2e test.
0be89c2 Tamper test structure
52ed874 Add merge helper
2a74d9f Refactor publisher like monitor/auditor
e6a343f WIP:e2e
0296fa6 Improvement: discart Body to reuse connection
1670123 tests/riot.go close body after evaluating statusCode
cd0c49c tests/riot.go: enable profiling
b252f47 Fix: memory leak in tests/riot.go
12d31e9 Add png to usage
4625d18 Improve readme
da00993 usage.md: fix typo
d9c3ece usage.md: specify bash for code block semantics
05e1c9e usage.md: remove trailing empty lines
588136b usage.md: remove trailing whitespace
a278be5 tests/make_graph: fix spurious whitespace
69b5cfa tests/make_graph: delay capturing screen geometry until is actually needed
1df205b tests/make_graph: fix a couple of cache handling issues
425d588 doc: Include basic usage file for testing tools
5009afa Improve README
44c066a Add bash to code blocks to allow coloring in markdown
9c421e6 Add advanced_usage and cleanup docs
c445d70 tests/make_graph: implement cache for /tmp/data
2e97ac3 tests/make_graph: plot several functions in the same graph
9fd0d7e Add cli e2e tests
2bb5450 .travis.yml: send email notifications to group instead of users
1f021e7 tests/make_graph: fix series title
8f8eaf7 tests/make_graph: fix function matching algorithm
e7099d1 tests/make_graph: fix func_name read
f38819c README.md: Fix URL to go documentation server
05667cd .travis.yml: enable email notifications
7eb64f3 README.md: Fix whitespace for clarity
07925ca tests/make_graph: cleanup & allow selection of field with dialog
7ba0302 tests/make_graph: improve readability
d3cea05 Enhance dumb terminal output by fitting graph to window size
4bee3b1 Remove spurious profile pattern
fe4e0c2 FIx debug statement
87fdb8d Change codec to json enconding
ee813c6 Fix hyper tree's pruner algorithm
f131ab9 Replace history tree's fifo cache with lru cache
05e890f tests/make_graph: Remove double quotes for numbers
e4ee6a1 tests/make_graph: Use dialog instead parameters to select functions
ee3c36c Remove alerts from agent, immplement them in processors
9bd3f62 Modify sender to empty the queue faster
668b5dd Fix lock passed by value
d566a7c Update dependencies to the latest version available
9eb4a60 USe goroutines to avoid blocking timers
0bd32f1 Change debug prints by log.Infof
99ff66b Fix tests e2e
ef817da Create new hasher on every membershit query
de11a30 Remove debug prints
42a77e9 Fix println
e5dd3f7 Fix missing dependencies
57fee22 Fix test api:TestMembership
aa43063 Add query digest membership
7df07b5 Add alerts functionality for testing, using the e2e test service
f8cd049 Refactor test_service as a e2e package
a1ef4a6 Refactor run_gossip to make it easier to read
6e34d2d identify the type name in decode and encode of signed snapshots
507e17c add auditor code to execute the membership against qed using the data from the snapshot store
ecb95a4 Add publiser endpoint to auditor configuration and cli
e2859d1 Add agent's local store for snapshots
e650307 Join to every specified raft address
0d6c560 Create Config struct to configure Server
808f84a fix codification to use codec/base64 in publisher and test_Service
c95e79d Add missing headers
5c7ab04 Set new xterm position arount the screen corners
8dfde2b Complete topology tests
ee7ff1e Fix peerlist bugs
ed55a77 Rename API endpoints
981c615 Fix auditor building problems
b34dcca add script to insert events for testing
1182af3 wip: auditor
46e5915 Fix ssh key type and start server
91e6507 Start gossip agent in a separate goroutine
6b47c3e Back to insert secuentially on Redis. WIP: batch inserts
0575511 Tune publisher behaviour
cc20259 Auto-generate required ssh key
78093af Add publisher to cmd and tests
c535c2b Change json.Marshall for codec.Encode. Show redis connection info in log
b196787 Include qed incremental requests into monitor
46ad21b Add batch inserts to Redis in test_service
afb6122 Fix raftwal tests
e198f1c Replace timer with ticker
d457f10 Fix default value privateKeyPath resolves homeDir correctly
6a732f0 Fix typo on gossip default port
957220e Fix routing and processor.
eaa6102 Rename balloon.Commitment to balloon.Snapshot
e098527 Fix go.mod
e61e180 Add EventDigest in balloon.Commitment
673ca18 Add gossip agent tests
db25d9c Fix agent routing
94981c8 implement route() using topology methods
f98f898 Fix topology peerlist update() and shuffle()
1fc45f1 Add monitor skeleton
f425b8a Fix start join config
0a89643 Unify test_service and store_clients
4f43f95 Fix typo in agent publisher command usage
07671af Fix flags problem in agent commands
29cd916 Add qed-publisher dummy test and benchmark
214fa8c QED-Publisher and publisher-service in tests
7ec96fc Initialize agent.Self correctly, implementing ParsePeer and its dependencies
88bab03 Divide agent command into multiple ones by role
3e324a0 Update start code with new agent
2548b3f Update gossip to support new topology and member
399be78 Implement dummy processor to check the system
6092393 refactor topology using new peerlist container
7b0e88a user the new member.Peer structure
b2772c8 delete old code
fdb714c move member to its own package
f897f64 Exclude sender from to-send nodes list
7608abc Filter source when gossiping snapshots
0736aa4 update service to report by nodeType
6322dc5 Add process function to measure performance with test_service.go, and adapt to changes in BatchSnapshots encode and decode
a25e7c6 Add encode and decode to BatchSnapshot type
fd96b9e GetPeers now retuns a list of memberlist.Nodes
7749711 Add monitor skeleton
2326381 First attempt to connect QED server with auditors
529c14a Add message handler and default delegate
da60ddd Add gossip address and gossip join address to cmd
2a84064 Signer functionality to Sender
ac88a2a Place agent inside Sender
6fb93eb Refactor gossip.node -> gossip.agent
fc2735b WIP: Integrate gossip agent into QED. Hungs in raftwal tests
d7798c7 Create protocol package. Include protocol file. New struct for batch of snapshots
2b236ef Configure graceful shutdown in gossip node
ab9c89d add license headers
0994419 add a test service to measure reqs/s and total visits to a bucket
2321aa8 add license header
b9af24a add script to run a test gossip network, requires xterm
e0fdb07 Add base gossip components
c90f351 tests/make_graph: One shot graph for all functions
57be27b Benchmark: plot go pprof profiles for a given directory
16be7e3 Benchmark: fix function call style in shell script
1282ce1 Benchmark: fix typos and remove spurious whitespace
46e42d0 Replace freecache with fastcache
7e3c0e2 Force xenial distribution in Travis build
810d326 Force cache size truncation
7ef38b2 Replace simple cache with free cache to avoid GC runtimes
9e9dd6a Enable garbage collection of Badger DBs
cc0e759 tests/riot.go Use fixed dirs for single server
6efb984 tests/riot.go: Change unexpexted status code output
17e9367 Refactor: Benchmarking tool
9798a17 Create CollectMutation test
d86f22f Fix typo
0c2786a Benchmark: Ensure file gets closed