0.1.0 release
Pre-release
Pre-release
What's Changed
- add github action to run CI by @chia7712 in #2
- apply google java format by @chia7712 in #4
- Add my name to README in authors field by @chinghongfang in #3
- Adding Zheng-Xian Li to author section by @garyparrot in #5
- Add my name to README in authors field by @wycccccc in #6
- add scripts to set up env quickly by @chia7712 in #9
- enable gradle to show test event by @chia7712 in #12
- App should be the entry point and show the executable classes by @chia7712 in #13
- Add latency benchmark by @chia7712 in #16
- Enable to configure dependencies versions by @chia7712 in #17
- Generated data should include random timestamp by @chia7712 in #18
- authors update by @qoo332001 in #19
- Format generated data by @chia7712 in #20
- Let CloseableThread could execute once. by @chinghongfang in #22
- Throw exception while
execute
callsclose
by @chinghongfang in #23 - Directly test
run()
instead of using thread pool by @chinghongfang in #25 - Implemetation of MBean client by @garyparrot in #15
- Offset explorer - used to expose the earliest offset and latest offset for topics by @chia7712 in #29
- Enable to run kafka official tool by container by @chia7712 in #31
- Access scope of BeanQueryBuilder is too strict by @garyparrot in #33
- Enable to run kafka from source code by @chia7712 in #32
- Implementation of KafkaMetricClient (early version) by @garyparrot in #35
- Add outline of tools by @chia7712 in #36
- Use JCommander to analysis command line argument by @chinghongfang in #34
- Reconstruct argument parsing by @chinghongfang in #37
- Generate uber jar to be release file by @chia7712 in #40
- Offset tool should show replica details and group details by @chia7712 in #39
- Add doc for uber jar by @chia7712 in #42
- Use slf4j-nop to eliminate the slf4j warning by @chia7712 in #44
- ReplicaCollie - used to migrate replicas between brokers by @chia7712 in #43
- All tools should touch internal topics by @chia7712 in #45
- add metric client to README.md by @garyparrot in #48
- Make output of ReplicaCollie in-order by @chia7712 in #47
- Add --admin.props.file to OffsetExplorer and ReplicaCollie by @chia7712 in #49
- Align the argument naming by @chia7712 in #50
- Replace CloseableThread by ThreadPool by @chia7712 in #51
- remove redundant code App::toString by @garyparrot in #53
- List members of partitions by @chia7712 in #54
- Implementation of KafkaMetricClient (revised & new metrics) by @garyparrot in #55
- Unify all topic admin by @chia7712 in #56
- Add embedded kafka cluster to run test by @chia7712 in #57
- RequireBrokerCluster should be abstract by @chia7712 in #58
- TopicExploer should show replica folder by @chia7712 in #59
- Make KafkaMetricsTest fetch metrics from a real cluster. by @garyparrot in #61
- Rewrite ReplicaCollieTest by embedded server by @chia7712 in #62
- Rewrite TopicExplorerTest by embedded server by @chia7712 in #63
- Rewrite End2EndLatencyTest by embedded server by @chia7712 in #64
- Fix the link of Kafka offset explorer by @chia7712 in #67
- Implementation of KafkaMetrics (more metrics) by @garyparrot in #66
- Fix typo by @cxorm in #71
- Performance testing tool by @chinghongfang in #11
- Add RequireJmxServer infra by @chia7712 in #70
- Remove stale latency tool by @chia7712 in #72
- Remove tryQueryBean by @chia7712 in #73
- Update dependencies: kafka 2.8.0 -> 2.8.1; junit 5.7.2 -> 5.8.1 by @chia7712 in #74
- Don't wait consuemr to get assignment and make sure all required reco… by @chia7712 in #77
- Optimize the package name of metrics by @chia7712 in #80
- Add producer interface and consumer interface by @chia7712 in #81
- Enable to get replica size by @chia7712 in #83
- Erase the chance of concurrent read/write. by @chinghongfang in #82
- Refactor TopicAdmin by @chia7712 in #84
- add Header#of(String, byte[]) by @chia7712 in #85
- Implement poisson partitioner by @wycccccc in #27
- Integrate prometheus service to docker script by @chia7712 in #87
- Correct the average bytes by @chia7712 in #92
- Update README file by @chinghongfang in #93
- Enable to build kafak with sasl by @chia7712 in #95
- Fix zero consumer behaviour by @chinghongfang in #94
- Enable to create topic repeatedly by @chia7712 in #96
- Unify prop.file by @chia7712 in #97
- Fix flaky TopicAdminTest#testCreator by @chia7712 in #99
- Weight should be sum correct by @wycccccc in #101
- No consumer causes incorrect console output by @chia7712 in #100
- Add consumer assignment listener by @chinghongfang in #91
- Implementation of Metric Explorer by @garyparrot in #86
- Make sure test can run on windows by @chia7712 in #104
- Partition score by @qoo332001 in #65
- Add Zhi-Mao Teng to README.md in author section. by @harryteng9527 in #109
- 印出produce/consume時間 by @chinghongfang in #108
- The total bytes are not equal to sum of all producers output by @chia7712 in #110
- Add migrator interface by @chia7712 in #115
- Add TopicConfig interface by @chia7712 in #116
- Enable performance tool to apply compression by @chia7712 in #117
- Update dependencies by @chia7712 in #118
- Implement API for change log folder of partitions in TopicAdmin by @qoo332001 in #114
- Increase the JVM memory for testing by @chia7712 in #122
- Enable to mount host folders to broker container by @chia7712 in #125
- Enable to mount host folder to zookeeper service by @chia7712 in #126
- Implementation of replica syncing monitor by @garyparrot in #119
- Make MBeanClient be interface by @chia7712 in #131
- The embedded jmx server should use JNDI by @chia7712 in #132
- Fix duplicate partition caused by TopicAdmin#replicas by @chia7712 in #129
- Random record and producing duration setting by @chinghongfang in #106
- Implmenet thread-safe mbean collector by @chia7712 in #123
- Move ExeTime to separate file by @chia7712 in #134
- Enable to configure compact topic by @chia7712 in #139
- The address of jmx server should not use '127.0.0.1' by @chia7712 in #140
- Check both 127.0.0.1 and 127.0.1.1 when running containers by @chia7712 in #144
- Fix flaky BeanCollectorTest#testAddNode by @chia7712 in #145
- Enable to configure docker repo used by docker scripts by @chia7712 in #146
- Add script to run spark cluster by @chia7712 in #143
- Rename the image name from spark to spark-job by @chia7712 in #148
- Enable to mount host folders when submitting spark job by @chia7712 in #149
- Introduce new BeanCollector which works without extra threads by @chia7712 in #150
- Update gradle from 7.3.0 to 7.3.2 by @chia7712 in #153
- The receiver should keep independent objects by @chia7712 in #154
- Implementation of Data Measurement/Unit Utility by @garyparrot in #147
- Check the condition of updating beans before requiring the lock by @chia7712 in #156
- 修改TopicAdmin interface by @chinghongfang in #151
- Pre-install dependencies to spark image; Skip building existent docke… by @chia7712 in #158
- Update junit from 5.8.1 to 5.8.2; Update mockito from 4.1.0 to 4.2.0 by @chia7712 in #159
- Remove docker/submit_spark_job.sh by @chia7712 in #162
- Use
DataSize
to rewrite--record.size
for performance tool by @chinghongfang in #161 - Remove gradle-wrapper.jar from repo by @chia7712 in #167
- Update gradle from 7.3.2 to 7.3.3 by @chia7712 in #166
- Observability tools by @garyparrot in #160
- Add script to run astraea by docker by @chia7712 in #165
- Log in english by @chinghongfang in #168
- Remove docker/start_kafka_tool.sh by @chia7712 in #170
- Refactor zookeeper script, broker script and spark script by @chia7712 in #169
- Enable to run spark by source code by @chia7712 in #171
- Replace "" by "" so as to pass arguments without quotes by @chia7712 in #175
- ASCII code character only by @garyparrot in #176
- Wait some more time for broker id by @chia7712 in #178
- Using uber jar to run astraea instead of compiling by @chia7712 in #179
- Integrate BeanColloctor into Partitioner by @wycccccc in #138
- Improve the readability of the offset tool output by @garyparrot in #177
- 新增record key分佈設定 by @chinghongfang in #152
- Record performance result into a file by @chinghongfang in #180
- start_broker.sh can't mount multiples host folders by @chia7712 in #186
- Move all docker images to github packages by @chia7712 in #184
- Don't end script after downloading image by @chia7712 in #188
- Don't show help message when running kafka-tool by @chia7712 in #189
- Generate dockerfile only if it needs to build image by @chia7712 in #191
- Enable to configure exposed port for zk, broker and spark by @chia7712 in #192
- Automation Performance by @wycccccc in #173
- Specify Broker for performance by @wycccccc in #185
- Generate random record by replacing one byte by @chinghongfang in #194
- fix flaky PerformanceTest by @wycccccc in #196
- Optimize partitioner algorithm by @wycccccc in #181
- Run an init inside for zookeeper, broker, kafka-tool, and spark by @chia7712 in #198
- Remove Dependency from Partitioner by @wycccccc in #204
- Enhance ReplicaCollie to support migrate replica to another folder by @qoo332001 in #133
- change the default distribution from null to uniform by @chia7712 in #210
- Enable JMX on kafka tools by @chia7712 in #211
- Add new metric for current throughput by @chinghongfang in #216
- Fix consumerDone() false when no consumer by @chinghongfang in #212
- To english by @qoo332001 in #220
- Allow manually JMX port assignment for
start_broker.sh
by @garyparrot in #224 - Improvements to problems in testing by @wycccccc in #203
- fix rejectProperty funtion in
start_broker.sh
by @qoo332001 in #227 - Argument check strictly by @chinghongfang in #225
- Move all converter/validator to individual java file by @chia7712 in #231
- Reduce zookeeper, broker, spark and astraea image size by @chia7712 in #232
- add a script to initialization by @qoo332001 in #208
- Add heap configs to kafka tool by @chia7712 in #219
- Fix partitionScore by @qoo332001 in #182
- Upgrade gradle from 7.3.3 to 7.4 by @chia7712 in #242
- Add HEAP_OPTS to set max and min JVM heap size for Zookeeper script by @harryteng9527 in #239
- Optimization Partitioner by @wycccccc in #241
- Enable to mount JMX exporter config for
start_broker.sh
by @garyparrot in #246 - Upgrade kafak from 2.8.1 to 3.1.0 by @chia7712 in #253
- Flexible Round Robin partitoner v2 by @chia7712 in #252
- Fix Test load situation test by @wycccccc in #255
- Improve Smooth weight algorithm by @wycccccc in #257
- Don't run test two times by @chia7712 in #258
- fix flaky ReplicaCollieTest by @qoo332001 in #259
- Introduce maxParallelForks by @chia7712 in #260
- Introduce cost functions by @chia7712 in #256
- Introduce Fetcher by @chia7712 in #261
- Introduce to integrate converter and validator by @chia7712 in #263
- Disable wildcard by @chia7712 in #264
- Refactor thread pool by @chia7712 in #266
- Add StringMapField by @chia7712 in #267
- Use ShortConverter for "--consumer" parameter by @chinghongfang in #269
- add configs field to Performance tool by @chia7712 in #271
- change return type of Performance#execute from Future to Result by @chia7712 in #272
- Add more tests for StrictCostDispatcher by @chia7712 in #273
- fix AdminClient#listOffsets API timeout error by @garyparrot in #274
- Improve Prometheus script by @garyparrot in #237
- 改善JMX server參數的使用方式 by @wycccccc in #270
- Fix flaky node exporter check by @garyparrot in #247
- Upgrade gradle from 7.4.0 to 7.4.1 by @chia7712 in #281
- Move cost functions out of partitioner folder by @chia7712 in #280
- Record size distribution by @chinghongfang in #213
- Improve the javadoc of
CostFunction
by @garyparrot in #286 - Generate broker dockerfile only if we need to build image locally by @chia7712 in #288
- add a script to quick start confluent cluster by @qoo332001 in #207
- Remove JmxServer Argument by @wycccccc in #276
- Enable transactional send by @chinghongfang in #136
- Tweak transactional producer by @chia7712 in #290
- Create CSV file on customized path by @chinghongfang in #214
- Rewrite
SmoothWeightPartitioner
by @chinghongfang in #291 - Upgrade gradle from 7.4.1 to 7.4.2 by @chia7712 in #297
- Throttle produce rate by @chinghongfang in #254
- Add created timestamp to all bean objects by @chia7712 in #296
- Revise
ClusterInfo
andPartitionInfo
implementation by @garyparrot in #299 - Score on partition by @chinghongfang in #303
- Enable change replica leaders by @qoo332001 in #287
- add ReplicaManager to KafkaMetrics by @qoo332001 in #309
- Four new cost functions by @wycccccc in #306
- Integrated Score by @wycccccc in #310
- Show the consumer group having no committed offset by @chia7712 in #316
- Add Isolation and Compression to simplify builder by @chia7712 in #317
- Add support for showing data folder of replicas by @garyparrot in #313
- Enable users to limit the returned number of records from Consumer#poll by @chia7712 in #318
- remove RequireBrokerCluster from CalculateUtilsTest by @chia7712 in #320
- Remove smooth weight by @wycccccc in #301
- Refactor ProducerExecutor by @chia7712 in #322
- Integrate normal producer with transactional producer by @chia7712 in #326
- Move --configs to base argument by @chia7712 in #327
- Configure cost-functions weight by @chinghongfang in #314
- Add web service to inspect kafka cluster by @chia7712 in #330
- Fix web service script and add more logs by @chia7712 in #331
- Rename brokersMetrics to broker; Rename topic to admin; Rename smooth… by @chia7712 in #332
- Enable to get broker configuration by @chia7712 in #334
- Enable to expose broker information by Restful API by @chia7712 in #335
- Nonexistent instance group id should be null by @chia7712 in #336
- Update Kafka from 3.1.0 to 3.1.1 by @chia7712 in #337
- Introduce comparable TopicPartition by @chia7712 in #338
- Don't use empty collection to imply it should return all data by @chia7712 in #339
- Enable to fetch producer state by @chia7712 in #340
- Add POST and DELETE method by @chia7712 in #341
- Fix flaky AdminTest#testOffsets by @chia7712 in #342
- pre-filter the data by user-defined target by @chia7712 in #343
- Enable to fetch producer state by Restful APIs by @chia7712 in #344
- Enable to write/read quota by @chia7712 in #345
- Upgrade ubuntu from 20.04 to 22.04 by @chia7712 in #346
- Add topic/partitions to broker for restful APIs by @chia7712 in #347
- Smooth weight Round Robin algorithm by @wycccccc in #333
- Enable to create topic by restful by @chia7712 in #348
- Enable to read/write quotas by restful by @chia7712 in #349
- Rename Quota.Action to Quota.Limit by @chia7712 in #350
- A new seek mode: the distance from the latest offset by @chia7712 in #351
- The web container should run in background by @chia7712 in #352
- Smooth weight Round Robin Dispatcher by @wycccccc in #315
- Downgrade ubuntu from 22.04 to 20.04 for spark image by @chia7712 in #355
- Implementation of
RebalancePlanGenerator
by @garyparrot in #329 - Simplify prometheus script by @chia7712 in #356
- rename functions by @qoo332001 in #363
- Add embedded MySQL by @chia7712 in #364
- SWRR supports the calculation of multiple topics by @wycccccc in #353
- Add deps image by @chia7712 in #365
- The build is broken after we rename availablePartitionLeaders to availableReplicaLeaders by @chia7712 in #366
- Enable to show the relationship between consumer/producer and topics by @chia7712 in #367
- Add database client which is implemented by JDBC by @chia7712 in #368
- Refactor Utils.class by @chia7712 in #380
- Fix typo: LodEndOffset -> LogEndOffset by @chia7712 in #381
- Decrease number of records buffered by @chinghongfang in #357
- Translate Readme Run Zookeeper in Chinese. by @harryteng9527 in #369
- Rename 'Run Zookeeper.md' by @harryteng9527 in #384
- Move all entropy code out of NeutralIntegratedCost by @chia7712 in #382
- 實作
Admin#preferredLeaderElection
by @garyparrot in #388 - Add maven-publish plugin by @chia7712 in #392
- Remove uber jar by @chia7712 in #394
- add apache license header by @chia7712 in #395
- add offline field to Replica by @qoo332001 in #308
- fix flaky test by @qoo332001 in #396
- Rename kafka-tool to app by @chia7712 in #399
- Update kafka from 3.1.1 to 3.2.0 by @chia7712 in #402
- make brokerCost() flexibly select the normalize policy by @wycccccc in #389
- Add web api chinese documents by @brandboat in #383
- Create
ClusterInfo
fromAdmin
by @garyparrot in #371 - Add Replica#isPreferredLeader flag by @garyparrot in #400
- Enable to query transaction state from Admin by @chia7712 in #404
- Add transaction web APIs by @chia7712 in #406
- Fix log shrinkage cause
ReplicaSyncingMonitor
to raise an exception. by @garyparrot in #401 - Rename transaction API path from "transaction" to "transactions" by @chia7712 in #407
- Fix incorrect return type by @brandboat in #414
- Web APIs for all beans by @chia7712 in #417
- Enable to query beans by properties by @chia7712 in #418
- Implement consumer assign topic partition api by @brandboat in #409
- Enable to commit offsets manually by @chia7712 in #419
- Enable to query group by topic by @chia7712 in #421
- Enable to remove all members/static members by @chia7712 in #423
- Enable to delete consumer group by @chia7712 in #424
- start_app.sh can't parse binding port when jmx port is defined by @chia7712 in #425
- Add docs for pipelines, transactions and beans by @chia7712 in #426
- Implement post record web api by @brandboat in #416
- Refactor ErrorObject to Response by @chia7712 in #427
- Enable to delete members by Web APIs by @chia7712 in #428
- Allow
ClusterLogAllocation#migrationReplica
specify data directory by @garyparrot in #415 - Add logo to readme by @jellynina in #429
- new interface for read beanObjects by @qoo332001 in #411
- Enable to list reassignment by Admin by @chia7712 in #430
- Test fetcher in cost function by @chinghongfang in #354
- Translate Run Kafka Broker by @harryteng9527 in #370
- Web APIs for reassignments by @chia7712 in #437
- Update mockit from 4.2.0 to 4.6.1; Update jcommander from 1.81 to 1.8… by @chia7712 in #438
- Fix MigratorImpl#moveTo issue by @garyparrot in #440
- Fix incorrect check in
Migrator#moveTo
by @garyparrot in #442 - Implement topic read web apis by @brandboat in #405
- Move the WEB docs link to the beginning of README by @chia7712 in #446
- Add new cost functions by @qoo332001 in #312
- Translate Run Node Exporter by @harryteng9527 in #372
- Add /records web api doc by @brandboat in #447
- Entropy needs to be calculated using raw metrics values by @wycccccc in #410
- Not all cost functions need to fetch Java beans by @chia7712 in #448
- Add todo comment in RecordHandler#get by @brandboat in #451
- tweak ClusterInfo#of(ClusterInfo, Beans) by @chia7712 in #452
- Integrate StrictCostDispatcher with SMRR by @chia7712 in #453
- StrictCostDispatcher should fail immediately if jmx ports are undefined by @chia7712 in #454
- StrictCostDispatcher should return partition id rather than broker id by @chia7712 in #455
- Introduce local MBeanClient by @chia7712 in #460
- Set min.insync.replicas explicitly by @chia7712 in #462
- Introduce ReplicaLeaderCost to be default cost function of StrictCost… by @chia7712 in #456
- Implementation of
BalancePlanExecutor
by @garyparrot in #403 - Introduce HasProducerNodeMetrics and HasProducerTopicMetrics by @chia7712 in #461
- Refactor metrics code by @chia7712 in #463
- Move ClusterInfo, NodeInfo, and ReplicaInfo to org.astraea.app.admin by @chia7712 in #465
- Introduce NodeLatencyCost depending on local metrics to be default co… by @chia7712 in #469
- Support durationfield in timeout by @brandboat in #468
- Allow to ignore jmx port and NodeLatencyCost can't parse beans by @chia7712 in #470
- Cache the cluster info to reduce the cost of converting kafka cluster… by @chia7712 in #471
- NodeThroughputCost can use producer metrics to calculate the throughp… by @chia7712 in #475
- Apply Utils#sleep to code base by @chia7712 in #477
- Support transactionId and multi records in POST /records by @brandboat in #464
- Move ClusterBean out of ClusterInfo by @chia7712 in #479
- Upgrade gradle from 7.4.2 to 7.5 by @chia7712 in #482
- Set no partitioner as default by @chinghongfang in #444
- Simplify ClusterLogAllocation by @chia7712 in #474
- Remove unused code by @chia7712 in #484
- Revise
DataSize
&DataRate
by @garyparrot in #481 - Revise DataSupplier by @chia7712 in #487
- QuotaCreator should use DataRate rather than long by @chia7712 in #489
- Change key distribution from fixed to uniform by @chia7712 in #491
- Swallow the exception thrown by fetchers by @chia7712 in #492
- Simplify input/ouput cost by @chia7712 in #493
- Fix SWRR without correct convergence by @wycccccc in #443
- Remove ReplicaCollie by @chia7712 in #494
- fix close embedded cluster by @qoo332001 in #435
- Remove Topic Explorer by @chia7712 in #502
- Add cache for transactional producer by @brandboat in #498
- Enable to query topic with specify partition by @chia7712 in #503
- Fix testQueryWithPartition by @chia7712 in #505
- Refactor Kafka Log metrics by @chia7712 in #504
- Simplify node size cost by @chia7712 in #506
- Add delete record api by @g1geordie in #495
- Refactor Performance tool by @chia7712 in #512
- Remove ThreadPool by @chia7712 in #513
- Move purgatory metrics to separate file by @chia7712 in #515
- Fix testConsumerRebalanceListener by @chia7712 in #516
- Refactor CpuCost by @chia7712 in #517
- Refactor MemoryCost by @chia7712 in #518
- Performance tool 產生檔案時使用相同的單位 by @chinghongfang in #511
- Refactor MBeanClient by @chia7712 in #519
- Refactor host metrics by @chia7712 in #520
- remove PartitionScore by @qoo332001 in #525
- Remove CostUtils by @chia7712 in #522
- Refactor broker topic metrics by @chia7712 in #521
- Fix node metrics by @chia7712 in #527
- Only take recent producer metrics by @chia7712 in #528
- Fix testDeleteRecord by @chia7712 in #529
- Add delete topic api by @g1geordie in #507
- Refactor producer metrics by @chia7712 in #530
- Refactor network metrics by @chia7712 in #531
- Refactor ReplicaManager metrics by @chia7712 in #532
- Construct
CostFunction
via Reflection by @garyparrot in #535 - Add a new author by @Haser0305 in #540
- Add delete group api by @g1geordie in #509
- Balance Process Demo by @garyparrot in #534
- Remove limit in RecordHandler#get by @brandboat in #542
- Apply Utils.constructCostFunction by @chia7712 in #538
- Remove properties in cost by @qoo332001 in #524
- Fix TopicHandlerTest#testDeleteTopic by @g1geordie in #545
- simplify sizeTimeSeries by @qoo332001 in #547
- Fix NodeLatencyCostTest#testCost by @chia7712 in #548
- Translate Performance Benchmark by @harryteng9527 in #374
- Add Chao-Heng to author list by @chaohengstudent in #550
- Add Kafka controller metrics by @g1geordie in #554
- Add YHL to Authors by @MaxwellYHL in #558
- Add Consumer Node Metrics by @chinghongfang in #552
- Translate run_prometheus.sh by @harryteng9527 in #485
- Upgrade gradle from 7.5.0 to 7.5.1 by @chia7712 in #560
- Upgrade kafka from 3.2.0 to 3.2.1 by @chia7712 in #561
- Implementation of
ReplicationThrottler
interface by @garyparrot in #478 - add ClustCost by @qoo332001 in #514
- Translate Run Grafana by @harryteng9527 in #373
- Enable to unsubscribe/resubscribe topics/partitions by @chia7712 in #564
- Fix Utils.swallowException by @brandboat in #572
- Wait for file writer complete by @chinghongfang in #570
- Performance tool gets hanging when number of consumers is smaller tha… by @chia7712 in #571
- Add simple chaos monkey to kill consumers by @chia7712 in #573
- add ClusterCost in ReplicaDiskInCost by @qoo332001 in #563
- Enable consumer to trace all subscriptions by @chia7712 in #576
- resolve #537 Missing stacktrace when using Utils.packException by @g1geordie in #567
- Simplify performance report by @chia7712 in #578
- Log size partition cost by @wycccccc in #569
- Enable to trace the elapsed time of assigning/revoking partitions by @chia7712 in #581
- removeMapByPartition by @qoo332001 in #583
- Upgrade zookeeper from 3.7.0 to 3.7.1 by @chia7712 in #587
- Implementation of
ReplicationThrottler
by @garyparrot in #574 - add costUtils by @qoo332001 in #575
- Address the issue of replication throttle in Kafka broker implementation by @garyparrot in #594
- Revise
RebalancePlanProposal
by @garyparrot in #539 - Reconstruct
ReportFormat
by @chinghongfang in #593 - Optimize dispatcher for large partitions by @chia7712 in #599
- Pre-create hash code of NodeIno by @chia7712 in #600
- Performance shows the incorrect producer info after all producers are… by @chia7712 in #602
- Fix flaky tests by @garyparrot in #605
- Avoid creating too many partition lists by @chia7712 in #604
- Add Kafka controll state metrics by @g1geordie in #589
- Refactor PostRequest by @chia7712 in #606
- Support to execute migration plans by Reassignment Web API by @chia7712 in #607
- Remove ClusterInfo#dataDirectories by @chia7712 in #608
- add ETL module by @chia7712 in #609
- Enable to query better assignment by Web API by @chia7712 in #610
- Cleanup README by @chia7712 in #612
- Fix unstable performance tool when it tries to create topic with a bu… by @chia7712 in #613
- add opening to README by @chia7712 in #615
- remove ExecutionRuntimeExceptionTest by @chia7712 in #614
- Support groupId in subscription mode in GET /records by @brandboat in #562
- Show real outgoing bytes by @chinghongfang in #236
- Refactor Response callback by @chia7712 in #617
- Remove partition cost by @chia7712 in #624
- Implementation of
GET /throttles
for WebService by @garyparrot in #611 - Remove MetricExplorer by @chia7712 in #627
- Enable to mount prop file automatically by @chia7712 in #628
- Fix unstable TransactionHandlerTest by @chia7712 in #630
- 增加
RebalanceAdmin#wait*Synced
的 debounce 次數 by @garyparrot in #632 - Implement APIs for clearing throttle bandwidth by @garyparrot in #620
- Add parameter to filter out internal topics in TopicHandler by @brandboat in #616
- Add ClusterInfo#replicas to show all cached replicas by @chia7712 in #636
- Remove ReplicaSyncingMonitor by @chia7712 in #635
- Avoid null data directory by making Replica be the subclass of Replic… by @chia7712 in #637
- Mount while
--report.path
occur by @chinghongfang in #634 - Refactor Admin#replicas and remove NodeInfo#isOffline by @chia7712 in #638
- Change balancer to Use NodeTopicSizeCost to evaluate cost by @chia7712 in #640
- Show the size of replica when running balancer plan by @chia7712 in #642
- Enable to generate migration plans for specify topics by @chia7712 in #643
- WebService
POST /throttles
和DELETE /throttles
的文件 by @garyparrot in #633 - Add template to ClusterInfo by @chia7712 in #645
- enhance performance tool by @harryteng9527 in #603
- Implementation of
POST /throttles
andDELETE /throttles
for WebService by @garyparrot in #646 - Give more time to wait the large topics by @chia7712 in #652
- Add gradle to deps base by @chia7712 in #654
- the url of kafka source should be based on ACCOUNT by @chia7712 in #655
- fix Dispersion by @qoo332001 in #656
- astraea-488 Performance#throughput ought to use DataRate rather than DataSize by @g1geordie in #651
- Add useful default implementations to ClusterInfo by @chia7712 in #662
- Don't mock ClusterInfo anymore by @chia7712 in #663
- add MoveCost by @qoo332001 in #641
- Change
specify.brokers
validation by @chinghongfang in #667 - Remove stale docs of performance tool by @chia7712 in #670
- Support to define "acks" when running performance tool by @chia7712 in #671
- [Perf tool] show the error rate by @chia7712 in #672
- Add ConsumerCoordinatorMetrics by @chia7712 in #673
- Move cost web api by @qoo332001 in #666
- Simplify ConsumerThread#Report by @chia7712 in #674
- Add SmoothDispatch.md by @wycccccc in #385
- Return the suitable plan early by @chia7712 in #682
- [Web APIs] enable to create topics by single request by @chia7712 in #683
- Fix partition selection by @chinghongfang in #657
- Add common and it module by @chia7712 in #688
- Fix package of SmoothWeightRoundRobinDispatcher by @chia7712 in #691
- fix consumerDone doesn't update by @harryteng9527 in #681
- Implementation of:
--specify.partitions
for performance tool by @garyparrot in #690 - astraea-660 Implement IgnoreCase Enum by @g1geordie in #668
- Add tests for TrackerThread by @chia7712 in #693
- Fix Entropy Test by @wycccccc in #697
- add doc for
--specify.partitions
by @garyparrot in #696 - add FakeParameter to check list field by @harryteng9527 in #692
- Fix raw type of Dispatcher by @chia7712 in #699
- [Fix Flaky] Test no target when specify broker and topic by @chinghongfang in #698
- [Perf Tool] stop consumers when there is no more data by @chia7712 in #700
- Fix flaky AdminTest.testTransactionIdsWithMultiPuts by @chia7712 in #703
- Fix flaky PerformanceTest#testCustomCreateMode by @chia7712 in #702
- Strict cost dispatcher experiment by @chinghongfang in #619
- implementation of
Scenario
by @garyparrot in #701 - Admin#replicas does not show the replicas moving to anohter folder by @chia7712 in #709
- Add ProducerMetrics by @chia7712 in #708
- Add Strict Cost Dispatcher doc by @chinghongfang in #705
- Replace manual repore by kafka metrics by @chia7712 in #711
- [Web APIs] enable to distribute partitions by probability by @chia7712 in #713
- Fix flay testCreateTopicByProbability by @chia7712 in #715
- astraea-704 Add consumer metrics by @g1geordie in #714
- Interdependent Message by @wycccccc in #553
- Replace consumer report by kafka metrics by @chia7712 in #716
- Add more server metrics by @g1geordie in #648
- Fix flaky test in
BalancerHandlerTest
by @garyparrot in #717 - Support progress in reassignments web api by @brandboat in #718
- Implementation of a simpler
Balancer
by @garyparrot in #712 - Dispatcher 文件新增使用說明 by @chinghongfang in #721
- Report of performance does not fetch latest metrics by @chia7712 in #726
- add replicaLeaderMoveCost by @qoo332001 in #675
- ETL : read prop file by @wycccccc in #695
- add replicaNumMoveCost by @qoo332001 in #676
- [Perf] Don't create topics automatically anymore by @chia7712 in #728
- Revise
ClusterLogAllocation#findNonFulfilledAllocation
by @garyparrot in #731 - Update web service doc by @chinghongfang in #736
- Fix flaky testCreateTopics by @brandboat in #733
- Add test for ClusterInfo by @Haser0305 in #730
- Fix flaky BalancerHandlerTest#testReport by @chaohengstudent in #729
- Balancer 實驗報告 by @garyparrot in #735
- astraea-720 Add embedded connector worker for test by @g1geordie in #737
- Tweak Admin#replicas by @chia7712 in #744
- Remove Admin#partitions(Set, Set) by @chia7712 in #747
- Balancer supports to set limit of execution time by @chia7712 in #749
- Add helper to merge multiple HasBrokerCost functions by @chia7712 in #753
- Revise
ClusterLogAllocation
by @garyparrot in #748 - Remove LogPlacement by @chia7712 in #758
- Add
Balancer
intoBalancerHandler
by @Haser0305 in #756 - Remove ConsumerGroup#activeMembers by @chia7712 in #759
- Enable Config to return raw map by @chia7712 in #760
- Add our LinkedHashMap by @chia7712 in #765
- Integrate ProducerState with TopicPartition by @chia7712 in #768
- Admin#partitions should return full partition information by @chia7712 in #770
- Replace reassignment by AddingReplica by @chia7712 in #771
- Remove unused consumer groups by @chia7712 in #772
- Fix flaky BalancerTest#testLeaderCountRebalance by @garyparrot in #774
- fix ConsumerTest by @qoo332001 in #777
- Fix flay TopicHandlerTest#testCreateTopicByProbability by @chia7712 in #776
- Add new class Node to represent more details of node by @chia7712 in #778
- Add VersionUtils to display the build information by @chia7712 in #781
- Revise
ClusterLogAllocation
by @garyparrot in #764 - Add Topic POJO by @chia7712 in #782
- Remove earliest/latest timestamp by @chia7712 in #783
- update replicas by @qoo332001 in #769
- Performance with interdependent by @chinghongfang in #732
- Add simple GUI by @chia7712 in #784
- Fix NPE in ExcludeNodeTab; AddingReplicaTab supports to search node by @chia7712 in #785
- Add GUI docs by @chia7712 in #788
- Guide reader through JRE installation by @chia7712 in #789
- Remove null directory usage in
ClusterLogAllocation
by @garyparrot in #790 - Enable to trace subscribed partitions when running perf tool by @chia7712 in #796
- Add replica builder by @Haser0305 in #786
- Replace old replica by @qoo332001 in #792
- fix flaky test TopicHandlerForProbabilityTest by @qoo332001 in #795
- Fix flaky test
RebalanceAdminTest#testOfflineReplicaWorks
by @garyparrot in #793 - Revise GUI and new tab - reassign replica by @chia7712 in #798
- Move Balancer from app to common by @chia7712 in #799
- [GUI] support to balance cluster by @chia7712 in #800
- Rename Node to Broker; Add isController to Broker by @chia7712 in #803
- ETL:Spark read CSV by @wycccccc in #755
- [GUI] add controller to BrokerTab by @chia7712 in #805
- Enable to trace leaders from Admin#brokers by @chia7712 in #806
- Fix flaky AdminTest#testListPartitions by @chia7712 in #787
- The documentation for balance plan execution in web service by @garyparrot in #767
- Fix flaky RecordHandlerTest#testDeleteParameter by @chia7712 in #809
- Add leaders to BrokerTab by @chia7712 in #810
- New cluster cost based on replica number by @chia7712 in #811
- Always try to find a cheaper cluster cost by @chia7712 in #812
- Apply greedy algorithm to balancer by @chia7712 in #804
- [GUI] apply greedy to balancer by @chia7712 in #813
- Add AdminMetrics to expose the status of admin by @chia7712 in #814
- Add Reassignment APIs: exclude specific broker. by @chaohengstudent in #757
- Reformat all tabs by unified layout by @chia7712 in #817
- Enable to add custom nodes to search tab by @chia7712 in #819
- ReplicaNumberCost should return highest cost when there are idle brokers by @chia7712 in #820
- Revise
GET /balancer
by @garyparrot in #794 - [GUI] use search button instead of auto search by @chia7712 in #822
- Fix flaky
BalancerTest#testLeaderCountRebalance
by @garyparrot in #823 - Add transaction tab by @chia7712 in #825
- Update document of reassignment APIs. by @chaohengstudent in #821
- Add execTime in balancer API by @Haser0305 in #801
- Create CODE_OF_CONDUCT.md by @chia7712 in #829
- Replace String by DataSize by @chia7712 in #827
- Add AsyncAdmin to fetch topic, partition and broker by @chia7712 in #833
- [GUI] TopicTab should show the partition distribution by @chia7712 in #831
- AsyncAdmin supports to list transaction, producers, consumers and rep… by @chia7712 in #834
- ETL:downgrade scala version to 2.12 by @wycccccc in #807
- Experiments on StrictCostDispatcher by @chinghongfang in #816
- Add main class to expose version by @Haser0305 in #835
- Convert kafka future to CompletableFuture by another thread by @chia7712 in #838
- Add migrator to AsyncAdmin by @chia7712 in #839
- [GUI] apply async admin by @chia7712 in #840
- [GUI] add metrics tab by @chia7712 in #841
- [GUI] enable to add partition; add coordinator to consumer tab by @chia7712 in #842
- [GUI] add standard page for write tab by @chia7712 in #843
- Add consumer constants by @chia7712 in #844
- [GUI] tweak the description of icon by @chia7712 in #845
- Enable to update topic/broker configs by @chia7712 in #846
- [GUI] add template page for all tabs by @chia7712 in #847
- Use configs to initialize producer/consumer by @chia7712 in #850
- Cleanup LinkedHashSet by @chia7712 in #851
- [GUI] add chinese name and copyable table by @chia7712 in #852
- [GUI] show all error on console by @chia7712 in #853
- [GUI] enable to config topic by @chia7712 in #854
- Implementation of
POST /balancer
andGET /balancer/{id}
for Web Service by @garyparrot in #828 - [GUI] enable to update configs of topic/broker by @chia7712 in #855
- [GUI] ConsumerTab should display the result matched to keyword by @chia7712 in #856
- switching names in README.md by @chaohengstudent in #860
- Fix AsyncAdmin can't get partitions when there is offline node by @chia7712 in #858
- Fix flaky
BalancerHandlerTest#testRebalanceDetectOngoing
by @garyparrot in #859 - [GUI] update docs by @chia7712 in #861
- [GUI] Refactor PaneBuilder by @chia7712 in #862
- [GUI] BrokerTab show the orphan partitions by @chia7712 in #864
- Enable AysncAdmin to delete records by @chia7712 in #865
- [GUI] Refactor code by @chia7712 in #866
- ETL: CSV to JSON by @wycccccc in #761
- ETL : create topic by @wycccccc in #797
- Batch migration to reduce number of requests by @chia7712 in #869
- Fix doc by @brandboat in #871
- Fix failed tests in MetadataTest by @brandboat in #872
- [GUI] enable to truncate records by @chia7712 in #868
- Refactor pane builder by @chia7712 in #873
- Enable AsyncAdmin to unset topic/broker configs by @chia7712 in #875
- Increase maxParallelForks from 1 to 3 by @chia7712 in #876
- Deps image should include all test dependencies by @chia7712 in #877
- [GUI] add profiler to AboutTab by @chia7712 in #880
- [GUI] the tab used to update config should show the current values by @chia7712 in #879
- Add topic metrics by @chia7712 in #882
- [GUI] TopicTab should show the topic metrics if metrics is enabled by @chia7712 in #883
- Add 2022 publication link by @chia7712 in #886
- [GUI] Revise UpdatePartition by @chia7712 in #889
- Make consistent order for AsyncAdmin by @chia7712 in #890
- Always build/test all code when running CI by @chia7712 in #891
- Add tests in AsyncAdminTest by @Haser0305 in #892
- Add kafka worker script by @brandboat in #867
- Update GUI doc by @chaohengstudent in #893
- add AsyncAdmin#waitCluster to wait synced cluster state by @chia7712 in #895
- AsyncAdmin supports to set/unset quotas by @chia7712 in #899
- [GUI] support to read/update quotas by @chia7712 in #900
- [GUI] all tabs should reuse mbean clients by @chia7712 in #901
- Fix flaky KafkaWriterTest#TopicCreatorTest by @wycccccc in #896
- [GUI] re-group tabs by @chia7712 in #902
- Raneme Replica#dataFolder to Replica#path by @chia7712 in #905
- [GUI] renew setting docs by @chia7712 in #904
- [GUI] move offline replicas to separate tab by @chia7712 in #906
- [GUI] renew replica doc by @chia7712 in #907
- [GUI] renew balancer doc by @chia7712 in #908
- [GUI] BalancerTab supports to mvoe folder by @chia7712 in #909
- Fix flaky KafkaWriterTest#topicCreatorTest by @chia7712 in #910
- Fix flaky BalancerAlgorithmTest#test by @chia7712 in #911
- [GUI] support to delete topcs by @chia7712 in #912
- [GUI] renew client doc by @chaohengstudent in #914
- Idle topic finder by @chinghongfang in #751
- [Web APIs] Make rebalance plan generation async by @garyparrot in #894
- [GUI] renew about docs by @Haser0305 in #915
- [WEB] use async interface for Handler by @chia7712 in #921
- [WEB] BrokerHandler/BeanHandler use AsyncAdmin to replace Admin by @chia7712 in #923
- The size of topic which having no data should be zero instead of -1 by @chia7712 in #924
- Refactor greedy algorithm by @chia7712 in #926
- Add more tests for offline replicas by @chia7712 in #925
- [GUI] renew quota and topic doc update by @chaohengstudent in #922
- [GUI] enable to move all partitions by @chia7712 in #927
- Remove BalancerUtils by @chia7712 in #928
- Renew broker and partition docs by @Haser0305 in #930
- Add test for AsyncAdmin by @chaohengstudent in #913
- [WEB] replace Admin by AsyncAdmin for QuotaHandler by @chia7712 in #929
- [WEB] remove pipeline apis by @chia7712 in #931
- [GUI] TopicTab should show the groups; ClientTab should show inactive… by @chia7712 in #932
- [GUI] apply placeholder to gui by @chia7712 in #935
- Fix flaky AsyncAdminTest#testPendingRequest by @chia7712 in #937
- [WEB] GroupHandler replace Admin by AsyncAdmin by @chia7712 in #936
- [WEB] replace Admin by AsyncAdmin for ProducerHandler by @chia7712 in #938
- Replace Admin by AsyncAdmin for Scenario by @chia7712 in #939
- [GUI] format timestamp of producer by @chia7712 in #940
- Add LogCleanerManager metrics by @chia7712 in #941
- Fix flaky SkewedPartitionScenarioTest by @chia7712 in #944
- Implementation of
BalancerBuilder#metricSource
by @garyparrot in #943 - add ClusterIntergratedCost by @qoo332001 in #884
- Replace Admin by AsyncAdmin for TopicHandler by @chia7712 in #942
- [WEB] replace Admin by AsyncAdmin for TransactionHandler by @chia7712 in #946
- Add zookeeper metrics by @chia7712 in #947
- [GUI] add zk metrics to BrokerTab by @chia7712 in #948
- Enable JMX for zookeeper by @chia7712 in #949
- Fix flaky GroupHandlerTest#testDeleteMembers by @chia7712 in #951
- Add AppInfo metrics by @chia7712 in #950
- [GUI] add folder tab to show details of data folder by @chia7712 in #953
- implement chaos monkey by @harryteng9527 in #888
- Move "leader.replication.throttled.replicas" and "follower.replicatio… by @chia7712 in #956
- Replace AdoptOpenJDK by zulu for CI by @chia7712 in #962
- Avoid the placement of unsuitable partition being alter by @garyparrot in #957
- Add earliest/latest/maxTimestamp to AsyncAdmin by @chia7712 in #960
- Enable AsyncAdmin to fetch timestamp of the latest records by @chia7712 in #963
- [WEB] replace Admin by AsyncAdmin for record by @chaohengstudent in #945
- Move SeekStrategy to separate file by @chia7712 in #964
- Add FutureUtils by @chia7712 in #965
- Add MapUtils by @chia7712 in #966
- [GUI] add no_write tab to search idle topics by @chia7712 in #968
- [GUI] TopicTab should show the active consumers by @chia7712 in #969
- Handle the exception thrown by older kafka by @chia7712 in #970
- [GUI] enable to copy whole table view to CSV by @chia7712 in #971
- [GUI] enable to use multi patterns by @chia7712 in #972
- Change Partition#maxTimestamp to be optional by @chia7712 in #973
- Add
Checkbox
to GUI by @qoo332001 in #954 - [WEB] Add Second control stage to unify write-only tab by @chia7712 in #975
- [GUI] add two phases (plan and execute) for BalancerTab by @chia7712 in #977
- [GUI] tweak GUI by @chia7712 in #978
- [PERF] Enhance performance partition change rate by @harryteng9527 in #958
- remove ReplicaDiskInCost and update BrokerInputCost by @qoo332001 in #976
- [GUI] Input#emptyValueKeys does not return true keys with empty value by @chia7712 in #980
- [GUI] sort the dynamic key of TopicTab by @chia7712 in #981
- Move wildcardToPattern from PaneBuilder to Utils by @chia7712 in #982
- [GUI] Replace time string by LocalDateTime by @chia7712 in #984
- migrateLeaderForGUI by @qoo332001 in #979
- multiMoveCostToBalancer by @qoo332001 in #983
- [GUI] enable to query TableView by @chia7712 in #985
- [GUI] Remove override objects to simplify code by @chia7712 in #990
- Record and statistics computation by @chinghongfang in #650
- Enable to append/subtract configs from AsyncAdmin by @chia7712 in #994
- [GUI] remove useless select items by @chia7712 in #995
- [GUI] enable to alter configs for multiples topics by @chia7712 in #996
- Allow
Receiver
to launch a thread to trigger metrics update by @garyparrot in #993 - ETL: DF write to Kafka by @wycccccc in #898
- astraea-738 Add http client by @g1geordie in #848
- Add more dynamic configs test by @chia7712 in #999
- [GUI] A compatible way to alter topic/broker configs by @chia7712 in #1001
- [GUI] Config tab should offer internal info of topic by @chia7712 in #1004
- [GUI] enable to configure poll timeout by @chia7712 in #1005
- [WEB] add max timestamp and active group ids to topic APIs by @chia7712 in #1006
- Add an async run in RebalancePlanExecutor by @Haser0305 in #989
- [WEB] replace Admin by AsyncAdmin for ReassignmentHandler by @chia7712 in #1009
- fix ReplicaLeaderCost by @qoo332001 in #1011
- Make flaky test Disable by @wycccccc in #1015
- Replace Admin By AsyncAdmin for Perf tool by @chia7712 in #1014
- Fix flaky WriterTest#topicCreatorTest by @wycccccc in #1013
- Replace Admin by AsyncAdmin for ThrottleHandler by @chia7712 in #1017
- Remove RebalanceAdmin by @chia7712 in #1018
- fix AsyncAdminWithOfflineBrokerTest by @chia7712 in #1019
- Replace Admin by AsyncAdmin for test code by @chia7712 in #1020
- [GUI] move "add partitions" to ReplicaTab by @chia7712 in #1021
- fix
ClusterInfo#diff
by @qoo332001 in #992 - Enable to update configs in batch by @chia7712 in #1023
- Fix flaky Spark2KafkaTest#archiveTest&WriterTest#topicCreatorTest by @wycccccc in #1016
- [GUI] Replace Button by click by @chia7712 in #1026
- Cost and weight for web by @qoo332001 in #987
- Revise
Balancer
by @garyparrot in #997 - [GUI] remove useless dynamic tab by @chia7712 in #1028
- ETL: Refactor MetaData by @wycccccc in #988
- [GUI] remove override Tab/TabPane by @chia7712 in #1029
- Move cost limit in balancer tab by @qoo332001 in #991
- [GUI] enhance Lattice to layout nodes by @chia7712 in #1032
- [WEB] replace Admin by AsyncAdmin for BalancerHandler by @chia7712 in #1033
- Cleanup blocking Admin by @chia7712 in #1034
- Fix flaky
TopicHandlerForProbabilityTest
by @garyparrot in #1036 - fix flaky BalancerHandlerTest#testReport by @chia7712 in #1039
- Remove TopicCreator#create by @chia7712 in #1037
- Make ClusterLogAllocation extend ClusterInfo by @chia7712 in #1041
- [GUI] enable to change both broker and path on ReplicaTab by @chia7712 in #1044
- add new MoveCost to webAPI by @qoo332001 in #740
- Add Lazy object to initialize objs lazily by @chia7712 in #1046
- Fix
ClusterLogAllocation
by @garyparrot in #1042 - Run CI by container by @chia7712 in #1048
- Update spotless from 5.14.3 to 6.11.0 by @chia7712 in #1050
- Fix Flaky
StraightPlanExecutorTest#testAsyncRun
by @garyparrot in #1045 - Upgrade kafka from 3.2.1 to 3.3.1 by @chia7712 in #1051
- Fix flaky
BalancerHandlerTest#testTopics
by @garyparrot in #1052 - Upgrade dependencies by @chia7712 in #1053
- [GUI] apply StraightPlanExecutor to BalancerNode by @chia7712 in #1056
- [PERF] Enhance performance pattern by @harryteng9527 in #1049
- Fix failed build caused by #1049 by @chia7712 in #1057
- [GUI] Fix NPE caused by Balancer by @chia7712 in #1058
- Fix dupicated config test by @chaohengstudent in #1031
- Enable RebalancePlanExecutor to execute plan with/without sycn waiting by @chia7712 in #1059
- [GUI] add internal field to replica tab by @chia7712 in #1062
- [GUI] add "isAdding" and "isRemoving" to replica tab by @chia7712 in #1063
- astraea-1067 Remove gson in common module by @g1geordie in #1068
- Statistic on gauge by @chinghongfang in #1024
- [GUI] add read/write records tab by @chia7712 in #1070
- [GUI] refactor PaneBuilder to decouple first/second part by @chia7712 in #1071
- Disallow to re-balance a cluster with moving replicas by @chia7712 in #1065
- Revise
RebalancePlanGenerator
toAllocationTweaker
by @garyparrot in #1066 - Remove Admin#addingReplicas and Admin#replicas by @chia7712 in #1073
- [GUI] show the cost of re-balance by @chia7712 in #1074
- Fix Flaky
BalancerHandlerTest#testPutSanityCheck
by @garyparrot in #1075 - More debounce for stable re-balance by @chia7712 in #1078
- Remove replica#of by @chaohengstudent in #1076
- Create build doc by @Haser0305 in #1060
- Integrate Period to Lazy by @chia7712 in #1087
- Fix flaky AdminTest#testMoveLeaderBroker by @chia7712 in #1088
- Implementation of
MetricCollector
by @garyparrot in #1035 - [MINOR] Unused testGroups method by @g1geordie in #1090
- Replace
BeanCollector
withMetricCollector
by @garyparrot in #1091 - Enable consumer builder to build stream directly by @chia7712 in #1094
- Add basic recrod reader/writer by @chia7712 in #1097
- [WEB] Enable the use of a custom balancer in
POST /balancer
by @garyparrot in #1083 - Fix Flaky AdminTest#testTimestampOfLatestRecords by @chia7712 in #1099
- astraea-1081 Json converter should serialize Map equals by @g1geordie in #1082
- Expose internal statistics of
GreedyBalancer
via JMX by @garyparrot in #1095 - Show something when wait balance by @chia7712 in #1098
- add ClusterCost to BrokerOutputCost by @qoo332001 in #1102
- [WEB] Support MoveCost limit for BalancerHandler by @qoo332001 in #1100
- Add simple Import/Export by @chia7712 in #1104
- Use
FifteenMinuteRate
inBrokerInputCost
andBrokerOutputCost
by @garyparrot in #1107 - [BACKUP] import/export from/to folder by @chia7712 in #1105
- Enhance
Balancer
with retry mechanism by @garyparrot in #1103 - add ExpWeightByTime by @qoo332001 in #1110
- Astraea improvement : add parse csv tool by @wycccccc in #1092
- Append full record for reader and writer by @chaohengstudent in #1101
- typo: alert -> alter by @chia7712 in #1116
- [GUI] wildcard should exclude empty/blank string by @chia7712 in #1117
- Replace CsvReaderBuilder.of by CsvReader.builder by @chia7712 in #1118
- [GUI] add import node by @chia7712 in #1119
- [BACKUP] import headers by @chia7712 in #1125
- Replace Producer.Sender by producer.Record by @chia7712 in #1126
- [CONNECTOR] add connector module by @chia7712 in #1127
- add builder for consumer record by @chia7712 in #1129
- Remove redundant fetcher adding by @chinghongfang in #1132
- [CONNECTOR] add ftp server, ftp client, and file system interface by @chia7712 in #1131
- Move file system and database to separate module by @chia7712 in #1133
- Move Configuration from common.cost to common by @chia7712 in #1135
- [WEB] Support MBean metrics sampling for BalancerHandler by @garyparrot in #955
- [FS] add local file system by @chia7712 in #1137
- [BACKUP] define RecordWriter interface by @Haser0305 in #1109
- 訂定 Astraea assignor interface by @harryteng9527 in #1113
- [BAKCUP] Apply RecordWriter on Exporter by @chia7712 in #1138
- remove unused code in LogMetricsTest by @saivirtue in #1139
- Fix deploy.model && excutor() by @wycccccc in #1069
- Combine multiple Avgs to implement
Stat
by @qoo332001 in #1144 - add a test for bootstrapServers by @Haser0305 in #1143
- Redo balancer experiment with Web API by @garyparrot in #1141
- [BALANCER] simplify JMX register of greedy balancer by @chia7712 in #1150
- [BACKUP] export topic data to multi-files by limiting size of archive… by @chia7712 in #1152
- [GUI][ETL] Avoid packaging unused dependencies by @chia7712 in #1153
- Deps image should include dependencies of etl test scope by @chia7712 in #1154
- Embed broker folders information into
ClusterInfo
by @garyparrot in #1147 - [WEB] add raw string case for RecordHandler by @chia7712 in #1155
- Remove unused SuppressWarnings from ConsumerThread by @Haser0305 in #1158
- Remove
BalanceProcessDemo
by @garyparrot in #1159 - astraea-974 Implement RecordHandler post request by @g1geordie in #1156
- [WEB] Remove RequestObject by @chia7712 in #1164
- [BACKUP] define RecordReader interface by @chaohengstudent in #1145
- astraea-974 Implement ThrottleHandler post request by @g1geordie in #1166
- astraea-974 Implement Topic Handler post request by @g1geordie in #1160
- Replace clean csv to import csv by @wycccccc in #1161
- [JSON] refactor json http client by @chia7712 in #1175
- Implementation of
ClusterInfoBuilder
by @garyparrot in #1165 - [WEB] Enable to fetch error message from response by @chia7712 in #1180
- Add more methods to convert primitive type to byte array by @Haser0305 in #1149
- Fix heap memory problem in SmoothWeightRoundRobinDispatcher by @chinghongfang in #1146
- Refactor MetricsCollector by @chia7712 in #1183
- [FS] enable to create file system dynamically by @chia7712 in #1191
- [CONNECTOR] add Astraea sink by @chia7712 in #1190
- add metricName to HasBeanObject by @qoo332001 in #1179
- Remove dispatcher configuration config via properties by @wycccccc in #1186
- Replace
ClusterLogAllocation
usage byClusterInfoBuilder
by @garyparrot in #1184 - Eliminate unused catch statement by @chia7712 in #1193
- Upgrade gradle from 7.5.1 to 7.6 by @chia7712 in #1196
- [0.1.0 release][Update GUI Docs]Update download_gui.png & README.md by @Jui-Yu-Hsieh in #1194
- Cleanup unused helpers from Utils by @chia7712 in #1198
- [WEB] Fix the HTTP request stream read issue temporarily by @garyparrot in #1197
- [WEB] Make WebService and standalone class by @chia7712 in #1202
- astraea-738 Add connector client by @g1geordie in #1012
- 新增 PartitionCost by @harryteng9527 in #1187
- [WEB] fix flaky WebServiceTest#testClose by @chia7712 in #1204
- [CONNECTOR] use connector client to rewrite ConnectorTest by @chia7712 in #1203
- [GUI] save setting by json by @chia7712 in #1206
- [GUI][CONNECTOR] add connector page by @chia7712 in #1210
- [CONNECTOR] Fix flaky ConnectorClientTest#testUrls by @chia7712 in #1208
- Json Serializer by @wycccccc in #1174
- [CONNECTOR] avoid weird error message from start_worker.sh by @chia7712 in #1209
- Remove
Comparable
interface fromNodeInfo
by @garyparrot in #1214 - Fix Flaky
TopicHandlerTest#testWithWebService()
by @garyparrot in #1211 - Implementation of
ClusterBeanQuery
by @garyparrot in #1195 - ETL tool: start script by @wycccccc in #1130
- Add Import csv.md & blank line argument by @wycccccc in #1192
- [CONNECTOR] enable to fetch connector status by @chia7712 in #1216
- [FS] Make file system be thread-safe by @chia7712 in #1217
- [GUI] enable to create connector and list task by @chia7712 in #1218
- add Sensor to MetricCollector by @qoo332001 in #1171
- [CONNECTOR] enable to validate configs by @chia7712 in #1221
- Move all argument field to app module by @chia7712 in #1223
- [CONNECTOR] add perf connector by @chia7712 in #1222
- [CONNECTOR] add astraea connector to worker by @chia7712 in #1224
- [GUI][CONNECTOR] enhance connector status by @chia7712 in #1226
- [CONNECTOR] Fix flaky ConnectorTest#testRunCustomConnector by @chia7712 in #1229
- Revise
ClusterBeanQuery
by @garyparrot in #1215 - [CONNECTOR] fix COnnectorClientTest.testUpdateConnector by @chia7712 in #1230
- [FS] exclude kafka dependency by @chia7712 in #1231
- astraea-974 Implement ReassignmentHandler post request by @g1geordie in #1176
- astraea-974 Implement BalancerHandler post request by @g1geordie in #1178
- Remove LinkedListTest and LinkedList by @chia7712 in #1232
- [WEB] tweak BalancerHandler by @chia7712 in #1234
- [CONNECTOR] fix ConnectorClientTest.testUpdateConnector by @chia7712 in #1235
- Replace ConsumerConfig.GROUP_ID_CONFIG by DistributedConfig.GROUP_ID_… by @chia7712 in #1237
- [WEB] move Scenario to app module by @chia7712 in #1233
- rename MetricSensors by @qoo332001 in #1242
- Replace With Astraea JsonConverter by @wycccccc in #1080
- [WEB] Refactor BalancerHandler#CostWeight by @chia7712 in #1245
- Apply BrokerTopic to ClusterInfo by @chia7712 in #1246
- [CONNECTOR] enable to configure jmx port for worker by @chia7712 in #1247
- Implement query cache mechanism for
ClusterBean#*Metrics()
by @garyparrot in #1244 - Tweak code base by @chia7712 in #1250
- Move MBeanRegister from org.astraea.common.metrics.jmx to org.astraea… by @chia7712 in #1248
- astraea-974 Implement QuotaHandler post request by @g1geordie in #1177
- astraea-974 App module remove gson by @g1geordie in #1243
- [CONNECTOR] add source connector metrics by @chia7712 in #1251
- [WEB] use Optional to represent null for BalancerHandler by @chia7712 in #1253
- [GUI] each node should not use MultiInput directly by @chia7712 in #1254
- [GUI] remove Prop.equals by @chia7712 in #1255
- [GUI] add source task metrics by @chia7712 in #1257
- Refactor Sensor builder by @chia7712 in #1259
- [CONNECTOR] add FtpSinkConnector by @Haser0305 in #1228
- Reame
Dispersion#correlationCoefficient
toDispersion#cov
by @garyparrot in #1256 - [CONNECTOR] add perf sink by @chia7712 in #1263
ClusterBean
query metrics should check all subClass by @qoo332001 in #1260- remove etl.dockerfile by @chia7712 in #1268
- Upgradle spark version to 3.3.1 in start_spark.sh by @wycccccc in #1264
- Provide descriptive text in
HasClusterCost#of()#toString()
by @garyparrot in #1266 - [CONNECTOR] add sink metrics by @chia7712 in #1269
- [CONNECTOR][GUI] fetch connector type from /status API by @chia7712 in #1270
- Remove QuotaCreator, ReplicationThrottler, and SyncReplicaMigrator by @chia7712 in #1271
- [CONNECTOR] move Ftp connector to org.astraea.connector.ftp by @chia7712 in #1272
- [CONNECTOR] add source record by @chia7712 in #1274
- Update the version of spark in etl to 3.3.1 by @wycccccc in #1275
- [CONNECTOR] add ConnectorConfigs by @chia7712 in #1278
- Add API usage note to
web_api_balancer_chinese.md
by @garyparrot in #1273 - [CONNECTOR] support to define distribution for Perf source by @chia7712 in #1277
- [CONNECTOR] add metadata storage to source connector by @chia7712 in #1284
- [CONNECTOR] PluginInfo should carry definitions by @chia7712 in #1287
- Implementation of
NetworkIngressCost
andNetworkEgressCost
by @garyparrot in #1240 - Change version from 0.0.1-SNAPSHOT to 0.1.0-SNAPSHOT by @chia7712 in #1288
- [CONNECTOR] rename FtpSource to Importer by @chia7712 in #1290
- Move score away from zero by @chinghongfang in #1236
- [CONNECTOR] add converter configs by @chia7712 in #1291
- spark2kafka process blank line by @wycccccc in #1227
- Upgradle Astraea version to 0.1.0 in start_etl.sh by @wycccccc in #1293
- [CONNECTOR] add connector info metrics by @chia7712 in #1292
- Rename Balancer config by @garyparrot in #1295
- implement sensors in ReplicaSizeCost by @qoo332001 in #1241
- Add configurable for assignor by @harryteng9527 in #1162
- Uniformly use string type to build schema by @wycccccc in #1298
- [COST] standardize move cost by @chia7712 in #1302
- [0.1.0 release][Update GUI Docs]Update setting.png #885 by @Jui-Yu-Hsieh in #1294
- Add ReplicaInfo#hashCode by @chia7712 in #1303
- [DISPATCHER] enable null key and null value by @chia7712 in #1305
- [SPARK] enable to mount host folder on spark master/worker container by @chia7712 in #1307
- Change tracker print out message by @chinghongfang in #1311
- [ETL] refactor etl module by @chia7712 in #1310
- [SPARK] the generated command used to start spark worker should inclu… by @chia7712 in #1312
- [CONNECTOR] add MetadataStorage to SourceTask by @chia7712 in #1313
- [GUI] enable to display documentation and wrap the long line by @chia7712 in #1314
- [PERF][CONNECTOR] support to define specify partitions to send records by @chia7712 in #1315
- [WEB] Provide extra failure information from Balancer response by @garyparrot in #1309
- Add experiment report by @chinghongfang in #1304
- [CONNECTOR] add task configs by @chia7712 in #1317
- [PERF] add documentation for key.length/value.length by @chia7712 in #1316
- [CONNECTOR] show task configs by @chia7712 in #1319
- [WEB] Fix the placement output order of
Change#before
andChange#after
by @garyparrot in #1321 - [BACKUP] fix incorrect rename caused by #1290 by @chia7712 in #1324
- [CONNECTOR] add FtpSourceConnector by @chaohengstudent in #1262
- [PERF] add throughput to PerfSource by @chia7712 in #1323
- Unify dependencies by @chia7712 in #1330
- Treat no partition load metric as zero load in
NetworkCost
by @garyparrot in #1332 - Rewrite Rate.of to apply DataSize by @chia7712 in #1331
- Delete
Avg.rateByTime
andRateByTime
by @chinghongfang in #1334 - Make
NetworkCost
replication bandwidth aware by @garyparrot in #1329 - [GUI] Topic tag should include number of producer id by @chia7712 in #1341
- [WEB] Perform ongoing rebalance check at the start of plan searching by @garyparrot in #1338
- [GUI] add health page to show the nonavailable topic/partition by @chia7712 in #1343
- Admin#producerStates get stuck if there are offline nodes by @chia7712 in #1344
- fix flaky BalancerHandlerTest#testTopics by @chia7712 in #1345
- [CONNECTOR] add required setter to create required argument by @chia7712 in #1348
- [CONNECTOR] Add exporter definition by @Haser0305 in #1346
- [CONNECTOR] apply required flag to Exporter definition by @chia7712 in #1350
- Return empty map instead of error when fetching producer states from … by @chia7712 in #1351
- [WEB] Revise
GET /balancer
Response by @garyparrot in #1335 - Fix
BalancerHandlerTest#testNoReport
by @garyparrot in #1354 - Replace error by empty map for partition reassignment when running wi… by @chia7712 in #1353
- [0.1.0 release][Update GUI Docs]Update README.md and pic in replica by @Jui-Yu-Hsieh in #1356
- Add check etl by @chia7712 in #1358
- [ETL] enable to recursive looking for source path by @chia7712 in #1359
- Refactor data supplier and sending data by @harryteng9527 in #1340
- [ETL] use RESOURCES_CONFIGS instead of HEAP_OPTS by @chia7712 in #1362
- 將 throttle 功能說明加入 performance docs 內 by @harryteng9527 in #1361
- enhance Grafana docs by @harryteng9527 in #1342
- [CONNECTOR] apply documentation require flag in Importer definition by @chaohengstudent in #1357
- Disable data-directory migration by @garyparrot in #1368
- [0.1.0 release][Update GUI Docs]Update README.md and pic in client by @Jui-Yu-Hsieh in #1364
- [Docs]Update gui README.md and pic by @Haser0305 in #1371
- [Docs] Update gui docs by @chaohengstudent in #1372
- [GUI][DOC] update docs about running GUI tool by @chia7712 in #1373
- [CONNECTOR] Add documents for connector by @Haser0305 in #1367
- [BACKUP] size of exporter should be optional by @chia7712 in #1376
- Remove exporter, importer, csv_importer from App by @chia7712 in #1374
- Decrease the step size of
GreedyBalancer
by @garyparrot in #1337 - [BACKUP] update docs for reminding the converter by @Haser0305 in #1377
- add the link of node_exporter readme into prometheus readme by @harryteng9527 in #1379
- Fix performance tool non throttle by @harryteng9527 in #1378
- etl experiment report by @wycccccc in #1360
- Update version from 0.1.0-SNAPSHOT to 0.1.0 by @chia7712 in #1380
New Contributors
- @chia7712 made their first contribution in #2
- @chinghongfang made their first contribution in #3
- @garyparrot made their first contribution in #5
- @qoo332001 made their first contribution in #19
- @cxorm made their first contribution in #71
- @harryteng9527 made their first contribution in #109
- @brandboat made their first contribution in #383
- @jellynina made their first contribution in #429
- @g1geordie made their first contribution in #495
- @Haser0305 made their first contribution in #540
- @chaohengstudent made their first contribution in #550
- @MaxwellYHL made their first contribution in #558
- @saivirtue made their first contribution in #1139
- @Jui-Yu-Hsieh made their first contribution in #1194
Full Changelog: https://github.com/skiptests/astraea/commits/0.1.0