0.2.0
Pre-release
Pre-release
What's Changed
- Update version from 0.1.0 to 0.2.0-SNAPSHOT by @chia7712 in #1382
- [WEB] Revise balancer documentation by @garyparrot in #1383
- [WEB] Revise balancer documentation by @garyparrot in #1389
- Changing rate statistics by @chinghongfang in #1064
- [DISPATCHER] add more tests for StrictCostDispatcher by @chia7712 in #1390
- [WEB] Make
costWeights
a mandatory argument inPOST /balancer
by @garyparrot in #1392 - [COMMON] add cluster id to ClusterInfo by @chia7712 in #1398
- [COMMON] add AdminConfigs by @chia7712 in #1399
- [COMMON] add get/require method to Cache by @chia7712 in #1400
- [DISPATCHER] change Dispatcher from interface to abstract class by @chia7712 in #1401
- [DISPATCHER] create Admin for all dispatcher to fetch full cluster info by @chia7712 in #1402
- [DISPATCHER] Dispatcher#partition ought to take Replica instead of Re… by @chia7712 in #1404
- [COST] replace ReplicaInfo by Replica for HasBrokerCost by @chia7712 in #1405
- [COST] replace ReplicaInfo by Replica for HasPartitionCost by @chia7712 in #1406
- [COMMON] Replace ReplicaInfo by Replica for test scope by @chia7712 in #1408
- [ASSIGNOR] refactor Assignor by @chia7712 in #1410
- [DOC][PERF] Update performance tool doc by @chinghongfang in #1395
- [COMMON] remove ReplicaInfo and template from ClusterInfo by @chia7712 in #1411
- [DISPATCHER] reduce the overhead of collecting leader info by @chia7712 in #1413
- [COST][DISPATCHER] add NodeSizeCost to balance broker data size by @chia7712 in #1414
- [ETL]add checkpoint_path in start_stl.sh by @wycccccc in #1407
- [DISPATCHER] Maintenance of smooth weight round robin by @wycccccc in #1396
- [PERF] tracker 需要檢查 null consumer by @harryteng9527 in #1419
- [COMMON] add ClusterInfo#brokers by @chia7712 in #1417
- [DOC] add issue link of hardware to README by @chia7712 in #1421
- [TEST] fix the potential bug of broker leak by @chia7712 in #1422
- [CONNECTOR] Exporter flush file base on the time by @Haser0305 in #1370
- [TEST] add new class - service - to unify all kafka-related services by @chia7712 in #1425
- [TEST] remove RequireWorkerCluster and RequireSingleWorkerCluster by @chia7712 in #1426
- [TEST] remove RequireSingleBrokerCluster and RequireBrokerCluster by @chia7712 in #1428
- [BACKUP] Update the doc about Exporter by @Haser0305 in #1429
- [ASSIGNOR] Assignor handle admin by @harryteng9527 in #1415
- [COMMON] Json converter should support DataSize and Duration by @chia7712 in #1431
- Fix flaky ExporterTest#testFtpSinkTaskIntervalWith2Writers by @Haser0305 in #1434
- [GUI] add empty topic to health page by @chia7712 in #1435
- [COST] add cost function for record size by @chia7712 in #1436
- [COMMON] add assignor and state to ConsumerGroup by @chia7712 in #1441
- [COMMON] Implementation of
MetricSeriesBuilder
by @garyparrot in #1412 - [GUI] enbale to show assignor and state of consumer group by @chia7712 in #1442
- [PERF] Remove
IOException
from performance tool method signature by @garyparrot in #1445 - [COST] change
ReplicaSizeCost
toReplicaLeaderSizeCost
by @qoo332001 in #1333 - [COMMON] Implementation of
Admin#declarePreferredDataFolders(Map)
by @garyparrot in #1433 - [COMMON] add more topic checkers by @chia7712 in #1448
- [etl] Refactor etl build pattern api by @wycccccc in #1416
- Add health page by @chia7712 in #1450
- [COMMON] DataSize#toString should display double value by @chia7712 in #1452
- [DISPATCHER] tweak Dispatcher by @chia7712 in #1454
- [COMMON] remove unused variables by @chia7712 in #1455
- [COST] make sure all brokers have cost by @chia7712 in #1456
- [COMMON] update dependencies by @chia7712 in #1457
- fix
HasMoveCost#of
by @qoo332001 in #1449 - [COMMON] add ClusterBean#brokerIds and ClusterBean#brokerMetrics by @chia7712 in #1458
- [GUI] add network metrics to broker page by @chia7712 in #1459
- [DEP] Upgrade kafka from 3.3.1 to 3.3.2 by @chia7712 in #1460
- [TEST] Fix lost
Service#close()
call by @garyparrot in #1461 - [DOC] add 2022 party to README by @chia7712 in #1462
- [COST] Provide descriptive
toString()
implementation for weight composite function by @garyparrot in #1463 - [COST] Rewrite
ReplicaNumberCost#clusterCost
by @garyparrot in #1464 - [CONNECTOR] Add hdfs server, hdfsFileSystem and tests by @Haser0305 in #1447
- [COST] Provide
Object#toString
implementation for CostFunctions by @garyparrot in #1470 - [COST] Normalize the return value of
ClusterCost
fromHasClusterCost#of
by @garyparrot in #1465 - [COMMON] upgrade zookeeper from 3.8.0 to 3.8.1 by @chia7712 in #1472
- [PERF] Add publish e2e latency to report by @chinghongfang in #1474
- [COST] Provide descriptive
Object#toString
for ClusterCosts by @garyparrot in #1473 - [COST] merge MetricSensor and Fetcher by @chia7712 in #1477
- [COMMON] simplify MBeanClient by @chia7712 in #1479
- [PERF] make AbstractThread package-private by @chia7712 in #1483
- [DOC] add zk doc link to broker doc by @chia7712 in #1484
- [PERF] Binary search on zipfian value generating by @chinghongfang in #1486
- [CONNECTOR] Add script to start hadoop by @chaohengstudent in #1438
- [HDFS] simplify/fix start_hadoop.sh for OSX by @chia7712 in #1488
- [DOC] Make clear of gui jar file name in build_project by @chaohengstudent in #1489
- [WEB] Refactor
BalancerHandler
by @garyparrot in #1469 - [HDFS] Make rpc and http service use correct hostname by @chia7712 in #1490
- [HDFS] export JAVA_HOME for hadoop script by @chia7712 in #1492
- [CONNECTOR] Fix some issues in connector by @Haser0305 in #1487
- [COMMON] upgrade kafka from 3.3.2 to 3.4.0 by @chia7712 in #1495
- [METRICS] unify AppInfo by @chia7712 in #1497
- [GUI] add memory to BrokerNode by @chia7712 in #1498
- [COMMON] Implementation of
ClusterInfo#topics
by @garyparrot in #1494 - [COST] Fix
NetworkCost
raises an exception when some brokers have no replica by @garyparrot in #1499 - [BALANCER] add init cluster info to Balancer.Plan by @chia7712 in #1503
- [METRICS] Append worker metrics by @chaohengstudent in #1504
- [COST] Revise
NetworkCost
calculation formula by @garyparrot in #1507 - [COMMON] upgrade gradle from 7.6 to 8.0.1 by @chia7712 in #1510
- [JSON] remove debug code by @chia7712 in #1514
- [TEST] Fix flaky BalancerHandlerTest.testSubmitRebalancePlanThreadSafe by @chia7712 in #1513
- [COMMON] replace java.io.File by nio 2 by @chia7712 in #1511
- [COMMON] remove BrokerCost#normalize by @chia7712 in #1515
- [BALANCER] Implementation of
BalancerConsole
by @garyparrot in #1493 - [COST] Partition cost of network ingress by @harryteng9527 in #1443
- [CONNECTOR] Fix listFolders in hdfs by @Haser0305 in #1522
- [COMMON] Fix
Admin#declarePreferredFolders
raising an exception when no cross-broker movement by @garyparrot in #1523 - Implementation of
ClusterInfoSensor
by @garyparrot in #1517 - Refactor Metric Collector by @chinghongfang in #1505
- Fix conflict of #1505 by @chinghongfang in #1528
- [WEB] Enable Data Directory Migration by @garyparrot in #1526
- [GUI] refactor PaneBuilder by @chia7712 in #1529
- [GUI][CONNECTOR] use tip to display documentation of connector plugins by @chia7712 in #1530
- [PERF] Configurable Distribution Type and Zipfian Exponent by @garyparrot in #1521
- Metric publisher by @chinghongfang in #1481
- [SCRIPT] cleanup confluent setup by @chia7712 in #1538
- fix LocalMetricCollector registerJMX by @harryteng9527 in #1536
- [CONNECTOR] Add dependencies for hdfs connector by @Haser0305 in #1525
- [SCRIPT] support to run broker with kraft by @chia7712 in #1539
- [COST] Improve
NetworkCost
Performance by @garyparrot in #1541 - [COMMON] upgrade gradle from 8.0.1 to 8.0.2 by @chia7712 in #1542
- add kafka Q&A docs by @qoo332001 in #1518
- [BALANCER] Implementation of
BalancerBenchmark
by @garyparrot in #1502 - [CONNECTOR] Writer will not close all other when exceeds the roll.duration by @Haser0305 in #1543
- [COMMON] use kraft to run integration test by @chia7712 in #1546
- [COMMON] hanging when creating multi consumers in single thread with … by @chia7712 in #1547
- [BALANCER] Improve balancer-related code execution speed by @garyparrot in #1544
- [TEST] fix Admin#testSubtractTopicConfigs and Admin#testAppendConfigs… by @chia7712 in #1550
- [TEST] stabilize AdminTest by @chia7712 in #1554
- [COST] rename Dispatcher to Partitioner; use prefix to search cost fu… by @chia7712 in #1555
- fix ReplicaSizeCost#clusterCost by @qoo332001 in #1532
- [COMMON] Parallelize the sampling of
MBeanClient#beans
by @garyparrot in #1557 - [COMMON] revise Utils#costFunctions by @chia7712 in #1559
- [Metric] Implement metric collector fetch from topic by @chinghongfang in #1545
- [CONNECTOR] Remove unnecessary output message by @Haser0305 in #1560
- Put the consumer discussion into Kafka Q&A by @harryteng9527 in #1552
- Add Duration into Configuration by @harryteng9527 in #1561
- [TEST] remove "auto.leader.rebalance.enable" from testing by @chia7712 in #1563
- move movementConstraint to MoveCost by @qoo332001 in #1531
- update Kafka QA docs by @qoo332001 in #1564
- [DOCS] Annotate the Log MBean disappearing bug into the troubleshooting page by @garyparrot in #1565
- [COMMON] move ClusterInfo#Optimized to OptimizedClusterInfo by @chia7712 in #1566
- [COST] move cluster-related cost to ClusterInfo by @chia7712 in #1571
- [Metric] Metric publisher failed when fetching many beans by @chinghongfang in #1568
- [COST] remove replica/record move cost from MoveCost, and flatten bal… by @chia7712 in #1574
- update move cost constraint config keys by @qoo332001 in #1576
- remove redundant file by @qoo332001 in #1579
- Provide exception handler construction for MetricSensors by @harryteng9527 in #1569
- [COMMON] delete unused log from LocalFilesSystem.java by @MaxwellYHL in #1582
- Fix MetricSensor test by @harryteng9527 in #1583
- [CONNECTOR] Add ClusterInfo serializer and deserializer by @chaohengstudent in #1577
- [PRODUCER] change Metadata to interface by @chia7712 in #1588
- [CONSUMER] optimize astraea consumer by @chia7712 in #1589
- [CONSUMER] Remove redundant debug message by @garyparrot in #1593
- [METRICS] revise signature of metrics collector by @chia7712 in #1595
- Filter local bean by @harryteng9527 in #1580
- [METRICS] a new infra for metrics collector by @chia7712 in #1596
- [CONSUMER] Make consumer naming static/fixed by @garyparrot in #1600
- [COMMON] add error stack for AttributeNotFoundException/InstanceNotFo… by @chia7712 in #1599
- [PERF] Add records' end-to-end Latency by @harryteng9527 in #1587
- [PERF] Enable the use of zero producer by @garyparrot in #1602
- [PERF] remove duplicate argument from ProducerThread#create by @chia7712 in #1605
- [BALANCER] use new metrics store by @chia7712 in #1598
- [ASSIGNOR] replace old MetricsCollector by new MetricsStore by @chia7712 in #1606
- [CONNECTOR] Reducing stress on exporter heap by @Haser0305 in #1572
- [METRICS] use CompletionStage for client supplier by @chia7712 in #1610
- [PARTITIONER] replace metrics collector by metrics store by @chia7712 in #1612
- [METRICS] remove MetricCollector by @chia7712 in #1614
- [WEB] Fix
WebService
doesn't consider default JMX port by @garyparrot in #1617 - [METRICS] Implement metric send to topic and receive from topic by @chinghongfang in #1603
- [METRICS] rename MetricsStore to MetricStore and rename MetricsFetche… by @chia7712 in #1619
- [METRICS] separate query from "fetch" by @chia7712 in #1620
- refactor replica migrate size moveCost by @qoo332001 in #1584
- [BACKUP] Build cluster form ClusterInfo by @chaohengstudent in #1608
- [WEB] Increase metric store expiration for
BalancerHandler
by @garyparrot in #1616 - [METRICS] use built-in cost functions to fetch beans by @chia7712 in #1622
- [TEST] fix BalancerHandlerTest#testRebalanceDetectOngoing by @chia7712 in #1625
- [BALANCER][COST]
ClusterInfoSensor
throws an inappropriate exception when supplied with partial info by @garyparrot in #1607 - [RELEASE] 0.2.0 by @chia7712 in #1626
Full Changelog: 0.1.0...0.2.0