1.0.2(End of Support)

Important Update

Adaptive Memory-Related Configurations: This new feature simplifies your setup process, enabling AutoMQ Kafka to run on machines of any memory size without requiring manual configuration adjustments.
With this update, AutoMQ Kafka intelligently adjusts heap sizes and various cache sizes based on the available machine memory by default. This advancement is designed to significantly simplify your setup process, enabling optimal performance without manual intervention and helping you get started with AutoMQ Kafka more efficiently.

What's Changed

• feat(release): update s3stream version by @Chillax-0v0 in #908
• fix(core): fix move out action break condition & extract common code by @SCNieh in #916
• feat(telemetry): support gzip compression for grpc otlp exporter by @SCNieh in #921
• feat(core): refactor AbstractGoal for better scalability by @SCNieh in #924
• chore(log): remove useless error log by @Chillax-0v0 in #926
• fix(core): fix optimize condition check by @SCNieh in #933
• chore: change dependency of s3stream from automq-for-rocketmq to automq-for-kafka by @Chillax-0v0 in #939
• feat(config): add config s3.stream.allocator.policy by @Chillax-0v0 in #941
• feat(config): add config s3.stream.allocator.policy by @Chillax-0v0 in #943
• chore(gradle): adapt to Gradle 8.6 by @Chillax-0v0 in #948
• feat(config): auto memory adaptation by @Chillax-0v0 in #946
• chore(release): update the release script by @Chillax-0v0 in #950
• fix(release): update main branch in the release script by @Chillax-0v0 in #951
• ci: bump version to 1.0.2 by @Chillax-0v0 in #952
• chore: switch to develop mode by @Chillax-0v0 in #953
• chore(workflow): ignore tags like "1.0.2-s3stream" by @Chillax-0v0 in #954
• feat(config): add a switch on tagging by @Chillax-0v0 in #969
• fix(config): adjust configs in KafkaConfig rather than Kafka by @Chillax-0v0 in #971

Full Changelog: 1.0.1...1.0.2
S3Stream Changelog: 1.0.1-s3stream...1.0.2-s3stream

1.0.1(End of Support)

What's Changed

• fix(ci): fix tag version regex; delete E2E results before running tests by @mooc9988 in #864
• fix(telemetry): add missing percentile metrics by @SCNieh in #865
• refactor(tests): show RemoteCommandError when starting kakfa by @mooc9988 in #866
• fix(telemetry): fix topic dashboard name by @SCNieh in #868
• fix(core): compare topic id with equal by @SCNieh in #870
• feat(issues871): log request info for stream object compaction by @superhx in #872
• feat(core): merge multiple reassignments for same partition by @SCNieh in #873
• feat(dashboard): add node level network metrics by @SCNieh in #874
• feat(dashboard): set query interval to 30s to match default metrics reporter interval by @SCNieh in #875
• fix(core): support alter auto balancer topic partitions by @SCNieh in #876
• feat: switch to develop mode by @superhx in #877
• feat(core): log exception when send autobalancer metrics failed by @SCNieh in #880
• fix(tools): create s3url pathStyle not used by @funky-eyes in #884
• feat(core): update detailed metrics dashboard by @SCNieh in #888
• feat(metrics): add metrics about event queue time by @Chillax-0v0 in #894
• feat(metrics): add prometheus alert rules template and unit tests by @SCNieh in #897
• fix(tools): endpoint compatibility includes HTTP protocol by @funky-eyes in #891
• feat(metrics): add s3 request error rate to alert rules by @SCNieh in #898
• chore: bump to 1.0.1 by @Chillax-0v0 in #904

New Contributors

• @funky-eyes made their first contribution in #884

Full Changelog: 1.0.0...1.0.1
S3Stream Changelog: AutoMQ/automq-for-rocketmq@1.0.0-s3stream...1.0.1-s3stream

1.0.0(End of Support)

What's Changed

• ci: Bump version to 1.0.0-rc8 by @mooc9988 in #785
• build(s3stream): switch back to dev mode by @SCNieh in #786
• fix(e2e): wait for more time for broker hard bounce by @mooc9988 in #787
• feat(issues791): change s3.stream.object.compaction.max.size.bytes default 1GB by @superhx in #792
• fix(auth): throw an exception when failed to create a credential from env by @Chillax-0v0 in #793
• fix(e2e): fix transaction timeout; merge streams tests by @mooc9988 in #795
• feat(core): verify stream epoch for stream object commit by @SCNieh in #796
• fix(core): prevent generate stream object record for noop object id by @SCNieh in #797
• fix(issues798): checkpoint NPE by @superhx in #800
• fix(e2e): add consumer api timeout to 90s in hard bounce tests by @mooc9988 in #803
• feat(issues801): stream trim only update stream metadata by @superhx in #805
• feat(core): add metrics to monitor auto balancer metrics delay by @SCNieh in #807
• fix(issues806): stream object leak by @superhx in #808
• fix: range end offset isn't revertable by @superhx in #809
• chore: rename s3ObjectRetention* to s3ObjectDeleteRetention for a more precise description by @daniel-y in #810
• fix: set destroyed object size by @superhx in #811
• chore: suppress out of order error by @superhx in #812
• fix(metrics): present metrics from active controller only by @SCNieh in #815
• fix(core): prevent anomaly detect exit on inactive controller by @SCNieh in #816
• fix(issues817): txn index fetch out of bound by @superhx in #818
• feat(shell): add metadata summary to metadata shell by @SCNieh in #813
• fix(ReplicaManager): fix memory leak caused by uncaught exception by @Chillax-0v0 in #821
• fix(core): remove topic partition metrics on partition offline by @SCNieh in #820
• feat(core): add metrics to monitor s3 objects by @SCNieh in #823
• fix(core): record s3 object metrics on active controller only by @SCNieh in #824
• feat: add object ttl reach log by @superhx in #825
• fix(issues826): fix consume records leak in closing channel by @superhx in #827
• fix(pr-827): fix release PooledMemoryRecords twice by @Chillax-0v0 in #828
• chore: support release tgz file in workflow by @KaimingWan in #832
• fix(core): catch exceptions on replaying records by @SCNieh in #836
• feat(core): refine grafana dashboards by @SCNieh in #837
• fix(core): fix auto balancer metrics delay time calculation by @SCNieh in #838
• fix(ReplicaManager): release permits after sending responses by @Chillax-0v0 in #831
• fix: log permanet fail by @superhx in #839
• feat(core): redirect JUL log to sl4j and remove unused logging exporter by @SCNieh in #843
• perf(DelayedFetch): only try to fast read on complete a delayed fetch by @Chillax-0v0 in #844
• perf(ReplicaManager): return fast if slow fetch timeout by @Chillax-0v0 in #845
• fix(core): fix node id regex in broker dashboard by @SCNieh in #841
• feat: record pooled record memory usage by @superhx in #846
• ci: skip nightly schedule on forks by @tisonkun in #842
• fix(metrics): add label 'version' to kafka.request.count by @SCNieh in #847
• feat(telemetry): add host name to OTel resource by @SCNieh in #849
• feat(metrics): metrics on fetch limiters and executors by @Chillax-0v0 in #848
• feat(metrics): add buffer and thread metrics by @ShadowySpirits in #851
• feat(telemetry): add direct memory panels by @SCNieh in #853
• fix(telemetry): fix read ahead throughput panel unit by @SCNieh in #854
• feat(metrics): rename DirectByteBufAlloc to ByteBufAlloc by @ShadowySpirits in #855
• fix(telemetry): fix memory allocation metrics name by @SCNieh in #856
• feat(metrics): enable buffer pools metrics by @ShadowySpirits in #857
• fix: remove special char from issue template file name by @superhx in #858
• fix(telemetry): fix jvm metrics by @SCNieh in #859
• fix(telemetry): refine grafana dashboard by @SCNieh in #860
• feat: release automq 1.0.0 by @superhx in #861
• ci: Bump version to 1.0.0 by @superhx in #862
• ci: fix regex on release by @Chillax-0v0 in #863

New Contributors

• @tisonkun made their first contribution in #842

Full Changelog: 1.0.0-rc8...1.0.0
S3Stream Changelog: AutoMQ/automq-for-rocketmq@1.0.0-s3stream-rc1...1.0.0-s3stream

1.0.0-rc8

What's Changed

• ci: Bump version to 1.0.0-rc7 by @mooc9988 in #771
• feat: switch to develop mode by @superhx in #772
• fix(e2e): fix mirror_maker test and streams_smoke test by @mooc9988 in #774
• fix: rename broker-address to broker-list by @daniel-y in #775
• chore: change STREAM_NOT_CLOSED log level to WARN by @superhx in #776
• feat(telemetry): make metrics dashboard compatible with Aliyun by @SCNieh in #778
• fix(telemetry): fix OTel collector http endpoint by @SCNieh in #780
• build(s3stream): lock s3stream tag 1.0.0-s3stream-rc1 by @SCNieh in #781
• fix(core): release only if it is PooledResource by @mooc9988 in #784

Full Changelog: 1.0.0-rc7...1.0.0-rc8

1.0.0-rc7

What's Changed

• ci: Bump version to 1.0.0-rc6 by @superhx in #725
• feat(metrics): add more comprehensive jmx rules by @SCNieh in #724
• fix: force to check AutoMQCreateTopicPolicy before creating a topic by @mooc9988 in #726
• fix: let kshell init holder by @KaimingWan in #727
• feat(metrics): support OTLP http exporter by @SCNieh in #728
• fix(log): file cache by @superhx in #729
• fix(transaction): fix the async callback may cause missing abort txn by @superhx in #734
• feat(e2e): add client tool core tests by @mooc9988 in #730
• fix: support ecs role by @KaimingWan in #733
• fix(core): initialize goals before optimization by @SCNieh in #737
• refactor(core): extract common methods to abstract class by @SCNieh in #739
• chore(config/log4j): fix log twice in com.automq.stream by @Chillax-0v0 in #738
• feat(log): file cache support merge put by @superhx in #740
• refactor(core): support customized ClusterModelSnapshot by @SCNieh in #741
• feat(e2e): wip, run main and extra e2e tests by @mooc9988 in #742
• feat(log): add txn index cache by @superhx in #743
• fix(core): use partition metrics time as broker time by @SCNieh in #744
• feat(log): timeindex api thread isolation by @superhx in #745
• feat(e2e): wip, split tests by @mooc9988 in #746
• feat: change block cache size default to 1GB by @superhx in #747
• feat(core): refine exported metrics and dashboard by @SCNieh in #748
• fix(metrics): fix network metrics label value by @SCNieh in #749
• fix: optimize and s3url and fix parse by @KaimingWan in #750
• feat: Nightly full e2e tests by @mooc9988 in #752
• fix(issues754): fix consume aborted txn by @superhx in #755
• fix: don't deprecate s3.wal.path, plus a minor polish of s3url by @daniel-y in #753
• fix(log): unit test by @superhx in #756
• feat(tests): add more core E2E tests by @mooc9988 in #757
• fix(issues751): support quota throttling by @superhx in #758
• feat(log): full checkpoint based on dirty bytes by @superhx in #760
• chore: convert license to bsl to accelerate open source innovation by @daniel-y in #761
• refactor(config): remove useless configs in wal, and add iops config by @Chillax-0v0 in #762
• fix(metrics): refine grafana dashboards by @SCNieh in #759
• fix(metrics): fix type by @SCNieh in #763
• fix(isssue764): ControllerRequestSender stuck by @superhx in #766
• feat(metrics): change ot cardinality limit from 2000 -> 5000 by @SCNieh in #767
• feat(dashboard): refine dashboards by @SCNieh in #768
• fix(logger): treat DuplicateSequenceException as expected by @superhx in #769
• feat: lock s3stream to 1.0.0-s3stream-rc0 by @superhx in #770

Full Changelog: 1.0.0-rc6...1.0.0-rc7

1.0.0-rc6

What's Changed

• ci: Bump version to 1.0.0-rc5 by @superhx in #639
• feat(core): support independent OTLP endpoint for trace by @SCNieh in #638
• fix(core): filter topics label for BrokerTopicMetrics by @SCNieh in #640
• feat: stream without async by @superhx in #641
• chore: polish the NOTICE files by @daniel-y in #643
• fix(s3stream): upgrade to 0.16.0-SNAPSHOT by @SCNieh in #645
• feat(issues619): optimize checkpoint size by @superhx in #646
• feat(telemetry): update grafana dashboard to fix label by @SCNieh in #649
• perf: return fast when the fetchOffset equals to the confirmOffset by @Chillax-0v0 in #651
• fix(telemetry): fix mbeans match rules by @SCNieh in #653
• feat(telemetry): support average stats for request time by @SCNieh in #655
• revert: perf: return fast when the fetchOffset equals to the confirmOffset by @Chillax-0v0 in #656
• feat: optimize s3stream metadata image memory usage by @superhx in #661
• feat(issues662): make default config adapt to 2c16g by @superhx in #663
• perf: return fast when the fetchOffset equals to the confirmOffset by @Chillax-0v0 in #658
• perf: check the last segment first to avoid calling floorSegment by @Chillax-0v0 in #659
• perf: allocate less in readFromLocalLogV2 by @Chillax-0v0 in #669
• feat(tool): add admin tool to help user start AutoMQ easily by @KaimingWan in #670
• feat(core): remove consumer group management for ab consumer by @SCNieh in #671
• feat: open core extension point by @superhx in #672
• feat(open_core): expose shared server by @superhx in #673
• feat(core): add telemetry to release package by @SCNieh in #675
• fix(core): create internal topic on demand by @SCNieh in #677
• feat(log): force compact meta when close by @superhx in #676
• fix(E2E): oom kill by @superhx in #679
• refactor(core): optimize scalability of autobalancer structure by @SCNieh in #678
• feat(core): add unit test for AnomalyDetector by @SCNieh in #682
• fix(issues680): fix S3StreamsMetadataImage#getObjects by @superhx in #681
• chore: fix readme by @KaimingWan in #684
• chore: fix readme content by @KaimingWan in #685
• fix: remove dependency on systemd; make sure kafka can be shutdown gracefully by @mooc9988 in #689
• feat(core): limit inflight requests pre channel by @ShadowySpirits in #690
• feat: atomic failover feature by @superhx in #693
• fix: get objects corner cases; add more tests and comments by @mooc9988 in #694
• feat: add credential provider holder by @KaimingWan in #695
• feat(log): expand com.automq logger match by @superhx in #697
• chore: bump s3stream to 0.18.0 by @Chillax-0v0 in #698
• feat(core): add kafka request time max metrics by @SCNieh in #699
• fix(tests): Fix org.apache.kafka.image.ImageDowngradeTest by @Dysprosium0626 in #701
• feat(tests): make kraft the default mode by @mooc9988 in #696
• refactor: rename module by @KaimingWan in #705
• feat(issues665): clean up scale-in nodes' objects by @superhx in #703
• chore: source dependency on s3stream by @daniel-y in #707
• fix(log): make txn read async to avoid deadlock by @superhx in #708
• fix(E2E): fix streams E2E by @superhx in #711
• refactor(core): simplify AutoBalancer goals by @SCNieh in #712
• fix(E2E): fix santiy check E2E by @superhx in #713
• fix(E2E): core first E2E test by @superhx in #714
• feat(core): represents raw metric types with single byte by @SCNieh in #717
• feat(tool): Support automq custom records parsing in metadata shell by @aaron-ai in #716
• feat(metrics): introduce group commit offset metrics by @SCNieh in #719
• fix(E2E): fix connect E2E by @superhx in #720
• feat(ci): use automq version along with kafka version by @mooc9988 in #723

New Contributors

• @ShadowySpirits made their first contribution in #690
• @Dysprosium0626 made their first contribution in #701
• @aaron-ai made their first contribution in #716

Full Changelog: 1.0.0-rc5...1.0.0-rc6

1.0.0-rc5

What's Changed

• ci: Release 1.0.0 rc4 by @mooc9988 in #635
• feat: bump s3stream to 0.14.0 by @superhx in #637

Full Changelog: 1.0.0-rc4...1.0.0-rc5

1.0.0-rc4

What's Changed

• ci: Bump version to 1.0.0-rc3 by @superhx in #620
• fix(ci): clean local tags anyway by @mooc9988 in #622
• feat(core): change autobalancer capacity unit to bytes by @SCNieh in #623
• feat(config): update bandwidth related config by @SCNieh in #624
• docs(docker): refine README.md for telemetry by @SCNieh in #626
• feat(s3stream): support config metrics level by @SCNieh in #627
• fix(server): return empty responses without error when fetch exceeds … by @Chillax-0v0 in #628
• feat(metadata): replace image map to delta map by @superhx in #629
• feat(core): support transforming jmx metrics to OTLP by @SCNieh in #632
• perf(server): speed up delayed fetch by @Chillax-0v0 in #633
• ci: Bump version to 1.0.0-rc4 by @superhx in #634

Full Changelog: 1.0.0-rc3...1.0.0-rc4

1.0.0-rc3

What's Changed

• ci: Release 1.0.0 rc2 by @mooc9988 in #583
• feat: meta json backward compatibility by @superhx in #587
• perf(ReplicaManager): speed up shutdown by @Chillax-0v0 in #591
• fix: fence producing if the first seq is not 0 after creating partition by @mooc9988 in #590
• chore(doc): modify readme and add other docs by @KaimingWan in #594
• fix: quick start doc address by @hantmac in #595
• feat(issues525): accelerate recovery from unclean shutdown by @superhx in #596
• fix(issues598): fix test_replication_with_broker_failure fail by @superhx in #599
• feat(core): introduce s3stream tracing by @SCNieh in #610
• feat(issues602): compress stream set object data by @superhx in #612
• feat(core): add telemetry docker compose scripts by @SCNieh in #613
• build(docker): exclude docker/telemetry from rat check by @SCNieh in #615
• chore: bump s3stream to 0.11.0-SNAPSHOT by @Chillax-0v0 in #614

New Contributors

• @KaimingWan made their first contribution in #594
• @hantmac made their first contribution in #595

Full Changelog: 1.0.0-rc2...1.0.0-rc3

1.0.0-rc2

What's Changed

• ci: ready to release 1.0.0-rc1 by @mooc9988 in #569
• fix(e2e): version match by @superhx in #570
• fix(core): use force path style if needed by @mooc9988 in #572
• fix(e2e): log by @superhx in #574
• fix(e2e): await clean up task start by @superhx in #576
• ci: fix rc release version by @mooc9988 in #577
• test(metadata): fix testDeleteTooManyOneRequest by @mooc9988 in #579
• feat: bump s3stream to 0.8.0 by @superhx in #582

Full Changelog: 1.0.0-rc1...1.0.0-rc2