Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tier storage uploaded segments not recycled #90

Open
gaobosince1987 opened this issue Sep 25, 2023 · 0 comments
Open

tier storage uploaded segments not recycled #90

gaobosince1987 opened this issue Sep 25, 2023 · 0 comments

Comments

@gaobosince1987
Copy link

I tried latest tier storage from apache 3.6 branch, one thing I notice is broker local segments are not cleaned up after uploaded to remote storage. This is show as local disk usage is keep increasing and local segment never get deleted. Anyone seeing similar behavior? I wonder if there are some new configurations I should add, thanks

topic configuration: bin/kafka-topics.sh --bootstrap-server kafka-test-51-kafka-bootstrap:9092 --topic dfi-test6 --create --config remote.storage.enable=true --config local.retention.bytes=104857600

local disk usage: [kafka@kafka-test-51-kafka-7 /]$ du -sh /var/lib/kafka/data-0/kafka-log7/dfi*
12G /var/lib/kafka/data-0/kafka-log7/dfi-test-10

offset 0 still exist and disk available is decreasing with incoming traffic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant