Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION]:如何处理日志轮转后的压缩文件以及监控日志采集状态 #1847

Open
yzhengwei opened this issue Oct 31, 2024 · 2 comments
Labels
question Further information is requested

Comments

@yzhengwei
Copy link

在采集程序日志时,程序配置了日志轮转及轮转后压缩文件,当日志生成过快,短时间内轮转压缩了多个文件时,采集的日志有丢失情况。并且这种异常无法发现,是否有相应的监控方法?

@yzhengwei yzhengwei added the question Further information is requested label Oct 31, 2024
@yzhengwei
Copy link
Author

测试时我将日志同时输出到了文件和容器标准输出,标准输出未压缩,同时使用 iuput_file 和 service_docker_stdout 插件采集,但在每秒生成 8万条左右的简单单行日志时,也出现大幅丢失,在将文件日志轮转关闭后,文件采集不再丢失,但容器标准输出仍然会大幅丢失

@messixukejia
Copy link
Collaborator

service_docker_stdout 改成 https://open.observability.cn/project/ilogtail/plugins-input-container-stdio/#_top

input_container_stdio 升级后的版本,内部机制同iuput_file。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants