tail plugin stops tailing the log files which are rotated based on file size.

[deepaksb2]

The application log rotation policy is defined based on log file size to limit the disk space consumption.

I have the below tail plugin configutation and I onserved the tail plugin stops reading the data from the log file which is writing new logs of application.

@type tail path /opt/appxyz/logs/applog* tag xyzApplogingest read_from_head false pos_file /opt/td-agent/fluentd/file-tail.log.pos follow_inodes true refresh_interval 2 skip_refresh_on_startup true enable_stat_watcher false from_encoding UTF-8 encoding UTF-8 exclude_path [""] multiline_flush_interval 5s @type none

The log files are generated in below format and each log file size is limit to 4096MB

applog.log
applog.log.1
applog.log.2
applog.log.3
and so on to max 10

Note: enable_stat_watcher set to true also results the same issue.

Please help me if any other parameter needs to be added in tail source configuration , would be great if working configuration with tuning parameters can be shared.

I did not face any issue if the files are rotated based on time.

[deepaksb2]

Please help me on this, i am still facing this issue. I set the path to path /opt/appxyz/logs/applog.log (instead of wild card *) where the live data is written by application but still facing same issue.