What should we do with the log locations variables?

[leopaul36]

Working on Fluentbit / Promtail, I am facing the same issue that we had before with the service ports variables.

For tdp-observability, I need access to the configured service log directories (ex: hbase_log_dir, hive_log_dir, etc.). These are currently configured in each service's tdp_vars.

I see two options:

Move every log dir to /var/log/tdp

Example: /var/log/hive and /var/log/knox becomes /var/log/tdp/hive and /var/log/tdp/knox.

This way the Fluentbit / Promtail can parse a default /var/log/tdp directory and everything is easier but it does not work if the user changes the default log directory for some services.

Move every log dir variables to tdp-cluster

Like we did for the ports. I am not a big fan of having variables around the place like this but I guess this is the only valid choice.

Let me know if you have more ideas.