Answer by Alex Suter

Alex Suter — Mon, 13 Jul 2020 02:59:49 -0400

I think this is a common problem of at least Java services. You can solve this problem with fluentd itself

It seems that in Log4j2 there is a configurable solution for this. It can also be done in log4j1 (current version in ivy) but it's not that easy to correctly implement it in ivy. https://stackoverflow.com/questions/38486248/how-to-make-log4j-syslog-appender-write-a-stack-trace-in-one-line/55407412#55407412

I recommend to solve it in fluentd for now. On our side we plan to upgrade to log4j2.

Comment by Oliver Heer on nndiem's question

Oliver Heer — Thu, 09 Jul 2020 02:21:51 -0400

Hello @nndiem, as I understand your setup fluentd reads the ivy.log and passes the logs to stackdriver. So fluentd would have to read the whole stacktrace as one and not each line separately, meaning it doesn't matter what you configure in log4j, fluentd will still read it in single lines.

You could try using a fluentd plugin like this: https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions

Make sure the messages are caught by their java rules: https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions/blob/master/lib/fluent/plugin/exception_detector.rb

Answers to: Config ivy log in GCP

Answer by Alex Suter

Comment by Oliver Heer on nndiem's question