Follow

Redirecting analytics.sh to a log file

By default, analytics.sh does not generate a log file. With this in mind, it can be difficult to determine if analytics is running/when it completed/etc... without logging in to the YARN Resource Manager UI.

To address this, you can redirect the output from analytics.sh to a log file by using a command similar to the following:

bin/analytics.sh conf/interset.conf > /tmp/analytics.log 2>&1

This will generate a file in /tmp/ called analaytics.log which will provide you with both real time and historical information on the analytics execution each day.

Note that the actual location specified is entirely configurable as long as the spark user has write access to the location.

Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

Comments

Powered by Zendesk