ulimits and my limits

Even Linux systems have their limits!  One of the systems I manage started throwing a “Too many open files” error in /var/log/messages.  No error is good but this error is fixable.  A little tuning and the error goes away.  On this particular server we were running the Oracle Client and a Java Application, two very […]

read more

When Tomcat stops responding to Apache

Today our multi-node tomcat servers became unresponsive to user/web traffic.  A quick look at our monitoring tools indicated that the tomcat servers were running healthily.  While the application administrator looked at catalina.out to see if we were missing something, I dug into the load balancer logs.  I immediately saw the following errors: [Date] [error] ajp_read_header: […]

read more

Putting ‘lsof’ to use

lsof is a powerful tool that has proven very userful over the years in troubleshooting and forensic investigations.  Here are some useful lsof command examples: In this example we are looking at all the files a given process has open (pid=1655 here this is the zabbix agent) lsof -p 1767 Note you can clean up […]

read more

Splunk Installation

Fairly short and sweet to get the agent installed; details are below. 1)      Install the appropriate package from a designated and trusted source: 2)     The default installation path, ${INSTALL_PATH} = /opt/splunkforwarder 3)      Next, create a file with the path /opt/splunkforwarder/etc/system/local/deploymentclient.conf with the contents: [deployment-client] [target-broker:deploymentServer] targetUri = splunkdeploy.uits.uconn.edu:8089 4)      Run the following (supplying your own […]

read more