SNMP Collector logfile SQL error: database disk image is malformed

Situation:

The SNMP collector SQLite database file can get corrupted with a power failure. This will result in the logging of a huge amount of errors in the messages log-file. Which will eventually raise alarms of a full log directory.

Symptomes:

  • systemmanagertrap (305,918) on snmp-col-02-dev-a1.iplease.local. message:  On sysmgr@snmp-col-02-dev-a1.iplease.local for service sysmgr, log storage used reached 100.5%

Solution:

execute:

sqlite3 /opt/recorder/snmpcol/snmpcol.db "PRAGMA integrity_check;"

should normally return "ok"

When returns errors:

  1. execute: "service recorder-sysmgr stop"
  2. execute: "rm /opt/recorder/snmpcol/snmpcol.db"
  3. clean up log directory:
    1. execute: "ls -l /var/log/"
    2. find biggest uncompressed logfile
    3. mv /var/log/messages-[BIGGEST] /tmp/
    4. cd /tmp
    5. gzip messages-[BIGGEST]
    6. mv messages-[BIGGEST].gz /var/log/
  4. execute: "service recorder-sysmgr start"

 

Article Details

Article ID:
1
Category:
Rating :