Monthly archives for December, 2007
Got an error reading communication pa...
If you look at your error log file for MySQL you’ll inevitably see the warning: “got an error reading communication packets”. The common solution is to increase the max_allowed_packet size.
I’ve seen this set as high as 1GB but typically the problem is alleviated by running it as max_allowed_packet=64M. If you set th [...]
Perl Parallel Processing for data col...
Figured I’d update and say that I solved the issue with threading. (Thanks Steve). The agent.pl script is now using the Proc::Queue module to automatically manage the number of spawned processes via forking. Here’s the run down.
use Proc::Queue;
Proc::Queue::size(10); # changing limit to 10 concurrent processes
Proc::Queue:: [...]
Monolith 1.2 Update
Lots of changes coming down the pipe for the upcoming release.
Changes as follows.
1. Name change – from Monolith MySQL – Backup Manager to Monolith – MySQL DBA Console [pending]
2. Performance auditing, Security Auditing, OLAP tools, Backup management [complete]
3. Parallel server polling for large cluster support [comp [...]
Perl Parallel Processing for data col...
I’ve been wanting to change the Monolith polling (poller.pl) script for a while. It’s written in perl and is called by the agent.pl script. This ideally runs from Cron on hourly or daily intervals – depending on how often you want to collect DB statistics for OLAP needs.
Problem:
I am currently polling >80 servers and [...]
OLAP Begins
Just downloaded this guy here: Mondrian
Over the years I’ve been writing my own OLAP scripts in Perl and PHP. It’s not that I’m tired of doing that – since it’s nice to have complete control over the process, but I just don’t have the time to commit to that right now. So perhaps this can streamline things [...]
Standard Issue
Some common issues I run into.
1. Disk space usage – usually a result of binary logs hogging up space. Usually alleviated by setting expire_logs_day=n but in some cases the server sees so much traffic it can fill up before n days is reached. Hence the usual method of “mysql> purge master logs to ‘log-name.xxx’; [...]
CNF files
I have some preconfigured cnf files for the following RAM sizes. These are for dedicated servers so if you’re running Tomcat or Apache on the box as well – you’ll want to drop the buffer sizes accordingly so that MySQL isn’t hogging the resources.
2GB RAM
4GB RAM
8GB RAM
16GB RAM
Connection Logging
Ever wonder how to track the number of active connections without using Cacti or some other monitoring system?
Yep, this does it. Script
New Backup Scripts
Features:
1. Email reporting
2. File consistency checking
3. Retention period file pruning
4. Daily/Weekly/Monthly scripts for Cron execution
Files
Daily backup
Weekly backup
Monthly backup
