There’s a lot of conflicting information out there on how to install the MySQL gem on CentOS 5, but it’s very easy to do.  On a clean CentOS 5 install, as root, run:

yum install mysql-devel gcc make
gem install mysql -- --with-mysql-config=/usr/bin/mysql_config

That’s pretty much it.  Compile should work fine.