So, I'm running show slave status and I'm seeing that my slave is around 14 days behind my master, which is weird since I the server's set to expire logs after 3 days.

After a bit of digging I found this: http://bugs.mysql.com/bug.php?id=2826

So I checked the system time on the slave and it was way out of whack with the current date.

So, I restarted ntpd (which causes it to re-sync), stopped and restarted the slave and there we go problem fixed.