I've only had one problem with the GP2X! My first one burnt out for some unknown reason, but I was given a replacement from gp2x.co.uk and this one works perfect too!
I've never had problems with the joystick, dead pixels, or anything else for that matter!
As for short battery life..... with 2x...