Yes aaronson, you're using crappy batteries.
Buy some new, more powerful batteries. Get the highest capacity batteries you can get for maximum battery life (they also take longer to charge though).
I use 3200mAh ni-mh batteries and I get plenty of battery life.
My GP2X is mostly used for...