I just got my new GP2X, and it did the exact thing as described here, with an empty SD card (Panasonic 128MB).
When I switched the device on for the first time (with nothing in the card slot), everything was fine.
Then, the second time(!), I switched it on with an empty SD card in the slot, and...