OK, so USB won't connect to GP2X (running XP Pro (not sure if SP1 or 2 make a difference).
Purchased card reader. Formatted 512Mb SD Card.
Download LinesX, BubbleX etc and SDL Libraries, putting them all on the card via the new reader (in their own directories not root).
Booted up GP2X...