I get this as well. Thing is, its when I'm playing mp3s. It will be playing along merrily, then when it starts playing a new song, it occasionally switches the speakers back on.
I can't see this being a hardware issue, as its always when it starts playing a new song (and not an intermittant...