Samsung U3 is a good media player that plays OGG. The thing is it uses a Microsoft transfer protocol, so if you're using Amarok you might have to tweak, but Rythmbox recognizes it out of the box. In the Windows world, it's pretty much compatible.