This is what a couple of appnotes and some tips earned me.
I picked the iRiver iClix2 because, unlike the iPod, it can play Vorbis audio out of the box. This little 4GB flash player also has an FM radio in it, can record radio, and also record voice (WMA format only, alas). It even can do video, when combined with the MythTV at home it means I can watch TV over lunch with no problems. Since it isn't in the Novell Rewards Catalog, I used an Amazon Gift Certificate to buy it. It has no problem plugging into my openSUSE 10.3 machine at work, and Banshee plays from its directories just peachy (.ogg, of course).
Disclaimer: As with everything else at Cool Solutions, this content is definitely not supported by Novell (so don't even think of calling Support if you try something and it blows up).
It was contributed by a community member and is published "as is." It seems to have worked for at least one person, and might work for you. But please be sure to test, test, test before you do anything drastic with it.