Yea, getting replacement batteries would be the way to go (if you like your current player), it would probably be cheaper than getting a new mp3 player.
I had the Archos AV420 and i loved it!!! I sold it thinking the PSP would be better, but i was wrong! I am now selling my PSP and am looking to by the new Archos AV500!