Something that's frustrated me for a while is the behaviour of the podcast browser.
If you go back to the main podcast list, you're sent back to the top of that list and not where you were. It makes browsing a collection of podcasts difficult as often series are not grouped correctly and you end up with a long list of identical podcast names, each containing only one episode. You can't tell where each episode is in the list and this behaviour only makes it harder to find the episode you're looking for.