If you’re on mobile clear your data cache. It seems to me like the app prioritizes a handful of cached songs it’s already downloaded, probably to save bandwidth, and doubly so when you’re in an area with poor signal.