No. Apple does not recommend 3rd party devices.
What's the functional difference of taking an MP3 player or your iPhone?
Also, by Apple Music do you mean tracks and albums from the Apple Music subscription service or CDs and albums purchased from the iTunes Store or other non-protected sources?
The first category, cannot be transferred to an external device as they require an active subscription to play, so only work on iPhones, iPads and Apple Watches.
The second type, can be copied to pretty much to any device out there that can play MP3s and AAC files, but will not be detected by iTunes or Finder. Music transfer will be done manually through the file manager on a computer.
For named brands probably Sony is your best bet:
click here ➜ Sony Nw-A306 - Amazon.com
Anything else, is going to be just a random Chinese made Android device from an unknown brand.
click here ➜ Android Music Player - Amazon.com