No, they do not. You have to create all of these controls on your own.
They do however offer several frameworks that are useful when it comes to making music playing applications. Once you create your own buttons, you can hook them up to the music API of your choice.
If you're looking to control the device's built in iPod, you'll want the Media Player Framework, but if you're looking to create something more your own, you probably want AVFoudation.