There is a regular shuttle bus network on the south coast which links the popular destinations of Padang Bai, Candidasa and Amed. Perama (http://peramatour.com) is always worth investigating.
Motorbikes are widely available for rental in the popular coastal towns and are great for nipping around from bay to bay.
Othwerwise you are best off renting a car and driving yourself.