Guangfu is a small town, so you can walk to most places from anywhere in about 20-30 minutes. However, if you're staying, check with your bed and breakfast host to see how they can help you. They may be willing to pick you up at the train station, help orient you by map, and lend you bikes to do your own exploring.
On foot
If you have a map it is possible to walk to most places in Guangfu, as long as you have some time and patience. A good tourist map exists, so check at a tourist information center in Hualien for maps with GuangFu town and its main sites on it. If you are staying at a bed and breakfast your host will most likely supply you with a map.
By Scooter
Scooter rental may be available, but you will probably need someone to arrange if for you your bed and breakfast should be willing to help.
By bike
Biking is probably one of the best way to see Guangfu's main sites. Check with your bed and breakfast to see if they will provide a bike for you.