There are plenty of cheap places, but foreigners are often not allowed to stay there but are referred to the more expensive foreigner places.
Traffic Hotel
¥30 for a bed in a three bed dorm with shared toilets down the hall; ¥100-120 for a private double room with attached bathroom
At the main bus station
Takes foreigners.