When you're in the La Jolla "village" area near the Cove, the best way to get around is not to drive. This area is dense enough that you can easily walk, bike, or roller skate around the neighborhood. Plus, parking can get a little difficult to find, so once you get a spot you might not want to risk losing it.
For the areas of La Jolla outside the "village", such as around UCSD or Torrey Pines, a car will be the easiest way to get around due to the distances and hilly terrain of the surrounding area.