Why do riders usually mount from the nearside of a horse?

In olden days men used to wear scabbards for their swords on their left hip so they could draw the sword quickly with their right hand. If they got on from the other side of the horse the sword would have been in the way!