This problem usually points to something involving either the front tires, front suspension or front brakes. The rear of the vehicle probably isn't a factor here. Why? Because, the front tires control the steering (thus "pulling") while the front brakes do most of the braking