Because of the "more or less" part of your post. Oversimplifying things is nice for a quick explanation, but physics don't care about your simplified model once you get up there, gravity isn't completely uniform, random space stuff sends you slightly off your path, and your target move in a mostly (but not 100%) predictable way, around your planet.