Why are orbits elliptical?

Answer 1

The inertia of the satellite makes it want to travel in a straight line, but if it does so, its velocity is no longer perfectly perpendicular to the pull of gravity, so gravity pulls it in; this will remove part of the velocity, but as the satellite is also falling inward, it gets a new component of velocity due to the acceleration of gravity. In a circular orbit, we know that the ground speed is constant, so these two effects must perfectly cancel one another out to leave the speed of the satellite unchanged.

More info at : http://curious.astro.cornell.edu/question.php?number=467