If a rocket is stable going forward, because its center of mass is ahead of its center of pressure, then it will continue on a curved trajectory even if it is accelerating. Fins will move the center of pressure to the back as will a large rocket nozzle.

If the rocket is launched at a high altitude, preferably at least twenty kilometers, its nozzle can be huge because the exhaust gases can expand to a very low pressure. This huge nozzle, besides moving the center of pressure back, can also serve as drag on the rocket especially at sea level atmospheric pressure, slowing the rocket to an empty falling speed of 42 m / s, which whould be a survivable water impact if the craft is designed for it. This way a simple reusable unguided rocket can be made which only needs a thrust control. The rocket will not have an optimal trajectory for reaching orbit; but, it's trajectory is good enough to serve as a first stage booster.

To reach a high altitude a balloon, high flying aircraft or supersonic aircraft can be used. If a balloon is used, the rocket should hang off center and the balloon should have a low drag lifting shape, so that it can rise to the side, ideally at a thirty degree angle from the vertical.

Because the gases are expanding to a low pressure, they can start out at a medium pressure in the combustion chamber and still get a good expansion ratio. Medium pressure can be reached by simply pressurizing the fuel tanks, no turbopumps are needed. For a first stage booster, a low specific impulse is acceptable, so kerosene / hydrogen peroxide with an exhaust velocity of 2,265 m / s or LOX / methane / water with an exhaust velocity of 2,326 m / s can be used. With LOX / methane, payload can be brought to orbit for about 400 USD / kg.

A large nozzle with vanes can be used on reentry to control the attitude of the spaceship and it can be used to slow the landing by autorotation. The vanes that turn the ship by giving the rocket exhaust a rotation can also function as crude helicopter blades on landing slowing the descent of the ship a bit. They won't be as good as dedicated helicopter blades; but, a landing with them would be survivable. For a gentle landing, retrorockets would be used just prior to contact; if the retrorockets fail, you'll still have a hard; but, survivable landing. This would be used for the last stages of the ship, those that need guidance anyways to achieve a specific orbit, the dumb booster simply falls into the ocean and has a higher landing speed if the retrorockets fail.

Another way is to have a rocket with a finned body design whose center of mass is ahead of the center of pressure when fueled and behind the center of pressure when empty. It could land engine down and so might be better for passenger travel; but, would be trickier to fly, less reliable and overall not worth it.
 
  Invention   Rocket   Spacecraft