If doing a "bare bones" simple setup, you'll need a tank, a regulator, some CO2 tubing (just like aquarium tubing but with really little holes), and a timer.
That's it; should run you <$300 all-in, especially if you use Craigslist to your advantage (I got three 20# tanks for $125 from there).