This goes for any other noobies who may read this as well.
Next time you fill a pot with soil, cover over the drain holes with little pieces (about 2" or 3" square) of window screen materiel before you add the soil. This will also stop the medium from leaking out the bottom and making a mess. You can use almost anything for this, in the past I have even used old, cut up, T-Shirts.