So I am guessing you are using basically worm castings?
It's not a bad thing but you will probably need more components. I am a soil grower and use worm castings as a supplement but not as a full grow medium. Take that soil you have, mix it with compost, perlite, and some standard potting soil like Scott's Moisture Advantage and you should be OK.