back in my younger years I used to do the exact same thing in times of desperation I tho we would also add a small amount of herbs to it to
grind up the weed very fine
mix with the crystals left in the grinder
mix in all the pipe scrapings
and usually it gave us a nice high not near what wee would but hey when your hurting your hurting right