You could have an underlying anxiety issue, though panic attacks are a pretty common side-effect, especially if you are new to smoking and take a high dosage.
The good news is, you're fine. Cannabis has yet to kill anyone, and there really isn't a dose so high that you could... worst case...