+1 for AC Infinity. I just put a 6" model of theirs in my stealth grow closet. They have a cheaper version without the temp/humidity controller - which you may not even need since you know you'll always want negative pressure in order to exhaust your grow's aroma.
As others are saying, consider a carbon filter. Most of what I have read suggests they work better if you pull through them. (So exhaust is downstream of filter and pulling air through it; as opposed to pushing air out the filter on the other side) The filter will tax your fan a bit, so you want to oversize -- but you don't want so much exhaust power that the air can't sit in the filter long enough. There's a really good post about this on here somewhere, but I can't seem to find it just now. I'll come back with the link if I come across it again.
Edit: This isn't the post I was thinking of, but the info is very similar and helpful for determining CFM requirements. It's a pretty straightforward formula.
So if you scrub the air inside the room, what would the general rule of thumb be? Ex if I have a 6” fan pulling 400cfm out of the room with a CF.. what size filter/fan combo would be needed inside the room to prescrub as secondary measure? Would a 4 inch work?
rollitup.org
Good luck!