Here is half the problem with that mentality.
When you become "used" to something, the nerve receptors in your nose and brain become burned out on a particular smell and it take way much more to make that noticable odor pungent again.
For intstance, a car painter who wears a respirator most of the time may still get to smell paint or hardener chemicals in the shop all day. Eventually he will become so used to the smell of it that its not noticeable at all for the most part.
Then a customer walks back and starts getting high on all the fumes.
Follow my drift?
If you live around people that never smell it and it is pungent, someone will smell it.
Spend the money on a carbon filter setup and some fans in a grow box and call it a day.
It would leave me a piece of mind in your position.
I dont smoke weed and consequently I can smell it a mile away.