Hiya M8,
They make mufflers/isilencers for inline fans( e-bay/amazon) that help alot. You can quiet it down abit more by encasing the fan in an enclosure made from various materials from the blue ridgid styrofoam used in construction to using an old ice chest or even multilple layers of cardboard. Forgot to add, My friend uses 12" duct and reduces it down to 8" at the fan, and that cuts almost all of the suction noise that the ductwork makes. I am going to try that on the next grow, but I will use 8" and reduce down to 4 for my little space.
Hope this helps
Peace and Quiet Grows
Asmallvoice