from the first few responses it doesnt sound necessary to insulate, however it doesn't exactly sound harmful to go ahead and do it anyhow.
Seeing how I will be venting directly outside (for summer, spring, fall), I will most likely do something light weight, just enough to dampen sound, and...