Just thought I would chime in as this sounds like an area I have a lot of experience in.
I agree with the above post, your drying technique is most likely to blame here and from what you describe I would bet mould is taking its hold on your harvest.
Does the taste get progressively worse...