Banana, egg shells, coffee grounds, will NOT hurt your soil or your grow.
That can be verified on every single gardening/horticulture site or forum on the net.
They won't break down and have a beneficial effect on the soil for quite some time though.
Those that say different, have received...