Get one of the seeds to check and light press between your fingers, if it cracks so it isnt ready yet.
If its hard enough you can harvest already. Letting dry is easier to remove as the seeds just falls out, but you can remove it manually.
Keep on a dry place to conservate.
~garam