That does look like a seed, but that doesn't necessarily mean hermie. If it's the only one, or if just a few, I wouldn't worry about it. Female plants sometimes make a couple of seeds.
I think that at this stage of growth it's OK unless you start finding seeds in the bud. As big as that seed is...