You can take them out of your grow area and clip off the bananas. After that just keep an eye out for more.
Or you can leave them on, let it flower and dont harvest until the seeds are mature. The plant that pollinates itself will produce "feminized" seeds, all females and herms only; no males.