Have they nested in the pot?
One way is to put the pot into a bigger bucket or whatever you can find and fill it with water so it covers your pot and drown them.
Could also try some surface spray around the pots.
There are also quite a few products for ant problems at your local nursery.