They stay away. Totally. It's amazing stuff.
Spray it where they are walking around, and spray it around your door as a barrier. They will be gone by tomorrow morning.
Just to clarify. It's in an aerosol tin and its called B&Q Ant and Woodlice killer. It's about £1.90.
(It comes in a powder as well, but I think the spray is better).