After the bait ball moved off, I decided not to chase them but to move on to other subjects. As soon as I did this, they came streaming back.