could be two things...
John in NM
If the air is dry every insect within miles seems to be attracted to moisture. Since milk paint has the protein casein as a component, they might be attracted to the smell too. Or it could just be Murphy coming along at the perfect time to annoy you 
When buffing out milk paint with steel wool, it always smells like cold McDonald's fries to me... not hot ones, but cold. I remember reading that when they switched from lard to some kind of vegetable frying media, people didn't like the change in taste, so they spent a lot of money on making the fries taste like they're fried in lard. I have to wonder if casein is part of how they do that.