Just Kill'em
Mark Mandell - Gone Round In Jersey
Get some activated borax powder (roach killer). Using a rubber bulb or even an old glue bottle, about sundown when the bees have gone ni-nite, squirt the powder into each hole, then plug with a tapered wood plug [woodworking reference]. You'll hear the bee buzzing around in the hole for a while, but that's all the better to spread the borax through the whole nest.
To prevent the peckerwoods from tearing it apart anyway, give each nest a shot of the foam caulk and put the peg back in. The birds will tape on the boards to find hollow parts (where the bee's nest is). The foam filled section won't sound hollow and they'll leave it alone.