I'm not sure of the entire process from the brief description, and I've never made a pepper grinder. The square stock is grabbed in a four jaw chuck and drilled from the tailstock end. Then?
I wouldn't expect the registration of a square blank in a 4 jaw chuck to be perfectly centered every time. And a cone can be angled into a round hole.