Warren in Lancaster, PA
I think Roman historian Pliny (79 AD) mentions Turkey stones. Maybe Isidore mentions them in the 7th century. So the trade was going on for quite some time. Actually Pliny talks about oil stones "in ancient times".
Botanist Thomas Nuttall explored Arkansas 1818-1820. I don't think there are any buildings in Akansas that predate this time. He brought back Arkansas stone samples to Philadelphia. The Academy of Natural Sciences has his herbarium specimens and they probably still have his stones also. From Nuttall's journal remarks I don't think there was a whetstone industry in Arkansas in 1819.
Here is a list of American stones from an 1890 article: