Re: I don't think so
TomD
"How often are the tools not from their advertisers?"
It can certainly happen, but the reality is people want to be marketed to. The tone around here amps up quite a bit when there is a new toy on offer. People like consumerism. It makes sense to review tools that support long term advertisers, and also from manufacturers and suppliers that can handle the demand an article may generate. They may sprinkle in a few cool tools but people will pressumably gravitate to the better represented products.
"That itself was a lack of diligence in work, I think, to not try to find out what japanese chisels were actually good. I would imagine if they called JWW, they would've gotten the matsumuras, and maybe that's what they did."
What little business dealings I have had with FWW were very satisfactory, among the best long term out there. In some magazine segments it is all about selling products through placement. They won't mention the sky unless god gives them a kickback. Often non-core products, like cars, airline, etc... are all pre-contacted, and sold before a word hits the paper. I think FWW has made statements about their tests saying they are impartial, and that is good enough for me. But there are lots of ways to skew tests. One is to get a complete tyro to write the copy. "I have never owned any quality chisels before, and I was really looking forward to the chance to put down the router and try my hand at sharpening..." So you give the writer a few samples from known advertisers, and turn him loose. You can rely on his not getting too off base, and maybe he will call the supplier for a few tips and quotes. This also works with the average tyro reader, who doesn't like being talked down to. I have read a few of those.
"Presumably JWW advertises in FWW? But maybe they don't.
Does Hida?"
Yup. For a long, long time. Which is a good thing, people know they will be there, and that they are supporting the segment. Given the stability in prices they are a virtual market maker.
"That said, if the person doing the article tests went to any japanese tool forum online and said "what's a good moderately priced japanese chisel" when that article was written, the tone of the responses would've led the reviewer to imai chisels at the time and not matsumura."
That isn't necesarilly all that representative either. JWW has been at it for over 30 years. People on forums come and go, and tend to be all abuzz about the lattest and greatest. I remember the great Shaptons bubble. They don't get the returns, etc... Anyway, a wise editor won't ask a question he doesn't already know the answer to...
"A lot of the rest of the tests seem aimed at pushing their high volume products, like sanders and 14 inch bandsaws. Maybe that's their duty to talk about that stuff since it will attract new subscribers, but it sure wasn't stimulating to someone who has no interest in a 14 inch bandsaw or more sanders."
Interesting metric is to know how long the average reader sticks with a publication. The early FWW was a potential lifetime subscription. Today I would be surprised if it's longer than 3 years. The money is in turning people and selling them all the stuff they need when they start up, then moving on to the next person. Bride mag is a good example of that. The best long term mag I have personally been exposed to is Wooden Boat. It has stayed relevant to it's readers for decades, but that is rare. Most of the esoteric stuff will not pay the bills, and exists to build the magazine's profile so that the people buying the bandsaws will have high confidence that FWW s actually reliable.