Home Articles Forums Gallery Marketplace Videos

WoodCentral Forums

Knowledge You Can Build On — Est. 1998

Lee Valley PMV11 chisel hardness

Posts

Lee Valley PMV11 chisel hardness

#1

Lee Valley PMV11 chisel hardness

Bill Tindall, E.Tn.

David sent me the Streeper table of data. There is much about it that is suspect which would lead one to conclude the data set is unreliable for comparison purposes. In the specific case of the LV chisel the reported value is well below the LV specification. Weaver speculated that LV may have lowered their specification to make it easier to sharpen.

I asked the technical staff of LV whether the specification for PMV11 was lowered. The reply was that PMV11 hardness specification remains the published value and significantly higher than the Streeper result (more on that later). LV heat treating is monitored for quality. Every heat treat batch is measured and must meet the published standard.

The LVV11 steel was chosen because its composition enables it to be taken to high hardness while preserving toughness, both critical attributes for a chisel. It would have been silly for LV to target a lower hardness than this steel was designed to achieve.

The Streeper data is flawed because the calibration procedure and data analysis procedure used is flawed and will lead to high variance of the results obtained with different instrument calibrations (day to day) that will not show up in repeats done with the same calibration at one time. Furthermore, an expert in the machine he used stated that it is not a precise measurement, good to about +/- 2 Rc units. Streeper reports results to 2 decimal places! This fact in itself demonstrates the person dong the word lacks the experience to do it.

Reliable conclusions can not be made from the Streeper data.

It is a good bet that every company monitors the hardness of their chisels. If you want a reliable answer just call their tech service staff and ask.

Re: Lee Valley PMV11 chisel hardness

#2

Re: Survey information and what you can surmise

david weaver

There is more than one chart from Rob's data experiments, but I recall one of the early charts showing a rounded figure of 60 for V11. The published range for V11 having looked yesterday is 61-63, and anyone who deals in likelihoods would say the following things are possible:

* the chisel that rob tested was 61 hardness or more and rob's reading was approximately 60 or 59.x, whatever it was (this seems the most likely)

* the chisel that rob tested was approximately 60 hardness despite most chisels being harder, and rob's measurement was accurate (this seems less likely, thus we'd love to have more than one person do this type of experiment to see what the data says - in the event that a spec is 61-63, if something ever does slip out from someone like a LV or LN, it wouldn't be the norm)

* that LV's found the bottom end of the spec to make a more workable chisel and some of the tools are regularly outside of it without changing the published spec. (what we know of LV makes this near zero chance)

Those are just my opinions.

When someone takes on a project like this on their own accord and publishes data, there isn't really an expectation of resolution vs. accuracy being lab standards (that is, you're suggesting that the display of two decimal places implies that level of accuracy - that's fine in peer reviewed work, but even in that case, standards are often blown). I think a reasonable individual would look at a data set like this and compare it to experience and ask how big the error could be. i doubt most of the public is familiar with the issue of resolution vs. precision in presenting data, even if they understand generally what c-scale hardness numbers represent.

That leaves us with two options - discuss data provided on forums not at all unless it's peer reviewed, or discuss them as they are and see if we can glean anything from them. I'd prefer the latter as long as absolute assertions aren't made (as in, you cannot just look at this data set and say "well, LV's chisels are softer than their spec" based on one test, and you can't say "look, blue spruce makes 65 hardness butt chisels").

Even better than either of these (no information or errant information) would be additional efforts that are more precise and controlled (and with a larger sample of examples). Once in a while, someone comes along and tests things for no obvious reasons, but it's rare.

Re: Lee Valley PMV11 chisel hardness

#4

Re: assumption of objective...

David Weaver

A guy uses a portable tester and ends up 1 point outside of the manufacturer's range.

I just don't see that as challenging manufacturer's specifications.

The woodcraft chisel fared far less well, but there have been cases of feedback on their branded chisels (especially the timber framing type) matching that.

From a brief browse of parts that occurred before i started reading the thread originally, it looks like Rob was testing more than one chisel in each set, and one of the narex chisels tested very low. That could be an error or (I know you don't believe it, but) maybe there was actually a manufacturing issue on a chisel or a donated chisel that had been overheated. I don't know.

But I recall the sentiment that rob was gathering information for his own use more than attempting to out someone.

Re: Lee Valley PMV11 chisel hardness

#5

One thing to remember...

John in NM

I don't put too much stock in an amateur being off by 1 vs a manufacturer's numbers. The amateur tested 1-2 points on 1-2 chisels. The manufacturer *probably* used a statistically valid series of 100-300 samples and is reporting a mean value.

There could also be a great deal of variation just due to testing setups, calibration methods, judgement calls (significant in more complex tests), and just operator errors. But usually the biggest reason these are apples to oranges comparisons comes down to statistics. It would be interesting to hear what range the first three standard deviations cover in LV's testing. I bet that 1 RC point is in the first or second.

Re: Lee Valley PMV11 chisel hardness

#6

Re: One thing to remember...

Joe Shelton

Empirically, 99.7% will be within 3 SD of the mean.

I think your guess about 1 RC is safe.

Finally, I've never seen any instance, prior to this tabular extract, of a report showing a mean value of std dev, and I think it is not a meaningful statistic.

Re: Lee Valley PMV11 chisel hardness

#7

Relying on ancient statistical memory

Wiley Horne

The way I learned it (I think :) )is that if you’re sampling from the same population—like ‘how many Ford 150’s were sold each day in the US’—and the Groups are months, say—and you assume normal distribution—then you could calculate a variance for each month (and its square root is the std. dev. for that month). And if you sum the variances of all the months and take that square root, you have the std. dev. for the whole year. You couldn’t just average the std. deviations across Groups (months in this case)—which I think is your point.

In the present case of the chisels, I never saw what the groups are, or how many observations are being made, so who knows what it means.

Wiley...wondering if he recalls it correctly

Re: Lee Valley PMV11 chisel hardness

#8

Re: Relying on ancient statistical memory

Joe Shelton

Yes, that's my point.

Statisticians may be a rather dull crowd, but they do have their moments.

Sorry. Couldn't help it.

Re: Lee Valley PMV11 chisel hardness

#9

Right you are...

John in NM

The point I was clumsily trying to make is that if a person does an independent test or two, and gets a value that varies some vs. the manufacturer's test numbers, there exist one of two possible explanations. First, it could be that the individual who did the testing screwed it up to some degree or another. Second, the "discovered" variation could be normal and within the expected range of values given a large sample size.

My opinion is that too much is made of an independent test that is assumed to vary significantly (and negatively) from various manufacturer's specifications.

Re: Lee Valley PMV11 chisel hardness

#10

Re: Right you are...

David Weaver

Bill mentioned offline to me that the typical variation for this type of hand held tester is 2. I don't know if that's a standard deviation or if it's just an offhand explanation from someone with experience -either is fine with me.

LV (bill relayed here) tests each batch - that's good enough for me to mentally substitute a 62 for them.

In the unlikely event that they ever decided, like friodur, that staying at the low end of a range made for a better customer experience - still, it's Lee Valley, I'd assume they had good reason to - making what customers want. I sort of see the world in likelihoods.

I don't see anything in this chart that's likely to change peoples' behavior. Somehow we're stuck on the narex chisels because one mortise chisel tested low and the chart doesn't convey why the average is low (it appears to be due to one chisel - I'd like to have seen that result culled and noted, and take the average of the rest of the set).

Bill has noted the process that narex uses is tight and shouldn't create the result. I have to be honest, I don't really much care, because I don't like the result of the narex process - I think it's inexpensive, it creates a white box chisel that is good for people looking for a white box chisel, but the maximum potential of the process makes, in my mind, a substandard chisel (one that's not quite hard enough and the wire edge is left even more rubbery - this is from actual experience, and the boast of flatness - first, I didn't see it, and second that's not a critical factor for me). I didn't notice the narex mortise chisels, the 57 1/2 measurement stuck out in my mind (which is also in the error range for narex spec).

What I am not going to do is take something I thought was interesting and turn it into a court case. It's getting ridiculous. Or, take the company line for each manufacturer and forgo all discussion. (John, that's not aimed at you!!)

Re: Lee Valley PMV11 chisel hardness

#11

Speaking of white box chisels...

John in NM

I was fixing a really cheaply installed strike plate in an aluminum clad french door over the weekend - swearing incessantly at the slap dash way stuff is installed these days. The strike plate sat on top of the door edge rather than flush, so I had to trim an aluminum lip in order to get it to sit flush like a mortised plate (door wouldn't close otherwise, and I refuse to install doors with 3/16" gaps!). So I used an already dull (but good quality) chisel to cut the aluminum ridge flush. Not something I would do with a fancy, high dollar chisel, and probably not something I would try with a blue handle Marples or any Stanley made after the 1960's, but my $6 Sandvik did a good job of it :D

Re: Lee Valley PMV11 chisel hardness

#12

Good job, John

Joe Shelton

I certainly appreciate your sensibility of the workman's responsibility.

Very often, the main factor is not the tool, it's the guy on the handle.

Re: Lee Valley PMV11 chisel hardness

#13

"House chisels "

David Weaver

Eons ago when hf carried chisels that are now the same as the aldi chisels, I bought a set to grind and try various things. They became the "house chisels". Same type of thing, any time you want to hack away at something or chisel off old adhesive that's got grout or plaster or something on it, out come the house chisels.

Despite what sellers says, they're probably not as good as your sandviks.

Re: Lee Valley PMV11 chisel hardness

#14

The Sandviks are nice chisels...

John in NM

They were cheap because they were from a store that carried a lot of liquidation from closed hardware stores and stuff like that. I would have probably used a Narex for the same task, but it had been sharpened fairly recently and I ended up needing it to whittle away some plastic in the same project. I doubt I would own a bench chisel that I couldn't turn to any task like this, the nature of what I need them for more or less requires a cheap yet good chisel.

I have an old carving chisel that is flat and I use as a parer. Honed at a very low angle it is a delight to use, but it is delicate. Just rounded some curly maple corners with that a couple weekends ago. The maple was some softer variety, and the bench chisels tended to compress the grain a little, leaving ugly pocks. The parer was just the ticket.

Re: Lee Valley PMV11 chisel hardness

#15

Why Aldi comes up...

Jim Matthews

The Aldi chisels are offered up as cheap, and available for starters.

There's a huge leap in cost between most chisels shaped objects and suitable makes.

Given that most of us will start off with a claw hammer and a stack of sandpaper, it makes some sense to recommend the lowest usable standard.

Re: Lee Valley PMV11 chisel hardness

#16

Re: Why Aldi comes up...

David Weaver

I don't have anything against them, but it's more of pauls comments sometimes where he says something like, "they hold an edge as well as anything else".

That's a little misleading, but they are functional and easy to sharpen.

If I was teaching someone locally, I'd recommend they get a set or two of them to grind into skews and dovetail chisels. You really can't lose doing that at their price. Plus, ....house chisels. Hf carried them only for a short period of time and the replacement set they have doesn't look nearly as good and is made up of mostly fat and wide chisels.

Re: Lee Valley PMV11 chisel hardness

#17

The trouble with Aldi...

John in NM

Or any other generic, cheap chisel, is that by the time someone tries them, finds out that they don't wholly suck, and blogs about it, the factory in China that did a run of them has moved on to something else.

We're left with a lot of talk about a perhaps marginal product that is now effectively unavailable.

I like the Narex line for inexpensive chisels. They may not be insanely cheap, but they are inexpensive and are not questionable in terms of QC, they are still available years after I remember Stephen Shepherd saying "hey, this is a decent cheap chisel", they sharpen easily, and they hold an edge vastly better than a lot of other "entry level" options I've seen over the years.

Why saddle a beginner with the conundrum of "is my super cheap, crappy chisel really a super cheap, kinda decent chisel?" My advice instead would be to buy an inexpensive decent chisel that has actual quality control in the manufacturing process and get on with some work.

Re: Lee Valley PMV11 chisel hardness

#18

Agree, for $13.50 you get

Wiley Horne

a quality serviceable chisel.

Focus: sharpening. If we’re mainly talking about people starting out, they will fall into two broad groups: Group 1 has some degree of over-the-shoulder mentoring on sharpening. They will quickly learn. Group 2 comprised of those on their own—they will have to pick it up from online clues. Problem: No one is born knowing what sharp is. Therefore, it is helpful to Group 2 people to have 1 chisel which arrives working sharp, as a definition of what the target is. Same argument on planes—good to have 1 which is known to be in serviceable shape from the outset.

Wiley

Re: Lee Valley PMV11 chisel hardness

#19

Despite my griping about narex

David Weaver

They're very good for the price. I bothered rob in his hardness testing to not consider just finding some wonder steel and stuffing it in a handle and declaring it superior because that's already out there and the $60 level with koyamaichi is really about where edge holding tops out.

When you start figuring put how you'd make a chisel, the industrial makers like narex and Ashley iles are selling retail what it will cost you to make.

Once you start getting a lot of exposure, you can get critical of some of the narex chisel properties, but that doesn't negate the fact that they're way more than fair for the cost.

In my opinion, even the expensive chisels are.