Home Articles Forums Gallery Marketplace Videos

WoodCentral Forums

Knowledge You Can Build On — Est. 1998

Rare Exotic & Domestic Hardwoods, Milled In-House in Oregon. Browse Unique Stock.

Some thoughts on judging

Posts

Some thoughts on judging

#1

Ellis Walentine

Some thoughts on judging

Ellis Walentine

>I missed the chat regarding judging, but I'd like to toss two belated cents into the discussion. I have been involved in judging woodworking contests for over ten years, and I have played by all kinds of judging rules. I have come to the conclusion that technical judging systems are way more trouble than they're worth.

Ultimately, judging is a subjective activity, no matter how you weigh it down with criteria and categories and rules and arithmetic. When you impose all these "objective" mathematical criteria, what gets lost is "which piece is best?" In other words, the operation can be a complete success, but the patient dies.

I would propose a system of considering the merits of the pieces in *this* contest (whatever contest you are judging) relative to each other, not measured against some absolute scale. No two judges can interpret an absolute scale the same anyhow. Have two or three simple criteria -- we always use design, craftsmanship and degree of difficulty as ours -- that all the judges can compare the entries by.

Let each judge come to his own ordering of the winners and losers, and then have a confab about the results to make sure that all the judges are in final agreement, even if one (or more) judge(s) has to compromise. I call this "judging by acclamation," and I think it is the only way to assure that, by some unintentional trick of arithmetic, the prizes aren't awarded to entries that nobody thinks should have won.

Besides being more realistic, this method is much faster because it doesn't require judges to assign numerical values to multiple aspects of each piece, and there is no number-crunching to do when all these sheets are tallied. Instead, the judges walk around the room, doing a preliminary scan of all the pieces up for consideration and making note of which ones they like best. Then, as a committee, they discuss their personal selections, debating them if necessary until a consensus has been reached.

This dialogue is vital, because it is the best way for judges to edify each other and assure that everyone is equally informed. Often, I've found that a judge will miss something the first time around, or they will be unfamiliar with a technique or other aspect of a piece that might affect their vote. The combined experience of the committee as a whole assures that they're all on the same page.

It's to be expected that different judges will order the entries differently. It's up to the judging committee to decide which pieces should ultimately score higher, based on a frank discussion of the judging criteria. Usually, these criteria are easy to apply individually, making consensus more objective and easier to reach.

I've found that a lot of people are pretty impassioned about how they think contests should be judged, so let the chips fall where they may.

Cheers,

Ellis

Re: Some thoughts on judging

#2

Re: Some thoughts on judging

Jennifer@Indy.USA

>I'm with you on this one Ellis.

I don't do numbers :)

Jen

Re: Some thoughts on judging

#3

This is the kind of...

TDaniel

>input we were looking for. There are always those who will not accept a judge's decision and finding a "best-way" will never be a perfect way to judge. Thanks for your input Boss; it will be helpful to us. Of course, if you happen to be in the neighborhood around April 27.......:)

Re: Some thoughts on judging

#4

Ellis Walentine

Ya never know....

Ellis Walentine

>...when the bossmobile might be heading south. :-) I'll try to let you know in advance if it's going to happen. It would be a shame to miss the opportunity to hang out with all these faceless names for a couple days.

Ellis

Re: Some thoughts on judging

#5

Re: Some thoughts on judging

Carole Valentine

>Question...if degree of complexity is a factor, then a simple, classic but exquisitely executed and finished piece may just fall by the wayside if there are numerous carved, embellished, eccentrically turned or otherwise complex pieces in the group. How do you get around that? Categories? I have seen some pieces that I suspected the embellishment, be it carving, texturing or whatever, was used to cover up poor tool and finishing techniques.

Re: Some thoughts on judging

#6

Keith Tompkins

Re: Some thoughts on judging

Keith Tompkins

>HI Ellis, I agree....the judges usually KNOW what the best pieces are, just from experience. Then a matter of deciding which gets first, second, and so forth.

On thing I suggested at NWA showcase was a critique after the awards are given, maybe Sunday morning. It would be a wonderful learning experience.

Regarding CArole's concerns, I think a well done, simple form has a good chance against any piece...the key is how well the piece is executed.

Re: Some thoughts on judging

#7

Ellis Walentine

Judges discretion

Ellis Walentine

>The operant variable here is that presumably you've selected judges who know how to balance that "scope of work" criterion against the others. Again, it has to come down to subjective judgement and agreement.

Ellis

Re: Some thoughts on judging

#8

Ellis Walentine

Agreed on all counts

Ellis Walentine

>We did that critique thing right after the judging at the Woodworks shows a while back. It was very well received. At the NWA show, I used to run a panel discussion called "What Judges Look For" and it was always very well attended and appreciated.

Up and coming craftsmen need feedback to get a handle on where/how they can improve.

Ellis

Re: Some thoughts on judging

#9

Steven Antonucci

Ends justify the means

steve antonucci

>I think that the most important thing is the "end object" and not how you got there. Carole mentioned that embellishments might be used to cover poor technique, but I don't think that tool technique should be a consideration for judging an object. I know that my roughing cuts are purely meant to remove as much wood as I can as fast as I can, and I really don't care about anything but how fast I can do it. Better technique reduces the amount of sanding- but it doesn't improve the end product (assuming you spend the proper time finishing.)

When a piece is in hand, I tend to feel it before I look at it. Is the profile correct? Does it weigh what I expect it to or is it top heavy/bottom heavy? Does the "embellishment" fit with the piece?

In the end, the judges really shouldn't be able to discern how a piece was executed, nor should they care. It is the object they are judging, not the manufacturing process.

Steve