Re: Towards a model for writing tool reviews.
Doug Littlejohn
>I am a IT professional and an Ex EE (just so you know my background). One thing I never grow tired of is information. I find it rather easy to determine what information is of value and that that is more suspect mostly based on the presentation itself (how it is written, structured, worded, etc.) as well as the 'track' record of the presenter.
As such, I would agree that some basic and simple to follow ground rules would increase the value of the reviews that have been and will be presented. Not make them more belivable, but easier to equate to what it is that I want to do with the subject being reviewed (or can relate it to).
Some people always doubt and will cast stones, others will have open minds that are capable of assimulating information on their own.
I have many times read a review and did indeed think to myself that while it was not a fully scientific study (either in execution or in communcication of the findings, and the author usually stated so as well) but that did not invalidate the information, it just changed the perspective from which to consider it under.
I think the most basic rule to follow (and I have seen followed in virtually every review that I have read) is a disclosure of interest or motivation. This forms the basis for understanding under what condtions the study was done to start with and while it may change how I view information, it does in no way negate it.
In short, I have read nothing to date that has seemed any bit of a problem. All of the reviews I have read have stated their ties to the items being tested and the vendors have stated theirs.
I have seen nothing in any of their behaviors to suggest that any of them have tried to be dishonest or to have any ulterior motives.
Keep on with what you all have been doing, you will never please those who are naturally naysayers.
Sherwood