From: "Brassha'per" Date: Fri, 23 Apr 1999 08:35:45 -0500 Subject: BHF Material Test: Middle Same Means Double Trouble?
I want to think about the Materials Test for a moment.. the *test*, not the harps, clamp, or results.
The way it worked was as follows, where H1, H2, H3 are 3 harp "trials".
H1 was played H2 was played
The listeners chose, always, Same or Different. In this case H1 = H2?
H3 was played.
The listeners chose Same or Different. i.e. H2 = H3?
H2 is in the middle, and participates in 2 different answers.
I'm afraid that single errors may propagate.
Let's look at an arbitrary set of 5 actually played combs A and B: 1 2 3 4 5 A B A A B , so correct answers are 0 0 1 0
then suppose what I heard or guessed was A B B A B , so test answers are 0 1 0 0
In this example, I would have heard only #3 wrong, but I would have gotten 2 wrong answers.
You say, that's because you're trying to identify comb material as A or B instead of Same or Different, but I don't think so. As soon as I say Same for the 2-3 trial, then if I correctly hear the next one as different from what I wrongly thought was the same.. 2 wrong answers from one wrong hearing.
As has been mentioned in a couple of posts, some hearings I was more sure of than others. One test style could be, as Lynda suggested, on a scale of Not Sure to Certain.
And as Vern suggested--I'm never satisfied. As in the first test, with 4 materials at a time, I certainly did not think it was fair to make me pick the material, in the most recent test I *did* want to pick the material, since there were only 2, and guess which one what I heard came closer to, rather than same or different! There's no pleasing me... but in this style test, the intermediate used-twice style seemed to compound my errors and uncertainties.
Same old objection, or a different one? ARGH don't make me pick!