Author: Marshall Schott
There are things known and there are things unknown, and in between are the doors of perception.
~ Aldous Huxley ~
Perception is a fascinating subject to me, something I spent years studying and pondering in musty university libraries. I recall times sitting in the skybridge at Western Washington University, creepily gazing down upon passing students doing their own things, wondering how they were perceiving things in that precise moment. As someone obsessed with the human condition, I came to my own private conclusion that perception is… everything. Our beliefs, habits, moods, understanding of self and others, everything is driven by how we perceive our world. I also came to understand, at least through the subjective filters of my own mind, that us confusingly complicated humans have yet to evolve into creatures with perfect perception. So, what does this have to do with beer and brewing?
Since I began conducting these exBEERiments, I’ve always wondered the extent to which a taster’s expectation of difference impacts their perception of the beers. I use a triangle test for data collection, which is a type of discrimination testing used for sensory evaluation that involves a taster receiving 3 portions of beer with 1 being different than the others, then they’re asked to identify the different one. The actual difference between the samples is limited to a single variable, so the perceptible difference can be pretty subtle. Statistically speaking, it’s assumed 1/3 of tasters would randomly guess the correct beer, thus findings aren’t interpreted as significant unless a good portion of tasters correctly choose the different beer (about 66% for our purposes). Interestingly, the majority of exBEERiment results have not yielded significant results, suggesting the variables I’ve tested don’t seem to have a huge impact. Many readers of these results have expressed interest in another type of test, one containing a slight element of deception, an exBEERiment I’ve been curious to perform for awhile.
| PURPOSE |
To evaluate the impact one’s expectation of difference has on their perception of actual differences between 3 beers… that are exactly the same.
| METHOD |
For extensive brew day notes, refer to the recent Mexico vs. Germany post comparing WLP940 to WLP830, as I used the former alone for the present exBEERiment. Each taster, all blind to the nature of the exBEERiment, was provided 3 samples in a private setting with limited distractions. The beers were poured first then the taster was asked to enter the tasting area. I used colors to identify each sample, they corresponded to the 3 selections in the survey used to collect data.
Maybe you noticed one of the options, the only accurate one in this case, is No detectable differences. This is the option we would expect tasters to select given the fact all 3 beers were exactly the same, filled from the same exact keg. Let’s not forget, though, that every taster was cognitively primed to expect one of the beers to be different.
| RESULTS |
Of the 10 people who participated in this exBEERiment, only 1 perceived no detectable difference between the beers. For what it’s worth, this single “correct” person is the only participant who isn’t a craft beer nerd and/or homebrewer, he’s my humble Coors Light drinking neighbor. Make of that what you will.
I’d caution anyone against being too presumptuous after reading these results, chances are you would have been wrong, too. The participants in this exBEERiment included award winning homebrewers, Cicerone certified beer servers, and a professional brewer. Leave it to the naive to jump to the simplest conclusion. The results of this exBEERiment appear to support the notion that one’s perception is influenced by their expectations, covert as it may be. As much as we like to think we’re in full control of our faculties, this simply does not appear to be the case. I experienced mixed emotions when sharing the nature of this exBEERiment with participants, a sort of sadistic shame, particularly when they were so convinced the beer they selected was different. The shit we stir for science.
More than anything, these findings support something we all know, that perception is not perfect and that despite all of our palate training efforts, we can still fall victim to our feeble minds. Does this mean sensory evaluation is a poor way to measure differences? Absolutely not! This is why we have measures of statistical significance. If 7+ of 10 tasters (p<0.05), for example, accurately select the different beer, we can trust the tasters selections were less than chance and be confident there was an actual difference.
This was a fun exBEERiment for me. Thanks to all the killer brewers and tasters who participated, please don’t hold it against me…
UPDATE: For those who get off on this type of stuff, I highly recommend you pick up Denny Conn’s and Drew Beechum’s newest book, Experimental Homebrewing, which has a section dedicated to tasting objectivity.
Support Brülosophy In Style!
All designs are available in various colors and sizes on Amazon!
Follow Brülosophy on:
FACEBOOK | TWITTER | INSTAGRAM
| Read More |
18 Ideas to Help Simplify Your Brew Day
7 Considerations for Making Better Homebrew
List of completed exBEERiments
How-to: Harvest yeast from starters
How-to: Make a lager in less than a month
| Good Deals |
Brand New 5 gallon ball lock kegs discounted to $75 at Adventures in Homebrewing
ThermoWorks Super-Fast Pocket Thermometer On Sale for $19 – $10 discount
Sale and Clearance Items at MoreBeer.com
If you enjoy this stuff and feel compelled to support Brulosophy.com, please check out the Support Us page for details on how you can very easily do so. Thanks!
14 thoughts on “exBEERiment | The Impact of Expectation on Perception”
Was there a certain amount of schadenfreude in this one? Perhaps next time you can do a “triangle test” where in fact none of the three beers are the same as another.
Just a little…
Did you have them describe the differences, or just stop after they said that there were some?
We chatted afterwards, but I had them stop after the triangle test, perhaps out of fear of losing friends.
Very interesting. I definitely have experiences to support that theory as well. Perception is very subjective for sure and there dozens of factors that can affect it at any given instant. Great exBEERiment thanks for sharing.
I read about a test performed on sommeliers testing the exact same thing, except they took two glasses, poured the same white wine in each, and added red dye to one glass. Each somm described the “red” using descriptors typical of red wines. The point of this study was that visual perception has an enormous effect on our perception of taste.
This is discussed in Experimental Homebrewing, fascinating study!
Any plans for a Hot side aeration test?
Uh huh 😉
This is probably my favorite subject of discussion when talking about wine and beer. But to take the findings of this exBEERiment even further, we are forced to ask the question, why are we so sure of ourselves?
I think it was Daniel Kahneman who wrote about why experts are much more likely to be confident in the wrong answer than someone with very little experience. One example is how most Harvard students got a simple math question wrong. (http://www.businessinsider.com/question-that-harvard-students-get-wrong-2012-12)
The explanation: “Many people are overconfident, prone to place too much faith in their intuitions. They apparently find cognitive effort at least mildly unpleasant and avoid it as much as possible.”
That could very well explain why your Coors Light drinking neighbor was the only one who got it right. Humility and a lack of expectation go a long way when it comes to finding the truth.
This is freakin funny exbeerement !
Data? I’m curious (for no reason really) what the distribution of choices was for the wrong answers. Was it equally spread among the three choices? Did everyone pick the red cup? Could be other psychology at play here.
Yeah, pretty even distribution, it’s not like one of the colors got significantly more than the others.
Marshall, great episode. Can’t wait to follow up with the next episode. Though you have me wondering… do you think that your friends have a new bias in their responses because you have repeatedly duped them in previous tastings 🙂