Examining the Value of ‘Best’ Beer: BeerGraphs

HolyGrail-lager

Quantifying aspects of beer is easy. We have definitive numbers that tell us about alcohol content, color, flavor and more.

But the question at the core of my last post, analyzing the value of “best” beer, asks about the potential of determining context for rarity. Given that the highest rated beers typically share common traits of style, ABV and availability, is there a way for us to better define what a lack of obtainable bottles or cans means to beer enthusiasts applying numbers to quality?

At worst, it’s a fool’s errand, trying to get into the minds of beer raters. At best, it’s an unscientific process that may scratch at the surface of a full effort, although we do have a good idea of what rarity means when it comes to product sales:

“Scarcity has this effect of making people perceive products as more valuable simply for the fact that they’re scarce,” business psychologist Nir Eyal told NPR in 2014, when, naturally, the network was covering the hype of Pliny the Elder, the sister beer of Pliny the Younger.

To build on the analysis of what we might have learned from Beer Advocate’s top 250 beers, I thought it’d be worthwhile to also peek at what we might learn from BeerGraphs.

Why BeerGraphs? Because the site pulls data from Untappd, I felt it offered two things:

  1. A strong archive of historical rare beers. Untappd typically has listings for both a beer and annual releases for the same beer. For example, we can find Bourbon County Brand Stout, as well as Bourbon County Brand Stout 2016.
  2. An assumption of broader subsection of raters than other online sites.

You can read my breakdown of Beer Advocate’s top 250 beers in this post. Since BeerGraphs doesn’t have a designated “best of” list on the site, I pulled the top 25 beers from seven different ABV sections, providing 175 total beers in the collection. The list was selected from ratings based on standings on Nov. 12.

Style

image-6

The biggest thing to mention here is the 22 different beer styles that add up to the 47 total beers in the “Other” category. Nine different styles had one beer listed and four brands were included for barleywine, gose, radler and strong ale.

Otherwise, things look pretty normal. Because this selection of beers is broken up by ABV, many inclusions from 10.1 percent and up include imperial stout. Even still, IPA hangs right in there. New Glarus is almost exclusively responsible for fruit beer being included.

The Value of ABV

For each ABV section, I averaged the “Beers Above Replacement” of all beers. Per BeerGraphs, BAR is a proprietary statistic used to measure of a beer’s quality by indexing a beer to its style. You can read all about it here. To put numbers into context, here’s how to consider values in sporting terms:

BAR Range Descriptor
10+ Hall-of-Famer
8 to 10 MVP
6 to 8 All Star
4 to 6 Very Good
2 to 4 Above Average
0 to 2 Useful to Average
Below 0 Not Good

… and here are the results:

image-7

The beauty of using BeerGraphs for this data is the fact we can pull the top 25 of every range above. With this information, we can look at the 0 to 4 percent range and see that people simply don’t go crazy for low-ABV goses, radlers and fruited table beers.

No surprise: the highest-rated section, 6.1 to 8 percent, features 24 IPA/DIPAs out of 25 featuring expected names like Tree House, Trillium, Russian River and The Alchemist, among others. The lone holdout is Funky Buddha’s Last Snow Porter, made with “coconut, coffee and natural flavor” and is so popular it gets its own release party.

From there, I took the top-10 rated beers in every ABV section – the best of the best – and pulled the averaged Beers Above Replacement for each set. Now we have some differentiation:

image-8

Fittingly, everything gets a boost, but that jump in the IPA-heavy 6.1 to 8 percent range clearly shows its dominance thanks to this top-10 lineup:

The Alchemist Heady Topper
Three Floyds Zombie Dust
Russian River Pliny the Elder
Tree House Julius
Lawson’s Sip of Sunshine
The Alchemist Focal Banger
Lawson’s Double Sunshine
Alpine Nelson
Maine Beer Dinner
New England Fuzzy Baby Ducks

Along with being good beers, we could likely narrow that list down to just one or two (Nelson and Pliny) that could be had with some ease within a normal distribution footprint.

The Value of Style

Like with Beer Advocate, the stranglehold of imperial stout and IPA is emphasized when you compare style-to-style.

From the total 175, I used the averaged Beers Above Replacement for any style that had four or more beers, leaving me with 147 beers across eight styles. For the purposes of this example, I put IPA, DIPA and hopped-to-heaven pale ales in the same category, the same as I did with the Beer Advocate list.

image-10

This type of listing is somewhat expected when the IPA/DIPA/pale ale (63) and imperial stout (53) categories represent 79 percent of all the beers included in this data set.

I then “normalized” the list in the same fashion of Beer Advocate’s collection, taking the top-10 beers from both the IPA/DIPA/pale ale and imperial stout categories to even out the number of beers included in each grouping. The chart changes quite a bit afterward:

image-11

For reference, here are those top-10 best beers for the two edited categories, per Beers Above Replacement:

IPA/DIPA/Pale Ale Imperial Stout
The Alchemist Heady Topper Goose Island Bourbon County Brand Stout (2013)
Three Floyds Zombie Dust Goose Island Bourbon County Brand Coffee Stout (2013)
Russian River Pliny the Elder Goose Island Bourbon County Brand Stout (2012)
Russian River Pliny the Younger Goose Island Bourbon County Brand Coffee Stout 2014
Bell’s Hopslam Founders Canadian Breakfast Stout (2014)
Tree House Julius Goose Island Bourbon County Brand Stout
Toppling Goliath pseudo Sue Goose Island Bourbon County Brand Stout – Proprietors
Lawson’s Sip Of Sunshine Goose Island Rare Bourbon County Brand Stout
The Alchemist Focal Banger Founders Kentucky Breakfast Stout
New England Brewery Gandhi-Bot Goose Island Bourbon County Brand Coffee Stout

We saw many of the hop-forward beers in the previous list above, but I do find the collection of Bourbon County brands representing all imperial stouts interesting. This differs from Beer Advocate’s list, which includes breweries like Tree House (of course), Founders, Funky Buddha and more, which points toward the broader user base of Untappd and a further definition of “rare” in beer. These Goose Island beers are more readily available – but still hard to come by – and that shows up here.

Rare Gets a Number, Sort Of

Building off all of this, BeerGraphs’ collection presents a good pivot from Beer Advocate. Because we’re able to look at this data set in even lists of 25, it’s easy to compare the top and bottom of these selections.

The graph below shows the top-10 beers of each ABV range compared to numbers 11 to 20, with an assumption that lower-rated beers, based off Beers Above Replacement, will present lower scores and fewer rarities:

screen-shot-2016-11-27-at-7-05-37-am

The split in scores is certainly noticeable, and in my subjective “rarity rank” as well. Looking over the 20 beers included in each set, I found that an average of 1.7 beers in the top 10 could be purchased in a normal fashion within a brewery’s footprint (Bell’s Hopslam or Surly Abrasive Ale, for example). That number rose to 3.7 for 11 to 20, which included beers from Southern Tier, Stone Brewing, Troegs, Ballast Point and more.

For sake of further emphasizing the point, I pulled the top overall 175 beers listed by Beers Above Replacement. This time the sections were still separated into 25 beers each, but based solely on ranking, not ABV. From that list, I averaged the BAR for each portion of 25 and again subjectively tallied the number of beers I felt a consumer could buy with a normal amount of hassle:

Average BAR Beers Able to Find
1-25 13.6 4
26-50 11.45 5
51-75 10.5 5
76-100 10.08 5
101-125 9.71 9
126-150 9.44 10
151-175 9.2 7

From a rating point of view, great beers to be found no matter where you look, but a change nonetheless.

What Does It Mean?

While certainly unscientific, these findings, paired with those from Beer Advocate’s list, hopefully lend more credence to the previous research hinting at the value of rare beer and how it can impact perception. As always, quality matters, and any beer included on these lists checks that box, but the extra boost garnered from being a small batch or one-off beer appears to help.

In recent weeks, while speaking with beer industry people for several stories I’m working on for publication, I have heard multiple times some variation of “we want to do more one-offs.” On one hand, that’s beneficial for a brewer, who gets the opportunity to play or expand their repertoire. On the other, these kinds of comments seem to suggest the knowledge of what those kinds of releases do in terms of impact for a brewery or beer.

If variety and new experiences are going to hold important places for consumers – not just in beer, mind you – then the idea of rarity may be as much of a business tool as circumstance of production.

Related: Examining Beer Advocate Data

Bryan Roth
“Don’t drink to get drunk. Drink to enjoy life.” — Jack Kerouac

Advertisement

8 thoughts on “Examining the Value of ‘Best’ Beer: BeerGraphs

  1. First of all, what you are doing is awesome. These analysis posts are wonderfully interesting – I like what Eno is up to as well. Thanks for doing it.

    I think the current beer categories need to be reassessed. There are too many differences between beers that are considered the same style for something like BAR to be truly effective as a method to suggest a “replacement” beer to a person, given other beer they like.

    If someones says to you “I really enjoyed Event Horizon, what other BA stouts would I like?” you wouldn’t respond with “try Black Tuesday” – 12 points of abv should be enough to put them in different spaces. Or how about American Wild Ales… You’ve got stuff that tastes like an Orval clone, and then stuff that tastes like hydrochloric acid with lime a hint of lavender. It would be near impossible to suggest a replacement beer within this category through a raw rating data.

    Unfortunately, the fix is difficult. Beer Advocate + Rate Beer + BJCP + Cicerone + etc would need to get together. Seems unlikely.

    1. Perhaps we need an Avengers-like team of rating platforms…

      I very much agree with the wheelhouse of flavor, as that’s where so many drinkers stick to (within styles) or how they recommend beers to others. It’s so easy to breakdown styles into sub-styles that across-the-board analysis can be really hard.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this:
search previous next tag category expand menu location phone mail time cart zoom edit close