Meta: How I Review Beer
Today, I wanted to take a step back to lay out the mentality of beer (or any) reviews in general.
I’ve been reviewing beer since 2008. There’s certainly no correct or best way to review beer, but I think there is a smart way. Reviews of anything, be it restaurants, hotels, AirBnB, or doctors; need to strike a balance between usefulness to the potential consumer and usefulness to the business you are reviewing. That usually means that diagnostic and detailed reviews are more useful than emotional reviews or those that rely on insider information. In addition to reviewing over 10,000 beers in the past decade, I’ve reviewed nearly 2,000 businesses including 300 breweries and brewpubs and 180 craft beer bars. What I find is that critical reviews are almost always the ones that people care about. If you start praising a restaurant, then the rest of the review is just gravy. If it is critical, though, both consumers and businesses will perk up and scrutinize every detail of the review. These reviews should focus not on how bad something is, but why it is unsatisfactory and how it can be fixed. There is a tendency for businesses to respond to these critical reviews, which I normally encourage. Indeed, I can expect a personal note from nearly every business owner after posting a critical review. Some of them are appreciative and want to make improvements for the next interaction. Others will lash out.
A well-written, thoughtful critical review should not be considered a slap in the face, however. It should be seen as free quality control. It is my hope that feedback, both positive and negative, may prove useful in the future. In 2010, I posted a review about a very poor tasting beer that I tried on tap in Philly. I posted the review along with where I found the beer. The brewery saw the review and visited the bar in question. They discovered that their distributor had been sitting on their kegs for several months in hot storage and then sold them to bars in the area well after the kegs’ best before dates. This was a very small, brand new brewery that did not have a lot of control over distribution. The brewery team was immensely thankful and invited me over for beers with them.
I’m sure some of my past reviews have been harsher than necessary, and I have made every effort to improve my methodology to be as diplomatic as possible. My concern is that there comes a level of sugar-coating and beating around the bush that transforms the review into something disingenuous. Indeed, some comments on my reviews have called me out for not flat out saying that a beer is bad. That is my never-ending struggle with the critical review: how to balance the feelings of the business with the curious mind of a potential buyer. I have two audiences with completely different information and completely different goals. The producer knows everything about the beer. The customer may know next to nothing. The producer wants everyone to buy their product, and bad reviews hinder that. The consumer wants to buy the best product for their money, and bad reviews help guide their purchases. However, producers need to see bad reviews not as sabotage to their sales, but as candid feedback on their product quality. Indeed, some of the best businesses are extremely active on social media and send out email surveys incessantly to garner feedback from their clients. Consider the alternative, which is where sales decline for seemingly no reason at all, simply because product quality was poor, but the producer was unaware of just how poor it was. Managers may not know that employees are cutting corners, brewery owners may not know that a new brewer or brewery equipment has altered beer quality. Indeed, I have tried beers time after time that should have been sent down the drain, but someone decided to sell the beer to naïve customers anyway so as to not lose money. Critical reviews may start with “Buyer Beware,” but they could just as easily start with “Proprietors Beware.”
With today’s landscape, instant feedback is a boon to producers. Though what you hear about most of the time is producers complaining about online reviews, the truth is that without online reviews, some businesses would cease to exist. Anyone who has used Yelp to find a Mondays-only taco truck in the middle of a parking lot knows what I mean. More specifically to this craft beer audience, breweries like Hill Farmstead and Tree House would not have lines of pilgrims out the door in the middle of rural nowhere without their quickly-earned reputation on BeerAdvocate and RateBeer. In a perfect world, online reviews should make good businesses more money and bad businesses less money. Because they can be so important, we must write with deep respect for the business and its reputation. But we must also write with honesty – respecting the intelligence of the reader. And on the flip side, readers should respect these opinions, especially when they don’t align their our own. Disagreement is a wonderful thing, but discrediting and undermining are not.
A common but dangerous response I hear from producers is, “I don’t care about critical feedback because our sales are fine.” This is a major business mistake. Sales may continue to increase in the short-term, but it is possible that consumers are one-time patrons only. They check out a new product or business, are not impressed, and then never return. It’s also possible that current sales are merely the product of filling a void in a local market where consumers have few options for comparison. Sales may increase up to a point and then either plateau, or worse, sink once a competitor moves in. Indeed, a business may be wearing rose-colored glasses thanks to a dedicated group of local patrons. Once the business tries to expand, they may find that their product is not competitive.
On the more technical side, there is no beating around the bush that I have affinities for certain beer styles and characteristics. I thought it would be helpful to our readers if I spelled out my personal preferences so that you can control for my palate when you read my reviews. In addition, my opinion of a beer is merely just one person’s point of view and should not be taken as a definitive assessment of a beer’s quality. If you, the reader, generally match up in palate with my own, then my reviews will be increasingly relevant to you. However, it cannot be overstated that beer quality, especially from small breweries, can be incredibly inconsistent from batch to batch. Couple that with different modes of transportation during distribution, storage temperatures, age since packaging, and then ultimately variables at the home or bar such as beer serving temperature, glassware, food pairings, and palate fatigue…the end result is that we all can have wildly different impressions of the same beer.
I ask you to keep this all in the back of your mind when reading my reviews. Below I’ve listed out some preferred beer styles. Keep in mind I sample all sorts of beer styles and don’t necessarily dislike styles not on this list. I’ve also listed out a group of my favorite commercially available beers. I could not possibly fit everything, so I have given just a sampling of beers that come to mind to paint a picture for you of what I have enjoyed in the past. With that, I thank you for making it this far in the post and wish you the very best. Happy beer hunting!
Favorite Styles: bright IPAs and APAs, Berliner Weisse, Black IPA, dry-hopped blonde sours, Flemish Red, Gose, Grisette, Kölsch, Lambic and its variants like Geuze and Kriek, Oud Bruin, Pilsner and pilsner-style variants such as Kellerbier and Zwickelbier, Rauchbier, Saison and other farmhouse-style variants like Grisette and Table Beer.
Favorite Commercial Beers: Aecht Schlenkerla rauchbiers, AleSmith Speedway Stout, Allagash Hoppy Table Beer, Beachwood Amalgamator, Bell’s Oarsman, Bell’s Expedition Stout, Birrificio Italiano Tipopils, Cantillon Iris, De Dolle Oerbier Reserva, De la Senne Taras Boulba, Deschutes Pacific Wonderland Lager, Dogfish Head SeaQuench Ale, Firestone Walker Pivo Pils, Girardin Gueuze Black Label, Heater Allen Pils, Hill Farmstead Legitimacy, Jolly Pumpkin Bam Bière, Jolly Pumpkin La Roja, Maine Beer Peeper Ale, Modern Times Black House, Modern Times Booming Rollers, New Glarus Apple Ale, Pizza Port Swami’s IPA, Port Brewing Santa’s Little Helper, Russian River Consecration, Sierra Nevada Celebration, Southampton Imperial Russian Stout, Stone Tangerine Express, Stone Sublimely Self-Righteous Black IPA, Struise Earthmonk, The Alchemist Focal Banger, Tree House Sap, Trillium Melcher Street IPA, Victory Prima Pils, Victory Storm King.