Are Product Reviews Full of Sh!t?

Words Dave Tolnai
Date Apr 12, 2016

I’ve started to become a little bit worried this month. There are a lot of questions rolling in. Many of them are great. Some of them are not. A few of you scare me. But it’s all made me a little bit worried about how I can possibly get this frame into the hands of the “right” person. So I’m not going to. Instead of giving the frame to whichever question I happen to answer last this month, we’re going to give every question answered a chance to win. So, Green Beret guy from last week, you’re still in the running for the frame.


Dear Uncle Dave,

I write this naked, lying prostrate and sauced up on good liquor. You see, I am one of those tragic single speeders who still believes the dream exists. Who chases it up trees in provincial backwaters at 3am. Who still stands on the pedals f#cking* hard because what else do we as humble men and women have to offer. We are finite, and unremarkable. Get after it. What else would you be doing?

*(Note – we have no problem with judicious use of profanity, but some articles are getting punished by the internet when words like f#ck and sh!t are present. So this is a f#cking experiment to see if the f#cking bots have an issue with hashtags and f#cking exclamation points. Back to the f#cking letter).

This f#cking industry. How have we collapsed inward to a state where product reviews aren’t worth the damn megabyte they consume? How is it that the media have ceased to serve the readership, and instead serve the advertising receivables? What happened to integrity?

I always imagined mountain biking as a counter-culture; a rebellion against what is accepted and what is the done thing. But increasingly I see our figureheads as a bunch of affable pussies, regurgitating marketing spiels and feeding the corporate line to the readership because “mate, we’re running a business here.”

Let’s call a spade a spade. Maybe it’s not tenable, maybe it’s bad business. But f#ck all that, I’d rather fail doing something honestly than limp along under false pretences. Get a backup plan. Quit the pandering. Grow a pair. Or do something else.

Either way, I probably still won’t read it, because I’ve checked out. But maybe some can still be saved. I wish you the best.

Apologies,
Tom


I’m not sure why, but this reader seems hell-bent on skirting our general policy of anonymity for question askers. They’ve used their real name and attached a photo for good measure. We’ll see if the editors decide to post the photo. If not, it’s a rather striking photograph of what appears to be a man in his underwear, wearing some sort of hipster approved hat, walking in a field with some kind of llama-type animal. His farmer’s tan is sublime. It’s not clear if he is drunk.

Ed: of course we’ll allow it. Here it is, in all its fedora-wearing-tipsy-hipster-feeding-a-llama glory. And, by the way, we like pictures. We’re not saying including a picture will improve your chances of winning a prize, but it can’t hurt. Look at Tom – he’s a bit nuts, but Uncle Dave is about to oblige him. You go, Tom.

We decided to use Tom’s image. Because it’s amazing.


Dear Tom:

I’ve only been on a couple of mountain bike-related junkets. I treated them like I treat anything else that I choose to write about. I asked questions, took in information and attempted to come up with something new and interesting to say about the whole thing. And I was surprised to see that not many of the other participants did the same. Some did, and were able to provide a novel point of view with fresh information that I didn’t pick up on. Many just regurgitated the information handed to them by the manufacturer and left it at that.

The first time this happened it confused me. Was I not flown across the country to add some sort of value to the operation? Was it really just a fancy show-and-tell that didn’t require any actual thought? The second time around I paid more attention and I started to understand what was going on a little bit better.

The problem, I think, is that some of these guys are pumping out an insane amount of content. They’re constantly on the road and they’re responsible for multiple posts every week (or day). Read through this article about a retiring Gizmodo Blogger responsible for 11,000+ blog posts and it starts to make sense. Quality and thoroughness are not always highest on the list of requirements.

So, with respect to the general state of mountain bike journalism these days I almost totally agree with what you are saying. There are too many press releases, too much acceptance of what manufacturers say as ‘the truth,’ and too many nearly identical stories showing up at exactly the same time.

With respect to product reviews, I don’t necessarily disagree with you, but I agree less. There are certainly many cases where, long term, a product is revealed to be a giant piece of shit, yet it was reviewed countless times and nothing was said. In some cases, there probably are some terrible shenanigans going on in the background. But the majority of the time I think the causes of this are relatively innocent. Lazy, maybe. But innocent.

As mentioned above, I think the primary villain is this insatiable demand for content. Readers want to read about the newest equipment right away and the result is that most reviews just don’t last long enough. You can learn a lot about a bike in a month, but you’re probably not going to discover any long term or durability issues. It is unfortunate, but people are far less interested in reading about a bike that was launched six months ago than the one that was launched last week.

As well, not all problems appear for all riders. Location, conditions, riding style, etc. all can contribute to the failure of a product. Something might work really well for a reviewer but fail under other riders.

The last point is that things tend to suck when you publish a negative review. The best manufacturers take the bad with the good and treat it as a learning experience. The worst manufacturers freak out over any perceived slight to their product and make life difficult for everybody involved. And that’s before you get to the readers. For some reason, there’s always a group that gets really angry about a negative review. This seems to degenerate into a pissing match of “hardcoreness” with suggestions that the only reason you didn’t like the product is because you’re not awesome enough to make it work properly. You’d have to be an idiot to seek this out on purpose.

My strategy for avoiding these pitfalls is to approach all gear reviews with an attitude of general fear and self-doubt. I always assume that I haven’t spent enough time on a piece of equipment and push for “just one more ride.” I ride on trails that I hate just so that I can be certain that I’ve covered off each and every angle. And before I dump on a product I make sure I have enough supporting information to throw it back in the complaint complainer’s stupid little face. But that’s just me. I’m lucky to have the support of people that let me take my sweet-assed time (for the most part) and are willing to back me up on my opinions. I’m also lucky enough to not have to rely on this sh!t to put food on my table. So if it all blows up in my face I can start kiteboarding or food blogging or something like that.

But really, I don’t see many publications or reviewers getting this all that wrong. We’re all facing the same pressures and we all respond a little bit differently, but I don’t think you can make it long term if you are actively deceiving readers. Ya, of course I wish there were more people that had the balls to explicitly call things out, but I also understand that blowing shit up is seldom the right way to change anything in the long term. Undoubtedly, a few giant pieces of shit that had no business being sold have slipped through the cracks, but it’s a stretch to lay all that blame at the hands of a corrupt mountain bike journalism cartel. We’re just not that smart or organized.

My advice for anybody reading reviews:

  • Never treat the word of one person as gospel. Several reviews will give you a better idea than one.
  • Don’t read too much into a review that comes out shortly after the bike is released. Gremlins don’t usually show up that quickly.
  • If you insist on buying that brand new product in its first year of existence, you might end up being a guinea pig. That is not necessarily the reviewer’s fault.
  • If you don’t agree or want some clarification, ask a respectful question of the reviewer. It’s amazing what information you can dig up if you’re not a dick about it.
  • If you no longer trust the opinions of somebody, stop reading their work. For bonus points, you can open up a satirical Twitter account in their name and get to work totally destroying their reputation. That takes effort though, but man do they ever deserve it for creating opinions about bikes that you don’t agree with. That shit is important!

Sorry,
Uncle Dave


Instagram blah blah @davetolnai. Twitter yada yada @ReallyUncleDave. Nobody cares. Don’t worry about it.

Tom wins a bar and stem from Commencal’s online store. If you’d like to win a prize from Uncle Dave – send him a question. And remember – there are no bad questions, unless you ask Uncle Dave.

“The RIDE ALPHA handlebar was developed in order to offer the most intuitive shape possible and to simplify the handlebar adjustments in relation to the stem, but also to the brakes, shifters and other components.”

 

RIDE ALPHA handlebar 30mm rise

RIDE ALPHA 780 MM WIDTH 20 MM RISE HANDLEBAR BLACK 2016 – €49

“RIDE ALPHA Stem – 50mm is a standard extension for a stem built to go big for downhill, dirt jumping or big mountain enduro – a length for the perfect harmony between commitment, comfort and fun with today’s frame geometries.”

RIDE ALPHA STEM 50

RIDE ALPHA FREERIDE 50 MM EXTENSION STEM BLACK 2016 – €49


Have an opinion about bike reviewers? Opine below.

 

 

Trending on NSMB

Comments

awesterner
0
awesterner  - April 12, 2016, 1:09 p.m.

f#ck, I think I know that guy in the picture. Or that's just a normal thing to do….chillin' just outside of Parksville.

Reply

morgan-taylor
0
Morgan Taylor  - April 12, 2016, 10:46 a.m.

Dear Uncle Dave,

Why do mountain bikers insist on calling people pussies and suggest that they "grow a pair"? Let's call a spade a spade. It's 2016, and we can communicate using language that doesn't alienate a majority of the world's population.

Sincerely,
Justin Trudeau.

Reply

extraspecialandbitter
+1 Greg Bly
ExtraSpecialandBitter  - April 12, 2016, 11:32 a.m.

“Why do people say "grow some balls"? Balls are weak and sensitive. If you wanna be tough, grow a vagina. Those things can take a pounding.”

― Betty White

Reply

jonathan-harris
0
Jonathan Harris  - April 12, 2016, 1:35 p.m.

Truth. Based on my own balls that is.

Reply

Dirk
0
Dirk  - April 12, 2016, 2:08 p.m.

Yes.

This is a valid topic that needs exploring.

Truth is I have terrible reading comprehension and tend to not pick up on things like that. And if I filtered for offensive question content I would be left with nothing.

Reply

JBV2
0
james  - April 12, 2016, 11:35 p.m.

stop being a pussy.

Reply

greg-heil
0
Greg Heil  - April 12, 2016, 10:41 a.m.

This line… love it!
"Undoubtedly, a few giant pieces of shit that had no business being sold have slipped through the cracks, but it’s a stretch to lay all that blame at the hands of a corrupt mountain bike journalism cartel. We’re just not that smart or organized."

Reply

redsonsam
0
Redson.sam  - April 12, 2016, 9:30 a.m.

Brilliant article! I needed to read something like this so that my rage didn't overcome me and force me to give up on my favourite of things- riding!

I have been reading pieces lately where the writer is talking about how the bike tracks the ground and how the angles affect the rider and at the end of the piece they say they are looking forward to getting to ride the bike themselves. Articles like this and others just make you feel distanced from the industry; in so much as there seems to be a few select companies who have the money / time to send journalists on fancy trips to "test" their bikes or pay big for advertising space and this relates directly to reviews or 'to call a spade a spade', a puff piece.

This article reassures me that the corporate knob-ish-ness that seems to permeate my reading and viewing online is not quite as prevalent as I first thought and I thank you for writing it.

Keep it up!

Reply

jonathan-harris
0
Jonathan Harris  - April 12, 2016, 9:02 a.m.

That photo… gold.

So to Dave's point regarding this - "The problem, I think, is that some of these guys are pumping out an insane amount of content. They’re constantly on the road and they’re responsible for multiple posts every week (or day)."
That's a distinct difference in the way NSMB operates and one that I don't think is well known. The vast majority of the guys that write reviews on this website are volunteers, Uncle Dave included. We have day jobs, we are not trained journo's (and sometimes that shows) but we are experienced and passionate mountain bikers. We pay for some of our own gear and then we get to review some stuff too, but as we typically have paid for gear in the past we approach reviews like a typical punter. Not someone that gets oodles of gear monthly to review.
I don't think many reader realize that nugget about the reviewers on the site, so thought it was worth sharing.

Reply

drewm
0
DrewM  - April 12, 2016, 8:20 a.m.

I think this is a, well written, fantastic counter point re. product reviews… albeit less entertaining than Uncle Dave's beautifully rambling cynicism… and worth a read:

Reply

blackbird
0
tw  - April 12, 2016, 7:29 a.m.

Tom, I had no idea Depends were so fashionable…….

Reply

tehllama42
0
Tehllama42  - April 12, 2016, 6:57 a.m.

Everything on this page is justification for why I'm here on NSMB, despite being a desert dweller.

Reply

whatyouthink
0
whatyouthink  - April 12, 2016, 6:44 a.m.

This is why I read nsmb (i am not cool enough to live on the north shore (yet)) but the reviews tend to say it like it is and don't sugar coat things. a lot of good points as always dave.

Reply

james-yallop
0
James Yallop  - April 12, 2016, 3:37 a.m.

I laughed when I read the description for the handlebar being given away, because I thought it was a touch of satire on the whole press release problem the article describes. But, sadly, no.

Reply

cam@nsmb.com
+1 Greg Bly
Cam McRae  - April 12, 2016, 7:56 a.m.

Actually I was playing with the idea some when I chose the text James.

But, a clear difference, for those paying attention, is that we were not trying to present our opinion about those products based on experience. That wasn't even suggested. We are giving them away and we've never even touched the items in question.

When we present an opinion we make it very clear. Our reviewers never use 'We' to water down their word like many outlets. Who the hell else are they talking about? Our reviewers own their words - and nobody was claiming those.

While an outlet with integrity is important, there is little hope if readers don't pay attention. If you can't tell what is review and what is marketing - when it's a giveaway - how much hope is there?

Reply

james-yallop
0
James Yallop  - April 12, 2016, 10:26 a.m.

Thanks for the reply, Mr. McRae.

But don’t get too hot under the collar: I’m amazed you believe I actually thought that any group other than Commencal PR would genuinely try and claim those words about the bar and stem. I am genuinely smiling at that idea.

Maybe next time you try to insinuate dramatically that here’s ‘little hope’ because of what you perceive to be someone else’s lack of thorough reading, perhaps take a leaf from your own book and another minute to think about what the other person might really be saying.

I mean, I never suggested you were trying to present your opinion on the products either; I was just trying to hint at maybe rewording the description to make it a little more human, a little less robotic. I don’t remember seeing those speech marks before - that is, of course, an easier way of dealing with the problem than rewording, and if they were there originally then I take my words back.

Reply

cam@nsmb.com
0
Cam McRae  - April 12, 2016, 10:51 a.m.

I did add the quotation marks later. I likely normally would have thought of that but we arrived late driving from Oregon to Santa Cruz and was finishing this up in the wee hours. It certainly would have been better to have had those there in the beginning. Thanks for helping me realize that.

My point was that readers have to be savvy as well. And Dave was talking about PR that was passed off as review - and that was not the case here - and I wanted to make that clear. Maybe you didn't mean to insinuate that - but the suggestion that it was not satire made that connection. I also wasn't trying to suggest there is little hope for you - rather that there is little hope that media outlets will be held accountable without savvy readership. We have cultivated that savvy readership and we get called on stuff regularly. And we do fuck up sometimes - and learn our lessons. But many other outlets that I could name post fluffy bullshit off as reviews and their readership sucks it up with a candy straw. They can have those readers.

Not hot under the collar though. I'm not even warmed up!

My apologies if I offended you!
Cheers!

Reply

james-yallop
0
James Yallop  - April 12, 2016, 11:20 a.m.

No worries and valid points. I especially agree with what you say about fluffy bullshit; your opinions are exemplified by the fact we're having this discussion.

Likewise, thanks a lot.

Reply

cam@nsmb.com
0
Cam McRae  - April 12, 2016, 1:40 p.m.

Thanks James!

Reply

Please log in to leave a comment.