'Real-world' Benchmarking.

[Kasrkin Guard]

http://www.firingsquad.com/hardware/jakub_rant_real_world_benchmarking/

Firing Squad pretty much told Hard OCP to shove it to summarize it. I can agree seeing as it's full of attitude most of the time it seems, but I just use as many other sites as possible. This got me thinking about benchmarking and the opinions of everyone on them. I know there have been several threads that touch on them here and there. I can agree with multi resolutions and I like to see what settings were used, etc. So what are everyone's thoughts on them and so on?

[Kougar]

Heh, in my opinion HardOCP had it coming to them, not even THG has pulled something on that level.

I didn't realize to the extent HardOCP compromised their own numbers though... I don't see how they get off claiming they have "real world benchmarks" when they ran their tests without AI control or physics. Excuse me, but wasn't testing the CPU the point of their benchmarks in the first place?

Turning those on would greatly increase the load on the CPU, and subsequently affect the FPS numbers by some large margins depending on how well the CPU can juggle AI processing, physics processing, and GPU processing by keeping the GPU(s) fed with data to crunch.

I think I'm going to be avoiding HardOCP from now own since complete BS seems to be their specialty. I guess I'll just spend the time browsing FireingSquad's website now... ;)

[Scott Sherman]

Yeah they really asked for the other webmasters and reviewers to hate them. They seem to do that alot these days.

[Kasrkin Guard]

I forgot what all it was about, however all but a while ago I think Kyle was butting heads with Guru3d about ATi and that his thread was deleted and felt the need to post news about it... Always stirring something up. :(

[XJnine]

I feel the same way as firingsquad.... I'm glad they posted this.

[Kasrkin Guard]

http://enthusiast.hardocp.com/article.html?art=MTExOCwxLCxoZW50aHVzaWFzdA==

Followed by a counter point... They say they are not benchmarking, however it's inevitable they are. I went back to read up a bit on their review and it seems like they tested much like video cards as opposed to CPUs like the Athlon 64s in the past. :???:

[werty316]

This flam war between HardOCP and Firingsquad is just immature and I don't see the point of whining like babies and bad mouthing eachother.

[XJnine]

Even if someone has a valid point?

[werty316]

Yep even if someone has a point the other party in this feud would most likely not agree. Its just an ending back and forth bash fest.

[Kougar]

Yep even if someone has a point the other party in this feud would most likely not agree. Its just an ending back and forth bash fest.

So you're saying everyone should just take it from HardOCP then? They fired the opening salvo, and FiringSquad offered back a formal, at least polite rebuttal. The only thing I see immature here is HardOCP being a hard-ass. Their own article is pretty bad, and I'm not even going to pick it apart here as it's not even worth the time.

HardOCP pretty much called into question the validity of everyone single website's testing methods and then insulted them all ontop of it. Have a difference of opinion is one thing, but I think FiringSquad had every right to defend their methods of testing analysis, and that is all that they have done. At least so far...

[werty316]

No I mean why question anyother website's method. Everyone isn't gonna foloow HardOCP benching practices and I say there is no reason for this. I honestly don't like to read HardOCP reviews and their benches.

After I saw they wrote the "Firing Squid Wastes their Ink" rebuttal I laughed and thought HardOCP were being babies.

[Kougar]

I think it has less to do with FiringSquad questioning HardOCP's testing methodology, and more to do with HardOCP making a big deal in their first article about they have the only correct tests, and that all the other websites are paid off to run "bad" or "none real life" canned benchmarks. That was primarily what drew FiringSquads article as more of a self-defense explanation as to the how and why they test as they do.

Regardless, I agree HardOCP's overreaction in their follow-up article couldn't be much more obvious I think. It speaks volumes about the individual that wrote it.

[GIBSON]

I'm really not surprised that an other HW site gave them an appropriate answer. HardOCP was begging for it. Sure they can say what they think, but the way they wrote it isn't like you'd express what your thinking. It's more like, "this is how we say it is, and that's that!"

[werty316]

I think HardOCP thinks they are all that and a bag of bananas.

[tomato]

Yeah, HardOCP in general seems to have a "holier than thou" air about them... not very welcoming, IMO.

That said, I prefer Firing Squads article anyway ;)

[Kougar]

I agree with both of your posts completely... :lol: I haven't really paid any attention to FiringSquad before as they are way more hardware/techkunkie sites out there than I could hope to keep up with... but after all of this mess, I think I can thank HardOCP for making space in my bookmarks folder for FiringSquad. :)

[XJnine]

HardOCP has been doing reviews like this for a while and everyone was fine with it. People knew they could go there and get that type of review if they wanted to and they could go to other sites to read other types of reviews. I don't understand why they decided to come out and slam all the other sites and denounce their methods this time. Just worry about yourself and don't drag others into it. It almost seems like they wanted to create a controversy. They sure managed to succeed. To come out with your review and preface it with a statement that pretty much said "This is the only way to review things and if you do it differently you're an idiot" is a sure fire way to stir up the pot.