> > > Since most/all of the subtests are irrelevant and meaningless for consumers, yeah I consider it
> > > miles better. There's a reason SPEC isn't popular among review sites. No one cares about it.
> >
> > Other review sites don't use it because first of all they don't have a license,
>
> My opinion is requiring a license reduces its value as a benchmark. It means you won't
> have a lot of runs from the general public and less data to compare against.

Building real things that don't suck costs money. Where does it come from?

> > second of all
> > they wouldn't even know what to do with it. I doubt anybody else is going into the source to
> > figure out to port things across operating systems and mobile devices on new architectures.
>
> They don't try porting across operating systems and architectures because most of
> them don't care and don't have an audience that cares. It's also why you don't see
> a lot of Mac OS benchmarks floating around - Apple market share is small.
>
> And yeah looking at new architectures is interesting. To me,
> SPEC is in the position of 'better than nothing at all'.

> If you want an example of a site that cares about cross-platform, Phoronix got their
> hands on a Mac Mini and have run a lot of tests including Rosetta ones. I like how they
> include Darktable - RAW conversion perf is interesting to me personally. It's just inconvenient
> to look up test scores for other non-mac configs on openbenchmarking.org.


> The Phoronix test suite still has a lot of weird 'who uses this' tests, but it
> also has some relevant stuff and is starting to look like SPEC done right.

Are you fucking kidding? They call the site Moronix for a good reason.

That benchmark suite is a fucking joke. There are one or two benchmarks that make sense, but it's mostly a collection of crap glued together with scripts.

It combines a pile of microkernels and unrealistic application benchmarks.

Also the fact that the author thinks that some of those tests should be included says volumes about his technical expertise.