By: Chester (lamchester.delete@this.gmail.com), November 26, 2020 6:32 pm
Room: Moderated Discussions
Groo (charlie.delete@this.semiaccurate.com) on November 26, 2020 1:46 pm wrote:
> Chester (lamchester.delete@this.gmail.com) on November 25, 2020 3:36 pm wrote:
>
> > Integrity is down to how much you trust the reviewer running the benchmarks....if a
> > reviewer does something dumb, intentionally or not, I don't think rules will stop them.
> > By dumb I mean stuff like leaving MCE enabled and presenting results as 'stock'.
> >
> Doesn't Spec mandate disclosure of such things? I haven't looked closely at such things but
> it makes it hard to do things like that and hide the fact. Which is how it should be.
>
> -Charlie
https://www.spec.org/cpu2017/Docs/runrules.html#rule_4.4.2 isn't very clear.
If you've over or under clocked, you're supposed to put that in nominal or max frequency fields.
It's not clear whether MCE counts as overclocking though. A 9900K official result lists 3600 MHz as the nominal frequency, even though at stock a 9900K will run all cores at 4.7 GHz. So the 'nominal frequency' field is pretty much meaningless.
Another thing board vendors do is raise or remove time limits on PL2 power, allowing Intel chips to sustain higher power targets (and higher clocks) for longer. Technically this isn't stock either, but it's also questionable whether it's considered overclocking.
There's a lot of debate about how reviewers should treat this stuff. But it doesn't seem like SPEC cares - they only care that the system vendor supports the configuration (which is irrelevant to people buying their own parts).
> Chester (lamchester.delete@this.gmail.com) on November 25, 2020 3:36 pm wrote:
>
> > Integrity is down to how much you trust the reviewer running the benchmarks....if a
> > reviewer does something dumb, intentionally or not, I don't think rules will stop them.
> > By dumb I mean stuff like leaving MCE enabled and presenting results as 'stock'.
> >
> Doesn't Spec mandate disclosure of such things? I haven't looked closely at such things but
> it makes it hard to do things like that and hide the fact. Which is how it should be.
>
> -Charlie
https://www.spec.org/cpu2017/Docs/runrules.html#rule_4.4.2 isn't very clear.
If you've over or under clocked, you're supposed to put that in nominal or max frequency fields.
It's not clear whether MCE counts as overclocking though. A 9900K official result lists 3600 MHz as the nominal frequency, even though at stock a 9900K will run all cores at 4.7 GHz. So the 'nominal frequency' field is pretty much meaningless.
Another thing board vendors do is raise or remove time limits on PL2 power, allowing Intel chips to sustain higher power targets (and higher clocks) for longer. Technically this isn't stock either, but it's also questionable whether it's considered overclocking.
There's a lot of debate about how reviewers should treat this stuff. But it doesn't seem like SPEC cares - they only care that the system vendor supports the configuration (which is irrelevant to people buying their own parts).
Topic | Posted By | Date |
---|---|---|
Interesting Zen IPC benchmarks | Adrian | 2020/11/21 07:14 AM |
Interesting Zen IPC benchmarks | juanrga | 2020/11/21 09:22 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/21 02:49 PM |
Interesting Zen IPC benchmarks | Andrei F | 2020/11/22 04:08 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/22 08:33 PM |
Interesting Zen IPC benchmarks | none | 2020/11/23 12:59 AM |
Interesting Zen IPC benchmarks | none | 2020/11/23 01:01 AM |
Interesting Zen IPC benchmarks | none | 2020/11/23 01:01 AM |
No... | David Kanter | 2020/11/23 07:16 AM |
No... | Chester | 2020/11/23 02:15 PM |
No... | Foo_ | 2020/11/24 02:34 AM |
No... | Chester | 2020/11/24 11:45 PM |
No... | Per Hesselgren | 2020/11/25 12:57 AM |
No... | Adrian | 2020/11/25 03:21 AM |
Interesting Zen IPC benchmarks | Doug S | 2020/11/23 12:03 PM |
Interesting Zen IPC benchmarks | Chester | 2020/11/23 02:26 PM |
Programs people use | Foo_ | 2020/11/24 02:43 AM |
Programs people use | Jukka Larja | 2020/11/24 06:07 AM |
Cinebench is the new Dhrystone :) (NT) | none | 2020/11/25 12:10 AM |
Interesting Zen IPC benchmarks | juanrga | 2020/11/24 07:38 AM |
Interesting Zen IPC benchmarks | Andrei F | 2020/11/24 04:47 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/24 11:32 PM |
Questionable thoughts | benchmark critic | 2020/11/25 07:41 AM |
Questionable thoughts | Chester | 2020/11/25 02:14 PM |
Questionable thoughts | none | 2020/11/26 12:14 AM |
Links? | benchmark critic | 2020/11/26 08:48 AM |
Interesting Zen IPC benchmarks | Groo | 2020/11/25 12:48 PM |
Interesting Zen IPC benchmarks | Chester | 2020/11/25 03:36 PM |
Interesting Zen IPC benchmarks | Groo | 2020/11/26 01:46 PM |
Interesting Zen IPC benchmarks | Chester | 2020/11/26 06:32 PM |
Interesting Zen IPC benchmarks | Groo | 2020/11/27 09:27 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/29 06:16 AM |
Interesting Zen IPC benchmarks | Groo | 2020/11/29 08:56 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/29 03:41 PM |
Interesting Zen IPC benchmarks | Rayla | 2020/11/26 06:46 AM |
Benchmarks | David Kanter | 2020/11/26 09:05 AM |
Benchmarks | blaine | 2020/11/26 12:04 PM |
Interesting Zen IPC benchmarks | Per Hesselgren | 2020/11/24 09:11 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/24 11:42 PM |
Interesting Zen IPC benchmarks | juanrga | 2020/11/22 06:09 AM |
Interesting Zen IPC benchmarks | Chester | 2020/11/22 08:53 PM |
Interesting Zen IPC benchmarks | juanrga | 2020/11/23 12:16 PM |
Interesting Zen IPC benchmarks | Chester | 2020/11/23 01:27 PM |
Interesting Zen IPC benchmarks | juanrga | 2020/11/24 07:25 AM |
Interesting Zen IPC benchmarks | Adrian | 2020/11/24 10:51 AM |
Interesting Zen IPC benchmarks | juanrga | 2020/11/26 03:52 AM |
The Stilt's Zen 3 IPC benchmarks | Dummond D. Slow | 2020/11/25 08:29 AM |
The Stilt's Zen 3 IPC benchmarks | Chester | 2020/11/25 03:49 PM |
The Stilt's Zen 3 IPC benchmarks | Dummond D. Slow | 2020/11/25 04:58 PM |
The Stilt's Zen 3 IPC benchmarks | Doug S | 2020/11/26 08:19 AM |
The Stilt's Zen 3 IPC benchmarks | Dummond D. Slow | 2020/11/25 05:13 PM |
The Stilt's Zen 3 IPC benchmarks | Chester | 2020/11/26 10:24 AM |
The Stilt's Zen 3 IPC benchmarks | itsmydamnation | 2020/11/26 02:06 PM |
The Stilt's Zen 3 IPC benchmarks | Chester | 2020/11/26 06:10 PM |
The Stilt's Zen 3 IPC benchmarks | Doug S | 2020/11/27 03:17 PM |
The Stilt's Zen 3 IPC benchmarks | juanrga | 2020/11/26 04:10 AM |