Interesting Zen IPC benchmarks

By: Chester (lamchester.delete@this.gmail.com), November 25, 2020 3:36 pm
Room: Moderated Discussions
Groo (charlie.delete@this.semiaccurate.com) on November 25, 2020 12:48 pm wrote:
> Chester (lamchester.delete@this.gmail.com) on November 24, 2020 11:32 pm wrote:
>
> >
> > My opinion is requiring a license reduces its value as a benchmark. It means you won't
> > have a lot of runs from the general public and less data to compare against.
> >
>
> This is quite true but the point of the license is to make sure people follow the rules. If you have a benchmark
> that is used for serious evaluations and large purchases, integrity is a lot more important than a, "Gee look
> at the pretty colors spinning around"-mark 2020. If you require a license, you can also dictate terms, and
> that keeps the idiocy down, or at least makes companies work creatively for it. *COUGH* Sun *COUGH*

Integrity is down to how much you trust the reviewer running the benchmarks....if a reviewer does something dumb, intentionally or not, I don't think rules will stop them. By dumb I mean stuff like leaving MCE enabled and presenting results as 'stock'.

> Sure the terms are a major pain in the ass but they also keep people from gaming the system
> (somewhat) and doing things that are expressly forbidden. You can do these things, or do anything
> you want, but you just can't call it an official Spec score when done. To me, what they are
> doing makes a lot of sense and removing the license would make the suite worthless.
>
> -Charlie

I can see why they did that with a benchmark distributed in source form. But STREAM does it better. They have rules and official results, but let anyone run it.

SPEC's official results database is a mess anyway. Even comparing between x86 systems is complicated by different compilers, compile flags, and page sizes. Also, the near complete lack of client CPUs in that database makes it even more useless for consumers.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Interesting Zen IPC benchmarksAdrian2020/11/21 07:14 AM
  Interesting Zen IPC benchmarksjuanrga2020/11/21 09:22 AM
    Interesting Zen IPC benchmarksChester2020/11/21 02:49 PM
      Interesting Zen IPC benchmarksAndrei F2020/11/22 04:08 AM
        Interesting Zen IPC benchmarksChester2020/11/22 08:33 PM
          Interesting Zen IPC benchmarksnone2020/11/23 12:59 AM
            Interesting Zen IPC benchmarksnone2020/11/23 01:01 AM
              Interesting Zen IPC benchmarksnone2020/11/23 01:01 AM
          No...David Kanter2020/11/23 07:16 AM
            No...Chester2020/11/23 02:15 PM
              No...Foo_2020/11/24 02:34 AM
                No...Chester2020/11/24 11:45 PM
                  No...Per Hesselgren2020/11/25 12:57 AM
                  No...Adrian2020/11/25 03:21 AM
          Interesting Zen IPC benchmarksDoug S2020/11/23 12:03 PM
            Interesting Zen IPC benchmarksChester2020/11/23 02:26 PM
              Programs people useFoo_2020/11/24 02:43 AM
                Programs people useJukka Larja2020/11/24 06:07 AM
                Cinebench is the new Dhrystone :) (NT)none2020/11/25 12:10 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 07:38 AM
          Interesting Zen IPC benchmarksAndrei F2020/11/24 04:47 AM
            Interesting Zen IPC benchmarksChester2020/11/24 11:32 PM
              Questionable thoughtsbenchmark critic2020/11/25 07:41 AM
                Questionable thoughtsChester2020/11/25 02:14 PM
                Questionable thoughtsnone2020/11/26 12:14 AM
                  Links?benchmark critic2020/11/26 08:48 AM
              Interesting Zen IPC benchmarksGroo2020/11/25 12:48 PM
                Interesting Zen IPC benchmarksChester2020/11/25 03:36 PM
                  Interesting Zen IPC benchmarksGroo2020/11/26 01:46 PM
                    Interesting Zen IPC benchmarksChester2020/11/26 06:32 PM
                      Interesting Zen IPC benchmarksGroo2020/11/27 09:27 AM
                        Interesting Zen IPC benchmarksChester2020/11/29 06:16 AM
                          Interesting Zen IPC benchmarksGroo2020/11/29 08:56 AM
                            Interesting Zen IPC benchmarksChester2020/11/29 03:41 PM
                Interesting Zen IPC benchmarksRayla2020/11/26 06:46 AM
                  BenchmarksDavid Kanter2020/11/26 09:05 AM
                    Benchmarksblaine2020/11/26 12:04 PM
          Interesting Zen IPC benchmarksPer Hesselgren2020/11/24 09:11 AM
            Interesting Zen IPC benchmarksChester2020/11/24 11:42 PM
      Interesting Zen IPC benchmarksjuanrga2020/11/22 06:09 AM
        Interesting Zen IPC benchmarksChester2020/11/22 08:53 PM
          Interesting Zen IPC benchmarksjuanrga2020/11/23 12:16 PM
            Interesting Zen IPC benchmarksChester2020/11/23 01:27 PM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 07:25 AM
            Interesting Zen IPC benchmarksAdrian2020/11/24 10:51 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/26 03:52 AM
  The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 08:29 AM
    The Stilt's Zen 3 IPC benchmarksChester2020/11/25 03:49 PM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 04:58 PM
        The Stilt's Zen 3 IPC benchmarksDoug S2020/11/26 08:19 AM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 05:13 PM
        The Stilt's Zen 3 IPC benchmarksChester2020/11/26 10:24 AM
          The Stilt's Zen 3 IPC benchmarksitsmydamnation2020/11/26 02:06 PM
            The Stilt's Zen 3 IPC benchmarksChester2020/11/26 06:10 PM
            The Stilt's Zen 3 IPC benchmarksDoug S2020/11/27 03:17 PM
      The Stilt's Zen 3 IPC benchmarksjuanrga2020/11/26 04:10 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell avocado?