Interesting Zen IPC benchmarks

By: Rayla (rayla.delete@this.example.com), November 26, 2020 6:46 am
Room: Moderated Discussions
Groo (charlie.delete@this.semiaccurate.com) on November 25, 2020 12:48 pm wrote:
> Chester (lamchester.delete@this.gmail.com) on November 24, 2020 11:32 pm wrote:
>
> >
> > My opinion is requiring a license reduces its value as a benchmark. It means you won't
> > have a lot of runs from the general public and less data to compare against.
> >
>
> This is quite true but the point of the license is to make sure people follow the rules. If you have a benchmark
> that is used for serious evaluations and large purchases, integrity is a lot more important than a, "Gee look
> at the pretty colors spinning around"-mark 2020. If you require a license, you can also dictate terms, and
> that keeps the idiocy down, or at least makes companies work creatively for it. *COUGH* Sun *COUGH*
>
> Sure the terms are a major pain in the ass but they also keep people from gaming the system
> (somewhat) and doing things that are expressly forbidden. You can do these things, or do anything
> you want, but you just can't call it an official Spec score when done. To me, what they are
> doing makes a lot of sense and removing the license would make the suite worthless.
>
> -Charlie

As a SPEC2017 licensee, I typically agree - though I still think vendor results are largely crap (we have our own DB of results run with configurations explicitly intended to be comparable to each other.) I also think that allowing OpenMP multithreading in SPECspeed (for 657.xz_s) was a really and truly baffling decision by SPEC that reduces the value of SPECspeed results.

Still, it's the best of limited options, especially if you're looking at the individual subtest results. I can't comprehend the "SPEC is just microbenchmarks, but Cinebench is a REAL WORKLOAD" argument - SPEC is real application code that does matter in the real world (gcc, perlbench, compression benches, XML parsing) distributed in a repeatable, portable form.

And that counts for a lot.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Interesting Zen IPC benchmarksAdrian2020/11/21 07:14 AM
  Interesting Zen IPC benchmarksjuanrga2020/11/21 09:22 AM
    Interesting Zen IPC benchmarksChester2020/11/21 02:49 PM
      Interesting Zen IPC benchmarksAndrei F2020/11/22 04:08 AM
        Interesting Zen IPC benchmarksChester2020/11/22 08:33 PM
          Interesting Zen IPC benchmarksnone2020/11/23 12:59 AM
            Interesting Zen IPC benchmarksnone2020/11/23 01:01 AM
              Interesting Zen IPC benchmarksnone2020/11/23 01:01 AM
          No...David Kanter2020/11/23 07:16 AM
            No...Chester2020/11/23 02:15 PM
              No...Foo_2020/11/24 02:34 AM
                No...Chester2020/11/24 11:45 PM
                  No...Per Hesselgren2020/11/25 12:57 AM
                  No...Adrian2020/11/25 03:21 AM
          Interesting Zen IPC benchmarksDoug S2020/11/23 12:03 PM
            Interesting Zen IPC benchmarksChester2020/11/23 02:26 PM
              Programs people useFoo_2020/11/24 02:43 AM
                Programs people useJukka Larja2020/11/24 06:07 AM
                Cinebench is the new Dhrystone :) (NT)none2020/11/25 12:10 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 07:38 AM
          Interesting Zen IPC benchmarksAndrei F2020/11/24 04:47 AM
            Interesting Zen IPC benchmarksChester2020/11/24 11:32 PM
              Questionable thoughtsbenchmark critic2020/11/25 07:41 AM
                Questionable thoughtsChester2020/11/25 02:14 PM
                Questionable thoughtsnone2020/11/26 12:14 AM
                  Links?benchmark critic2020/11/26 08:48 AM
              Interesting Zen IPC benchmarksGroo2020/11/25 12:48 PM
                Interesting Zen IPC benchmarksChester2020/11/25 03:36 PM
                  Interesting Zen IPC benchmarksGroo2020/11/26 01:46 PM
                    Interesting Zen IPC benchmarksChester2020/11/26 06:32 PM
                      Interesting Zen IPC benchmarksGroo2020/11/27 09:27 AM
                        Interesting Zen IPC benchmarksChester2020/11/29 06:16 AM
                          Interesting Zen IPC benchmarksGroo2020/11/29 08:56 AM
                            Interesting Zen IPC benchmarksChester2020/11/29 03:41 PM
                Interesting Zen IPC benchmarksRayla2020/11/26 06:46 AM
                  BenchmarksDavid Kanter2020/11/26 09:05 AM
                    Benchmarksblaine2020/11/26 12:04 PM
          Interesting Zen IPC benchmarksPer Hesselgren2020/11/24 09:11 AM
            Interesting Zen IPC benchmarksChester2020/11/24 11:42 PM
      Interesting Zen IPC benchmarksjuanrga2020/11/22 06:09 AM
        Interesting Zen IPC benchmarksChester2020/11/22 08:53 PM
          Interesting Zen IPC benchmarksjuanrga2020/11/23 12:16 PM
            Interesting Zen IPC benchmarksChester2020/11/23 01:27 PM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 07:25 AM
            Interesting Zen IPC benchmarksAdrian2020/11/24 10:51 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/26 03:52 AM
  The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 08:29 AM
    The Stilt's Zen 3 IPC benchmarksChester2020/11/25 03:49 PM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 04:58 PM
        The Stilt's Zen 3 IPC benchmarksDoug S2020/11/26 08:19 AM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 05:13 PM
        The Stilt's Zen 3 IPC benchmarksChester2020/11/26 10:24 AM
          The Stilt's Zen 3 IPC benchmarksitsmydamnation2020/11/26 02:06 PM
            The Stilt's Zen 3 IPC benchmarksChester2020/11/26 06:10 PM
            The Stilt's Zen 3 IPC benchmarksDoug S2020/11/27 03:17 PM
      The Stilt's Zen 3 IPC benchmarksjuanrga2020/11/26 04:10 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell avocado?