By: Chester (, November 23, 2020 3:15 pm
Room: Moderated Discussions
David Kanter ( on November 23, 2020 7:16 am wrote:
> > Since most/all of the subtests are irrelevant and meaningless for consumers, yeah I consider it
> > miles better. There's a reason SPEC isn't popular among review sites. No one cares about it.
> SPEC is unpopular because it's more difficult to obtain than
> other benchmarks and it's harder to run and understand.

Yeah, cost factors into it. But it's also bad for other reasons. Some of those were discussed in another thread (unrealistic workloads/compile settings).
- performance varies with compiler and compiler flags as well as hardware
- many of the tests just don't correspond to any consumer workload. Taking specint2017:
-- gcc - compile gcc itself
-- x264 - encode movie (but only write out every 200th frame, and use 1 mbps bitrate, and no asm)
-- perlbench - lots of email operations in perl, including spam filtering
-- mcf - single-depot vehicle scheduling
-- omnetpp - ethernet network simulation
-- xalancbmk - transform XML into HTML
-- deepsjeng - chess engine
-- leela - Go engine
-- exchange2 - sudoku generator, to test Fortran 95 array handling perf
-- xz - xz compression

Of these, the GCC test is nice to see. x264 would have been nice if not for its flaws. The rest...well are those really popular client applications?

gz, zip/deflate, and 7z are far more popular than xz compression.
perlbench sounds more like a server-side than client-side workload
mfc/omnetpp/exchange2/xalancbmk are super obscure
deepsjeng doesn't come to mind as a popular chess engine, unlike stockfish, crafty, and fritz.
I have no clue about leela.

Anyway, my main point is that pretty much any reputable review site has put together a better benchmark suite than SPEC. For example, take gamers nexus:
- Chromium compile - good to have, just like spec gcc
- Blender - good to have, also in specfp
- 7z compression/decompression - 7z is far more popular than xz
- Adobe Photoshop - lots of people use this
- Adobe Premier - also very popular for video editing
- V-Ray - meh, everyone I know uses Blender instead because it's free
- Handbrake x264 to x265 transcode - this is spec x264 done properly
- Cinebench R15 for validation - good because it's a free benchmark with results from lots of platforms and thus a good point of comparison to make sure something isn't horribly wrong with your system
- 10 games. Like it or not, the gaming market is growing, and a lot of people put gaming perf first when getting a system.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Interesting Zen IPC benchmarksAdrian2020/11/21 08:14 AM
  Interesting Zen IPC benchmarksjuanrga2020/11/21 10:22 AM
    Interesting Zen IPC benchmarksChester2020/11/21 03:49 PM
      Interesting Zen IPC benchmarksAndrei F2020/11/22 05:08 AM
        Interesting Zen IPC benchmarksChester2020/11/22 09:33 PM
          Interesting Zen IPC benchmarksnone2020/11/23 01:59 AM
            Interesting Zen IPC benchmarksnone2020/11/23 02:01 AM
              Interesting Zen IPC benchmarksnone2020/11/23 02:01 AM
          No...David Kanter2020/11/23 08:16 AM
            No...Chester2020/11/23 03:15 PM
              No...Foo_2020/11/24 03:34 AM
                No...Chester2020/11/25 12:45 AM
                  No...Per Hesselgren2020/11/25 01:57 AM
                  No...Adrian2020/11/25 04:21 AM
          Interesting Zen IPC benchmarksDoug S2020/11/23 01:03 PM
            Interesting Zen IPC benchmarksChester2020/11/23 03:26 PM
              Programs people useFoo_2020/11/24 03:43 AM
                Programs people useJukka Larja2020/11/24 07:07 AM
                Cinebench is the new Dhrystone :) (NT)none2020/11/25 01:10 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 08:38 AM
          Interesting Zen IPC benchmarksAndrei F2020/11/24 05:47 AM
            Interesting Zen IPC benchmarksChester2020/11/25 12:32 AM
              Questionable thoughtsbenchmark critic2020/11/25 08:41 AM
                Questionable thoughtsChester2020/11/25 03:14 PM
                Questionable thoughtsnone2020/11/26 01:14 AM
                  Links?benchmark critic2020/11/26 09:48 AM
              Interesting Zen IPC benchmarksGroo2020/11/25 01:48 PM
                Interesting Zen IPC benchmarksChester2020/11/25 04:36 PM
                  Interesting Zen IPC benchmarksGroo2020/11/26 02:46 PM
                    Interesting Zen IPC benchmarksChester2020/11/26 07:32 PM
                      Interesting Zen IPC benchmarksGroo2020/11/27 10:27 AM
                        Interesting Zen IPC benchmarksChester2020/11/29 07:16 AM
                          Interesting Zen IPC benchmarksGroo2020/11/29 09:56 AM
                            Interesting Zen IPC benchmarksChester2020/11/29 04:41 PM
                Interesting Zen IPC benchmarksRayla2020/11/26 07:46 AM
                  BenchmarksDavid Kanter2020/11/26 10:05 AM
                    Benchmarksblaine2020/11/26 01:04 PM
          Interesting Zen IPC benchmarksPer Hesselgren2020/11/24 10:11 AM
            Interesting Zen IPC benchmarksChester2020/11/25 12:42 AM
      Interesting Zen IPC benchmarksjuanrga2020/11/22 07:09 AM
        Interesting Zen IPC benchmarksChester2020/11/22 09:53 PM
          Interesting Zen IPC benchmarksjuanrga2020/11/23 01:16 PM
            Interesting Zen IPC benchmarksChester2020/11/23 02:27 PM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 08:25 AM
            Interesting Zen IPC benchmarksAdrian2020/11/24 11:51 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/26 04:52 AM
  The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 09:29 AM
    The Stilt's Zen 3 IPC benchmarksChester2020/11/25 04:49 PM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 05:58 PM
        The Stilt's Zen 3 IPC benchmarksDoug S2020/11/26 09:19 AM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 06:13 PM
        The Stilt's Zen 3 IPC benchmarksChester2020/11/26 11:24 AM
          The Stilt's Zen 3 IPC benchmarksitsmydamnation2020/11/26 03:06 PM
            The Stilt's Zen 3 IPC benchmarksChester2020/11/26 07:10 PM
            The Stilt's Zen 3 IPC benchmarksDoug S2020/11/27 04:17 PM
      The Stilt's Zen 3 IPC benchmarksjuanrga2020/11/26 05:10 AM
Reply to this Topic
Body: No Text
How do you spell tangerine? 🍊