Interesting Zen IPC benchmarks

By: Chester (lamchester.delete@this.gmail.com), November 29, 2020 3:41 pm
Room: Moderated Discussions
> > If everyone is 'cheating' by ignoring turbo time limits and/or using MCE, and consumers are likely to leave
> > those options on or turn them on themselves if not enabled by default, what should reviewers do?
> >
> There are two schools of thought here. One is that you are doing what the system is capable of doing even though
> it is cheating an only applicable to a specific benchmark or scenario. I don't subscribe to this one.

Stuff like MCE/ignoring time limits can be very broadly applicable though. Multithreaded applications often run for a while (say, video encoding).

> The other is you expose it, call it out, and trash the vendor/product in public for cheating. This is my preferred
> way. That said some are unwilling to do this because they know it will hurt their income stream.

My preferred way would be to test both. Show results with those 'enhancements' on, along with higher power consumption. But also show stock results to be fair to Intel/AMD. Let consumers know what vendors are doing, so they can make informed decisions.

> > Should they test the config customers will most likely be using?
> > Or turn off those options to get a 'proper' stock result?
> >
> Personally I would run it both ways, point out the level of cheating, trash the vendor
> who cheats, and recommend the other product. If a product cheats on X and is caught, are
> they doing other things elsewhere that weren't? Is it a good/safe/reliable product?
>
> > > What it comes down to is look a little deeper than the scores themselves, and
> > > point it out when people do wrong. If you don't, they will keep doing it.
>
> >
> > Yeah, keep pointing it out. But most people by now know to at least wait for independent
> > reviews, and to take initial manufacturer benchmarks with a grain of salt.
> >
> Another problem of late is companies are trying to short-circuit the independent review process.
> Some don't sample at all before sales, other do a teaser and pre-orders before reviews, and others
> just ignore the who idea of reviews. It usually blows back on them, but usually not for the short
> term so they 'win'. Long term they lose but that isn't in the calculus for the marketers
>
> -Charlie

Yeah, whoever pre-orders based on that limited info is taking a big gamble. How hard is it to wait for reviewers to publish reviews with more comprehensive benchmarks?
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Interesting Zen IPC benchmarksAdrian2020/11/21 07:14 AM
  Interesting Zen IPC benchmarksjuanrga2020/11/21 09:22 AM
    Interesting Zen IPC benchmarksChester2020/11/21 02:49 PM
      Interesting Zen IPC benchmarksAndrei F2020/11/22 04:08 AM
        Interesting Zen IPC benchmarksChester2020/11/22 08:33 PM
          Interesting Zen IPC benchmarksnone2020/11/23 12:59 AM
            Interesting Zen IPC benchmarksnone2020/11/23 01:01 AM
              Interesting Zen IPC benchmarksnone2020/11/23 01:01 AM
          No...David Kanter2020/11/23 07:16 AM
            No...Chester2020/11/23 02:15 PM
              No...Foo_2020/11/24 02:34 AM
                No...Chester2020/11/24 11:45 PM
                  No...Per Hesselgren2020/11/25 12:57 AM
                  No...Adrian2020/11/25 03:21 AM
          Interesting Zen IPC benchmarksDoug S2020/11/23 12:03 PM
            Interesting Zen IPC benchmarksChester2020/11/23 02:26 PM
              Programs people useFoo_2020/11/24 02:43 AM
                Programs people useJukka Larja2020/11/24 06:07 AM
                Cinebench is the new Dhrystone :) (NT)none2020/11/25 12:10 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 07:38 AM
          Interesting Zen IPC benchmarksAndrei F2020/11/24 04:47 AM
            Interesting Zen IPC benchmarksChester2020/11/24 11:32 PM
              Questionable thoughtsbenchmark critic2020/11/25 07:41 AM
                Questionable thoughtsChester2020/11/25 02:14 PM
                Questionable thoughtsnone2020/11/26 12:14 AM
                  Links?benchmark critic2020/11/26 08:48 AM
              Interesting Zen IPC benchmarksGroo2020/11/25 12:48 PM
                Interesting Zen IPC benchmarksChester2020/11/25 03:36 PM
                  Interesting Zen IPC benchmarksGroo2020/11/26 01:46 PM
                    Interesting Zen IPC benchmarksChester2020/11/26 06:32 PM
                      Interesting Zen IPC benchmarksGroo2020/11/27 09:27 AM
                        Interesting Zen IPC benchmarksChester2020/11/29 06:16 AM
                          Interesting Zen IPC benchmarksGroo2020/11/29 08:56 AM
                            Interesting Zen IPC benchmarksChester2020/11/29 03:41 PM
                Interesting Zen IPC benchmarksRayla2020/11/26 06:46 AM
                  BenchmarksDavid Kanter2020/11/26 09:05 AM
                    Benchmarksblaine2020/11/26 12:04 PM
          Interesting Zen IPC benchmarksPer Hesselgren2020/11/24 09:11 AM
            Interesting Zen IPC benchmarksChester2020/11/24 11:42 PM
      Interesting Zen IPC benchmarksjuanrga2020/11/22 06:09 AM
        Interesting Zen IPC benchmarksChester2020/11/22 08:53 PM
          Interesting Zen IPC benchmarksjuanrga2020/11/23 12:16 PM
            Interesting Zen IPC benchmarksChester2020/11/23 01:27 PM
              Interesting Zen IPC benchmarksjuanrga2020/11/24 07:25 AM
            Interesting Zen IPC benchmarksAdrian2020/11/24 10:51 AM
              Interesting Zen IPC benchmarksjuanrga2020/11/26 03:52 AM
  The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 08:29 AM
    The Stilt's Zen 3 IPC benchmarksChester2020/11/25 03:49 PM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 04:58 PM
        The Stilt's Zen 3 IPC benchmarksDoug S2020/11/26 08:19 AM
      The Stilt's Zen 3 IPC benchmarksDummond D. Slow2020/11/25 05:13 PM
        The Stilt's Zen 3 IPC benchmarksChester2020/11/26 10:24 AM
          The Stilt's Zen 3 IPC benchmarksitsmydamnation2020/11/26 02:06 PM
            The Stilt's Zen 3 IPC benchmarksChester2020/11/26 06:10 PM
            The Stilt's Zen 3 IPC benchmarksDoug S2020/11/27 03:17 PM
      The Stilt's Zen 3 IPC benchmarksjuanrga2020/11/26 04:10 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell avocado?