New Article: Compute Efficiency 2012

Article: Computational Efficiency for CPUs and GPUs in 2012
By: Eric (eric.kjellen.delete@this.gmail.com), July 27, 2012 5:12 am
Room: Moderated Discussions
forestlaughing (forestlaughing.delete@this.yahoo.com) on July 25, 2012 8:51 am wrote:
> David Kanter (dkanter.delete@this.realworldtech.com) on July 25, 2012 1:37 am
> wrote:
> > New computational efficiency data shows GPUs with a clear edge over
> CPUs, but
> > the gap is narrowing as CPUs adopt wide vectors (e.g. AVX).
> Surprisingly, a
> > throughput CPU is the most energy efficient processor,
> offering hope for future
> > architectures. Our data also shows some
> advantages of AMD's Bulldozer, and the
> > overhead associated with highly
> scalable server CPUs.
> >
> > Comments and feedback
> > welcome!
> >
>
> > David
>
> So what's the point of looking at peak DP floating-point? That's
> not really a good measure, well, of anything. One can pack a fpga full of vector
> pipes, and get way more peak throughput than these processors, if you don't need
> reasonable memory bandwidth and control structures to go with the ALU. Granted,
> the fact that all of these are successful commercial products, indicates that
> they have all maintained some reasonable ratio of compute and their other
> functionality.
>
> Are we assessing these processors based on their
> applicability to the HPC marketplace? Not that linpack is a good benchmark, in
> fact it's a pretty terrible benchmark, but even that is better than simply
> looking at peak throughput. If we assess these processors for other
> applications, then why look at Floating-point. Almost nothing else is FPU bound.
>
>
> I guess what I'm saying is, these graphs don't really show anything of
> interest. Do they?
>

I think they do, if for nothing else than that they directly compare two approaches to the same problem, i.e. extending the CPU for vector processing or doing the same calculations in a co-processor (and this will be a major point of conflict in the HPC and gaming businesses to be decided within the next 10 years). Real-world implications to efficiency arising from I/O bandwidth, latency, branching, caching etc. are of course always relevant, but should be looked at as different problems appearing further down the pipeline in my opinion (particularly since they depend on implementation and thus on factors such as process technology, company R&D and engineering resources and skills and not just on the architectural features).

So for making a purely theoretical analysis of the base architectures and the viability of their high-level design choices, it could actually be an advantage to overlook other factors than peak DP performance. And the charts show, which I find very interesting (although not completely surprising), that the gap between CPUs and GPUs has actually narrowed since 2009, not widened (although David Kanter is of course correct in that the gap will widen again with Nvidia and AMD going to 28nm and Intel MIC going to 22nm). Any other way of looking at it would miss the fact that not only has the real-world performance gap between CPUs and GPUs shrunk (which could easily be attributed to just the difficulties of GPGPU programming models etc.), but the advantage of GPUs even in raw, peak performance has actually decreased, contrary to everything that has been predicted and promised by the GPGPU camp.

And the next step going from that is of course that if CPUs through vector extensions can deliver peak performance within a certain fraction of that of GPUs, their major advantages in thread control and OoOE will outweigh the advantage in peak performance of the GPUs. But for drawing that conclusion, I think it makes sense to first look at peak performance separately, and then take other factors which affect performance into account.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
New Article: Compute Efficiency 2012David Kanter2012/07/25 01:37 AM
  New Article: Compute Efficiency 2012SHK2012/07/25 02:31 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 02:42 AM
  New Article: Compute Efficiency 2012none2012/07/25 03:18 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 11:25 AM
  GCN (NT)EBFE2012/07/25 03:25 AM
    GCN - TFLOP DPjp2012/08/09 01:58 PM
      GCN - TFLOP DPDavid Kanter2012/08/09 03:32 PM
        GCN - TFLOP DPKevin G2012/08/11 05:22 PM
      GCN - TFLOP DPEric2012/08/09 05:12 PM
        GCN - TFLOP DPjp2012/08/10 01:23 AM
          GCN - TFLOP DPEBFE2012/08/12 08:27 PM
            GCN - TFLOP DPjp2012/08/13 02:02 AM
              GCN - TFLOP DPEBFE2012/08/13 07:45 PM
                GCN - TFLOP DPjp2012/08/14 01:21 AM
  New Article: Compute Efficiency 2012Adrian2012/07/25 04:39 AM
    New Article: Compute Efficiency 2012EBFE2012/07/25 09:33 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 11:11 AM
  New Article: Compute Efficiency 2012sf2012/07/25 06:46 AM
    New Article: Compute Efficiency 2012aaron spink2012/07/25 09:08 AM
      New Article: Compute Efficiency 2012someone2012/07/25 10:06 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 11:14 AM
      New Article: Compute Efficiency 2012EBFE2012/07/26 02:27 AM
        BG/QDavid Kanter2012/07/26 09:31 AM
          VR-ZONE KNC B0 leak, poor number?EBFE2012/08/03 01:57 AM
            VR-ZONE KNC B0 leak, poor number?Eric2012/08/03 07:59 AM
              VR-ZONE KNC B0 leak, poor number?EBFE2012/08/04 06:37 AM
                VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/04 06:51 PM
                Leaks != productsDavid Kanter2012/08/05 03:19 AM
                  Leaks != productsEBFE2012/08/06 02:49 AM
                VR-ZONE KNC B0 leak, poor number?Eric2012/08/05 10:37 AM
                  VR-ZONE KNC B0 leak, poor number?EBFE2012/08/06 03:09 AM
                    VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/06 04:33 AM
                      VR-ZONE KNC B0 leak, poor number?jp2012/08/07 03:08 AM
                        VR-ZONE KNC B0 leak, poor number?Eric2012/08/07 04:58 AM
                          VR-ZONE KNC B0 leak, poor number?jp2012/08/07 05:17 AM
                            VR-ZONE KNC B0 leak, poor number?Eric2012/08/07 05:22 AM
                              VR-ZONE KNC B0 leak, poor number?anonymou52012/08/07 09:43 AM
                            VR-ZONE KNC B0 leak, poor number?jp2012/08/07 05:23 AM
                              VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/07 07:24 AM
                        VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/07 07:20 AM
                          VR-ZONE KNC B0 leak, poor number?jp2012/08/07 11:22 AM
                            VR-ZONE KNC B0 leak, poor number?EduardoS2012/08/07 03:15 PM
                        KNC has FMADavid Kanter2012/08/07 09:17 AM
  New Article: Compute Efficiency 2012forestlaughing2012/07/25 08:51 AM
    New Article: Compute Efficiency 2012Eric2012/07/27 05:12 AM
      New Article: Compute Efficiency 2012hobold2012/07/27 11:53 AM
        New Article: Compute Efficiency 2012Eric2012/07/27 12:51 PM
          New Article: Compute Efficiency 2012hobold2012/07/27 02:48 PM
            New Article: Compute Efficiency 2012Eric2012/07/27 03:29 PM
        New Article: Compute Efficiency 2012anon2012/07/29 02:25 AM
          New Article: Compute Efficiency 2012hobold2012/07/29 11:53 AM
  Efficiency? No, lack of highly useful featuressomeone2012/07/25 09:58 AM
    Best case for GPUsDavid Kanter2012/07/25 11:28 AM
      Best case for GPUsfranzliszt2012/07/25 01:39 PM
      Best case for GPUsChuck2012/07/25 08:13 PM
        Best case for GPUsDavid Kanter2012/07/25 09:45 PM
        Best case for GPUsEric2012/07/27 05:51 AM
  Silverthorn data pointMichael S2012/07/25 02:45 PM
    Silverthorn data pointDavid Kanter2012/07/25 04:06 PM
  New Article: Compute Efficiency 2012Unununium2012/07/25 05:55 PM
    New Article: Compute Efficiency 2012EduardoS2012/07/25 08:12 PM
      Ops... I'm wrong...EduardoS2012/07/25 08:14 PM
  New Article: Compute Efficiency 2012TacoBell2012/07/25 08:36 PM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 09:49 PM
    New Article: Compute Efficiency 2012Michael S2012/07/26 02:33 AM
  Line and factorMoritz2012/07/26 01:34 AM
    Line and factorPeter Boyle2012/07/27 07:57 AM
      not entirelyMoritz2012/07/27 12:22 PM
      Line and factorEduardoS2012/07/27 05:24 PM
        Line and factorMoritz2012/07/28 12:52 PM
  tables Michael S2012/07/26 02:39 AM
  Interlagos L2+L3Rana2012/07/26 03:13 AM
    Interlagos L2+L3Rana2012/07/26 03:13 AM
    Interlagos L2+L3David Kanter2012/07/26 09:21 AM
      SP vs DP & performance metricsjp2012/07/27 07:08 AM
        SP vs DP & performance metricsEric2012/07/27 07:57 AM
          SP vs DP & performance metricsjp2012/07/27 09:18 AM
            SP vs DP & performance metricsaaron spink2012/07/27 09:36 AM
              SP vs DP & performance metricsjp2012/07/27 09:47 AM
                "Global" --> systemPaul A. Clayton2012/07/27 10:31 AM
                  "Global" --> systemjp2012/07/27 03:55 PM
                    "Global" --> systemaaron spink2012/07/27 07:33 PM
                      "Global" --> systemjp2012/07/28 02:00 AM
                        "Global" --> systemaaron spink2012/07/28 06:54 AM
                          "Global" --> systemjp2012/07/29 02:12 AM
                            "Global" --> systemaaron spink2012/07/29 05:03 AM
                              "Global" --> systemnone2012/07/29 09:05 AM
                                "Global" --> systemEduardoS2012/07/29 10:26 AM
                                "Global" --> systemjp2012/07/30 02:24 AM
                                  "Global" --> systemaaron spink2012/07/30 03:05 AM
                                "Global" --> systemaaron spink2012/07/30 03:03 AM
                                  daxpy is STREAM TRIADPaul A. Clayton2012/07/30 06:10 AM
                SP vs DP & performance metricsaaron spink2012/07/27 07:25 PM
                  SP vs DP & performance metricsEmil Briggs2012/07/28 06:40 AM
                    SP vs DP & performance metricsaaron spink2012/07/28 07:05 AM
                      SP vs DP & performance metricsjp2012/07/28 11:04 AM
                        SP vs DP & performance metricsBrett2012/07/28 03:32 PM
                      SP vs DP & performance metricsEmil Briggs2012/07/28 06:11 PM
                        SP vs DP & performance metricsanon2012/07/29 02:53 AM
                        SP vs DP & performance metricsaaron spink2012/07/29 05:39 AM
                          Coherency for discretesRohit2012/07/29 09:24 AM
                          SP vs DP & performance metricsanon2012/07/29 11:09 AM
                          SP vs DP & performance metricsEric2012/07/29 01:08 PM
        SP vs DP & performance metricsaaron spink2012/07/27 09:25 AM
  Regular updates?Joe2012/07/27 09:35 AM
  New Article: Compute Efficiency 20123092012/07/27 10:34 PM
  New Article: Compute Efficiency 2012Ingeneer2012/07/30 09:01 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/30 01:11 PM
      New Article: Compute Efficiency 2012Ingeneer2012/07/30 08:04 PM
        New Article: Compute Efficiency 2012David Kanter2012/07/30 09:32 PM
          Memory power and bandwidth?Iain McClatchie2012/08/03 04:35 PM
            Memory power and bandwidth?David Kanter2012/08/04 11:22 AM
              Memory power and bandwidth?Michael S2012/08/04 02:36 PM
              Memory power and bandwidth?Iain McClatchie2012/08/06 02:09 PM
              Memory power and bandwidth?Eric2012/08/07 06:28 PM
                WorkloadsDavid Kanter2012/08/08 10:49 AM
                  WorkloadsEric2012/08/09 05:21 PM
                Latency and bandwidth bottlenecks Paul A. Clayton2012/08/08 04:02 PM
                  Latency and bandwidth bottlenecks Eric2012/08/09 05:32 PM
                    Latency and bandwidth bottlenecks none2012/08/10 06:06 AM
                  Latency and bandwidth bottlenecks -> BDPajensen2012/08/11 03:21 PM
            Memory power and bandwidth?Ingeneer2012/08/06 11:26 AM
  NV aims for 1.8+ TFLOPS DP ?jp2012/08/11 01:21 PM
    NV aims for 1.8+ TFLOPS DP ?David Kanter2012/08/11 09:25 PM
      NV aims for 1.8+ TFLOPS DP ?jp2012/08/12 02:45 AM
      NV aims for 1.8+ TFLOPS DP ?EBFE2012/08/12 10:02 PM
        NV aims for 1.8+ TFLOPS DP ?jp2012/08/13 01:54 AM
          NV aims for 1.8+ TFLOPS DP ?Gabriele Svelto2012/08/13 09:16 AM
            NV aims for 1.8+ TFLOPS DP ?Vincent Diepeveen2012/08/14 03:04 AM
          NV aims for 1.8+ TFLOPS DP ?David Kanter2012/08/13 09:50 AM
            NV aims for 1.8+ TFLOPS DP ?jp2012/08/13 11:17 AM
        NV aims for 1.8+ TFLOPS DP ?EduardoS2012/08/13 06:45 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell green?