SP vs DP & performance metrics

Article: Computational Efficiency for CPUs and GPUs in 2012
By: Emil Briggs (me.delete@this.nowherespam.com), July 28, 2012 6:40 am
Room: Moderated Discussions
aaron spink (aaronspink.delete@this.notearthlink.net) on July 27, 2012 7:25 pm wrote:


>
> PRACE data. ORNL data. In many cases in real
> world workloads, it cannot even maintain perf/w parity with equiv CPUs. TTS is
> horrid because of the fragmented and complex programming model.
>
> Here's
> reality: GPUs struggle to hit 50% efficiency in LINPACK. LINPACK!
>

By ORNL do you mean Oak Ridge National Laboratory? I ask since I am a large user at ORNL. Currently only some of the Jaguar/Titan nodes are equipped with GPU's but there are enough of them installed to do realistic evaluations. For certain workloads (and when properly programmed) they beat CPU's pretty handily performance wise. And that data comes from a real world application not LINPACK. The section of the code that I adapted for GPU's runs 3 to 4 times faster than it does on CPU's. It's also possible with this particular application to overlap some operations on the CPU and GPU and hide the latency of PCI-E data transfers. Obviously not all applications can benefit in the same way and it's not easy to do so even when possible but GPU's can offer some very nice performance gains in some cases.

That being said I do think that the cost of moving data across the PCI-E bus and the difficulty of the programming model are some real downsides to GPU's. How all that plays out will be interesting and I'm looking forward to getting my hands on some Intel MIC hardware to see what we can do with it.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
New Article: Compute Efficiency 2012David Kanter2012/07/25 01:37 AM
  New Article: Compute Efficiency 2012SHK2012/07/25 02:31 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 02:42 AM
  New Article: Compute Efficiency 2012none2012/07/25 03:18 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 11:25 AM
  GCN (NT)EBFE2012/07/25 03:25 AM
    GCN - TFLOP DPjp2012/08/09 01:58 PM
      GCN - TFLOP DPDavid Kanter2012/08/09 03:32 PM
        GCN - TFLOP DPKevin G2012/08/11 05:22 PM
      GCN - TFLOP DPEric2012/08/09 05:12 PM
        GCN - TFLOP DPjp2012/08/10 01:23 AM
          GCN - TFLOP DPEBFE2012/08/12 08:27 PM
            GCN - TFLOP DPjp2012/08/13 02:02 AM
              GCN - TFLOP DPEBFE2012/08/13 07:45 PM
                GCN - TFLOP DPjp2012/08/14 01:21 AM
  New Article: Compute Efficiency 2012Adrian2012/07/25 04:39 AM
    New Article: Compute Efficiency 2012EBFE2012/07/25 09:33 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 11:11 AM
  New Article: Compute Efficiency 2012sf2012/07/25 06:46 AM
    New Article: Compute Efficiency 2012aaron spink2012/07/25 09:08 AM
      New Article: Compute Efficiency 2012someone2012/07/25 10:06 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 11:14 AM
      New Article: Compute Efficiency 2012EBFE2012/07/26 02:27 AM
        BG/QDavid Kanter2012/07/26 09:31 AM
          VR-ZONE KNC B0 leak, poor number?EBFE2012/08/03 01:57 AM
            VR-ZONE KNC B0 leak, poor number?Eric2012/08/03 07:59 AM
              VR-ZONE KNC B0 leak, poor number?EBFE2012/08/04 06:37 AM
                VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/04 06:51 PM
                Leaks != productsDavid Kanter2012/08/05 03:19 AM
                  Leaks != productsEBFE2012/08/06 02:49 AM
                VR-ZONE KNC B0 leak, poor number?Eric2012/08/05 10:37 AM
                  VR-ZONE KNC B0 leak, poor number?EBFE2012/08/06 03:09 AM
                    VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/06 04:33 AM
                      VR-ZONE KNC B0 leak, poor number?jp2012/08/07 03:08 AM
                        VR-ZONE KNC B0 leak, poor number?Eric2012/08/07 04:58 AM
                          VR-ZONE KNC B0 leak, poor number?jp2012/08/07 05:17 AM
                            VR-ZONE KNC B0 leak, poor number?Eric2012/08/07 05:22 AM
                              VR-ZONE KNC B0 leak, poor number?anonymou52012/08/07 09:43 AM
                            VR-ZONE KNC B0 leak, poor number?jp2012/08/07 05:23 AM
                              VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/07 07:24 AM
                        VR-ZONE KNC B0 leak, poor number?aaron spink2012/08/07 07:20 AM
                          VR-ZONE KNC B0 leak, poor number?jp2012/08/07 11:22 AM
                            VR-ZONE KNC B0 leak, poor number?EduardoS2012/08/07 03:15 PM
                        KNC has FMADavid Kanter2012/08/07 09:17 AM
  New Article: Compute Efficiency 2012forestlaughing2012/07/25 08:51 AM
    New Article: Compute Efficiency 2012Eric2012/07/27 05:12 AM
      New Article: Compute Efficiency 2012hobold2012/07/27 11:53 AM
        New Article: Compute Efficiency 2012Eric2012/07/27 12:51 PM
          New Article: Compute Efficiency 2012hobold2012/07/27 02:48 PM
            New Article: Compute Efficiency 2012Eric2012/07/27 03:29 PM
        New Article: Compute Efficiency 2012anon2012/07/29 02:25 AM
          New Article: Compute Efficiency 2012hobold2012/07/29 11:53 AM
  Efficiency? No, lack of highly useful featuressomeone2012/07/25 09:58 AM
    Best case for GPUsDavid Kanter2012/07/25 11:28 AM
      Best case for GPUsfranzliszt2012/07/25 01:39 PM
      Best case for GPUsChuck2012/07/25 08:13 PM
        Best case for GPUsDavid Kanter2012/07/25 09:45 PM
        Best case for GPUsEric2012/07/27 05:51 AM
  Silverthorn data pointMichael S2012/07/25 02:45 PM
    Silverthorn data pointDavid Kanter2012/07/25 04:06 PM
  New Article: Compute Efficiency 2012Unununium2012/07/25 05:55 PM
    New Article: Compute Efficiency 2012EduardoS2012/07/25 08:12 PM
      Ops... I'm wrong...EduardoS2012/07/25 08:14 PM
  New Article: Compute Efficiency 2012TacoBell2012/07/25 08:36 PM
    New Article: Compute Efficiency 2012David Kanter2012/07/25 09:49 PM
    New Article: Compute Efficiency 2012Michael S2012/07/26 02:33 AM
  Line and factorMoritz2012/07/26 01:34 AM
    Line and factorPeter Boyle2012/07/27 07:57 AM
      not entirelyMoritz2012/07/27 12:22 PM
      Line and factorEduardoS2012/07/27 05:24 PM
        Line and factorMoritz2012/07/28 12:52 PM
  tables Michael S2012/07/26 02:39 AM
  Interlagos L2+L3Rana2012/07/26 03:13 AM
    Interlagos L2+L3Rana2012/07/26 03:13 AM
    Interlagos L2+L3David Kanter2012/07/26 09:21 AM
      SP vs DP & performance metricsjp2012/07/27 07:08 AM
        SP vs DP & performance metricsEric2012/07/27 07:57 AM
          SP vs DP & performance metricsjp2012/07/27 09:18 AM
            SP vs DP & performance metricsaaron spink2012/07/27 09:36 AM
              SP vs DP & performance metricsjp2012/07/27 09:47 AM
                "Global" --> systemPaul A. Clayton2012/07/27 10:31 AM
                  "Global" --> systemjp2012/07/27 03:55 PM
                    "Global" --> systemaaron spink2012/07/27 07:33 PM
                      "Global" --> systemjp2012/07/28 02:00 AM
                        "Global" --> systemaaron spink2012/07/28 06:54 AM
                          "Global" --> systemjp2012/07/29 02:12 AM
                            "Global" --> systemaaron spink2012/07/29 05:03 AM
                              "Global" --> systemnone2012/07/29 09:05 AM
                                "Global" --> systemEduardoS2012/07/29 10:26 AM
                                "Global" --> systemjp2012/07/30 02:24 AM
                                  "Global" --> systemaaron spink2012/07/30 03:05 AM
                                "Global" --> systemaaron spink2012/07/30 03:03 AM
                                  daxpy is STREAM TRIADPaul A. Clayton2012/07/30 06:10 AM
                SP vs DP & performance metricsaaron spink2012/07/27 07:25 PM
                  SP vs DP & performance metricsEmil Briggs2012/07/28 06:40 AM
                    SP vs DP & performance metricsaaron spink2012/07/28 07:05 AM
                      SP vs DP & performance metricsjp2012/07/28 11:04 AM
                        SP vs DP & performance metricsBrett2012/07/28 03:32 PM
                      SP vs DP & performance metricsEmil Briggs2012/07/28 06:11 PM
                        SP vs DP & performance metricsanon2012/07/29 02:53 AM
                        SP vs DP & performance metricsaaron spink2012/07/29 05:39 AM
                          Coherency for discretesRohit2012/07/29 09:24 AM
                          SP vs DP & performance metricsanon2012/07/29 11:09 AM
                          SP vs DP & performance metricsEric2012/07/29 01:08 PM
        SP vs DP & performance metricsaaron spink2012/07/27 09:25 AM
  Regular updates?Joe2012/07/27 09:35 AM
  New Article: Compute Efficiency 20123092012/07/27 10:34 PM
  New Article: Compute Efficiency 2012Ingeneer2012/07/30 09:01 AM
    New Article: Compute Efficiency 2012David Kanter2012/07/30 01:11 PM
      New Article: Compute Efficiency 2012Ingeneer2012/07/30 08:04 PM
        New Article: Compute Efficiency 2012David Kanter2012/07/30 09:32 PM
          Memory power and bandwidth?Iain McClatchie2012/08/03 04:35 PM
            Memory power and bandwidth?David Kanter2012/08/04 11:22 AM
              Memory power and bandwidth?Michael S2012/08/04 02:36 PM
              Memory power and bandwidth?Iain McClatchie2012/08/06 02:09 PM
              Memory power and bandwidth?Eric2012/08/07 06:28 PM
                WorkloadsDavid Kanter2012/08/08 10:49 AM
                  WorkloadsEric2012/08/09 05:21 PM
                Latency and bandwidth bottlenecks Paul A. Clayton2012/08/08 04:02 PM
                  Latency and bandwidth bottlenecks Eric2012/08/09 05:32 PM
                    Latency and bandwidth bottlenecks none2012/08/10 06:06 AM
                  Latency and bandwidth bottlenecks -> BDPajensen2012/08/11 03:21 PM
            Memory power and bandwidth?Ingeneer2012/08/06 11:26 AM
  NV aims for 1.8+ TFLOPS DP ?jp2012/08/11 01:21 PM
    NV aims for 1.8+ TFLOPS DP ?David Kanter2012/08/11 09:25 PM
      NV aims for 1.8+ TFLOPS DP ?jp2012/08/12 02:45 AM
      NV aims for 1.8+ TFLOPS DP ?EBFE2012/08/12 10:02 PM
        NV aims for 1.8+ TFLOPS DP ?jp2012/08/13 01:54 AM
          NV aims for 1.8+ TFLOPS DP ?Gabriele Svelto2012/08/13 09:16 AM
            NV aims for 1.8+ TFLOPS DP ?Vincent Diepeveen2012/08/14 03:04 AM
          NV aims for 1.8+ TFLOPS DP ?David Kanter2012/08/13 09:50 AM
            NV aims for 1.8+ TFLOPS DP ?jp2012/08/13 11:17 AM
        NV aims for 1.8+ TFLOPS DP ?EduardoS2012/08/13 06:45 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell green?