Heterogeneous GPUs

Article: Impressions of Kepler
By: Gary M. (gary83.delete@this.yahoo.com), April 6, 2012 4:35 pm
Room: Moderated Discussions
Oscar Eddington (oscare@gmail.com) on 3/28/12 wrote:
> If Nvidia's graphics and compute products diverge
> as explained in this article, doesn't that make
> it difficult to use both a graphics card and a
> tesla card in a workstation for compute?

It will be nearly impossible to keep both a graphics card and a Tesla card running at full speed if these cards have different capabilities. It is too difficult to do load balancing across chips with different capabilities. Nvidia's strategy to diverge their graphics and compute products seems similar to the transition from heterogeneous pixel shaders and vertex shaders to unified shaders except it's going in the opposite direction.

Some amount of bandwidth per flop to shared data is certainly needed for GPU computing but I don't see how Mr. Kanter concludes or has the impression that 1 byte/flop is enough (Fermi) but .33 bytes/flop is not enough (Kepler). What is the basis for this conclusion/impression?

It seems to me that a key strength of Nvidia's Tesla line was that the same software that ran on Tesla also ran on Nvidia's graphics cards. Perhaps Nvidia realized that "dusty deck" Fortran code that uses double precision is better suited to Intel's MIC and Nvidia is going to focus on new codes designed to use mostly single precision. On the other hand, Intel's MIC is starting to smell like another Itanic fiasco. Intel is already saying "We know the performance of our current MIC chip stinks but just wait until our next version comes out." This is exactly what Intel said about each generation of their Itanic microprocessor.

I don't understand why vidia scrapped ECC (Error Correction Code). ECC for on-chip memory takes under 5% of total chip area since only a fraction of GPU chip area is memory. Giving programmers the option to use ECC for DRAM (in exchange for DRAM space) costs next to nothing in GPU chip area. If the Quadro cards based on Kepler don't have ECC, I think Nvidia made a big mistake. Intel's MIC has ECC.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
First impressions of Nvidia's KeplerDavid Kanter2012/03/22 06:00 PM
  First impressions of Nvidia's Keplerfellix2012/03/23 01:25 AM
  First impressions of Nvidia's KeplerMike2012/03/23 08:24 AM
    First impressions of Nvidia's KeplerDavid Kanter2012/03/23 09:02 AM
      First impressions of Nvidia's KeplerMike2012/03/23 09:34 AM
        First impressions of Nvidia's KeplerDavid Kanter2012/03/23 12:15 PM
      First impressions of Nvidia's Kepleranon2012/03/23 11:37 AM
        I use ALUsMark Roulo2012/03/23 12:59 PM
          I use ALUsanon2012/03/23 02:07 PM
            I use ALUsMark Roulo2012/03/23 03:12 PM
              I use ALUsanon2012/03/23 04:08 PM
        Makes no sense...EduardoS2012/03/23 05:30 PM
          Makes no sense...anon2012/03/23 06:14 PM
            Makes no sense...David Kanter2012/03/25 10:45 AM
          Makes no sense...fellix2012/03/24 05:41 AM
  Comparing against the 560Cat2012/03/26 08:51 AM
    Comparing against the 560David Kanter2012/03/26 09:24 AM
  Shuffle InstructionMartin2012/03/27 06:17 AM
    Shuffle InstructionDavid Kanter2012/03/27 08:47 AM
      Shuffle InstructionMartin2012/03/27 10:52 AM
        .msi unarchiver?hobold2012/03/28 10:20 AM
          .msi unarchiver?Joe2012/03/28 12:55 PM
          .msi unarchiver?Martin2012/03/29 12:53 AM
      Shuffle InstructionRohit2012/03/27 12:04 PM
  Workgroups vs. warps/wavefrontsAndrew McDonald2012/03/28 02:31 PM
    Workgroups vs. warps/wavefrontsDavid Kanter2012/03/28 03:14 PM
      Workgroups vs. warps/wavefrontsRohit2012/03/28 08:53 PM
        Workgroups vs. warps/wavefrontsLee Howes2012/03/29 06:38 AM
          ThreadsDavid Kanter2012/04/09 11:36 AM
    Fixed (NT)David Kanter2012/04/09 11:37 AM
  Heterogeneous GPUsOscar Eddington2012/03/28 07:41 PM
    Heterogeneous GPUsGary M.2012/04/06 04:35 PM
      Different shader coresDavid Kanter2012/04/09 11:29 AM
        Different shader coresTom2012/04/11 02:36 PM
          Nope...David Kanter2012/04/12 01:10 AM
            Nope...Tom2012/04/13 03:58 PM
              Nope...David Kanter2012/04/14 12:24 PM
                Load balancing between Tesla and graphics boardsTom2012/04/15 06:11 PM
                  Load balancing between Tesla and graphics boardsDavid Kanter2012/04/15 10:11 PM
                    Load balancing between Tesla and graphics boardsAnon2012/04/16 05:05 PM
  Why isn't AMD hardware used for GPU computing?Richard G.2012/04/03 07:39 PM
    Why isn't AMD hardware used for GPU computing?anon2012/04/04 03:11 AM
      Why isn't AMD hardware used for GPU computing?Soupdragon2012/04/04 05:24 AM
        Why isn't AMD hardware used for GPU computing?Groo2012/04/04 08:41 AM
      Why isn't AMD hardware used for GPU computing?Michael S2012/04/04 06:24 AM
      Why isn't AMD hardware used for GPU computing?Alexko2012/04/04 08:43 AM
        Why isn't AMD hardware used for GPU computing?EduardoS2012/04/04 03:37 PM
          Why isn't AMD hardware used for GPU computing?David Kanter2012/04/09 02:51 PM
    Why isn't AMD hardware used for GPU computing?Ricardo B2012/04/04 12:57 PM
    Why isn't AMD hardware used for GPU computing?Tom2012/04/04 05:36 PM
      Why isn't AMD hardware used for GPU computing?Brett2012/04/04 06:55 PM
      Why isn't AMD hardware used for GPU computing?David Kanter2012/04/09 02:55 PM
  Predictions about KeplerRussell Baker2012/04/18 02:09 PM
    Predictions about Kepler01000102012/04/18 03:14 PM
      Predictions about KeplerEduardoS2012/04/18 03:38 PM
        Predictions about KeplerAnon2012/04/18 08:48 PM
          Predictions about KeplerEduardoS2012/04/19 03:03 PM
            Predictions about KeplerMeeps2012/04/19 03:39 PM
      Predictions about KeplerJohn P.2012/04/18 06:13 PM
      Predictions about KeplerFoo_2012/04/19 12:15 PM
        Predictions about KeplerEduardoS2012/04/19 03:07 PM
    Predictions about KeplerGroo2012/04/19 09:13 AM
      Predictions about Kepleranon2012/04/19 03:26 PM
        Predictions about KeplerGroo2012/04/20 08:01 AM
    Predictions about KeplerAlex L.2012/04/20 03:41 PM
      Predictions about KeplerAnon2012/04/21 09:34 AM
        Predictions about Keplermpx2012/04/21 11:23 PM
          Predictions about Keplerac2012/04/22 01:49 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell tangerine? 🍊