Intel is bringing HBM to CPUs after all

By: Michael S (already5chosen.delete@this.yahoo.com), November 4, 2020 12:45 am
Room: Moderated Discussions
Robert Williams (crispysilicon.delete@this.gmail.com) on November 3, 2020 8:47 am wrote:
> Paul (pavel.delete@this.noa-labs.com) on November 3, 2020 1:51 am wrote:
> > Intel Sapphire Rapids: MCM Design, 56 Golden Cove Cores, 64GB HBM2 On-Board Memory
> >
> >
The Saphhire Rapids CPUs will contain 4 HBM2 stacks with a maximum memory of 64 GB (16GB each). The total
> > bandwidth from these stacks will be 1 TB/s. According to Matthew's source, HBM2 and GDDR5 will be able to
> > work together in flat, caching/2LM and hybrid modes. The
> > presence of memory so near to the die would do absolute
> > wonders for certain workloads that require huge data sets and will basically act as an L4 cache.

> >
> >
> >
>
> Crystal Well on HBM, delicious.
>
> Also excited for the DDR5 and CXL.

Crystal Well had both latency and bandwidth advantages.
HBM is only bandwidth and most likely it would be rare that CPU cores will be able to take advantage of extra bandwidth. For a single core or a few cores most likely there would be no measurable improvement at all.

IMHO, it is intended mostly for big supercomputers that would have HBM as the main memory, with no traditional DDR at all. 64 GB per 56 cores is tiny for normal server workloads, but sufficient for at least part of supercomputer.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Intel is bringing HBM to CPUs after allPaul2020/11/03 01:51 AM
  Intel is bringing HBM to CPUs after allAnon2020/11/03 02:40 AM
    Intel is bringing HBM to CPUs after allGroo2020/11/03 08:53 AM
      Intel is bringing HBM to CPUs after allJacob Marley2020/11/03 11:16 PM
  Intel is bringing HBM to CPUs after allRobert Williams2020/11/03 08:47 AM
    Intel is bringing HBM to CPUs after allMichael S2020/11/04 12:45 AM
      Intel is bringing HBM to CPUs after allFoo_2020/11/04 03:24 AM
        Intel is bringing HBM to CPUs after alltarlinian2020/11/04 07:09 AM
          Intel is bringing HBM to CPUs after allanonymou52020/11/04 04:55 PM
          Intel is bringing HBM to CPUs after allDavid Kanter2020/11/04 06:44 PM
            Intel is bringing HBM to CPUs after allJacob Marley2020/11/04 11:02 PM
      Intel is bringing HBM to CPUs after allwumpus2020/11/04 08:35 AM
      Intel is bringing HBM to CPUs after allRobert Williams2020/11/21 04:46 PM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell avocado?