Some info about the Amazon Graviton 3

By: --- (---.delete@this.redheron.com), December 3, 2021 10:03 am
Room: Moderated Discussions
Kara (karaardalan.delete@this.gmail.com) on December 3, 2021 6:01 am wrote:
> Adrian (a.delete@this.acm.org) on December 3, 2021 5:51 am wrote:
> >
> > https://www.nextplatform.com/2021/12/02/aws-goes-wide-and-deep-with-graviton3-server-chip/
> >
> >
>
> L2pc and L3pc same size? Why do companies do this? Is there any Perf benefit I don't know of?
>
> Sounds like a waste of SRAM and cycles

L2 and L3 solve (or at least can solve) different problems.
Of course if they are forced inclusive equal sizes is dumb. But no-ones forcing inclusion.
Look at Apple for a very different philosophy for how to do this.
I bring up Apple because the fact of the DRAM controllers on a separate die (on non-trivial size) hints that AMZ may be doing something similar.

- Apple's SLC/LLC/LC (call it what you will) is essentially a cache IN FRONT OF DRAM rather than a cache on top of L2.

- It is best thought of as part of a massive memory controller, and as part of the memory controller can be used by the memory controller as optimal. For example, rather than having small write queues, the memory controller can flush altered lines out to DRAM on an optimal schedule whenever read and refresh aren't busy.

- As part of the memory controller all DMA hits the SLC automatically (and can sit there, no power cost of write to RAM) if it will be used soon.(This is orthogonal to DDIO in the case of DMA controllers that, for whatever reason, don't want to or can't write to L2 or L1.)

- It acts as a coherence point, and by having extra tags that cover the L2s, is not forced to inclusive, exclusive, or anything else, just the lines play out as they will fighting amongst each other.

Also all indications are this is a V1 part not an N2 part.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Some info about the Amazon Graviton 3Adrian2021/12/03 06:51 AM
  Some info about the Amazon Graviton 3Kara2021/12/03 07:01 AM
    Some info about the Amazon Graviton 3---2021/12/03 10:03 AM
      Some info about the Amazon Graviton 3Kara2021/12/03 10:45 AM
  Some info about the Amazon Graviton 3Kara2021/12/03 07:05 AM
    Some info about the Amazon Graviton 3none2021/12/03 07:19 AM
      Some info about the Amazon Graviton 3Kara2021/12/03 07:36 AM
        N2, or V1? Anon2021/12/03 07:52 AM
          N2, or V1? Adrian2021/12/03 09:47 AM
            N2, or V1? Adrian2021/12/03 09:52 AM
              N2, or V1? G2021/12/03 10:25 AM
                N2, or V1? Adrian2021/12/03 11:51 AM
                  N2, or V1? Wilco2021/12/03 02:58 PM
                    N2, or V1? Adrian2021/12/04 03:33 AM
                      N2, or V1? -.-2021/12/04 04:37 AM
                      N2, or V1? Rayla2021/12/04 02:20 PM
                        N2, or V1? Adrian2021/12/05 01:15 AM
                          N2, or V1? dmcq2021/12/05 02:43 AM
                            N2, or V1? Adrian2021/12/05 03:54 AM
                              N2, or V1? ---2021/12/05 11:45 AM
                                N2, or V1? Adrian2021/12/05 01:07 PM
                                  Other (minor) power factors?Paul A. Clayton2021/12/06 07:37 AM
                    N2, or V1? Anon2021/12/04 10:53 PM
                      N2, or V1? Andrei F2021/12/05 04:22 AM
                Only 4 ALUsJörn Engel2021/12/03 07:37 PM
                  Only 4 ALUsWilco2021/12/04 09:54 AM
          N2, or V1? -.-2022/05/24 06:34 AM
            Graviton3 on Chip &CheesePer Hesselgren2022/06/17 06:19 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell avocado?