Transistor count

By: Mark Roulo (nothanks.delete@this.xxx.com),
Room: Moderated Discussions
--- (---.delete@this.redheron.com) on May 14, 2024 12:14 pm wrote:
> Philip Turner on Twitter pointed out a striking fact that,
> once you see it, can help but modify your thinking.
>
> "
> Going from M1, M2, M3, M4, the transistor count has increased exactly by 4 billion per year.
> Next chip will have 32 billion, then 36, then 40. We're in the era where transistor count
> scales linearly, not exponentially. Just like clock speed when Dennard Scaling stopped.
> "
>
> He's right.
> M1 16B
> M2 20B
> M3 25B
> M4 28B
>
> This certainly gives one explanation for why Apple hasn't been able to move IPC much,
> and has pivoted (at least for these 4 chips) to alternative ways, so far... successful,
> to boost performance. I'd phrase this more in terms of linear reductions in density,
> but that's harder to present in a way that hits home like the above does.
>
> Apple is leading edge, but the way to bet is that everyone else will hit the same wall. Will be interesting
> to track this sort of metric for Intel over the next few years w/ i4, i3, A20; though it's tougher
> to agree on what counts as "the same" chip for Intel vs Apple – is there a commonly agreed upon "Intel
> Entry Level" chip that plays the role of M and is much the same from year to year?
>
> Superficially chiplets may provide a way out of this – but that depends on the full cost of chiplets, AND
> the extent to which they actually help. (Sure you CAN move the GPU to a separate chiplet and have twice the
> space for the CPU, but if you don't improve density, does that help much? You can thereby provide 2x the cores,
> but we're adults here and we care about single threaded throughput, not cinebench dick measuring).

Transistors aren't getting cheaper with process shrink. They used to get cheaper with newer processes, but they don't any more. You can put more of them in a given area, but the cost per transistor is fairly flat so 2x the density would provide 2x the transistors in the same area but also 2x the cost from TSMC.
< Previous Post in ThreadNext Post in Thread >
Thread (124 posts)
TopicPosted ByPosted
Transistor count---
  Transistor countMark Roulo
  Transistor counthobold
    Transistor countAnanon
      Transistor counthobold
  Transistor countMark Heath
    Transistor countDoug S
      Cache scalingMark Heath
        You might find AMD's V-Cache interestingMark Roulo
          You might find AMD's V-Cache interestingMark Heath
          You might find AMD's V-Cache interestingMichael S
            You might find AMD's V-Cache interestinganon2
              You might find AMD's V-Cache interestingMichael S
                You might find AMD's V-Cache interestinganon2
              You might find AMD's V-Cache interestingBrett
                You might find AMD's V-Cache interestingMichael S
                  You might find AMD's V-Cache interestingBrett
                  Xeon CPU Max has 64 GB of HBM that can act as L4 cacheMark Heath
                    Xeon CPU Max has 64 GB of HBM that can act as L4 cacheSimon Farnsworth
                      Xeon CPU Max has 64 GB of HBM that can act as L4 cacheMark Heath
                        Xeon CPU Max has 64 GB of HBM that can act as L4 cacheSimon Farnsworth
                          Xeon CPU Max has 64 GB of HBM that can act as L4 cacheMark Heath
                          HBM used as a cache for operating system pages on LinuxMark Heath
                            HBM used as a cache for operating system pages on LinuxSimon Farnsworth
                              HBM used as a cache for operating system pages on LinuxMark Heath
                                HBM used as a cache for operating system pages on LinuxSimon Farnsworth
                  Off-chip cache design spacePaul A. Clayton
                    Off-chip cache design spaceMark Heath
                    Off-chip cache design spaceSimon Farnsworth
                      Off-chip cache design spaceLinus Torvalds
                        Off-chip cache design spaceanon
                          Off-chip cache design spaceLinus Torvalds
                      Off-chip cache design spacePaul A. Clayton
      Transistor countanon2
    Transistor count---
      Exponential growth looks linear over a short time windowMark Heath
        Exponential growth looks linear over a short time windowhobold
          Exponential growth looks linear over a short time windowDoug S
            energy overhead: dependencieshobold
              energy overhead: dependenciesBrett
                energy overhead: dependencieshobold
          Exponential growth looks linear over a short time windowMark Heath
            Exponential growth looks linear over a short time windowhobold
        Exponential growth looks linear over a short time window---
          Exponential growth looks linear over a short time windowMark Heath
            Exponential growth looks linear over a short time windowhobold
        Exponential growth looks linear over a short time windowLinus Torvalds
          Exponential growth looks linear over a short time windowMark Heath
            Exponential growth looks linear over a short time windowMark Roulo
              Exponential growth looks linear over a short time windowMark Heath
                Exponential growth looks linear over a short time windowMichael S
            Exponential growth looks linear over a short time windowLinus Torvalds
              Exponential growth looks linear over a short time windowanonymou5
              Exponential growth looks linear over a short time window
                Exponential growth looks linear over a short time windowBrett
                  Exponential growth looks linear over a short time window
                    Robot chefs---
                      Chef > cook > food preparer/assemblerPaul A. Clayton
                      Robot chefs
                Exponential growth looks linear over a short time windowLinus Torvalds
                  Exponential growth looks linear over a short time windowSeni
                    Exponential growth looks linear over a short time windowLinus Torvalds
                      Exponential growth looks linear over a short time windowSeni
                      Human-level AGI => singularity ?Mark Heath
                        Human-level AGI => singularity ?Doug S
                          Human-level AGI => singularity ?
                        Human-level AGI => singularity ?---
                          Human-level AGI => singularity ?Mark Heath
                            Human-level AGI => singularity ?---
                              Superhuman AGI is not "more of the same"Mark Heath
                          Human-level AGI => singularity ?Simon Farnsworth
                            Human-level AGI => singularity ?Michael S
                              Human-level AGI => singularity ?Michael S
                              Human-level AGI => singularity ?dmcq
                              Human-level AGI => singularity ?Anne O. Nymous
                            Human-level AGI => singularity ?Doug S
                              Human-level AGI => singularity ?Mark Heath
                                Human-level AGI => singularity ?---
                                  Human-level AGI => singularity ?Mark Heath
                                Human-level AGI => singularity ?Doug S
                                  Human-level AGI => singularity ?Mark Heath
                                  Facebook's future use of AGIChristopher V.
                                    Facebook's future use of AGIAndrew M
                      Exponential growth looks linear over a short time windowdmcq
                        Large language model lieBrett
                          Large language model lie---
                            Automated scienceMark Heath
                              Automated science---
                          Large language model lieChristopher V.
                            Large language model lie---
                        Exponential growth looks linear over a short time window---
                          Exponential growth looks linear over a short time windowdmcq
                  Exponential growth looks linear over a short time window
                    Exponential growth looks linear over a short time windowEtienne
                Cryptocurrencies are an internet-powered tulip maniaChristopher V.
              Logistic growth looks exponential before its inflection pointTim Etler
            Exponential growth looks linear over a short time windowDoug S
        We aren't getting half a dozen viable competitors in each technologyMark Roulo
          We aren't getting half a dozen viable competitors in each technologyMark Heath
            We aren't getting half a dozen viable competitors in each technologyanonymou5
            We aren't getting half a dozen viable competitors in each technologyBrett
              We aren't getting half a dozen viable competitors in each technologyDoug S
                We aren't getting half a dozen viable competitors in each technologyBrett
                  We aren't getting half a dozen viable competitors in each technologyBjörn Ragnar Björnsson
                    We aren't getting half a dozen viable competitors in each technologyBrett
                      We aren't getting half a dozen viable competitors in each technologyBjörn Ragnar Björnsson
                        We aren't getting half a dozen viable competitors in each technologyBrett
                          We aren't getting half a dozen viable competitors in each technologyRobert Wessel
                            We aren't getting half a dozen viable competitors in each technologyBrett
                              We aren't getting half a dozen viable competitors in each technologyRobert Wessel
                          We aren't getting half a dozen viable competitors in each technologyBjörn Ragnar Björnsson
                            We aren't getting half a dozen viable competitors in each technologyBrett
                          We aren't getting half a dozen viable competitors in each technologyDoug S
                            We aren't getting half a dozen viable competitors in each technologyBrett
                              We aren't getting half a dozen viable competitors in each technologyDoug S
                                We aren't getting half a dozen viable competitors in each technologyBrett
                                  We aren't getting half a dozen viable competitors in each technologydmcq
              We aren't getting half a dozen viable competitors in each technologyEtienne
                Conductive Ink CPUBrett
                We aren't getting half a dozen viable competitors in each technologydmcq
              We aren't getting half a dozen viable competitors in each technologyBrett
            population is the only major solutionc
        Exponential growth looks linear over a short time window
  Transistor countMichael S