Public cloud infrastructure

By: anon2 (, July 18, 2022 4:25 pm
Room: Moderated Discussions
Brett ( on July 18, 2022 12:38 pm wrote:
> Ben T ( on July 16, 2022 4:50 pm wrote:
> > >> Would you say even the Last Level Cache or System Level
> > Cache should not be shared with an untrusted user?
> > >
> > > Yes, certainly. And not only that. Even memory and disks
> > > shouldn't be shared. IMHO, even SAN shouldn't be shared.
> >
> > Do people here think the ideal public cloud infrastructure would be a cluster in a box rather than a single
> > symmetric multiprocessor running virtual machines from multiple
> > users? For example, imagine a 1U chassis containing
> > 12 processor chips and 12 hot-swap 2.5” U.2 NVMe drives. Each processor chip could include:
> >
> > 8 performance CPU cores plus caches
> > interfaces to two 128-bit LPDDR DRAMs
> > 4 PCIe lanes to connect to one NVMe drive
> > a 10G ethernet connection
> >
> > If the minimum unit a cloud user could get is 8 cores, they would not be sharing this chip
> > with anyone else so the risk of data leakage between users would be greatly reduced. If
> > it is possible to combine these processor units for bigger single tasks but still keep
> > them partitionable into independent units for small tasks, that would be even better.
> A 12 socket cluster in a box is far better than doing a 12 socket unified memory system.
> Linux would be allocating memory two sockets away on the mesh and performance would go strait
> to hell. You would need a ridiculous number of PCIe channels in a mesh to try and overcome
> the bottlenecks by brute force, and pay a needless heat cost for that connect.

If a job had to allocate memory on another socket then a cluster will also be horrible. Possibly even worse. What are you even talking about? A cluster doesn't magically make inter-chip communication free. "just add a switch then communication does not matter" -- this is nonsense.

> With cluster in a box you can use desktop/laptop chips and at most add a network switch to both
> share the networking and communicate between the sockets without hitting the Ethernet.
> This is the future for 1U server boxes. But Intel and AMD have financial and competitive
> reasons to keep severs using DIMM’s and unified memory, moat maintenance reasons.
> I expect the new server entrants to copy Apple with RAM on socket over the next 2-5
> years, and only after loosing market share for Intel and AMD to release such sockets.

< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Retbleedanonymous22022/07/13 03:14 PM
  Retbleedanon22022/07/13 10:03 PM
    RetbleedAdrian2022/07/14 12:05 AM
    RetbleedAnon42022/07/14 02:17 PM
      Retbleedanon22022/07/14 04:29 PM
        RetbleedAnon42022/07/14 05:05 PM
          Retbleedanon22022/07/14 05:37 PM
            Retbleedanon22022/07/14 06:40 PM
              Retbleeddmcq2022/07/15 04:54 AM
                Retbleedanon22022/07/17 07:17 AM
              RetbleedMichael S2022/07/15 07:08 AM
                RetbleedBen T2022/07/16 05:06 AM
                  RetbleedMichael S2022/07/16 11:41 AM
                    Public cloud infrastructureBen T2022/07/16 04:50 PM
                      Public cloud infrastructureRayla2022/07/16 09:15 PM
                      Public cloud infrastructureme2022/07/17 09:19 AM
                      Public cloud infrastructureBrett2022/07/18 12:38 PM
                        Public cloud infrastructureAdrian2022/07/18 01:19 PM
                          Public cloud infrastructureme2022/07/18 03:54 PM
                          Public cloud infrastructureBrett2022/07/20 03:35 PM
                            Public cloud infrastructureBrett2022/07/21 01:18 PM
                              Public cloud infrastructureinthestratosphere2022/07/21 02:46 PM
                                Public cloud infrastructureBrett2022/07/21 10:38 PM
                                What’s needed for a viable Apple server?Ben T2022/07/22 05:31 AM
                                  What’s needed for a viable Apple server?Michael S2022/07/22 09:09 AM
                                  More DRAM capacity?Mark Roulo2022/07/22 09:48 AM
                                    More DRAM capacity?Doug S2022/07/22 11:05 AM
                                      More DRAM capacity?Mark Roulo2022/07/22 11:20 AM
                                        More DRAM capacity?Doug S2022/07/22 01:48 PM
                                    More DRAM capacity?Wes Felter2022/07/22 04:49 PM
                        Public cloud infrastructureanon22022/07/18 04:25 PM
                      Putting 12 processor packages in a 1U serverBen T2022/07/22 10:02 PM
                        Putting 12 processor packages in a 1U serverrwessel2022/07/23 07:15 AM
                        Putting 12 processor packages in a 1U serverDaniel B2022/07/23 04:15 PM
                          Putting 12 processor packages in a 1U serverBen T2022/07/24 05:29 AM
                            Multi-system cluster design spacePaul A. Clayton2022/07/24 08:49 AM
            RetbleedAnon42022/07/15 03:00 AM
          RetbleedMichael S2022/07/15 06:59 AM
      Retbleed---2022/07/15 11:14 AM
Reply to this Topic
Body: No Text
How do you spell tangerine? 🍊