Article: Intel’s Plans for 3DXP DIMMs Emerge
By: Michael S (already5chosen.delete@this.yahoo.com), December 1, 2018 8:56 am
Room: Moderated Discussions
Howard Chu (hyc.delete@this.symas.com) on December 1, 2018 5:23 am wrote:
> David Kanter (dkanter.delete@this.realworldtech.com) on July 23, 2018 9:02 am wrote:
> > In honor of our anniversary, I have a new article on Intel's 3DXP DIMMs:
> >
> > Intel will offer 3DXP-based DIMMs (previously codenamed Apache
> > Pass) that use the DDR4 interface on the next-generation
> > Cascade Lake server processor. The first DIMMs will be available in 128GB, 256GB, and 512GB capacities and
> > work with a new software architecture for persistent memory.
> > Intel and its partners have enabled the new persistent
> > memory programming model for Java, Linux, VMware, and Windows and many customers are eagerly awaiting the
> > non-volatile, high-capacity memory for in-memory databases and other applications.
> >
> > I also point out many of the areas Intel has been less than forthcoming,
> > particularly around security and serviceability.
> >
> > As always - comments, questions, and feedback are appreciated.
> >
> > David
>
> I've spent several weeks working with Intel to benchmark LMDB on Optane DIMMs, starting this
> past July. Unfortunately, we still don't have permission to discuss performance results. (But
> you can check out our results on Optane SSDs here http://www.lmdb.tech/bench/optanessd/ )
>
> Some comments and bragging though:
> LMDB Lightning Memory-Mapped DB works out of the box with all operating modes
> of Optane DIMMs. Whether using the DIMMs configured as a raw block device, or
> using regular file access through a filesystem, with or without DAX. All of
> these modes were tested and It Just Works.
>
> But, presenting Optane DIMMs as separate storage is not sensible, and IMO all
> the work done at SNIA to create their PMDK (which we don't use) was wasted
> effort.
>
> It is a fact of computing that the size of work always grows to exceed the
> available space. Even with 512GB NVDIMMs and terabytes of addressable
> "RAM". What SNIA has done is allow people to use NVDIMMs as RAMdisks. Hello,
> RAMdisks went out of style in the late 1980s, for good reasons. Primarily
> because they require users to explicitly decide what portions of their data
> to move onto RAMdisks, forcing them to leave other portions of their data
> still on slower storage. The only sensible way to use finite RAM is as a cache
> for (nearly) infinite secondary storage. And a cache should operate invisibly,
> so there should be no need for special APIs like PMDK.
>
> Personally I don't believe Optane DIMMs are going to replace DRAM, but tech
> like STT-MRAM has a good shot, if they ever reach parity to DRAM density.
I don't quite get it. Why parity is enough? Doesn't new tech has to be at least 1.5x to 2x denser in order to get a shot at replacement of old tech? Especially something like MRAM that seems to get an inherent disadvantage in write energy.
Or do you consider non-volatility an advantage?
I used to think about non-volatility as minor disadvantage, but in lights of all those new security threats around I am starting to think that may be disadvantage is not so minor.
> So
> we shouldn't be building software systems around the notion of mixed RAM/NVRAM
> memory maps. We should assume that eventually we're going to have machines
> with 100% NVRAM, and design accordingly. That means you want a kernel whose
> pagecache manager knows how to reuse the hot contents of NVRAM after a reboot.
> That's all you need, the rest of user space can go on without changing a single
> line of code.
>
> David Kanter (dkanter.delete@this.realworldtech.com) on July 23, 2018 9:02 am wrote:
> > In honor of our anniversary, I have a new article on Intel's 3DXP DIMMs:
> >
> > Intel will offer 3DXP-based DIMMs (previously codenamed Apache
> > Pass) that use the DDR4 interface on the next-generation
> > Cascade Lake server processor. The first DIMMs will be available in 128GB, 256GB, and 512GB capacities and
> > work with a new software architecture for persistent memory.
> > Intel and its partners have enabled the new persistent
> > memory programming model for Java, Linux, VMware, and Windows and many customers are eagerly awaiting the
> > non-volatile, high-capacity memory for in-memory databases and other applications.
> >
> > I also point out many of the areas Intel has been less than forthcoming,
> > particularly around security and serviceability.
> >
> > As always - comments, questions, and feedback are appreciated.
> >
> > David
>
> I've spent several weeks working with Intel to benchmark LMDB on Optane DIMMs, starting this
> past July. Unfortunately, we still don't have permission to discuss performance results. (But
> you can check out our results on Optane SSDs here http://www.lmdb.tech/bench/optanessd/ )
>
> Some comments and bragging though:
> LMDB Lightning Memory-Mapped DB works out of the box with all operating modes
> of Optane DIMMs. Whether using the DIMMs configured as a raw block device, or
> using regular file access through a filesystem, with or without DAX. All of
> these modes were tested and It Just Works.
>
> But, presenting Optane DIMMs as separate storage is not sensible, and IMO all
> the work done at SNIA to create their PMDK (which we don't use) was wasted
> effort.
>
> It is a fact of computing that the size of work always grows to exceed the
> available space. Even with 512GB NVDIMMs and terabytes of addressable
> "RAM". What SNIA has done is allow people to use NVDIMMs as RAMdisks. Hello,
> RAMdisks went out of style in the late 1980s, for good reasons. Primarily
> because they require users to explicitly decide what portions of their data
> to move onto RAMdisks, forcing them to leave other portions of their data
> still on slower storage. The only sensible way to use finite RAM is as a cache
> for (nearly) infinite secondary storage. And a cache should operate invisibly,
> so there should be no need for special APIs like PMDK.
>
> Personally I don't believe Optane DIMMs are going to replace DRAM, but tech
> like STT-MRAM has a good shot, if they ever reach parity to DRAM density.
I don't quite get it. Why parity is enough? Doesn't new tech has to be at least 1.5x to 2x denser in order to get a shot at replacement of old tech? Especially something like MRAM that seems to get an inherent disadvantage in write energy.
Or do you consider non-volatility an advantage?
I used to think about non-volatility as minor disadvantage, but in lights of all those new security threats around I am starting to think that may be disadvantage is not so minor.
> So
> we shouldn't be building software systems around the notion of mixed RAM/NVRAM
> memory maps. We should assume that eventually we're going to have machines
> with 100% NVRAM, and design accordingly. That means you want a kernel whose
> pagecache manager knows how to reuse the hot contents of NVRAM after a reboot.
> That's all you need, the rest of user space can go on without changing a single
> line of code.
>
Topic | Posted By | Date |
---|---|---|
New article on Intel's 3DXP | David Kanter | 2018/07/23 10:02 AM |
New article on Intel's 3DXP | Groo | 2018/07/23 01:53 PM |
New article on Intel's 3DXP | Michael S | 2018/07/23 02:47 PM |
New article on Intel's 3DXP | Teemo | 2018/07/23 05:38 PM |
New article on Intel's 3DXP | Wes Felterw | 2018/07/23 09:41 PM |
Flash DIMMs = bad idea | David Kanter | 2018/07/24 04:31 AM |
Flash DIMMs = bad idea | Emil Briggs | 2018/07/24 06:30 AM |
Flash DIMMs = bad idea | David Kanter | 2018/07/24 06:49 AM |
Flash DIMMs = bad idea | Michael S | 2018/07/24 06:59 AM |
Flash DIMMs = bad idea | Emil Briggs | 2018/07/24 08:29 AM |
Flash DIMMs = bad idea | Doug S | 2018/07/24 08:49 AM |
price | Michael S | 2018/07/24 03:16 PM |
price | Doug S | 2018/07/24 03:32 PM |
price | Michael S | 2018/07/24 03:49 PM |
Flash DIMMs = bad idea | blaine | 2018/12/03 04:40 PM |
Flash DIMMs = bad idea | Wes Felter | 2018/12/04 12:07 PM |
Flash DIMMs = bad idea | RichardC | 2018/12/04 04:09 PM |
Flash DIMMs = bad idea | Michael S | 2018/07/24 06:51 AM |
Flash DIMMs = bad idea | Adrian | 2018/07/24 07:35 AM |
Flash DIMMs = bad idea | Ricardo B | 2018/07/24 09:24 AM |
Flash DIMMs = bad idea | bakaneko | 2018/07/24 06:55 PM |
New article on Intel's 3DXP | Etienne | 2018/07/25 05:02 AM |
New article on Intel's 3DXP | Howard Chu | 2018/12/01 06:23 AM |
New article on Intel's 3DXP | Michael S | 2018/12/01 08:56 AM |
New article on Intel's 3DXP | anon | 2018/12/01 09:21 AM |
New article on Intel's 3DXP | Howard Chu | 2018/12/01 01:52 PM |
New article on Intel's 3DXP | Adrian` | 2018/12/01 03:43 PM |
New article on Intel's 3DXP | Adrian | 2018/12/01 11:05 PM |
New article on Intel's 3DXP | Howard Chu | 2018/12/11 05:17 AM |
New article on Intel's 3DXP | Adrian | 2018/12/11 05:42 AM |
New article on Intel's 3DXP | Maynard Handley | 2018/12/11 08:20 AM |
New article on Intel's 3DXP | wumpus | 2018/12/11 09:36 AM |
New article on Intel's 3DXP | Anon | 2018/12/11 05:21 PM |
New article on Intel's 3DXP | Maynard Handley | 2018/12/11 05:32 PM |
New article on Intel's 3DXP | Anon | 2018/12/12 12:29 AM |
New article on Intel's 3DXP | Maynard Handley | 2018/12/12 11:32 AM |
New article on Intel's 3DXP | wumpus | 2018/12/12 12:07 PM |
New article on Intel's 3DXP | Maynard Handley | 2018/12/12 12:41 PM |
New article on Intel's 3DXP | Anon | 2018/12/12 03:55 PM |
New article on Intel's 3DXP | Anon | 2018/12/12 03:49 PM |
New article on Intel's 3DXP | Anne O. Nymous | 2018/12/12 01:14 AM |
New article on Intel's 3DXP | anon | 2018/12/12 06:28 AM |
New article on Intel's 3DXP | Maynard Handley | 2018/12/12 11:26 AM |
New article on Intel's 3DXP | Anne O. Nymous | 2018/12/12 02:10 PM |
New article on Intel's 3DXP | innocent bystander | 2018/12/12 10:34 PM |
New article on Intel's 3DXP | anon | 2018/12/12 02:42 PM |
New article on Intel's 3DXP | Howard Chu | 2018/12/02 05:53 AM |
New article on Intel's 3DXP | Adrian | 2018/12/02 07:01 AM |
New article on Intel's 3DXP | Howard Chu | 2018/12/02 11:34 AM |
Intel's 3DXP availability | Etienne Lorrain | 2018/12/03 04:50 PM |