Supercomputer variant of Kahan quote

Article: Intel's Near-Threshold Voltage Computing and Applications
By: Robert Myers (rbmyersusa.delete@this.gmail.com), October 20, 2012 11:23 am
Room: Moderated Discussions
Emil Briggs (me.delete@this.nowherespam.com) on October 20, 2012 10:04 am wrote:

>
> Robert I don't know exactly what sort of
> background you have in these types of calculations so please forgive me if I
> start at too low a level here. The DFT acronym refers to Density Functional
> Theory
and is not related to fourier transforms of any kind.
>
> DFT calculations
> are accurate because they originate from quantum mechanical first principles. QM
> is non local and the wavefunctions associated with the electrons extends over
> all space. In practice we can truncate them at some point or use periodic
> boundary conditions to limit the region of interest but as we increase the
> number of atoms the size of the region we have to address increases in a roughly
> linear manner. So we pick up one factor of N. But as the number of atoms
> increases the number of electrons increases as well and we pick up another
> factor of N. Finally the orthogonality constraint for the wave functions gives
> us another factor and we're at N^3.
>
> There are a variety of techniques to
> solve the resultant equations (referred to as the Kohn-Sham equations). Some of
> them use FFT's. Others use finite difference methods. The FFT based methods have
> scaling issues on computer systems with poor interconnect bandwidth. The finite
> difference methods can do better on such systems.
>
> In either case though the
> N^3 scaling of the algorithm with the number of atoms is the real fundamental
> limit. Even a system with with enough interconnect bandwidth to provide good FFT
> performance on thousands of nodes would still run into this problem. Hence the
> work on finding algorithms that don't have that limit.

Well, at least the mystery of the amazing FFT has been resolved. In my world, DFT is used as an acronym for Discrete Fourier Transform, and it is usually used when, for any number of reasons, the cleverness of the FAST Fourier Transform (FFT) is not available. We are agreed that FFT's do not scale well with limited global bandwidth.

I just happen to have a copy of Kittel here, but the Kohn-Sham equation is not in the index. Fortunately, there is a Wikipedia article on the subject, so now I know everything I need to know about the subject (that's a joke). I suspect that, if I knew more about the subject than I do, I'd have many of the same concerns about what you are doing as I do about many of the things that are done in CFD, but it's not my discipline, and I don't have the competence to engage in a meaningful discussion.

As with the flapping wing problem, sometimes it doesn't matter that the actual mathematics are subtle and very difficult. Sometimes even a crude approach will provide the insight you need. Your post points to the really fundamental problem, though. For many problems in actual three-dimensional space, adding zillions of processors and memory location buys you very little, because the scaling with some N is so daunting. I claim that that inescapable reality only strengthens my argument. Brute force isn't going to get us anywhere. We should be focusing on computers that are reasonably fast, don't require ugly approximations (and all finite difference approximations are ugly, as far as I'm concerned), and are as transparent as possible to the user. Pushing things just a bit further in the problem that interests me may offer us no further useful insight, in which case my decision not to be so interested in warehouse-sized computers is the right one. Everything you say indicates to me that, aside from your professional investment so far, your thinking should be headed in the same direction.

Robert.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
New article: Intel's Near-Threshold ComputingDavid Kanter2012/09/18 12:26 PM
  Higher SRAM voltage and shared L1Paul A. Clayton2012/09/18 02:38 PM
    Higher SRAM voltage and shared L1David Kanter2012/09/18 05:20 PM
      Higher SRAM voltage and shared L1Eric2012/09/20 10:44 AM
        Higher SRAM voltage and shared L1David Kanter2012/09/20 12:24 PM
      Yes, that kind of asynchronousPaul A. Clayton2012/09/20 02:53 PM
    Higher SRAM voltage and shared L1somebody2012/09/19 09:27 AM
      So micro-turboboost is doubly impracticalPaul A. Clayton2012/09/20 02:53 PM
  Big littleDoug S2012/09/18 03:04 PM
    Big littleDavid Kanter2012/09/18 04:05 PM
    Big littleRicardo B2012/09/19 04:06 AM
  New article: Intel's Near-Threshold Computingdefderdar2012/09/18 09:39 PM
    New article: Intel's Near-Threshold Computingtarlinian2012/09/19 08:32 AM
      New article: Intel's Near-Threshold ComputingDavid Kanter2012/09/19 10:44 AM
  New article: Intel's Near-Threshold ComputingMark Christiansen2012/09/19 11:31 AM
    New article: Intel's Near-Threshold ComputingChris Brodersen2012/09/19 12:54 PM
  New article: Intel's Near-Threshold ComputingEric2012/09/20 10:47 AM
  Latency and HPC WorkloadsRobert Myers2012/10/03 10:52 AM
    Latency and HPC Workloadsanon2012/10/03 06:50 PM
      Latency and HPC WorkloadsRobert Myers2012/10/04 10:24 AM
        Latency and HPC WorkloadsSHK2012/10/08 05:42 AM
          Latency and HPC WorkloadsMichael S2012/10/08 01:59 PM
            Latency and HPC WorkloadsSHK2012/10/08 02:42 PM
              Latency and HPC WorkloadsMichael S2012/10/08 05:12 PM
                Latency and HPC Workloadsforestlaughing2012/10/15 08:41 AM
                  The original context was Micron RLDRAM (NT)Michael S2012/10/15 08:55 AM
                    The original context was Micron RLDRAMforestlaughing2012/10/15 10:21 AM
              Latency and HPC Workloads - Why not SRAM?Kevin G2012/10/09 09:48 AM
                Latency and HPC Workloads - Why not SRAM?Michael S2012/10/09 10:33 AM
                  Latency and HPC Workloads - Why not SRAM?SHK2012/10/09 12:55 PM
                    Why not SRAM? - CapacityRohit2012/10/09 09:13 PM
                  Latency and HPC Workloads - Why not SRAM?Kevin G2012/10/09 03:04 PM
                    Latency and HPC Workloads - Why not SRAM?Michael S2012/10/09 04:52 PM
                      Latency and HPC Workloads - Why not SRAM?Robert Myers2012/10/10 10:11 AM
                        Latency and HPC Workloads - Why not SRAM?forestlaughing2012/10/15 08:02 AM
                          Latency and HPC Workloads - Why not SRAM?Robert Myers2012/10/15 09:04 AM
                            Latency and HPC Workloads - Why not SRAM?forestlaughing2012/10/16 09:13 AM
                          Latency and HPC Workloads - Why not SRAM?SHK2012/10/16 08:12 AM
                    Latency and HPC Workloads - Why not SRAM?slacker2012/10/11 01:35 PM
                      SRAM leakageDavid Kanter2012/10/11 03:00 PM
          Latency and HPC Workloadsforestlaughing2012/10/15 08:57 AM
            Latency and HPC WorkloadsRobert Myers2012/10/16 07:28 AM
              Latency and HPC WorkloadsMichael S2012/10/16 07:35 AM
              Latency and HPC Workloadsanon2012/10/16 08:17 AM
                Latency and HPC WorkloadsRobert Myers2012/10/16 09:56 AM
                  Supercomputer variant of Kahan quotePaul A. Clayton2012/10/16 11:09 AM
                    Supercomputer variant of Kahan quoteanon2012/10/17 01:17 AM
                      Supercomputer variant of Kahan quoteRobert Myers2012/10/17 04:34 AM
                        Supercomputer variant of Kahan quoteanon2012/10/17 05:12 AM
                          Supercomputer variant of Kahan quoteRobert Myers2012/10/17 02:38 PM
                            Supercomputer variant of Kahan quoteanon2012/10/17 05:24 PM
                              Supercomputer variant of Kahan quoteRobert Myers2012/10/17 05:45 PM
                                Supercomputer variant of Kahan quoteanon2012/10/17 05:58 PM
                                Supercomputer variant of Kahan quoteanon2012/10/17 05:58 PM
                                  Supercomputer variant of Kahan quoteRobert Myers2012/10/17 07:14 PM
                                    Supercomputer variant of Kahan quoteanon2012/10/17 08:36 PM
                                      Supercomputer variant of Kahan quoteRobert Myers2012/10/18 09:47 AM
                                        Supercomputer variant of Kahan quoteanon2012/10/19 02:34 AM
                                          Supercomputer variant of Kahan quoteanon2012/10/19 04:47 AM
                                          Supercomputer variant of Kahan quoteRobert Myers2012/10/19 03:14 PM
                        Supercomputer variant of Kahan quoteMichael S2012/10/17 06:56 PM
                          Supercomputer variant of Kahan quoteanon2012/10/17 09:02 PM
                            Supercomputer variant of Kahan quoteRobert Myers2012/10/18 01:29 PM
                              Supercomputer variant of Kahan quoteanon2012/10/19 02:27 AM
                                Supercomputer variant of Kahan quoteRobert Myers2012/10/19 07:24 AM
                                  Supercomputer variant of Kahan quoteanon2012/10/19 08:00 AM
                                    Supercomputer variant of Kahan quoteRobert Myers2012/10/19 09:28 AM
                                      Supercomputer variant of Kahan quoteanon2012/10/19 10:27 AM
                              Supercomputer variant of Kahan quoteforestlaughing2012/10/19 10:26 AM
                                Supercomputer variant of Kahan quoteRobert Myers2012/10/19 07:04 PM
                                  Supercomputer variant of Kahan quoteEmil Briggs2012/10/20 04:52 AM
                                    Supercomputer variant of Kahan quoteRobert Myers2012/10/20 07:51 AM
                                      Supercomputer variant of Kahan quoteEmil Briggs2012/10/20 08:33 AM
                                        Supercomputer variant of Kahan quoteEmil Briggs2012/10/20 08:34 AM
                                          Supercomputer variant of Kahan quoteRobert Myers2012/10/20 09:35 AM
                                            Supercomputer variant of Kahan quoteEmil Briggs2012/10/20 10:04 AM
                                              Supercomputer variant of Kahan quoteRobert Myers2012/10/20 11:23 AM
                  Latency and HPC Workloadsanon2012/10/16 06:48 PM
                    Latency and HPC Workloadsforestlaughing2012/10/19 11:43 AM
              Latency and HPC Workloadsforestlaughing2012/10/19 09:38 AM
                Latency and HPC WorkloadsRobert Myers2012/10/19 11:40 AM
                Potential false economics in researchPaul A. Clayton2012/10/19 12:54 PM
                  Potential false economics in researchVincent Diepeveen2012/10/20 08:59 AM
                  Potential false economics in researchforestlaughing2012/10/23 10:56 AM
                    Potential false economics in researchRobert Myers2012/10/23 07:16 PM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell green?