Matrix Math Accelerator

By: Michael S (, August 17, 2020 1:32 am
Room: Moderated Discussions
Adrian ( on August 17, 2020 1:01 am wrote:
> Crystal S. Diamond ( on August 16, 2020 10:20 pm wrote:
> > Here it is boys...
> >
> >
> So IBM also jumps on the bandwagon of adding ISA extensions for matrix
> computations, like NVIDIA, Intel Sapphire Rapids, future ARM etc.

> New Processor Core Architectures in the IBM POWER10 processor with an embedded Matrix
> Math Accelerator which is extrapolated to provide 10x, 15x and 20x faster AI inference
> for FP32, BFloat16 and INT8 calculations per socket respectively than the IBM POWER9
> processor to infuse AI into business applications and drive greater insights.


IBM appears to do it on FP32 inputs. Is it the case for the rest of them?
4x4 FP32 matmul would be useful not just for deep learning.
The problem is that 2048 bits per core per cycle is not very impressive for such massive core, that is more similar to 2-4 cores by other manufacturers.
A64FX and Cascade Lake already do 1024 bits per core without special instructions.

I wonder why they expose their engine as an outer-product.
Of course, outer product is very generic, and likely fits well in pipeline due to latency, comparable to "normal" FP operations, but it seems to me that it makes good FLOPS gains impossible, because of RF write bottleneck.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
IBM introduces POWER10Crystal S. Diamond2020/08/16 09:20 PM
  "New ISA Prefix Fusion"QAnon2020/08/16 10:21 PM
    "New ISA Prefix Fusion"Anon32020/08/17 05:59 AM
      "New ISA Prefix Fusion"Kevin G2020/08/17 09:51 AM
        "New ISA Prefix Fusion"Maynard Handley2020/08/17 10:51 AM
          "New ISA Prefix Fusion"Anon32020/08/17 03:10 PM
            "New ISA Prefix Fusion"Maynard Handley2020/08/17 03:34 PM
              "New ISA Prefix Fusion"Anon32020/08/17 04:34 PM
                "New ISA Prefix Fusion"Adrian2020/08/17 05:39 PM
                "New ISA Prefix Fusion"anon22020/08/17 08:24 PM
                  "New ISA Prefix Fusion"Doug S2020/08/17 08:58 PM
                    "New ISA Prefix Fusion"hobold2020/08/18 12:47 AM
                    "New ISA Prefix Fusion"Michael S2020/08/18 03:48 AM
                      "New ISA Prefix Fusion"hobold2020/08/18 10:58 AM
                        "New ISA Prefix Fusion"dmcq2020/08/18 12:00 PM
                          "New ISA Prefix Fusion"Michael S2020/08/18 12:48 PM
                            "New ISA Prefix Fusion"hobold2020/08/18 01:29 PM
                            "New ISA Prefix Fusion"Maynard Handley2020/08/18 02:46 PM
                          "New ISA Prefix Fusion"Maynard Handley2020/08/18 02:42 PM
                            "New ISA Prefix Fusion"anon22020/08/18 06:04 PM
                              "New ISA Prefix Fusion"Maynard Handley2020/08/18 08:17 PM
                                "New ISA Prefix Fusion"dmcq2020/08/19 03:08 AM
                                  "New ISA Prefix Fusion"Maynard Handley2020/08/19 09:02 AM
                                    "New ISA Prefix Fusion"dmcq2020/08/19 10:08 AM
                                      "New ISA Prefix Fusion"Maynard Handley2020/08/19 11:05 AM
                                        "New ISA Prefix Fusion"dmcq2020/08/19 01:14 PM
                                          "New ISA Prefix Fusion"Maynard Handley2020/08/19 01:44 PM
  IBM introduces POWER10Thu2020/08/16 10:56 PM
    IBM introduces POWER10Michael S2020/08/17 01:12 AM
      IBM introduces POWER10Thu2020/08/17 02:27 AM
        IBM introduces POWER10TransientStudent2020/08/17 03:23 AM
          IBM introduces POWER10Rayla2020/08/17 03:29 AM
          IBM introduces POWER10Maynard Handley2020/08/17 09:44 AM
            IBM introduces POWER10Kevin G2020/08/17 09:57 AM
        IBM introduces POWER10Rayla2020/08/17 03:26 AM
          IBM introduces POWER10Thu2020/08/17 04:00 PM
  Matrix Math AcceleratorAdrian2020/08/17 12:01 AM
    Matrix Math AcceleratorMichael S2020/08/17 01:32 AM
      Matrix Math AcceleratorAdrian2020/08/17 01:46 AM
      Matrix Math Acceleratorj2020/08/18 01:32 AM
Reply to this Topic
Body: No Text
How do you spell avocado?