Matrix Math Accelerator

By: Adrian (a.delete@this.acm.org), August 17, 2020 2:46 am
Room: Moderated Discussions
Michael S (already5chosen.delete@this.yahoo.com) on August 17, 2020 2:32 am wrote:
> Adrian (a.delete@this.acm.org) on August 17, 2020 1:01 am wrote:
> > Crystal S. Diamond (cdiamond.delete@this.diamondgirls.com) on August 16, 2020 10:20 pm wrote:
> > > Here it is boys...
> > >
> > > https://www.hardwareluxx.de/index.php/news/hardware/prozessoren/53864-ibm-power10-bietet-30-kerne-mit-smt8-pcie-5-und-omi-memory.amp.html?__twitter_impression=true
> >
> >
> >
> > So IBM also jumps on the bandwagon of adding ISA extensions for matrix
> > computations, like NVIDIA, Intel Sapphire Rapids, future ARM etc.
> >
> >
> >

> > New Processor Core Architectures in the IBM POWER10 processor with an embedded Matrix
> > Math Accelerator which is extrapolated to provide 10x, 15x and 20x faster AI inference
> > for FP32, BFloat16 and INT8 calculations per socket respectively than the IBM POWER9
> > processor to infuse AI into business applications and drive greater insights.
> >

> >
> >
>
> IBM appears to do it on FP32 inputs. Is it the case for the rest of them?
> 4x4 FP32 matmul would be useful not just for deep learning.


Unlike the previous NVIDIA GPUs, whose matrix (a.k.a. "tensor") operations were limited to 16-bit inputs, Ampere, at least in its HPC version, is said to accept inputs up to FP64.

I do not know which will be the capabilities of the gaming Ampere GPUs, to be launched in September, maybe they will accept inputs up to FP32.


AFAIK, at least in Sapphire Rapids, Intel AMX is only for INT8 and BF16, so, unlike in Ampere or POWER10, it is useful only for Deep Learning, not for more general numeric algorithms.










< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
IBM introduces POWER10Crystal S. Diamond2020/08/16 10:20 PM
  "New ISA Prefix Fusion"QAnon2020/08/16 11:21 PM
    "New ISA Prefix Fusion"Anon32020/08/17 06:59 AM
      "New ISA Prefix Fusion"Kevin G2020/08/17 10:51 AM
        "New ISA Prefix Fusion"Maynard Handley2020/08/17 11:51 AM
          "New ISA Prefix Fusion"Anon32020/08/17 04:10 PM
            "New ISA Prefix Fusion"Maynard Handley2020/08/17 04:34 PM
              "New ISA Prefix Fusion"Anon32020/08/17 05:34 PM
                "New ISA Prefix Fusion"Adrian2020/08/17 06:39 PM
                "New ISA Prefix Fusion"anon22020/08/17 09:24 PM
                  "New ISA Prefix Fusion"Doug S2020/08/17 09:58 PM
                    "New ISA Prefix Fusion"hobold2020/08/18 01:47 AM
                    "New ISA Prefix Fusion"Michael S2020/08/18 04:48 AM
                      "New ISA Prefix Fusion"hobold2020/08/18 11:58 AM
                        "New ISA Prefix Fusion"dmcq2020/08/18 01:00 PM
                          "New ISA Prefix Fusion"Michael S2020/08/18 01:48 PM
                            "New ISA Prefix Fusion"hobold2020/08/18 02:29 PM
                            "New ISA Prefix Fusion"Maynard Handley2020/08/18 03:46 PM
                          "New ISA Prefix Fusion"Maynard Handley2020/08/18 03:42 PM
                            "New ISA Prefix Fusion"anon22020/08/18 07:04 PM
                              "New ISA Prefix Fusion"Maynard Handley2020/08/18 09:17 PM
                                "New ISA Prefix Fusion"dmcq2020/08/19 04:08 AM
                                  "New ISA Prefix Fusion"Maynard Handley2020/08/19 10:02 AM
                                    "New ISA Prefix Fusion"dmcq2020/08/19 11:08 AM
                                      "New ISA Prefix Fusion"Maynard Handley2020/08/19 12:05 PM
                                        "New ISA Prefix Fusion"dmcq2020/08/19 02:14 PM
                                          "New ISA Prefix Fusion"Maynard Handley2020/08/19 02:44 PM
  IBM introduces POWER10Thu2020/08/16 11:56 PM
    IBM introduces POWER10Michael S2020/08/17 02:12 AM
      IBM introduces POWER10Thu2020/08/17 03:27 AM
        IBM introduces POWER10TransientStudent2020/08/17 04:23 AM
          IBM introduces POWER10Rayla2020/08/17 04:29 AM
          IBM introduces POWER10Maynard Handley2020/08/17 10:44 AM
            IBM introduces POWER10Kevin G2020/08/17 10:57 AM
        IBM introduces POWER10Rayla2020/08/17 04:26 AM
          IBM introduces POWER10Thu2020/08/17 05:00 PM
  Matrix Math AcceleratorAdrian2020/08/17 01:01 AM
    Matrix Math AcceleratorMichael S2020/08/17 02:32 AM
      Matrix Math AcceleratorAdrian2020/08/17 02:46 AM
      Matrix Math Acceleratorj2020/08/18 02:32 AM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell avocado?