-.- (blarg.delete@this.mailinator.com) on May 29, 2022 5:28 pm wrote:
> Michael S (already5chosen.delete@this.yahoo.com) on May 29, 2022 1:38 pm wrote:
> > And while not everything is matmul, a lot of "dense" compute-intensive
> > things can be turned into likes of matmul.
> > And if your workload is not "dense" then you are probably
> > limited by bandwidth of one or another cache/memory
> > level and can't take advantage of amount of FLOPs provided by good old AVX+FMA, much less so by AVX-512.
>
> What about something like JSON parsing? Definitely not "dense" or mat-mul transformable,
> and not fast enough to be bandwidth limited, but gets notable speedups with AVX-512.

I am old-fashioned. Never believed in principles of Doug McIlroy.
IMHO, if for your workload JSON parsing can be measurably sped up by SIMD and if this speed up is noticeable in time profile of the whole app then it means one thing - you need something better than JSON as your storage/COMM format. Start rearchitecting now and you will be regarded in the future. That is, if you're not shown the door before that.