Pseudo-random number generator would provide reproducible stochastic rounding

By: Adrian (a.delete@this.acm.org), March 24, 2022 2:34 pm
Room: Moderated Discussions
rwessel (rwessel.delete@this.yahoo.com) on March 24, 2022 1:28 pm wrote:
> Paul A. Clayton (paaronclayton.delete@this.gmail.com) on March 24, 2022 11:43 am wrote:
> > Pseudo-random number generator would provide reproducible stochastic rounding
>
> Easier said than done if the code is multi-threaded. Which is something of a given if we're assuming GPUs.


There are many good PRNG's that allow the deterministic splitting of the generated sequence of numbers in separate subsequences for each thread.

For example the multiplicative Fibonacci generators or those which use a pseudo-random function in counter mode.


So the problem of having a multi-threaded program with pseudo-random but reproducible behavior has been solved since about 1984 for the cases when very fast PRNGs are needed and since about 1970 for the cases when the speed of the PRNGs does not matter so much.



< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Nvidia H100 Tensor Core GPUHopper2022/03/22 08:48 AM
  Nvidia H100 Tensor Core GPUMarcus2022/03/23 11:23 PM
    Nvidia H100 Tensor Core GPUdmcq2022/03/24 01:40 AM
      Nvidia H100 Tensor Core GPUMarcus2022/03/24 03:03 AM
        Pseudo-random number generator would provide reproducible stochastic rounding (NT)Paul A. Clayton2022/03/24 11:43 AM
          Pseudo-random number generator would provide reproducible stochastic roundingrwessel2022/03/24 01:28 PM
            Pseudo-random number generator would provide reproducible stochastic roundingAdrian2022/03/24 02:34 PM
              Pseudo-random number generator would provide reproducible stochastic roundingMarcus2022/03/25 12:57 AM
                Pseudo-random number generator would provide reproducible stochastic roundingAdrian2022/03/25 04:16 AM
                  Pseudo-random number generator would provide reproducible stochastic roundingMarcus2022/03/25 05:48 AM
                    Pseudo-random number generator would provide reproducible stochastic roundingAdrian2022/03/25 09:37 AM
                      stateless PRNGshobold2022/03/25 02:34 PM
                        stateless PRNGsJörn Engel2022/03/25 09:30 PM
                          stateless PRNGshobold2022/03/26 10:32 AM
                            stateless PRNGsJörn Engel2022/03/26 02:14 PM
                              stateless PRNGshobold2022/03/27 02:11 AM
                      Pseudo-random number generator would provide reproducible stochastic roundingblaine2022/03/26 01:09 PM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell tangerine? 🍊