video rendering

By: Ireland (boh.delete@this.outlook.ie), January 26, 2017 12:49 pm
Room: Moderated Discussions
RichardC (tich.delete@this.pobox.com) on January 26, 2017 11:39 am wrote:

> You need the higher bandwidths elsewhere - where you put together the output of
> several/many rendering machines to serve full-speed uncompressed 24fps video to many
> desktops simultaneously.
>


Okay, so if they wanted to get even final production quality frames at 24 frames per second, maybe they could even still do that using 1Gbit networking. But I don't think they leave it at just that any longer. They do final production quality frames, and then they don't stop working. They keep re-working on top of already rendered final quality footage.

So, you're probably getting into some part of that process, that needs something above 1Gbit.

From what I can gather, from what I've listened to in their interviews - they're previewing other rendering effects, on-top-of previously finished rendered footage, at that 24fps. They seem to have found a lot more intermediary stages, between rendering the frames initially, and putting the finishing touches on it. My guess, is that they've done a large amount of rendering of final footage, and they continue to re-render and develop parts of those finished image frames, making a lot more passes and working on parts of the image, for a long time.

That could get pretty intensive.

There was that old, old expression in traditional film movie making - it's 'in the can'. I suspect that nowadays with the medium, they do get it into the can, but they go back inside the can a lot more times, and play around with what's contained inside the can. And I don't mean, that old two-dimensional, 'post-production', that was basically about using photoshop on images, frame by frame. I mean, actual three dimensional adjustment and rendering, on top of pre-existing rendered footage.

The other thing too, is that when you build up a lot of separate 'channels' on top of those pre-rendered frames, to adjust certain things, you're adding a lot more un-compressed data that is travelling through at that twenty-four frames per second rate - in addition to just the frame images.


> So it seems clear to me - the description of Pixar's render farm says most of the links
> are/were 1Gbit/s, and a reasonable analysis shows that under reasonable assumptions,
> 1Gbit/s is enough for the vast majority of rendering problems.
>
> The numbers don't support your argument.
>
> As for the idea that story-telling is critical, well, sure. But that's just the same as
> live-action movies: you need a good script with a good story and good characters, and good
> direction and acting, and all of those are hard to put together. But once you've spent
> $100M or more on all that stuff and you've got the raw footage, then you're in a heck of a hurry
> to do the editing and the score and the soundtrack so that you get it in the theaters
> and start the payback on your huge investment.



I've listened to some movie directors who describe the editing process often, as a script re-write. The extreme example of that, was Adrien Brody who showed up to the opening night of a Terrence Malick movie expecting to be in the starring role - and he was hardly in the movie at all. Ridley Scott talks about having to 'make the movie' no less than three times - once as a script, once during production camera shooting stage, and then a third time in the editing suite.

Listening to some of 'The Future of RenderMan' (Pixar's RenderMan channel on Vimeo), and similar PR talk from Pixar available to listen to, what I'm noticing is that they're are beginning to play around with the 'final footage' so to speak, later and later in the process. I.e. Take something that is rendered to final production stage rendering, and they are still working on re-rendering those images. Maybe that does account for the increase in bandwidth appetite.

But I still take your point, that for basic 'HD' 1080p, the bandwidth is not the issue. 4K is a different beast though, isn't it?

Some other things of interest, that Ed Catmull had to say about it, was his desire to maintain a separation between what Pixar is doing, what Disney is doing, what Lucas is doing, and several other branches of the enterprise, including the Renderman division, which stands on it's own too. Even within the Disney part, there are even separate divisions in it, which do research on technology that Aaron mentioned, the Hyperion etc.

That makes a lot of sense to me, that Ed Catmull would see the future in their industry, as supporting different workstreams and supporting a wealth of different ideas and approaches to technology, and to the creative direction also. I mean, it's easier said than done. How to have so many different creative projects joined together, and still have each exploring different avenues. But, these guys are good at supporting a creative process, and backing that up with technology in a way that blends it all together, in an intelligent way.

As I say, we've got something to learn from them, on that level.

One other thing that Ed Catmull did emphasize in the PR video from two years ago, is that the people who license Pixar's Renderman engine from them to use - lots and lots of other different production companies - are throwing a heck of a lot more processors at the task of rendering now. What it meant from Pixar's point of view he explained, is they're having to re-think the way that they license out the Renderman, because there are so many more processors getting thrown at the job, than there were before.

It would seem to suggest that the idea of more computation connected by modest bandwidth, is the key. He and others have mentioned something called bi-directional ray tracing too. I haven't looked into what that is, but it sounds painful (ray tracing by itself is horrible on computation). Ed Catmull talked about global illumintation and he talked about a lot of other stuff too. There's about ten different short videos by Catmull, if you search through the whole collection on that channel.

The technical expert from Disney, Andy Hendrickson, who described the Hyperion technology in a dumbed down way - he explained a little about how they tried to 'contain' the ray tracing within quite a confined part of the world/scene, and not have too many rays chasing off into broader space - so as to conserve on computation. He hinted at the ways they had found, to divide up the job of rendering, in a way that runs better on hardware. But, given it was an interview for the Adam Savage tech channel, they didn't get into too much details.


> Doing the final rendering in a reasonably
> short elapsed time is financially valuable. But having 10Gbit vs 1Gbit on each rendering
> machine makes precisely no difference to that, because it is completely compute-bound
> - much better to spend the money on a few more machines than on an expensive
> network infrastructure which will have ridiculously low utilization.
>
> Heck, a whole 90-minute movie in 4K resolution uncompressed is about 3800GB, and a single
> 10Gbit link could transfer that in about 1 hour. That can't possibly be critical.
>

I.e. Faster than real time, at un-compressed image format/quality. Yeah.
< Previous Post in ThreadNext Post in Thread >
TopicPosted ByDate
Cray to Develop ARM-based Isambard Supercomputer for UK Met Officegallier22017/01/20 07:48 AM
  Cray to Develop ARM-based Isambard Supercomputer for UK Met Officegallier22017/01/20 07:48 AM
    Ignore second post (NT)gallier22017/01/20 07:49 AM
  ARM-based supercomputersDavid Kanter2017/01/20 02:55 PM
    ARM-based supercomputersMaynard Handley2017/01/20 08:55 PM
      ARM-based supercomputers lolRobert David Graham2017/01/21 05:34 PM
        ARM-based supercomputers lolnone2017/01/21 06:44 PM
          ARM-based supercomputers lolMaynard Handley2017/01/21 07:36 PM
            ARM-based supercomputers lolMichael S2017/01/22 02:07 AM
            What did you learn?Innocent Bystander2017/01/22 08:26 AM
          ARM-based supercomputers lolanon2017/01/22 02:24 AM
            ARM-based supercomputers lolGabriele Svelto2017/01/23 12:53 AM
              ARM-based supercomputers lolanon2017/01/23 06:40 AM
            ARM-based supercomputers loljuanrga2017/01/29 05:01 AM
              ARM-based supercomputers lolanon2017/01/29 09:35 AM
        ARM-based supercomputers lolBrendan2017/01/21 07:36 PM
         Dumb belief? ROFL (NT)juanrga2017/01/22 02:59 AM
          Dumb belief? ROFLwumpus2017/01/22 11:31 AM
            Dumb belief? ROFLjuanrga2017/01/29 05:13 AM
        ARM-based supercomputers lolDavid Kanter2017/01/22 08:20 AM
    ARM-based supercomputersRichardC2017/01/22 07:54 AM
      ARM-based supercomputersAaron Spink2017/01/22 12:03 PM
        ARM-based supercomputersNiels Jørgen Kruse2017/01/22 12:16 PM
          ARM-based supercomputersAaron Spink2017/01/23 07:01 PM
            ARM-based supercomputersNiels Jørgen Kruse2017/01/23 10:41 PM
              ARM-based supercomputerstarlinian2017/01/24 08:58 AM
                ARM-based supercomputersMichael S2017/01/24 09:05 AM
                  ARM-based supercomputersAaron Spink2017/01/24 10:38 AM
        ARM-based supercomputersdmcq2017/01/22 01:03 PM
          A73 does not have L1 ECCDavid Kanter2017/01/22 09:50 PM
            A73 does not have L1 ECCdmcq2017/01/23 03:32 PM
              A73 does not have L1 ECCMichael S2017/01/23 03:50 PM
              A73 does not have L1 ECCdmcq2017/01/24 08:15 AM
                A73 does not have L1 ECCMichael S2017/01/24 08:47 AM
          ARM SOCs with ECC DRAMMichael S2017/01/23 03:17 AM
          ARM-based supercomputersAaron Spink2017/01/23 07:02 PM
            X-Gene 3 supports 1TB of memoryvvid2017/01/24 01:55 AM
              X-Gene 3 supports 1TB of memoryWilco2017/01/24 02:13 AM
                You seem to be confusing "SoC" with "CPU core" (NT)Anon2017/01/24 03:12 AM
                X-Gene 3 supports 1TB of memoryMichael S2017/01/24 05:26 AM
                  X-Gene 3 supports 1TB of memorydmcq2017/01/24 08:28 AM
                X-Gene 3 supports 1TB of memoryAaron Spink2017/01/24 06:46 AM
                  X-Gene 3 supports 1TB of memoryWilco2017/01/24 03:10 PM
                    X-Gene 3 supports 1TB of memoryDavid Kanter2017/01/24 07:31 PM
                X-Gene 3 supports 1TB of memorySimon Farnsworth2017/01/26 02:23 AM
              X-Gene 3 supports 1TB of memoryAaron Spink2017/01/24 06:44 AM
                X-Gene 3 supports 1TB of memoryAnon2017/01/24 01:54 PM
                  X-Gene 3 supports 1TB of memoryWilco2017/01/24 03:07 PM
                    X-Gene 3 supports 1TB of memoryDavid Kanter2017/01/24 07:34 PM
                      X-Gene 3 supports 1TB of memorynone2017/01/24 10:48 PM
                        X-Gene 3 supports 1TB of memoryMichael S2017/01/25 01:32 AM
                        X-Gene 3 supports 1TB of memoryDavid Hess2017/01/25 09:47 PM
                          X-Gene 3 supports 1TB of memoryMichael S2017/01/26 12:55 AM
                            Really that different?Daniel B2017/01/26 03:37 AM
                              Really that different?none2017/01/26 05:39 AM
                                Really that different?itsmydamnation2017/01/26 03:55 PM
                                  Really that different?none2017/01/26 11:14 PM
                      X-Gene 3 supports 1TB of memoryWilco2017/01/25 03:22 AM
                        Sharing between servers and phonesDavid Kanter2017/01/25 07:15 AM
                          Sharing between servers and phonesWilco2017/01/25 04:41 PM
                            Sharing between servers and phonesDavid Kanter2017/01/25 06:10 PM
                              Sharing between servers and phonesGabriele Svelto2017/01/26 03:15 AM
                                Sharing between servers and phonesDavid Kanter2017/01/26 07:33 AM
                                  Sharing between servers and phoneswumpus2017/01/26 03:25 PM
                                    Sharing between servers and phonesDavid Kanter2017/01/27 06:46 AM
                                      Any idea why Intel doesn't ship server chips with eDRAM?Mark Roulo2017/01/27 09:02 AM
                                        Any idea why Intel doesn't ship server chips with eDRAM?Per Hesselgren2017/01/28 06:49 AM
                                          Any idea why Intel doesn't ship server chips with eDRAM?Simon Farnsworth2017/01/28 07:06 AM
                                          Any idea why Intel doesn't ship server chips with eDRAM?Michael S2017/01/29 02:43 AM
                                            off die eDRAM?wumpus2017/01/29 06:57 AM
                                              off die eDRAM?anon2017/01/29 09:46 AM
                                      Sharing between servers and phonesrwessel2017/01/27 10:36 PM
                                      Sharing between servers and phonesLinus Torvalds2017/01/28 11:49 AM
                                        Sharing between servers and phonesrwessel2017/01/29 08:56 PM
                                          Sharing between servers and phonesLinus Torvalds2017/01/30 10:01 AM
                                            Sharing between servers and phonesrwessel2017/01/31 12:29 AM
                                              Sharing between servers and phonesIreland2017/01/31 07:55 AM
                                                Please keep your posts on topicDavid Kanter2017/01/31 11:32 AM
                                                  Technology that can survive in harsh conditionsIreland2017/01/31 12:51 PM
                                                    Stay on topic, you have been warnedDavid Kanter2017/01/31 06:56 PM
                                                On topic summary and my thoughts on it. Jouni Osmala2017/01/31 01:10 PM
                                                  On topic summary and my thoughts on it. Ireland2017/01/31 01:27 PM
                                              Sharing between servers and phonesLinus Torvalds2017/01/31 01:01 PM
                                                Sharing between servers and phonesLinus Torvalds2017/01/31 01:49 PM
                                                  Sharing between servers and phonesDoug S2017/01/31 02:12 PM
                                                Sharing between servers and phonesrwessel2017/01/31 05:54 PM
                                                  Sharing between servers and phonesLinus Torvalds2017/02/01 09:17 AM
                                                    Sharing between servers and phonesrwessel2017/02/02 03:40 PM
                                                  Sharing between servers and phonesjoncmu2017/02/01 01:36 PM
                                                    Sharing between servers and phonesChristian Borntraeger2017/02/02 03:46 AM
            ARM-based supercomputersRichardC2017/01/24 05:50 AM
              ARM-based supercomputersAaron Spink2017/01/24 07:20 AM
                ARM-based supercomputersdmcq2017/01/24 08:44 AM
                  ARM-based supercomputersnone2017/01/24 09:10 AM
                  ARM-based supercomputersjuanrga2017/01/29 05:33 AM
                    ARM-based supercomputershobel2017/01/30 02:35 AM
                ARM-based supercomputersRichardC2017/01/24 09:34 AM
                  ARM-based supercomputersdmcq2017/01/24 10:10 AM
                  ARM-based supercomputersAaron Spink2017/01/24 11:01 AM
                    ARM-based supercomputersRichardC2017/01/24 04:06 PM
                      ARM-based supercomputersIreland2017/01/24 05:16 PM
                      ARM-based supercomputersAaron Spink2017/01/24 07:43 PM
                    video renderingRichardC2017/01/24 05:08 PM
                      video renderingIreland2017/01/24 05:26 PM
                      video renderingAaron Spink2017/01/24 07:54 PM
                        video renderingRichardC2017/01/25 04:26 AM
                          display bandwidthRichardC2017/01/25 05:30 AM
                          video renderingIreland2017/01/25 08:11 AM
                            You can keep a coal furnace fed all the time. (NT)anon2017/01/25 03:27 PM
                              You can keep a coal furnace fed all the time.Ireland2017/01/25 03:36 PM
                                You can keep a coal furnace fed all the time.anon2017/01/27 03:29 AM
                                  You can keep a coal furnace fed all the time.Michael S2017/01/27 07:22 AM
                                    You can keep a coal furnace fed all the time.Ireland2017/01/27 10:59 AM
                                    You can keep a coal furnace fed all the time.anon2017/01/27 03:09 PM
                                      Information and Super Materials Ireland2017/01/28 11:13 AM
                            video renderingRichardC2017/01/26 11:39 AM
                              video renderingIreland2017/01/26 12:49 PM
                                video renderingIreland2017/01/26 12:58 PM
                                video renderingRichardC2017/01/26 03:24 PM
                                  video renderingIreland2017/01/26 05:09 PM
                          video renderingGabriele Svelto2017/01/25 08:16 AM
                            video renderingIreland2017/01/25 08:33 AM
                              The challenge at Pixar Ireland2017/01/25 08:40 AM
                                Pixar story & technologyRichard Cownie2017/01/25 11:36 AM
                                  Pixar story & technologyIreland2017/01/25 11:58 AM
                          video renderingAaron Spink2017/01/25 02:49 PM
                            video renderingIreland2017/01/25 03:26 PM
                            cloud network infrastructureRichardC2017/01/26 10:47 AM
                              cloud network infrastructureAaron Spink2017/01/26 07:37 PM
                ARM-based supercomputersGabriele Svelto2017/01/24 12:40 PM
                  ARM-based supercomputersAaron Spink2017/01/24 08:00 PM
        ARM-based supercomputersRichardC2017/01/22 09:45 PM
          ARM-based supercomputersGabriele Svelto2017/01/23 01:03 AM
            ARM-based supercomputersRichardC2017/01/23 06:57 AM
      ARM-based supercomputersGabriele Svelto2017/01/23 03:23 AM
    Mont blanc project and ARM HPC in generaljuanrga2017/01/29 04:42 AM
      Juan, why do you have to be such an arrogant twat to the person who provides this forum? (NT)Annoyed2017/01/30 02:32 AM
      Still idioticDavid Kanter2017/01/30 07:49 AM
        Still idioticMr. Camel2017/01/30 08:16 PM
        Still idioticjuanrga2017/02/02 08:11 AM
      Mont blanc project and ARM HPC in generalIreland2017/01/31 04:53 PM
        Four Things to Consider Ireland2017/01/31 05:11 PM
          Four Things to Consider tarlinian2017/01/31 06:38 PM
            Four Things to Consider Ireland2017/01/31 06:58 PM
              no evidence that it goes on a shipRichardC2017/02/01 06:05 AM
                no evidence that it goes on a shipIreland2017/02/02 01:57 PM
                  no evidence that it goes on a shipRichardC2017/02/03 06:04 AM
                    no evidence that it goes on a shipIreland2017/02/03 08:02 AM
              A better place to site a supercomputerAnon2017/02/01 06:57 AM
                A better place to site a supercomputerIreland2017/02/01 06:37 PM
                  A better Ireland..Anon2017/02/01 07:52 PM
                    A better Ireland..slacker2017/02/01 10:32 PM
                    A better Ireland..Ireland2017/02/02 04:06 AM
                    He is manic (NT)anonymo2017/02/02 12:21 PM
                      or a botanon2017/02/02 02:17 PM
                        or a botanonymou52017/02/02 03:46 PM
                        or a botnone2017/02/02 10:45 PM
                          or a botanon2017/02/03 09:30 AM
                        Better bot example: amanfrommars1Doug S2017/02/03 10:44 AM
            Make allowances, the man never sleeps..Anon2017/01/31 08:22 PM
        Mont blanc project and ARM HPC in generaletudiant2017/02/02 08:39 AM
          Mont blanc project and ARM HPC in generalIreland2017/02/02 11:12 AM
            Connection between two different modelsIreland2017/02/02 11:18 AM
              Connection between two different modelsetudiant2017/02/04 02:40 PM
                Connection between two different modelsRichardC2017/02/06 08:36 AM
                  Connection between two different modelsdmcq2017/02/06 10:07 AM
                  Connection between two different modelsIreland2017/02/06 11:17 AM
                    probably not the right forum ...RichardC2017/02/06 12:31 PM
                      probably not the right forum ...Ireland2017/02/06 01:53 PM
Reply to this Topic
Name:
Email:
Topic:
Body: No Text
How do you spell green?