By: David Kanter (dkanter.delete@this.realworldtech.com), November 3, 2008 11:23 am
Room: Moderated Discussions
Howard Chu (hyc@symas.com) on 10/31/08 wrote:
---------------------------
>Given the flakiness of the tools, it would have been >worthwhile to hack the codepath
>selection in each of the programs-under-test, to force >identical codepaths on both
>platforms.
I think that was a bit beyond my skills at the time. Even today, the only way I can think of doing that is to use virtualization to trick the software, but that is not a great idea when using graphics performance.
>Then you could assess just how badly the tools were lying. >As it is,
>you have a variable propagating systematically through all >your results and no way to account for it.
That's true, and next time I will probably stop using Code Analyst as a result.
David
---------------------------
>Given the flakiness of the tools, it would have been >worthwhile to hack the codepath
>selection in each of the programs-under-test, to force >identical codepaths on both
>platforms.
I think that was a bit beyond my skills at the time. Even today, the only way I can think of doing that is to use virtualization to trick the software, but that is not a great idea when using graphics performance.
>Then you could assess just how badly the tools were lying. >As it is,
>you have a variable propagating systematically through all >your results and no way to account for it.
That's true, and next time I will probably stop using Code Analyst as a result.
David
