Difference between revisions of "Efficiency Tester"

From Second Life Wiki
Jump to navigation Jump to search
(guess the inaccuracy is +-1ms since that's more than I saw, first time I tried measuring the cost of no code for 1000 (not 10,000) times)
m (Replaced <source> with <syntaxhighlight>)
 
(10 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{LSL Header}}
{{LSL Header}}


Q1: Want to see how small some code is?
'''Q1: Want to see how small some code compiles?'''


A: Add three copies of your code to a script, call [[llGetFreeMemory]] to count free space, and start deleting copies. After deleting each copy, you should see a consistent savings in free space, ''i.e'', the code space cost of your code.
'''A:''' See the [[Code Sizer]] harness for [[llGetFreeMemory]].


Q2: Want to see how fast some code is?
'''Q2: Want to discover quickly if a change to code makes the code run faster?'''


A: Run your code inside code like this example to call your code time and again to measure the consequent change in [[llGetTimestamp]].
'''A:''' See the [[Code Racer]] harness for [[llGetTimestamp]].


'''Q3: Want to see approximately how fast some code runs?'''
'''A:''' Run your code inside code like this example to call your code time and again to measure the consequent change in [[llGetTimestamp]].
Sample Results:
<pre>
<pre>
15249 free bytes of code at default.state_entry
0.177314+-??% ms may have elapsed on average in each of
10000 trials of running the code in the loop
0.176341+-??% ms may have elapsed on average in each of
10000 trials of running the code in the loop
0.201925+-??% ms may have elapsed on average in each of
10000 trials of running the code in the loop
</pre>
Code:
<syntaxhighlight lang="lsl2">
// IMPORTANT:
// IMPORTANT:
// Only perform tests in an empty region.
// Only perform tests in an empty region.
Line 17: Line 34:
// There is a margin of error so run the tests multiple times to determine it.
// There is a margin of error so run the tests multiple times to determine it.


integer time() { // count milliseconds since the day began
// (16384 - (15267 - 18)) was the well-known byte code size of this llGetTime/ llGetTimestamp harness
 
// Measure the race instead
// in calendar milliseconds elapsed since the day began,
// if called in place of llGetTime.
 
integer getTime() // count milliseconds since the day began
{
     string stamp = llGetTimestamp(); // "YYYY-MM-DDThh:mm:ss.ff..fZ"
     string stamp = llGetTimestamp(); // "YYYY-MM-DDThh:mm:ss.ff..fZ"
     return (integer) llGetSubString(stamp, 11, 12) * 3600000 + // hh
     return (integer) llGetSubString(stamp, 11, 12) * 3600000 + // hh
Line 24: Line 48:
}
}


default {
default
     state_entry() {
{
     state_entry()
    {


         // always measure how small, not only how fast
         // always measure how small, not only how fast
Line 49: Line 75:
             // begin
             // begin


             float t0 = time();
             float t0 = llGetTime();


             // loop to measure elapsed time to run sample code
             // loop to measure elapsed time to run sample code
Line 58: Line 84:
               // test once or more
               // test once or more


               counter += 1;
               counter += 1; // 18 bytes is the well-known byte code size of this sourceline
        
        
             } while (++i < max);
             } while (++i < max);


             float t1 = time();
             float t1 = llGetTime();


             // loop to measure elapsed time to run no code
             // loop to measure elapsed time to run no code
Line 68: Line 94:
             do ; while (++j < max);
             do ; while (++j < max);


             float t2 = time();
             float t2 = llGetTime();


            // complain if time ran backwards
           
            if (!((t0 <= t1) && (t1 <= t2)))
            {
                llOwnerSay("MEANINGLESS RESULT -- SIMULATED TIME RAN BACKWARDS -- TRY AGAIN");
            }
           
             // report average time elapsed per run
             // report average time elapsed per run


             float elapsed = ((t1 - t0) - (t2 - t1))/max;
             float elapsedms = 1000.0 * (((t1 - t0) - (t2 - t1)) / max);
             llOwnerSay((string) elapsed + "+-1 milliseconds passed on average in each of");
             llOwnerSay((string) elapsedms + "+-??% ms may have elapsed on average in each of");
             llOwnerSay((string) max + " trials of running the code in the loop");
             llOwnerSay((string) max + " trials of running the code in the loop");
         }
         }
     }
     }
}
}
</pre>
</syntaxhighlight>


Launched by [[User:Xaviar Czervik|Xaviar Czervik]], then modified by [[User:Strife Onizuka|Strife Onizuka]], then further edited as the history of this article shows.
Launched by [[User:Xaviar Czervik|Xaviar Czervik]], then modified by [[User:Strife Onizuka|Strife Onizuka]], then further edited as the history of this article shows.

Latest revision as of 01:50, 9 September 2023

Q1: Want to see how small some code compiles?

A: See the Code Sizer harness for llGetFreeMemory.

Q2: Want to discover quickly if a change to code makes the code run faster?

A: See the Code Racer harness for llGetTimestamp.

Q3: Want to see approximately how fast some code runs?

A: Run your code inside code like this example to call your code time and again to measure the consequent change in llGetTimestamp.

Sample Results:

15249 free bytes of code at default.state_entry
0.177314+-??% ms may have elapsed on average in each of
10000 trials of running the code in the loop
0.176341+-??% ms may have elapsed on average in each of
10000 trials of running the code in the loop
0.201925+-??% ms may have elapsed on average in each of
10000 trials of running the code in the loop

Code:

// IMPORTANT:
// Only perform tests in an empty region.
// To reduce contamination and be sure to wearing no attachments.
// Preferably do tests in a private sim with one on it.
// Don't move while performing the test.
// There is a margin of error so run the tests multiple times to determine it.

// (16384 - (15267 - 18)) was the well-known byte code size of this llGetTime/ llGetTimestamp harness

// Measure the race instead
// in calendar milliseconds elapsed since the day began,
// if called in place of llGetTime.

integer getTime() // count milliseconds since the day began
{
    string stamp = llGetTimestamp(); // "YYYY-MM-DDThh:mm:ss.ff..fZ"
    return (integer) llGetSubString(stamp, 11, 12) * 3600000 + // hh
           (integer) llGetSubString(stamp, 14, 15) * 60000 +  // mm
           llRound((float)llGetSubString(stamp, 17, -2) * 1000000.0)/1000; // ss.ff..f
}

default
{
    state_entry()
    {

        // always measure how small, not only how fast

        llOwnerSay((string) llGetFreeMemory() + " free bytes of code at default.state_entry");

        // always take more than one measurement

        integer repeateds;
        for (repeateds = 0; repeateds < 3; ++repeateds)
        {

            // declare test variables

            float counter;

            // declare framework variables

            float i = 0;
            float j = 0;
            integer max = 10000; // 2ms of work takes 20 seconds to repeat 10,000 times, plus overhead

            // begin

            float t0 = llGetTime();

            // loop to measure elapsed time to run sample code

            do
            {

              // test once or more

              counter += 1; // 18 bytes is the well-known byte code size of this sourceline
      
            } while (++i < max);

            float t1 = llGetTime();

            // loop to measure elapsed time to run no code

            do ; while (++j < max);

            float t2 = llGetTime();

            // complain if time ran backwards
            
            if (!((t0 <= t1) && (t1 <= t2)))
            {
                llOwnerSay("MEANINGLESS RESULT -- SIMULATED TIME RAN BACKWARDS -- TRY AGAIN");
            }
            
            // report average time elapsed per run

            float elapsedms = 1000.0 * (((t1 - t0) - (t2 - t1)) / max);
            llOwnerSay((string) elapsedms + "+-??% ms may have elapsed on average in each of");
            llOwnerSay((string) max + " trials of running the code in the loop");
        }
    }
}

Launched by Xaviar Czervik, then modified by Strife Onizuka, then further edited as the history of this article shows.

Try the empty test of deleting the { counter += 1; } source line to see the astonishing inaccuracy of this instrument. The time cost of no code, as measured here, isn't always zero!

See the LSL Script Efficiency article for a less brief discussion. Please understand, we don't mean to be arguing for many different ways to measure the costs of code. Here we do mean to be building a consensus on best practices, in one considerately short article constructed from a neutral point of view.