Difference between revisions of "Fixed Precision"

From Second Life Wiki
Jump to navigation Jump to search
m
m (lsl code tagging)
Line 4: Line 4:
Here's a function to do fixed precision.
Here's a function to do fixed precision.


<pre>
<lsl>
string fixedPrecision(float input, integer precision)
string fixedPrecision(float input, integer precision)
{
{
Line 11: Line 11:
     return (string)input;
     return (string)input;
}
}
</pre>
</lsl>


{{LSLC|Examples|Fixed Precision}}
{{LSLC|Examples|Fixed Precision}}
{{#vardefine:sort|Fixed Precision}}
{{#vardefine:sort|Fixed Precision}}

Revision as of 16:19, 30 March 2008

Function to do fixed precision

Here's a function to do fixed precision.

<lsl> string fixedPrecision(float input, integer precision) {

   if((precision = (precision - 7 - (precision < 1))) & 0x80000000)
       return llGetSubString((string)input, 0, precision);
   return (string)input;

} </lsl>