Difference between revisions of "Fixed Precision"

From Second Life Wiki
Jump to navigation Jump to search
m (<lsl> tag to <source>)
 
(7 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{LSL Header|ml=*}}
== Function to do fixed precision ==
Here's a function to do fixed precision.
Here's a function to do fixed precision.


<pre>
<source lang="lsl2">
string fixedPrecision(float input, integer precision)
string fixedPrecision(float input, integer precision)
{
{
     if(precision < 7)
     if((precision = (precision - 7 - (precision < 1))) & 0x80000000)
         return llGetSubString((string)input, 0, precision - 7 - !precision);
         return llGetSubString((string)input, 0, precision);
     return (string)input;
     return (string)input;
}
}
</pre>
</source>


[[Category:LSL Examples]]
{{LSLC|Examples|Fixed Precision}}

Latest revision as of 13:57, 24 January 2015