Sculpted Prims: Technical Explanation

Introduction

Sculpted prims are three dimensional meshes created from textures. Each texture is a mapping of vertex positions, where at full resolution each pixel would be one vertex, this can be less due to sampling (read below how the Second Life viewer treats your data). Each row of pixels (vertices) links back to itself, and for every block of four pixels two triangles are formed. At the top and bottom the vertices link to their respective pole.

Pixel Format

The alpha channel (if any) in position maps is currently unused, so we have 24 bits per pixel giving us 8 bits per color channel, or values from 0-255. Each color channel represents an axis in 3D space, where red green and blue map to X, Y, and Z respectively. If you're mapping from other software take in mind that not all 3D software will name their axises the same as SL does. If you have a different default orientation in SL than in your designer compare the axises and swap where appropriate.

The color values map to an offset from the origin of the object <0,0,0>, with values less than 127 being negative offsets and values greater than 127 being positive offsets. An image that was entirely <127,127,127> pixels (flat gray) would represent a single dot in space at the origin.

A sculpted prim intrinsically has a size of one meter, so the color values from 0-255 map to offsets from -0.5 to 0.5 meters. Combined with the scale vector that all prims in Second Life possess, sculpted prims have the same maximum dimensions as regular procedural prims (10 meter diameter).

Texture Mapping

The position map of a sculpted prim also doubles as the UV map, describing how a texture will wrap around the mesh. The image is already an explanation of what vertices correlate to what pixel, which is used to generate UV coordinates for vertices as they are created. This presents a big advantage for texture mapping over procedural prims created in Second Life because you can do all of your texturing in a 3D modeling program such as Maya, and when you export the position map you know the UV coordinates will be exactly preserved in Second Life.

Rendering in Second Life viewer

This analysis is based on 1.16.0(5) source and some tests.

Warning: Further tests have shown the viewer interpolates the sculpt textures depending on LOD. This likely has multiple effects: - Textures larger than a certain size are interpolated even at max LOD (Qarl has hinted before that 64x64 is max size which probably means anything above is interpolated). - When LOD drops the texture interpolation may cause strange deformation. We'll need to update this page with precise info on how and when textures get interpolated.

Important: When we refer to the texture in terms of how the viewer sees it, the first row (0) is the bottom row of your texture. For the columns they are left to right.

The Second life viewer will at it's highest level of detail render a grid of vertices in the following form:

1 top row of 33 vertices all mapped to a pole

31 rows of 33 vertices taken from your texture

1 bottom row of 33 vertices all mapped to a pole

For each row the 33th vertex is the same as the 1st, this stitches the sculpture at the sides. The poles are determined by taking the pixel on width/2 on the first and last row of your texture. (In a 64x64 texture that would be the 33rd pixel as we start counting columns from 0).

For example, a sculpture at the highest level of detail Second Life supports requires a mesh of 33 x 33 vertices If we have a 64x64 texture, this grid of vertices is sampled from the texture at the points:

 (32,0)  (32,0)  (32,0) ...  (32,0)  (32,0)  (32,0)
  (0,2)   (2,2)   (4,2) ...  (60,2)  (62,2)   (0,2)
   .                                       . 
   .                                       .
   .                                       .
 (0,60)  (2,60)  (4,60) ... (60,60) (62,60)  (0,60)
 (0,62)  (2,62)  (4,62) ... (60,62) (62,62)  (0,62)
(32,63) (32,63) (32,63) ... (32,63) (32,63) (32,63)

It is recommended to use 64x64 images. In theory 32x32 should give you the same quality but current code will not use your last (top!) row of your texture both as vertices and as the row to get the pole from. It will incorrectly trigger generation of a pole 1 row early and you'll hence get your 2 last rows of vertices filled with the pole.

Note that the next levels of detail are: 17x17 vertices and 9x9 vertices which are taken in the same way as above but the texture may be interpolated first. The only way to control how your sculpture looks at lower levels of detail is by using less vertices from the start and having more pixels colored the same.

The quality of your final result is also determined by the JPEG compression which is currently still too aggressive. This generally tends to make larger textures look better as the intermediate points help to have less distortion.

Examples

A pack of sculpture maps available for download: sculpt-tests.zip

An apple sculpt shown in the sculptedpreview program

An S-shaped sculpture shown in the latest version of sculptedpreview, with the sculpture map also applied as the texture map