Texture Pipeline Performance Test

From Second Life Wiki
Revision as of 12:38, 1 May 2012 by Jeremy Linden (talk | contribs) (Created page with "Category:QA Portal Category:Test Scripts Category:Quality Assurance ==Setup== * Delete your settings.ini file (C:\Documents and Settings\LOGIN_NAME\Application Data\S…")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Setup

  • Delete your settings.ini file (C:\Documents and Settings\LOGIN_NAME\Application Data\SecondLife\user_settings\settings.ini on PC, /Users/LOGIN_NAME/Library/Application Support/SecondLife/user_settings/settings.ini on Mac)
  • Log in
  • Wear the Male Shape & Outfit from the Library
  • Set your draw distance to 256
  • Leave your viewer resolution at the default 1024x738
  • Verify network speed is 500K. This test assumes you are on a LAN connection. Note if you are not using a LAN connection.
  • Go to Texturetest (40, 189, 75) and stand in the orange ring facing East.
  • Verify you see all 100 number textures on the boxes in front of you.
  • Open Statistics, ctrl-shift-1
  • Close the minimap
  • Log out.
  • Get a stopwatch or other timing device ready

Load textures from cache test

  • Log in
  • When bandwidth drops to < 30 kps, log out.
  • Log in again and start counting time when the "Logging in..." message disappears.
  • Stop counting time when you see all 100 number textures on the boxes in front of you, texture on the ground of this region, and texture on the trees in front of you.

Analysis

  • Note the elapsed time below and compare to previous versions.
  • Alert a developer if the elapsed time is > 10% of previous version.

1.22.7.108773 (Release Candidate) AGNI 1-26-09

  • "Burst" AMD64x2 - (29, 27, 26) ~27

1.22.11.113941 (Release) Agni, 5-7-09

  • Desktop PC, Intel Core 2, 2.4 MHz - (13, 13, 12) ~13

1.23.1.119104 (Release) Agni, 5-7-09

  • Desktop PC, Intel Core 2, 2.4 MHz - (12, 11, 12) ~12

Perceptual difference between 1.22.11 and 1.23.1 is that 1.23.1 appears to load the avatar much later in the process. Takes the same amount of time, maybe even slightly faster, but FEELS slower.

2.0.0.20517 (Beta 4) Agni, 3-5-10

  • iMac 2GB Intel Core 2 Duo - (43, 44, 45) ~44

1.23.5 (136262) Aditi 5-18-10

  • "Burst" AMD64x2 - (24, 23, 25) ~24

2.0.1 (203797) Aditi 5-18-10

  • "Burst" AMD64x2 - (28, 25, 24) ~26

2.0.2 (204734)Mesh FirstLook (using HTTP texture) Aditi 5-18-10

  • "Burst" AMD64x2 - (26, 27, 25) ~26

2.1.0 (207030) (HTTP Textures disabled) Aditi 7-22-10

  • Pentium(R) D CPU 2.8 GHz - (29, 29, 28) ~29

2.1.0 (207030) (HTTP Textures enabled) Aditi 7-22-10

  • Pentium(R) D CPU 2.8 GHz - (28, 28) ~28

Load textures from network test

  • Clear the cache (on PC, delete the C:\Documents and Settings\LOGIN_NAME\Application Data\SecondLife\cache folder, on Mac delete the /Users/LOGIN_NAME/Library/Application Support/SecondLife/cache folder)

The above instructions for cache clearing aren't complete. Some of the directories are wrong (Library/Cache is now involved on Mac) and the scene object cache is now working as well so must be cleared. -monty

  • Log in and start counting time when the "Logging in..." message disappears.
  • Mark the time when you see all 100 number textures on the boxes in front of you, texture on the ground of this region, and texture on the trees in front of you. This is "Time to no gray".

Analysis

  • Note the elapsed time below and compare to previous versions.
  • Alert a developer if the elapsed time is > 10% of previous version.
  • Be aware that Windows 2.x viewer is ~6 seconds slower than 1.23 (EXT-8683), so compare to previous 2.x viewers instead.

1.20.17 (98669) Viewer/1.24.9.98659 Server AGNI 2008-10-09

  • "Burst" AMD64x2 - (30, 26, 27) ~28

1.22.7.108773 (Release Candidate) AGNI 1-26-09

  • "Burst" AMD64x2 - (27, 42, 36) ~36

1.22.11.113941 (Release) Agni, 5-7-09

  • Desktop PC, Intel Core 2, 2.4 MHz - (12, 12, 22) ~15

1.23.1.119104 (Release) Agni, 5-7-09

  • Desktop PC, Intel Core 2, 2.4 MHz - (12, 12, 13) ~12

2.0.0.20517 (Beta 4) Agni, 3-5-10

  • iMac 2GB Intel Core 2 Duo - (55, 54, 54) ~54

1.23.5 (136262) Aditi 5-18-10

  • "Burst" AMD64x2 - (26, 31, 25) ~27

2.0.1 (203797) Aditi 5-18-10

  • "Burst" AMD64x2 - (55, 57, 60) ~57

2.0.2 (204734)Mesh FirstLook (HTTP Textures enabled) Aditi 5-18-10

  • "Burst" AMD64x2 - (38, 27, 42) ~39

2.1.0 (207030) (HTTP Textures disabled) Aditi 7-22-10

  • Pentium(R) D CPU 2.8 GHz - (73, 73, 75, 78) ~75

2.1.0 (207030) (HTTP Textures enabled) Aditi 7-22-10

  • Pentium(R) D CPU 2.8 GHz - (36, 34, 35, 40) ~36

Load all textures in the queue

  • Clear the cache
  • Log in and start counting time when the "Logging in..." message disappears.
  • Mark the time when you see all textures cleared from the texture console queue. (Open texture console with ctrl-shift-3 when the Advanced menu (ctrl-alt-q) is open)

Analysis

  • Note the elapsed time below and compare to previous versions.
  • Alert a developer if the elapsed time is > 10% of previous version.
  • Be aware that Windows 2.x viewer is ~6 seconds slower than 1.23 (EXT-8683), so compare to previous 2.x viewers instead.

Teleporting away and back

  • Log in and go to http://maps.secondlife.com/secondlife/TextureTest/40/189/75 (Restricted access - Contact Oz Linden) looking east.
  • When bandwidth drops to < 30 kps, teleport to a non-adjacent region.
  • Wait for 60 seconds. This is about how long it takes for the viewer to release the objects and their textures.
  • Teleport back to http://maps.secondlife.com/secondlife/TextureTest/40/189/75 and immediately start counting time.
  • Stop counting time when you see all 100 number textures on the boxes in front of you, texture on the ground of this region, and texture on the trees in front of you.

Analysis

  • Note the elapsed time below and compare to previous versions.
  • Alert a developer if the elapsed time is > 10% of previous version.

1.22.7.108773 (Release Candidate) AGNI 1-26-09

  • "Burst" AMD64x2 - (24, 20, 20 ) ~21

1.22.11.113941 (Release) Agni, 5-7-09

  • Desktop PC, Intel Core 2, 2.4 MHz - ~17

1.23.1.119104 (Release) Agni, 5-7-09

  • Desktop PC, Intel Core 2, 2.4 MHz - ~17

2.0.0.20517 (Beta 4) Agni, 3-5-10

  • iMac 2GB Intel Core 2 Duo - (25, 23, 27) ~25

(Optional) Run Multiple Threads affect on Frametime while decoding textures

Run this test while Debug > Rendering > Run Multiple Threads is ON and while it's OFF and compare in the analysis.

  • Log in and turn on Debug > Rendering > Run Multiple Threads.
  • Allow textures to load and log out.
  • Log in while textures are in the cache.
  • As soon as rendering starts, open fast timers(ctrl-shift-9) and texture console(ctrl-shift-3).
  • When texture decode (yellow column in the Texture Console) stops updating, click the mouse on the fast timers to stop the fast timers.
  • Note the frametime in the fast timers.

Analysis

  • Note the average frametime below and compare to previous versions.
  • Alert a developer if the frametime is > 10% of previous version.
  • Frametime for Run Multiple Threads=ON should be ~5ms less than OFF on dual CPU machines
  • Frametime should be identical for single CPU machines when Run Multiple Threads is ON or OFF.

1.13.0(8) AGNI

  • "Burst" AMD64x2 - (28, 27, 27, 24.5, 26) ~26.5
  • minspec GeForce2 PC - (61, 63.5, 65.5, 62) ~63

1.13.0 (55270) (pipeline) AGNI 12-04-06

  • Threads OFF "Burst" AMD64x2 - (29.5, 28.5, 31.5, 25.0, 27.0, 28.0) ~28.25
  • Threads ON "Burst" AMD64x2 - (27, 27, 28, 32, 24.5, 26) ~27.4
  • Threads OFF minspec GeForce2 PC - (61.5, 63, 62.5) ~62.3
  • Threads ON minspec GeForce2 PC - (62.5, 61.5) similar (SL-29153 makes this test prohibitively difficult)

1.13.3.2 AGNI 2-4-07

  • "Constantine" PentiumD 3Ghz DC - Could not test

1.13.3.57575 (Firstlook) AGNI 2-4-07

  • "Constantine" PentiumD 3Ghz DC - Could not test

1.22.7.108773 (Release Candidate) AGNI 1-26-09

  • "Burst" AMD64x2 - Can't run this because AMD affinity bug makes the frametime a spiky mess.
Retrieved from "https://wiki.secondlife.com/w/index.php?title=Texture_Pipeline_Performance_Test&oldid=1166583"