Puppeteering - Revision history

Gwyneth Llewelyn: Added references to the new project for 2022, 'Puppetry'

2022-09-23T00:37:27Z

Added references to the new project for 2022, 'Puppetry'

← Older revision		Revision as of 17:37, 22 September 2022
Line 1:		Line 1:
			{{distinguish\|How Puppetry Works{{!}}Puppetry}}
	{{Obsolete\|This project is no longer active.}}		{{Obsolete\|This project is no longer active.}}

Line 15:		Line 16:
	The code to puppeteer one's avatar locally (visible only to the person doing the puppeteering) is complete. A simple feature to save a puppeted pose as a still animation asset is complete. A proposed UI rework (cosmetic only) is designed but not yet implemented. The networking layer, which will allow others to see the real time puppeteering of one's avatar has not been thoroughly tested, and several issues remain. The foundational work to allow puppeteering to blend in with traditional animations (for example, waving an arm or pointing while dancing) is in place, however work remains to do smooth blending.		The code to puppeteer one's avatar locally (visible only to the person doing the puppeteering) is complete. A simple feature to save a puppeted pose as a still animation asset is complete. A proposed UI rework (cosmetic only) is designed but not yet implemented. The networking layer, which will allow others to see the real time puppeteering of one's avatar has not been thoroughly tested, and several issues remain. The foundational work to allow puppeteering to blend in with traditional animations (for example, waving an arm or pointing while dancing) is in place, however work remains to do smooth blending.

	~~'''Note:'''~~ The Puppeteering team has decided to put this project on the back burner until further notice.		{{Notice\|The Puppeteering team has decided to put this project on the back burner until further notice.}}

			{{See Also\|How Puppetry Works{{!}}Puppetry}}

	= Roadmap =		= Roadmap =
Line 23:		Line 26:
	== Prototype Release: Expressive Puppeteering ==		== Prototype Release: Expressive Puppeteering ==

	~~NOTE: this~~ list hasn't been edited since the project was put on hold. The features listed here may or may not be available in the release on svn.secondlife.com		{{Notice\|This list hasn't been edited since the project was put on hold. The features listed here may or may not be available in the release on [http://svn.secondlife.com/svn/linden/branches/2008/Puppeteering080323/ svn.secondlife.com].}}

	* The first release is about laying the foundation for the future of avatar manipulation. Key is the development of the Physical Avatar, a code layer which models an avatar as physically-based joint balls connected by springs, and allows influence by external forces (from UI and from world). As this model is being manipulated, it continually converts back to the standard avatar representation so it can be rendered.		* The first release is about laying the foundation for the future of avatar manipulation. Key is the development of the Physical Avatar, a code layer which models an avatar as physically-based joint balls connected by springs, and allows influence by external forces (from UI and from world). As this model is being manipulated, it continually converts back to the standard avatar representation so it can be rendered.
Line 32:		Line 35:
	= Vision =		= Vision =
	The Physical Avatar layer enables the development of several Grid-changing technologies.		The Physical Avatar layer enables the development of several Grid-changing technologies.
	* <b>Real-time gesturing</b>: An advanced UI, perhaps using keyboard chording or even alternate input devices to produce complicated avatar expression. Real time dancing.
	* <b>IK and rag-doll physics</b>: Residents could walk hand in hand with realistic motion. Avatars tumble realistically when falling (or when shot, pushed).
	** Play awesomely with Havok. When bumped, ragdoll friction relative to impact force. :)
	* <b>In-world animation tools</b>: Residents can build and save their own gestures, animations in world. No need for external modeling applications, exporting, and uploading.
	* <b>Scripted animations</b>: Additions to LSL would allow the scripted adjustment of the Physical Avatar joint tree.
	* <b>Procedural animations</b>: Ability to blend puppeteered actions into running animations including previously puppeteered loops.
	* <b>Touch a surface</b>: Ride on the 'texture surface' code to move a joint to a surface on a nearby object, pulling IK chain along.

			* {{strong\|Real-time gesturing}}: An advanced UI, perhaps using keyboard chording or even alternate input devices to produce complicated avatar expression. Real time dancing.
			* {{strong\|IK and rag-doll physics}}: Residents could walk hand in hand with realistic motion. Avatars tumble realistically when falling (or when shot, pushed).
			** Play awesomely with Havok. When bumped, ragdoll friction relative to impact force. :)
			* {{strong\|In-world animation tools}}: Residents can build and save their own gestures, animations in world. No need for external modeling applications, exporting, and uploading.
			* {{strong\|Scripted animations}}: Additions to LSL would allow the scripted adjustment of the Physical Avatar joint tree.
			* {{strong\|Procedural animations}}: Ability to blend puppeteered actions into running animations including previously puppeteered loops.
			* {{strong\|Touch a surface}}: Ride on the 'texture surface' code to move a joint to a surface on a nearby object, pulling IK chain along.

	= Source code =		= Source code =

	~~'''NOTE''' -~~ THIS CODE IS NOT SUPPORTED, PROVIDED AS IS, AND DOES NOT REPRESENT THE DIRECTION LINDEN LAB WILL WANT TO TAKE THIS FEATURE. This source code is released purely for demonstration and research purposes		{{Warning\|1=THIS CODE IS NOT SUPPORTED, PROVIDED AS IS, AND DOES NOT REPRESENT THE DIRECTION LINDEN LAB WILL WANT TO TAKE THIS FEATURE.

			This source code is released purely for demonstration and research purposes}}

	SVN URL:http://svn.secondlife.com/svn/linden/branches/2008/Puppeteering080323/		SVN URL: http://svn.secondlife.com/svn/linden/branches/2008/Puppeteering080323/

	The code itself is somewhat complete - there are definitely some things we would do differently and there are still definitely bugs in there, but right now it's pretty unlikely that we will return to this to complete it or refactor that which we would want to change with the code and intent as it stands. It's based off 1.19.1 and we have a region on aditi that is running the simulator code (note, again, this code is relatively incomplete and the simulator could well crash) named Puppeteering. You may need to log directly into that region for it to work.		The code itself is somewhat complete - there are definitely some things we would do differently and there are still definitely bugs in there, but right now it's pretty unlikely that we will return to this to complete it or refactor that which we would want to change with the code and intent as it stands. It's based off 1.19.1 and we have a region on aditi that is running the simulator code (note, again, this code is relatively incomplete and the simulator could well crash) named '''Puppeteering'''. You may need to log directly into that region for it to work.

	Direct any questions you may have about this to the [[SLDev]] mailing list.		Direct any questions you may have about this to the [[SLDev]] mailing list.
Line 54:		Line 59:
	* [[Render Roadmap]]		* [[Render Roadmap]]
	* [http://avatarpuppeteering.com/ avatarpuppeteering.com] - JJ Ventrella's site discussing the feature.		* [http://avatarpuppeteering.com/ avatarpuppeteering.com] - JJ Ventrella's site discussing the feature.
			* [[How Puppetry Works\|Puppetry]] (for the 2022 project with a similar name)

Oz Linden at 15:17, 26 April 2011

2011-04-26T15:17:25Z

← Older revision		Revision as of 08:17, 26 April 2011
Line 1:		Line 1:
			{{Obsolete\|This project is no longer active.}}

	= Objectives =		= Objectives =
	* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars		* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars

Saijanai Kuhn: /* Source code */

2009-11-01T23:44:28Z

Source code

← Older revision		Revision as of 16:44, 1 November 2009
Line 43:		Line 43:
	'''NOTE''' - THIS CODE IS NOT SUPPORTED, PROVIDED AS IS, AND DOES NOT REPRESENT THE DIRECTION LINDEN LAB WILL WANT TO TAKE THIS FEATURE. This source code is released purely for demonstration and research purposes		'''NOTE''' - THIS CODE IS NOT SUPPORTED, PROVIDED AS IS, AND DOES NOT REPRESENT THE DIRECTION LINDEN LAB WILL WANT TO TAKE THIS FEATURE. This source code is released purely for demonstration and research purposes

	SVN URL:		SVN URL:http://svn.secondlife.com/svn/linden/branches/2008/Puppeteering080323/
	http://svn.secondlife.com/svn/linden/branches/Puppeteering080323/

	The code itself is somewhat complete - there are definitely some things we would do differently and there are still definitely bugs in there, but right now it's pretty unlikely that we will return to this to complete it or refactor that which we would want to change with the code and intent as it stands. It's based off 1.19.1 and we have a region on aditi that is running the simulator code (note, again, this code is relatively incomplete and the simulator could well crash) named Puppeteering. You may need to log directly into that region for it to work.		The code itself is somewhat complete - there are definitely some things we would do differently and there are still definitely bugs in there, but right now it's pretty unlikely that we will return to this to complete it or refactor that which we would want to change with the code and intent as it stands. It's based off 1.19.1 and we have a region on aditi that is running the simulator code (note, again, this code is relatively incomplete and the simulator could well crash) named Puppeteering. You may need to log directly into that region for it to work.

Rob Linden: Updated with pointer to source code

2008-06-12T00:25:41Z

Updated with pointer to source code

@@ Line 1: / Line 1: @@
 = Objectives =
 * Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars
@@ Line 18: / Line 13: @@
 The code to puppeteer one's avatar locally (visible only to the person doing the puppeteering) is complete. A simple feature to save a puppeted pose as a still animation asset is complete. A proposed UI rework (cosmetic only) is designed but not yet implemented. The networking layer, which will allow others to see the real time puppeteering of one's avatar has not been thoroughly tested, and several issues remain. The foundational work to allow puppeteering to blend in with traditional animations (for example, waving an arm or pointing while dancing) is in place, however work remains to do smooth blending.
-'''Note:''' The Puppeteering team has decided to put this project on the back burner until 2008. We believe that resident facing issues of viewer stability, bug fixing, and performance are currently more critical than the development of this new feature. Team members are now engaged in tactical efforts to improve Second Life, and Puppeteering will not resume until (at the earliest) Q1, 2008.
+'''Note:''' The Puppeteering team has decided to put this project on the back burner until further notice.
 * The first release is about laying the foundation for the future of avatar manipulation. Key is the development of the Physical Avatar, a code layer which models an avatar as physically-based joint balls connected by springs, and allows influence by external forces (from UI and from world). As this model is being manipulated, it continually converts back to the standard avatar representation so it can be rendered.
 * The visible component of this is a simple UI enabling the momentary manipulation of avatar body parts. Initially this will be triggered by holding the CTRL key down. Mouse cursor proximity will cause joints to highlight, and a click and drag allows the positioning of that joint. As long as the CTRL key is held down the pose will be fixed, allowing the adjustment of several joints. All these manipulations will be visible to other residents. Movement, or the ESC key, will end puppeteering and revert the avatar back to original animation.
@@ Line 26: / Line 28: @@
 * You will be able to save a puppeteering pose as an animation asset, for later use as a pose or in a gesture.
-= Future Releases =
+= Vision =
 The Physical Avatar layer enables the development of several Grid-changing technologies.
 * <b>Real-time gesturing</b>: An advanced UI, perhaps using keyboard chording or even alternate input devices to produce complicated avatar expression. Real time dancing.
@@ Line 36: / Line 38: @@
 * <b>Touch a surface</b>:  Ride on the 'texture surface' code to move a joint to a surface on a nearby object, pulling IK chain along.
-'''Project in hibernation so that developers have time to devote to projects that increase Second Life's stability and performance'''
+= Source code =

Crystal Falcon: /* See Also */ added a link to Ventrella Linden's page avatarpuppeteering.com

2008-03-29T00:35:50Z

See Also: added a link to Ventrella Linden's page avatarpuppeteering.com

← Older revision		Revision as of 17:35, 28 March 2008
Line 1:		Line 1:
	= See Also =		= See Also =
	[[Render Roadmap]]		[[Render Roadmap]]

			[http://avatarpuppeteering.com/ avatarpuppeteering.com]

	= Objectives =		= Objectives =

Periapse Linden at 17:52, 13 September 2007

2007-09-13T17:52:00Z

@@ Line 10: / Line 10: @@
 It refers to nascent avatar expression technology. As with a real puppet, people will be able to manipulate the joints of their avatar, and others will be able to see these changes. The initial release will be rather humble -- the ability to temporarily adjust the position of individual joints. Enabling this is the deeper infrastructure of the Physical Avatar which, in subsequent evolutions, will allow (besides Puppeteering) a variety of new tools for real-time gesturing, inverse kinematics, rag-doll physics, in-world animation building, and scripted animation.
 = First Release: Expressive Puppeteering =
 * The first release is about laying the foundation for the future of avatar manipulation. Key is the development of the Physical Avatar, a code layer which models an avatar as physically-based joint balls connected by springs, and allows influence by external forces (from UI and from world). As this model is being manipulated, it continually converts back to the standard avatar representation so it can be rendered.
 * The visible component of this is a simple UI enabling the momentary manipulation of avatar body parts. Initially this will be triggered by holding the CTRL key down. Mouse cursor proximity will cause joints to highlight, and a click and drag allows the positioning of that joint. As long as the CTRL key is held down the pose will be fixed, allowing the adjustment of several joints. All these manipulations will be visible to other residents. Movement, or the ESC key, will end puppeteering and revert the avatar back to original animation.
@@ Line 27: / Line 33: @@
 * <b>Procedural animations</b>:  Ability to blend puppeteered actions into running animations including previously puppeteered loops.
 * <b>Touch a surface</b>:  Ride on the 'texture surface' code to move a joint to a surface on a nearby object, pulling IK chain along.
 = Roadmap =
-Tasks and milestones remaining:
+'''Project in hibernation so that developers have time to devote to projects that increase Second Life's stability and performance'''

Benja Kepler: /* Objectives */

2007-08-16T13:28:44Z

Objectives

← Older revision		Revision as of 06:28, 16 August 2007
Line 4:		Line 4:
	= Objectives =		= Objectives =
	* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars		* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars
	* Create a Physical Avatar code layer which enables the addition of ragdoll physics and inverse ~~kinemtatics~~ to second life avatars		* Create a Physical Avatar code layer which enables the addition of ragdoll physics and inverse kinematics to second life avatars

	= Overview =		= Overview =

Periapse Linden: /* Roadmap */

2007-08-09T23:09:27Z

Roadmap

@@ Line 11: / Line 11: @@
 It refers to nascent avatar expression technology. As with a real puppet, people will be able to manipulate the joints of their avatar, and others will be able to see these changes. The initial release will be rather humble -- the ability to temporarily adjust the position of individual joints. Enabling this is the deeper infrastructure of the Physical Avatar which, in subsequent evolutions, will allow (besides Puppeteering) a variety of new tools for real-time gesturing, inverse kinematics, rag-doll physics, in-world animation building, and scripted animation.
-= Roadmap =
+= First Release: Expressive Puppeteering =
 * The first release is about laying the foundation for the future of avatar manipulation. Key is the development of the Physical Avatar, a code layer which models an avatar as physically-based joint balls connected by springs, and allows influence by external forces (from UI and from world). As this model is being manipulated, it continually converts back to the standard avatar representation so it can be rendered.
@@ Line 20: / Line 17: @@
 * A base set of normal joint constraints should be available to users that allow for realistic movement
 * You will be able to save a puppeteering pose as an animation asset, for later use as a pose or in a gesture.

Periapse Linden: /* Objectives */

2007-08-09T22:48:32Z

Objectives

← Older revision		Revision as of 15:48, 9 August 2007
Line 4:		Line 4:
	= Objectives =		= Objectives =
	* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars		* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars
			* Create a Physical Avatar code layer which enables the addition of ragdoll physics and inverse kinemtatics to second life avatars

			= Overview =
			Puppeteering is real-time, user-manipulated animation of avatar joints.

			It refers to nascent avatar expression technology. As with a real puppet, people will be able to manipulate the joints of their avatar, and others will be able to see these changes. The initial release will be rather humble -- the ability to temporarily adjust the position of individual joints. Enabling this is the deeper infrastructure of the Physical Avatar which, in subsequent evolutions, will allow (besides Puppeteering) a variety of new tools for real-time gesturing, inverse kinematics, rag-doll physics, in-world animation building, and scripted animation.

			= Roadmap =


			'''First Release: Expressive Puppeteering'''

			* The first release is about laying the foundation for the future of avatar manipulation. Key is the development of the Physical Avatar, a code layer which models an avatar as physically-based joint balls connected by springs, and allows influence by external forces (from UI and from world). As this model is being manipulated, it continually converts back to the standard avatar representation so it can be rendered.
			* The visible component of this is a simple UI enabling the momentary manipulation of avatar body parts. Initially this will be triggered by holding the CTRL key down. Mouse cursor proximity will cause joints to highlight, and a click and drag allows the positioning of that joint. As long as the CTRL key is held down the pose will be fixed, allowing the adjustment of several joints. All these manipulations will be visible to other residents. Movement, or the ESC key, will end puppeteering and revert the avatar back to original animation.
			* A base set of normal joint constraints should be available to users that allow for realistic movement
			* You will be able to save a puppeteering pose as an animation asset, for later use as a pose or in a gesture.

Steve Linden: New page: = See Also = Render Roadmap = Objectives = * Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars

2007-08-03T21:58:17Z

New page: = See Also = Render Roadmap = Objectives = * Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars

New page

= See Also =
[[Render Roadmap]]

= Objectives =
* Further the ability to communicate in Second Life by enabling residents to 'puppeteer' their avatars