Difference between revisions of "Plugin architecture"

From Second Life Wiki
Jump to navigation Jump to search
 
(55 intermediate revisions by 6 users not shown)
Line 1: Line 1:
As of this writing (February 12, 2007), there's not an official plugin architecture in the Second Life viewer.  However, there's been a lot of interest in developing one.  This page (and the pages it links to) are an attempt to capture a lot of the informal discussion that has occurred so far.
These are the three main issues to be addressed:
== Code loading ==
Dynamic loading of natively-compiled executable code can be accomplished with dlopen / dlsym in Linux and MacOSX and LoadLibrary on Win32.
[[dlopen code example]]
There are wrappers to allow this to be more cross platform:
* Apache APR - Already in use in llimage/llimagej2c.cpp.  Not GPL compatible, but is compatible with the GPL+FLOSS exception license used in the Second Life viewer
* libtltdl
* Glib GModules
== Making the client into dynamic libs itself ==
Most interesting functions in the viewer could be broken out into dylibs / dlls so that plugins could link against them.  Code that we want to be able to call from a plugin needs to be in a DLL, and they can all be in the same DLL.  Code that is so rarely used we'd like to not load it unless we have to should go into a separate DLL.
== Calls from viewer to plugin (hooks) ==
In order to override or enhance existing functionality in the viewer, we need to be able to replace some code with our own.  One way to do this would be to install "hooks" into commonly-used functions.  In the example implementation code below, you can hook any function by adding 'PLUGIN_HOOK("function_name", data1, data2)' to the top of the function.
When that macro is called, it looks to see if any hooks have been registered with a name that matches "function_name".  If so, it executes each one in turn.
Each hook function can affect program execution in one of three ways:
* Pass event through -- a function might decide to ignore this hook based on the contents of data1 and data2, or it might do something which doesn't disrupt the program flow (such as adding data to an internal list for later use, or displaying a dialog box).  In this case, it should just return TRUE.
* Modify params, pass event through -- as above, except the hook function can modify the contents of data1 and/or data2 before returning TRUE
* Swallow event:  Sometimes, we want to completely override the function being hooked, for various reasons -- in this case, the plugin should return FALSE.
PLUGIN_HOOK executes each function in turn; if it function returns FALSE, it just issues a 'return' in the context of the hooked function.  If all hooks return TRUE, control will eventually be passed to the hooked function.
[[hook example code]]
[[hooking sending IMs]]
== Calls from plugin to viewer (exposing an API) ==
Most plugins will want to call into the client and have it do things like display dialog boxes, send IMs, etc.  Unfortunately, there's no simple way to do this.
One solution is to pick a number of useful functions, build a function pointer table, and allow plugins to ask for them by name.
[[function pointer example code]]
== Required Changes ==
== Required Changes ==
Some changes in the code will be required to support plugins.  
Some changes in the code will be required to support plugins.  
Line 7: Line 54:
* Add internal callbacks for events such as rendering a frame, receiving a chat message, etc.
* Add internal callbacks for events such as rendering a frame, receiving a chat message, etc.


[[Category:Feature Requests]]
=Other Information=
== Capabilities and Plugin Examples ==




'''Plugin <--> LSL Communication Channels'''
The following is a discussion of what we'd like to be able to do with a plugin.  Note it is not a discussion of how plugins will be managed.


Many compelling applications would benefit from a pipe between the plugin process and server side LSL scripts.   Anything which wants to communicate status or information which can only be gathered reliably via LSL rather than typical protocol messages the client receives would benefit from such a pipe. 
* Affecting rendering pipeline (eg, improving rendering of clouds)
* Transforming messages (eg:  adding encryption to IM messages)
* Improving the User Interface (eg: better building tools)
* Automated Agents, potentially headless (no GUI).
* Extend client to support new 3D object types and their behaviors (eg: rendering of objects with complex, non-primitive shapes or complex behaviors)
* Extend client to be a platform for other applications (eg: PDF viewer with scrollbars on the face of a prim)


A brief discussions on the alternatives for communication follows:
== More Plugin Architecture Ideas ==


* Ideally, this pipe could be written differently from the current chat channels afforded by llSay or Instant Message, to avoid performance and size limitations.  However, an early implementation using available technologies would be preferable to one which may take significantly longer.
# [[Plugin_architecture_RoadMap|Development Road Map]]
# Discussions
## [[Plugin_architecture_survey|Survey of Client Plugins as Potential Models]]
## [[Plugin_architecture_backwards|Backwards Compatibility]]
## [[Plugin_architecture_Security|Security Model Issues]]
## [[Plugin_architecture_Stability|Plugins affecting Client Stability]]
## [[Plugin_LSL_Communication|Plugins <--> LSL Communication Channels]]
## [[Plugin_closed_source|Closed Source versus Open Source]]


* A chat channel implementation would require the ability for an avatar to have his client register a listener with the servers on channels other than channel 0.  The client would not display messages on channels other than 0, but would send them to any plugins which have been registered to listen on those channels.   
# Alternatives
## [[Plugin_Embedded|Embedded Virtual Machine With Scripting Language]]
## [[Plugin_Separate_Process|Separate Process]]


* Another implementation, using instant messages, would be useful for the added privacy, however time lag between messages are significant and it would be desirable not to have these messages show up on the client itself so a flag would need to be added for plugin-only instant messages.
[[Category:Feature Requests]]
 
* Other ideas, such as HTTP requests or Emails, for external plugin communication should be discarded quickly for the very reason that most systems now have significant firewalls and NAT'd connections which will deny such communication channels immediately.

Latest revision as of 23:55, 6 April 2007

As of this writing (February 12, 2007), there's not an official plugin architecture in the Second Life viewer. However, there's been a lot of interest in developing one. This page (and the pages it links to) are an attempt to capture a lot of the informal discussion that has occurred so far.


These are the three main issues to be addressed:

Code loading

Dynamic loading of natively-compiled executable code can be accomplished with dlopen / dlsym in Linux and MacOSX and LoadLibrary on Win32.

dlopen code example


There are wrappers to allow this to be more cross platform:

  • Apache APR - Already in use in llimage/llimagej2c.cpp. Not GPL compatible, but is compatible with the GPL+FLOSS exception license used in the Second Life viewer
  • libtltdl
  • Glib GModules

Making the client into dynamic libs itself

Most interesting functions in the viewer could be broken out into dylibs / dlls so that plugins could link against them. Code that we want to be able to call from a plugin needs to be in a DLL, and they can all be in the same DLL. Code that is so rarely used we'd like to not load it unless we have to should go into a separate DLL.

Calls from viewer to plugin (hooks)

In order to override or enhance existing functionality in the viewer, we need to be able to replace some code with our own. One way to do this would be to install "hooks" into commonly-used functions. In the example implementation code below, you can hook any function by adding 'PLUGIN_HOOK("function_name", data1, data2)' to the top of the function.

When that macro is called, it looks to see if any hooks have been registered with a name that matches "function_name". If so, it executes each one in turn.

Each hook function can affect program execution in one of three ways:

  • Pass event through -- a function might decide to ignore this hook based on the contents of data1 and data2, or it might do something which doesn't disrupt the program flow (such as adding data to an internal list for later use, or displaying a dialog box). In this case, it should just return TRUE.
  • Modify params, pass event through -- as above, except the hook function can modify the contents of data1 and/or data2 before returning TRUE
  • Swallow event: Sometimes, we want to completely override the function being hooked, for various reasons -- in this case, the plugin should return FALSE.

PLUGIN_HOOK executes each function in turn; if it function returns FALSE, it just issues a 'return' in the context of the hooked function. If all hooks return TRUE, control will eventually be passed to the hooked function.

hook example code

hooking sending IMs

Calls from plugin to viewer (exposing an API)

Most plugins will want to call into the client and have it do things like display dialog boxes, send IMs, etc. Unfortunately, there's no simple way to do this.

One solution is to pick a number of useful functions, build a function pointer table, and allow plugins to ask for them by name.

function pointer example code

Required Changes

Some changes in the code will be required to support plugins.

  • Complete GUI and other classes with functions that would be expected to exist, but don't because nothing needed them yet. For instance, add method overloads that should logically exist.
  • Allow multiple callbacks per message, as well as unregistering a previously registered one. Currently only one callback can be registered per message type.
  • Verify that all the callbacks work in such a way that they wouldn't be confused by plugins. When a callback for a reply to a request runs it must make sure that the data to arrived is what was requested, and if not, ignore it.
  • Add internal callbacks for events such as rendering a frame, receiving a chat message, etc.

Other Information

Capabilities and Plugin Examples

The following is a discussion of what we'd like to be able to do with a plugin. Note it is not a discussion of how plugins will be managed.

  • Affecting rendering pipeline (eg, improving rendering of clouds)
  • Transforming messages (eg: adding encryption to IM messages)
  • Improving the User Interface (eg: better building tools)
  • Automated Agents, potentially headless (no GUI).
  • Extend client to support new 3D object types and their behaviors (eg: rendering of objects with complex, non-primitive shapes or complex behaviors)
  • Extend client to be a platform for other applications (eg: PDF viewer with scrollbars on the face of a prim)

More Plugin Architecture Ideas

  1. Development Road Map
  2. Discussions
    1. Survey of Client Plugins as Potential Models
    2. Backwards Compatibility
    3. Security Model Issues
    4. Plugins affecting Client Stability
    5. Plugins <--> LSL Communication Channels
    6. Closed Source versus Open Source
  1. Alternatives
    1. Embedded Virtual Machine With Scripting Language
    2. Separate Process