Difference between revisions of "PyOGP Client Library Development Sandbox"

From Second Life Wiki
Jump to navigation Jump to search
(Added links to archives)
 
(66 intermediate revisions by 7 users not shown)
Line 1: Line 1:
{{PyOGP/navigation}}
We will first run down the general explanation and add platform specific notes later.
We will first run down the general explanation and add platform specific notes later.


==Browse the Code==
If all you want to do is glance at the source code, use the [http://svn.secondlife.com/trac/linden/browser/projects/2008/pyogp browser link to the repository]
== Prerequisites ==


Agents used in testing OGP grids run by Linden Lab need to be in the gridnauts group in sl.
== Repositories ==


You need to have the following things installed:<br>
Stable trunk repositories:
<b>Note: subversion 1.5.x was tried, and it gave errors such as "unrecognized .svn/entries format" and "log not found". We suggest using svn 1.4.x. Also, if you use TortoiseSVN, use the 1.4.x version as well. Finally, it seems that these steps need to be done in order, but that is not fully confirmed.</b>
* http://bitbucket.org/lindenlab/pyogp.apps/
* http://bitbucket.org/lindenlab/pyogp.lib.base/
* http://bitbucket.org/lindenlab/pyogp.lib.client/
* http://bitbucket.org/lindenlab/pyogp.buildout/


<table>
Maintenance repositories:
<Tr><Td width=200>Component<td width=300>URL<td width=100>Linux<td width=100>Windows XP<td width=100>MacOS
* http://bitbucket.org/lindenlab/pyogp.apps-maint/
<TR><td>Subversion 1.4.x<td>http://subversion.tigris.org/ <Td>Recommended<td>Recommended<td>Recommended
* http://bitbucket.org/lindenlab/pyogp.lib.base-maint/
<TR><td>Subversion 1.5.x<td>http://subversion.tigris.org/ <Td>Failed<td><td>
* http://bitbucket.org/lindenlab/pyogp.lib.client-maint/
<TR><td>Subversion 1.5.4<td>http://subversion.tigris.org/ <Td>Gentoo co OK<td><td>
* http://bitbucket.org/lindenlab/pyogp.buildout-maint/
<TR><td>Python 2.3<td>http://python.org/download<td>Failed<td>Failed<td>Failed
<TR><td>Python 2.4<td>http://python.org/download<td>Untested<td>Untested<td>Failed
<TR><td>Python 2.5<td>http://python.org/download<td>Recommended<td>Recommended<td>Pre-installed
<TR><td>C/C++ Compiler<td><td>Required<td>Required<td>XCode
<TR><td>setuptools 0.6c9<td>http://peak.telecommunity.com/<Td>Rqd by greenlet<td><td>
<TR><td>[http://pypi.python.org/pypi/greenlet/0.2 greenlet]<td>http://pypi.python.org/pypi/greenlet/0.2<td>Required<td>Required<td>Required
</table>


=== Mac specific requirements ===
Defunct until someone picks them up and fixes them:
* http://bitbucket.org/lindenlab/pyogp.interop/
* http://bitbucket.org/lindenlab/pyogp.lib.agentdomain/


* make sure you have X-Code installed.
Archives of the above repositories:
* zc.Buildout on the mac requires python 2.5. This is the pre-installed version.
* https://bitbucket.org/tapplek/ [[User:Tapple Gao|Tapple Gao]] ([[User talk:Tapple Gao|talk]])
* Use the pre-installed version of python to use some of the GUI packages with the [http://www.wingware.com WingIDE], such as wx. Do not run virtualenv if you want to use GUIs and WingIDE.
* https://github.com/orgs/SL-PyOGP/repositories [[User:Kadah Coba|Kadah Coba]] ([[User talk:Kadah Coba|talk]])


=== Windows specific requirements ===
== Browse the Code ==


=== Linux specific requirements ===
If all you want to do is glance at the source code, use the bitbucket source browser:
* http://bitbucket.org/lindenlab/pyogp.apps/src/
* http://bitbucket.org/lindenlab/pyogp.buildout/src/
* http://bitbucket.org/lindenlab/pyogp.interop/src/
* http://bitbucket.org/lindenlab/pyogp.lib.agentdomain/src/
* http://bitbucket.org/lindenlab/pyogp.lib.base/src/
* http://bitbucket.org/lindenlab/pyogp.lib.client/src/


== Environment Preparation ==
== Environment Preparation ==
=== Prerequisites ===
You must have the following installed:
* Mercurial - 1.3 or greater
* Python 2.4.4, 2.5.x, 2.6.x (untested on 3.0)
'''Setuptools''' and '''easy_install''' are Python standard means for installing modules. For more info, start here: http://pypi.python.org/pypi/setuptools.
'''Virtualenv''' is a method which allows you to create isolated Python environments, separate from your base install if you so prefer. For more, see here: http://pypi.python.org/pypi/virtualenv.


Your distribution may have Python's '''setuptools''' and '''virtualenv''' packages in its package repository.  If so, it is probably best to use your normal package installation procedures (see below for information on specific Linux distributions).  If the packages are not available then follow these generic instructions.
Your distribution may have Python's '''setuptools''' and '''virtualenv''' packages in its package repository.  If so, it is probably best to use your normal package installation procedures (see below for information on specific Linux distributions).  If the packages are not available then follow these generic instructions.


=== Generic Linux distribution ===
=== Mac Specifics ===
 
'''Note:''' Snow Leopard upgrades require a updated install of XCode, in this case to accommodate gcc (and greenlet).
 
=== Generic *nix Specifics ===
 
In order to install Python Packages and creating a development sandbox you have to do the following:
In order to install Python Packages and creating a development sandbox you have to do the following:


==== easy_install ====
=== easy_install ===
 
"Easy Install is a python module (easy_install) bundled with setuptools that lets you automatically download, build, install, and manage Python packages." I stole that from here: http://peak.telecommunity.com/DevCenter/EasyInstall.


Download ez_setup.py and run it with your Python interpreter. You can find it here: http://peak.telecommunity.com/dist/ez_setup.py
Download ez_setup.py and run it with your Python interpreter. You can find it here: http://peak.telecommunity.com/dist/ez_setup.py
Line 47: Line 66:


  wget http://peak.telecommunity.com/dist/ez_setup.py
  wget http://peak.telecommunity.com/dist/ez_setup.py
  -or-
curl -O http://peak.telecommunity.com/dist/ez_setup.py
  sudo python ez_setup.py
  sudo python ez_setup.py


==== greenlet ====
=== virtualenv ===
 
Install greenlet (required by eventlet for running coroutines)
 
  sudo easy_install greenlet
 
There may be a requirement to update your setuptools. If so, do this:
 
  sudo easy_install -U setuptools


==== virtualenv ====
Virtualenv builds isolated python environments. To learn more, read this: http://pypi.python.org/pypi/virtualenv.


To use a dedicated python installation in your host, install virtualenv like this:
To use a dedicated python installation in your host, isolated from your system python install, install virtualenv like this:


  easy_install virtualenv
  easy_install virtualenv


or if you need to be root something like this:
Or, if you need to be root something like this:


  sudo easy_install virtualenv
  sudo easy_install virtualenv


on windows, you may need a different path to easy_install
On windows, you may need a different path to easy_install


  c:\Python25\Scripts\easy_install.exe virtualenv
  c:\Python25\Scripts\easy_install.exe virtualenv


=== Gentoo Linux ===
== Install methods ==
 
As root, run:
 
emerge setuptools
emerge virtualenv
 


Note that there is now a dependency on greenlet, which is not available in Portage. Instead use:
Python modules can be installed in a variety of ways... we're encouraging the virtualenv and setup.py method.


  easy_install greenlet
=== buildout ===


In addition, greenlet itself adds a dependency on the non-stable setuptools-0.6c9 , so either add:
Buildout has a variety of uses, in PyOGP's case it is used as a development sandbox. Buildout will checkout all the necessary PyOGP repositories and their dependencies, and configure everything automatically (set up the right path members and install scripts). Once the sandbox is set up, you can make changes to the libs in the parts/ directory (they are actually local mercurial repositories), update the code referenced in buildout (re-run bin/buildout), and test your changes.


/etc/portage/package.keywords:  dev-python/setuptools ~x86
It's really easy to work with...
 
or use
 
ACCEPT_KEYWORDS='~x86' emerge setuptools
 
== Getting the buildout ==
 
We use zc.buildout to automatically setup a development environment. buildout gives you the ability to install packages only locally instead of your global python installation. It's sort of a local python installation which helps you avoiding version conflicts of packages.


1. First check out the buildout into a directory of your choice:
1. First check out the buildout into a directory of your choice:


  svn co http://svn.secondlife.com/svn/linden/projects/2008/pyogp/buildouts/libdev/trunk/ libdev
  hg clone http://bitbucket.org/enus_linden/pyogp.buildout (or grab pyogp.buildout-maint to work with maintenance repos)
 
If you are using svn1.5 or have otherwise problems on Mac OSX, try this buildout instead:
 
svn co http://svn.secondlife.com/svn/linden/projects/2008/pyogp/buildouts/libdev_svn15/trunk/ libdev
 
It needs Python2.5 though (which is the standard Python version of Mac OSX though)


2. Now turn this directory into a virtual python environment which is independant of your normal Python installation:
2. Now turn this checkout into a virtual python environment, independent of your normal Python installation:


  cd libdev
  cd pyogp.buildout
  virtualenv . --no-site-packages
  virtualenv . --no-site-packages


Line 127: Line 120:


   bin/buildout -v
   bin/buildout -v
*** This fails with the message:
  Abort: repository 'http://bitbucket.org/enus_linden/pyogp.lib.base/' is not local


or on Windows:
or on Windows:
Line 132: Line 129:
   bin\buildout.exe -v
   bin\buildout.exe -v


5. The development sandbox is ready. There now is a bin/pyogp which is a python interpreter which contains all the installed packaged and the pyogp library and related projects.
5. The development sandbox is ready. There now is a bin/pyogp_interpreter, a python interpreter which contains all the installed packages and the pyogp libraries and dependencies referenced in the path.


== Run the tests ==
6. Test the buildout installation. To test this installation you can (at least at this stage of the project) try the following sample script or run the unittests:
 
  bin/region_connect <firstname> <lastname>
 
  -or-
 
  bin/unittests --where=parts/pyogp.lib.base (or pyogp.lib.client)
 
Enter the avatar's password when prompted, and you're on your way to aditi, the Beta Grid.


Run the tests by simply saying
=== setup.py ===


bin/client_unittest
If you prefer to not use buildout, and to do things a bit more manually, well, you probably don't need much help here then do you? ;)


Hopefully they all pass.
Grab the source for each of the pyogp repos, and install them to a virtualenv instance (see above for installing virtualenv if you don't have it)..


== Using the login example ==
Here's a simple setup that Enus likes:
cd ~
mkdir sandbox
cd sandbox
virtualenv . --no-site-packages
cd ~
mkdir hg
cd hg
hg clone https://enus_linden@bitbucket.org/lindenlab/pyogp.apps/
hg clone https://enus_linden@bitbucket.org/lindenlab/pyogp.lib.base/
hg clone https://enus_linden@bitbucket.org/lindenlab/pyogp.lib.client/
cd ~/hg/pyogp.lib.base
~/sandbox/bin/python setup.py install
cd ~/hg/pyogp.lib.client
~/sandbox/bin/python setup.py install
cd ~/hg/pyogp.apps
~/sandbox/bin/python setup.py install
......
now, in ~/sandbox/bin/ you'll have all kinds of pyogp executables for testing stuff out (like region_connect, etc)


To test this installation you can (at least at this stage of the project) try the following:
You now have all the source, plus a sandbox, for tinkering with pyogp!


   bin/login <firstname> <lastname>
To try an executable out, just run it in ~/sandbox/bin/. for example:
   ~/sandbox/bin/region_connect firstname lastname
This command will login in your agent to aditi, and will prompt you for a password.


Give your Avatar name and it will ask for a password. Then it tries to login using the Linden Lab Agent Domain and placing the avatar on a different's grid region. You need to be in the gridnauts group though.
Pass any script the "-h" param to get it's usage.


== Run the tests ==


== The structure of the sandbox ==
See [[PyOGP_Package_Unittests]] for details...


You now might wonder what all those directories are good for. To learn more about this check out the [[Pyogp/Filesystem_Structure|Filesystem Structure]]


[[Category: Pyogp_Client_Lib]]
[[Category: Pyogp_Client_Lib]]
[[Category:Pyogp_Kitchen_Sink]]
[[Category:Pyogp Draft]]

Latest revision as of 02:27, 13 September 2022

We will first run down the general explanation and add platform specific notes later.


Repositories

Stable trunk repositories:

Maintenance repositories:

Defunct until someone picks them up and fixes them:

Archives of the above repositories:

Browse the Code

If all you want to do is glance at the source code, use the bitbucket source browser:

Environment Preparation

Prerequisites

You must have the following installed:

  • Mercurial - 1.3 or greater
  • Python 2.4.4, 2.5.x, 2.6.x (untested on 3.0)

Setuptools and easy_install are Python standard means for installing modules. For more info, start here: http://pypi.python.org/pypi/setuptools.

Virtualenv is a method which allows you to create isolated Python environments, separate from your base install if you so prefer. For more, see here: http://pypi.python.org/pypi/virtualenv.

Your distribution may have Python's setuptools and virtualenv packages in its package repository. If so, it is probably best to use your normal package installation procedures (see below for information on specific Linux distributions). If the packages are not available then follow these generic instructions.

Mac Specifics

Note: Snow Leopard upgrades require a updated install of XCode, in this case to accommodate gcc (and greenlet).

Generic *nix Specifics

In order to install Python Packages and creating a development sandbox you have to do the following:

easy_install

"Easy Install is a python module (easy_install) bundled with setuptools that lets you automatically download, build, install, and manage Python packages." I stole that from here: http://peak.telecommunity.com/DevCenter/EasyInstall.

Download ez_setup.py and run it with your Python interpreter. You can find it here: http://peak.telecommunity.com/dist/ez_setup.py

Eventually you have to be root to do this depending on your system (mostly non-windows). It should look like this on a unix based machine:

wget http://peak.telecommunity.com/dist/ez_setup.py
 -or-
curl -O http://peak.telecommunity.com/dist/ez_setup.py
sudo python ez_setup.py

virtualenv

Virtualenv builds isolated python environments. To learn more, read this: http://pypi.python.org/pypi/virtualenv.

To use a dedicated python installation in your host, isolated from your system python install, install virtualenv like this:

easy_install virtualenv

Or, if you need to be root something like this:

sudo easy_install virtualenv

On windows, you may need a different path to easy_install

c:\Python25\Scripts\easy_install.exe virtualenv

Install methods

Python modules can be installed in a variety of ways... we're encouraging the virtualenv and setup.py method.

buildout

Buildout has a variety of uses, in PyOGP's case it is used as a development sandbox. Buildout will checkout all the necessary PyOGP repositories and their dependencies, and configure everything automatically (set up the right path members and install scripts). Once the sandbox is set up, you can make changes to the libs in the parts/ directory (they are actually local mercurial repositories), update the code referenced in buildout (re-run bin/buildout), and test your changes.

It's really easy to work with...

1. First check out the buildout into a directory of your choice:

hg clone http://bitbucket.org/enus_linden/pyogp.buildout (or grab pyogp.buildout-maint to work with maintenance repos)

2. Now turn this checkout into a virtual python environment, independent of your normal Python installation:

cd pyogp.buildout
virtualenv . --no-site-packages

on windows, you may need to specify the path

c:\Python25\Scripts\virtualenv.exe . --no-site-packages

3. Now run the bootstrap.py file with the newly created local Python interpreter:

bin/python bootstrap.py

or on Windows:

 Scripts\python bootstrap.py

4. This creates a bunch of directories and the bin/buildout script (bin\buildout.exe on windows). We now run this:

 bin/buildout -v
      • This fails with the message:
 Abort: repository 'http://bitbucket.org/enus_linden/pyogp.lib.base/' is not local

or on Windows:

 bin\buildout.exe -v

5. The development sandbox is ready. There now is a bin/pyogp_interpreter, a python interpreter which contains all the installed packages and the pyogp libraries and dependencies referenced in the path.

6. Test the buildout installation. To test this installation you can (at least at this stage of the project) try the following sample script or run the unittests:

 bin/region_connect <firstname> <lastname>
 -or-
 bin/unittests --where=parts/pyogp.lib.base (or pyogp.lib.client)

Enter the avatar's password when prompted, and you're on your way to aditi, the Beta Grid.

setup.py

If you prefer to not use buildout, and to do things a bit more manually, well, you probably don't need much help here then do you? ;)

Grab the source for each of the pyogp repos, and install them to a virtualenv instance (see above for installing virtualenv if you don't have it)..

Here's a simple setup that Enus likes:

cd ~
mkdir sandbox
cd sandbox
virtualenv . --no-site-packages
cd ~
mkdir hg
cd hg
hg clone https://enus_linden@bitbucket.org/lindenlab/pyogp.apps/
hg clone https://enus_linden@bitbucket.org/lindenlab/pyogp.lib.base/
hg clone https://enus_linden@bitbucket.org/lindenlab/pyogp.lib.client/
cd ~/hg/pyogp.lib.base
~/sandbox/bin/python setup.py install
cd ~/hg/pyogp.lib.client
~/sandbox/bin/python setup.py install
cd ~/hg/pyogp.apps
~/sandbox/bin/python setup.py install
......
now, in ~/sandbox/bin/ you'll have all kinds of pyogp executables for testing stuff out (like region_connect, etc)

You now have all the source, plus a sandbox, for tinkering with pyogp!

To try an executable out, just run it in ~/sandbox/bin/. for example:

 ~/sandbox/bin/region_connect firstname lastname

This command will login in your agent to aditi, and will prompt you for a password.

Pass any script the "-h" param to get it's usage.

Run the tests

See PyOGP_Package_Unittests for details...