Life at the Feeding Edge » opensim

Rezzable, Unity3d, Opensim FTW

epredator — Wed, 30 Jun 2010 14:14:52 +0000

The team at rezzable have a live demo up and running using Unity3d talking to Opensim and getting some of the geometry and packages from the opensim server.

It is good to see this sort of experimentation happening and will lead to yet more people trying things out I think. I know there are more out there too so maybe there is some sort of unity3d coalition or opensource style federation that could get together and share to drive this forward?
As I have written before there are all sort of options(my most read post ever so it must be of interest) for how this can me mixed and matched, some of it is smoke an mirrors for user experience but none the less immersive.
The key is to consider other ways to achieve the goals of a particular virtual world expereince, from immersion to whether things need to be user created or not.
So well done Rezzable, and thankyou for sharing it so far

Opensim/Second Life Vs Unity3d

epredator — Wed, 19 May 2010 09:50:59 +0000

I actually get asked a lot about how Unity3d stacks up against Opensim /Second Life. This question is usually based on wanting to use a virtual world metaphor to replicate what Opensim/Second Life do but with a visually very rich browser based client such as Unity3d.
There is an immediate clash of ideas here though and a degree of understanding that Unity3d is not comparable in the usual sense with SecondLife/OpenSim.
At its very heart you really have to consider Opensim and Second Life as being about being a server, that happens to have a client to look at it. Unity3d is primarily a client that can talk to other things such as servers but really does not have to to be what it needs to be.
Now this is not a 100% black and white description but it is worth taking these perspectives to understand what you might want to do with either type of platform.
Everything from an Opensim style server is sent to all the clients that need to know. The shapes, the textures, the position of people etc. When you create things in SL you are really telling a server to remember some things and then distribute them. Clearly some caching occurs as everything is not sent every time, but as the environment is designed to be constantly changing in every way it has to be down to the server to be in charge.

Now compare this to an “level” created in Unity3d. Typically you build all the assets into the unity3d file that is delivered to the client. i.e. its a stand alone fully interactive environment. That may be space invaders, car racing, a FPS shooter or an island to walk around.

Each person has their own self contained highly rich and interactive environment, such as this example. That is the base of what Unity3d does. It understands physics, ragdoll animations, lighting, directional audio etc. All the elements that make an engaging experience with interactive objects and good graphic design and sound design.
Now as unity3d is a container for programming it is able to use network connectivity to be asked to talk to other things. Generally this is brokered by a type of server. Something has to know that 2,3 or many clients are in some way related.
The simplest example is the Smartfox server multiplayer island demo.
Smartfox is a state server. It remembers things, and knows how to tell other things connected to it that those things have changed. That does not mean it will just know about everything in a unity3d scene. It its down to developers and designer to determine what information should be shared.

In the case above a set of unity clients all have objects numbered 1, 2 and 3 in them. It may be a ball, a person and a flock of birds in that order.

When the first client moves object number 1 smartfox on your own remote web server somewhere in the ether is just told some basic information about the state of that ball. Its not here now its here. Each of the other unity clients is connected to the same context. Hence they are told by the server to find object number 1 and move it to the new position. Now in gaming terms each of those clients might be a completely different view of the shared system. The first 2 might be a first person view, the thirds might be a 2d top down map view which has no 3d element to it at all. All they know is the object they consider to be object number 1 has moved.
In addition object number 3 in this example never shares any changes with the other clients. The server does not know anything about it and in the unity3d client it claims no network resources.
This sort of game object is one that is about atmosphere, or one that has no real need to waste network sending changes around. In the island example form unity3d this is a flock of seagulls on the island. They are a highly animated, highly dynamic flock of birds, with sound, yet technically in each client they are not totally the same.
(Now SL and Opensim use principle this for things such as particles and clouds but that is designed in)
For each user they merely see and hear seagulls, they have a degree of shared experience.
Games constantly have to balance the lag and data requirements of sending all this information around versus things that add to the experience. If multiplayer users need to have a common point of reference and it needs to be precise then it needs to be shared. e.g. in a racing game, the track does not change for each person. However debris and the position of other cars does.
In dealing with a constantly changing environment unity3d is able to be told to dynamically load new scenes and new objects in that scene, but you have to design and decide what to do. Typically things are in the scene but hidden or generated procedurally. i.e. the flock of seagulls copies the seagull object and puts it in the flock.
One of the elements of dealing the network lag in shuffling all this information around is interpolation. Again in a car example typically if a car is travelling north at 100 mph there if the client does not hear anything about the car position for a few milliseconds it can guess where the car should be.
Very often virtual worlds people will approach a game client expecting a game engine to be the actual server packaged, like wise game focused people will approach virtual worlds as a client not a server.
Now as I said this is not black and white, but opensim and secondlife and the other virtual world runnable services and toolkits are a certain collection of middleware to perform a defined task. Unity3d is a games development client that with the right programmers and designers can make anything, including a virtual world.

*Update (I meant to link this in the post(thanks Jeroen Frans for telling me but hit send too early!)
Rezzable have been working on a unity3d client with opensim, specifically trying to extract the prims from opensim and create unity meshes.

Unity3d and voice is another question. Even in SL and Opensim voice is yet another server, it just so happens than who is in the voice chat with you is brokered by the the main server. Hence when comparing to unity3d again, you need a voice server, you need to programatically hook in what you want to do with voice.
As I have said before though, and as is already happening to some degree some developers are managing to blend thing such as the persistence of the opensim server with a unity3d client.
Finally in the virtual world context in trying to compare a technology or set of technologies we actually have a third model of working. A moderately philosophical point, but in trying use virtual worlds to create mirror worlds at any level will suffer from the model we are basing it on, name the world. The world is not really a server and we are not really clients. We are all in the same ecosystem, what happens for one happens for all.

Helping organise thoughts, and speaking freely

epredator — Sun, 09 May 2010 09:09:49 +0000

Once again for my pitch at metameets I used a little bit of virtual world technology as a mental aid to help me figure out what it was I was going to say and in what order. I am finding thins an increasingly useful technique, so as this is the second time around for it I thought I would explain it again.
I created the presentation in the usual fashion a set of keynote/powerpoint slides, mostly because I had ones from other presentations that I wanted to thread in and re-use. Once I had the single threaded narrative sorted, and the slide in the right order a structure, for what is in effect a story, appeared.
In order to preserve this structure I took images from all the slides and put them into my local Opensim.
Once in there these simple flat panels take on a relationship to one another that just does not happen when you are flicking from slide to slide.

In the picture above the pitch really started at the back. The back row is the underpinning, an introduction. Seven related slides to go through at any pace, but ideally quite quickly.
Next is a challenging step forward, as the next row comes forward. To support that is a another row, which is held to the side a little as it is really optional. In this case its a slide about how it feels to attach things to your avatar. That allows free expression, no script but just a memory of a feeling.
Then the next row is group into three groups. This is a change of pace, a set of ideas with an example in each of the three.
Then the penultimate row as you come forward is the tying it all together picture. Ideally by the time I get here the other 3 ideas have started to make a little sense.
Then there is the final slide to finish on.
Rather than sit and read the slides or over rehearse I just had this image on my iphone of the layout. It is enough that I can see the sort of pages I had created and when presenting I can think where I am in the flow. So if there is some sort of distruption, or an idea that comes to mind whilst talking I can think quickly as to where it will fit in or if it has missed its chance.
This is really just storyboarding meets mindmapping, but the multiple dimensions of it and the visual memory of having been there is incredibly powerful and I recommend anyone try and structure some thoughts or ideas or keypoints in some way like this to see how it feels.
Does anybody else do this, I would love to hear stories about it ?

We have all the pieces – Unity3d, Opensim, Evolver, Smartfox

epredator — Tue, 15 Dec 2009 10:30:03 +0000

I have now had this conversation several times with people about the potential future that a mix of open source and open minded development may bring to the virtual world industry. Much of what is happening seems to be driven by some of the direction Second Life has taken or is taking, though not so much to follow it into corporate lockdown but to breakout and provide the flexibility and creativity that is needed for the next generation of virtual worlds.
In the early days of 2006 many of us said it would be great to be able to run a Second Life server, our own one under out control. That has taken a while to start to emerge, but it has emerged as an expensive product aimed at corporate IT departments. Luckily the opensource community had rallied and created the excellent Opensim. This ticks all the boxes of being able to be run locally, be run in the cloud, be provided as a service. So we have an extensible virtual world server ready to be built upon.
The other component missing was a more controllable and rich interface. Yes there is the Second Life Snowglobe open source client but the need to certify and lockdown variants to align with the product needs for Second Life means that lots of the flexibility is lost. Likewise the initial open source Linden based client was under a GPL licence which caused all sorts of development to not happen at the time it really could have done with it.
This is where Unity3d steps in I believe. It was Rob Smart who first started to show me this way back. Unity3d is a great front end, very flexible in how you build games and content for it.
This was a movie form back in September 2008, using a message from Second Life to several unity clients to create a cube. This is loose integration, telling one place something has happened and letting the other place get on with it.

Unity3d has a plugin architecture too. It runs in a browser or deploys to application platforms like mac and windows. The visuals can be made very good very quickly too. Unity3d needs a server of some sort to operate as a multiuser platform (though it does do some peer 2 peer) hence applications like Smartfox are ideal for producing Unity multiplayer and MMO style games.
However Opensim has all the other layers of things needed to maintain a virtual world. It has assets databases, chat, positional awareness, server side scripting (as does Second Life that is was originally based on of course).
So we have an extensible and easy to get hold of Unity3D client engine, and extensible and easy to get hold of Server/Persistence VW engine in Opensim. There may well be challenges in making the two understand one another but with the flexibility both sides of the equation that makes them very solvable. This is a high level view, Rob has some more detail here on the challenges. Add in some interoperation definition with Vastpark to help bind the two and make some mappings.
Throw into the mix an open minded avatar wizard such as Evolver. There we can build avatars that we know definitely can be dropped into Unity3d.
So…..I create an Evolver avatar, dropped as a resource bundle into a web deployed Unity3d client that tells the opensim server where I am in the coordinate system, and which bundle I am using. Other people with a Unity3d client see the rich detailed avatar and the shiny Unity3d environment. However we do not have to stick to that one client. Other people using a Second Life style client see the Second Life style rendering of the world?
This is already happening in some respects, the Iphone application Touch Life lets you logon to the public Second Life. In a sort of bugblatter beast of traal moment everyone can see you, but you cant see them. You navigate your avatar around the map, have full chat, inventory and economy access, but a very different view of the world to everyone else. (Of course Unity3d runs well on an Iphone too, so imagine that as an extension to Touch Life?)
Once there is an acceptance that there can be more that one view of the data, one where people without the full equipment can still see what is going on and participate things get a lot easier to consider. Whilst a gaming assumption tends to be we all need the same view at the same speed in order to be able to have balanced gameplay (lag gets you killed) in collaborative spaces, education, meetings and art galleries this is less of an issue.
As the parts of the jigsaw come together over the next year the ability to have the same experience will re-emerge.

Second Life Enterprise – A good addition to the mix

epredator — Fri, 06 Nov 2009 00:15:15 +0000

Yesterday the enterprise 2.0 conference saw the official release and announcements relating to Second Life Enterprise and of course featuring some preferred content in the form of Rivers Run Red’s Immersive Workspace and more to come via the Work Marketplace. It is interesting to see this happen both at something like an enterprise 2.0 conference and focussed as a packaged product in the way it is.
Back in April 2006 thru to Dec 2006 (which seems a very long while ago now) we said to one another as we (those early eightbars) realised that there was a huge scope for internal corporate communication…. wouldn’t this be great behind our firewall?
By September 2006 (after the first Wimbledon in Second Life) the US based CIO office had realised the potential and a few of us from places not just in the US ended up on that growing project to understand SL and all the other platforms and their implications to an internal corporate audience. This also started to lead to the more commercial based business unit forming, which interestingly is now part of the CIO office according the communications out of IBM.
This journey and the things that happened on the way (good and bad) all form part of the story I share with people in various ways including the in progress book on the subject.
Linden Lab focussing on enterprise and producing a product, however it is priced and packaged is an important further catalyst to this industry, one that those of us in IBM, Cisco, Sun etc. started to generate corporate and public interest in through our patronage. However this is now happening (unlike in 2006) in an era that has very many more potential direct competitors. many have been there for a while but will now be dropping into even more invitation to tender conversations, Proton Media, Forterra Olive, Teleplace, web.alive…. Equally there will be an increasing drive in take up of the hosted and self hosting services based on Opensim (SecondPlaces, ReactionGrid, Rezzable and SimHost ). Other platforms and standards such as Vastpark, or Wonderland for those who want to still explore and drive forward and develop things for themselves and get a step up on the packages. Services such as Venuegen, specialized in providing a particular quick access service also start to take a share of the market.
It is of course a huge market, business/enterprise communication relates to every employee in every company that has any form of electronic or remote communication. Like email, web and increasingly instant messaging and voip and social media in general it is essential business addresses the communication gaps we have generated. All these options may be confusing, but just pick one and get on with it!
I also still expect an actual games company to realize that their middleware and massive scaling and runtime abilities can be applied to a spin off market. So rather that enterprise business trying to figure out how to use games, games will figure out how to use enterprise business. With some of the developments this week too such as Unity3d becoming free to develop with and also Unreal 3 doing the same to some extent the future looks very rosy and very interesting.
However….. remember that the problems and challenges are not wholly technical. We are dealing here with social and cultural change. Something else I have experienced both the good and bad of and happy to share if you need to talk about the implications to your business, industry or life.