Virtual World Jet Lag – Los Santos style

Last week Grand Theft Auto V was released. That of course is something everyone probably spotted. In amongst all the hype, the outrage and the $1 billion dollars in takings there are some interesting nuggets that may have been missed.
GTA V is a giant virtual world simulator. Whilst GTA V Online is not yet live it is a single player experience, it does have a very large and detailed environment. The attention to detail is almost so good as to not be impressive as you tend not to notice it. The environment is very big from a sprawling city, to a desert and a mountain range and lakes that you can explore on foot or on a variety of vehicles on land sea and water ( or even in a cable car or a blimp) act as a backdrop to a set of mission and story arcs. The place is bustling with activity, people and cars everywhere. It is a pity that it could not just have a mode or version of this world that removed a the swearing and the violence just a little. The reason I say this is that just exploring, being in the place would make a great experience in its own right. Heading off to the lake to watch the sunset, flying and landing planes on the runway. The games or darts, golf and tennis that are just sitting in there as a side task all make it a fine example of game technology and design in action. As it is it obviously deserves its 18 rating which in context all makes sense. You can’t though drive down the road or listen to the radio or even play the iFruit Iphone companion app without a torrent of abusive language.
Chop
Chop on Ifruit the companion app.
Me as a gamer and an adult I find this all more than acceptable, however as a parent I would be worried because I know many people will end up letting much younger kids play this without fully appreciating whats going on. Tone and intent is everything in a narrative and the cartoon violence of stealing cars and having shootouts is pretty normal and I would say acceptable. However there are part of GTA V that enter other territory. A scene with the psychotic Trevor extracting information which has to be played through made me wince. I am not sure what is coming next as that is only 1/4 way through.
There is something that felt different though. In GTA V you swap between 3 characters. This stops them seeming like they are your character and turns them more into toys or puppets that you are playing with. The 3rd person view helps re-enforce that as you can clearly see which character you are. Character swaps happen in other games such as Call of Duty but in 1st person if becomes less obvious you are not you. So playing GTA V, customising the characters with hair, clothes and tattoos becomes more of a dress up doll experience than a “hey look at me” experience. I am not sure if this makes it easier to cope with the excesses of some of the characters in that you are almost in god mode rather than sinking into the character. That may just be me but it is definitely a different feel. It is more like looking into an aquarium than being in a swimming pool.
That said is is a very absorbing experience, exploring or following the story. It has always been fun to just drive around in a car listening to the really good soundtracks playing via the various radio stations. The news reports that interrupt the music also match nicely with the activities you have been up to. Again so we done you almost don’t notice.
The in game web experience is also very neat. Facebook and twitter are copied and mocked but if you bother reading the details you will see, just as with the radio news there is a consistency with the in game social media interactions. There is also a working stock market, investing in the right things before a mission that alters the share price is a clever way to get cash.
GTA V has also reached out to the actual web, lifehacker (the Facebook clone) exists for real. Before the game was released could stalk (i.e. like) various business pages such as the barber shops. That then linked in game to a discount or a freebie.
I already mentioned the iFruit app but it too affects the game. If you train up the tamagotchi style dog Chop his action will alter in the game. If you buy custom car parts they will appear. This feature obviously had some trouble at launch, it was not scaled to cope with the day 1 blitz but it seems to be fine now.
I entitled this virtual world jet lag because I have certainly experienced a form of jet lag, or tiredness as you might like to call it. Late nights playing and exploring Los Santos have been needed in order to understand the game and it’s development. However it does feel like I have visited somewhere, in the same way exploring Second Life and alike does. The experience and memories are rich enough to make it feel like a journey has happened. It is large free roaming worlds that have this impact more so than the frenetic close in shooters. They leave you dazed and adrenalin pumped, you remember the small experiences, taking a flag or an unusual frag. GTA V and alike provide so many memorable inputs and ones that are linked to discovery and learning that they are really a place. It is something everyone should try and experience to feel the difference between this and other styles of game. I hope this Los Santos model world can be used for some other experiences too though for those who are not gamers but who might change their minds about the art of game creation and the technical expertise of its creators.

3d Something from nothing

Modelling in 3d from scratch is hard. It is digital sculpture. Whilst the tools help it is really for the hands of an artists as much as a hammer, chisel and block of marble is to create something from nothing. There are qll sorts of wizards and helper programs plus lots of existing artwork in the public domain that let us less artistic more techie people get some things done. I don’t think you can ever replace the talent and eye of an artist but some technology is going to help as a starting point for 3d objects.
I have been looking at Kinect Fusion which uses the kinect to scan and then produce a 3d model of the things it is looking at. This looks like a very promising way to get existing objects into a good format for dropping into virtual worlds and Unity3d.
You will notice from this sample picture from Microsoft that the mesh created can be an OBJ as in normal 3d packages or an STL the format for 3d printers so this is nearly a 3D photocopier.
fusion
I say I have been looking at it, though I have not been able to use it fully yet. The sample is a Windows only application. Whilst the kinect works fine as a “normal” kinect on the Mac the scanning application isn’t supported (for obvious reasons). I run windows on a bootcamp on the 5 year old Macbook pro. Unfortunately that does not have a full DX11 graphics card. Without all the bells and whistles of DX11 the application doesn’t work. So I may have to get a full windows machine as long as I can be sure its full DX11 compliant.
There is another interesting development in the works that @asanyfuleno pinged me way before I saw it explode across my twitter feed. It is the ability to create a 3d object from three simple swipes across a 2d picture.
It sounds crazy but it does seem to work in this video. Which is also honest enough to show cases where this does not work.

This is an academic presentation from SIGRAPH Asia 2013. There are always interesting things to read about from the various SIGRAPH events such as these

Things at SIGRAPH and other high end tech conferences can sometimes seem out of the reach of most of us however (just to bring this full circle) This paper from 2002 just 11 years ago shows a 3d scanning application which performs the same task as the Kinect Fusion application I started this post with.
It was also good too see recently from SIGRAPH the wonderful MCOR paper printer now doing full colour. We had some samples from MCOR on Cool Stuff Collective and I wrote them a little article. Now though they are doing even more clever things with paper and colour.

It is great seeing the advances in tech and art and even more exciting as they mature into accessible tools and toys for anyone to use.

Disney Infinity – Money Grabbing but Metaversal

Disney Infinity arrived on the scene recently. It is Disney’s response to the clever development of Skylanders. Where physical toys are used to select what happens on screen. If you thought Skylanders may have had a slightly cynical collect ’em all, spend ’em up side to it then Disney have ramped that up to a new level.
Skylanders you typically get a set of characters that you can experience the main game with, without buying new characters. Getting a new character for £8 or so gets you some new powers, effectively new lives for a game session and possibly access to a bonus level.
Disney have chosen a more complicated (and expensive route it seems). The starter set gets you 3 characters. Each effectively from a different set of game levels. So you get Cap’n Jack Sparrow, Mr Incredible and Sully from Pirates of the Caribbean, The Incredibles and Monsters University/Inc.
You get a “level” select piece (they call them play set pieces) that when placed on the USB powered platform selects the available levels. This happens to be multiple one for the 3 games but others are individual tokens.
There is also another token type that unlocks a little bit of content. These are the sort of pocket money prices elements, like buying a lego minifig. Ours unlocked a background from Wreck It Ralph.
It is the collection on the right of the picture. A “starter” set.
Disney infinity
So we plugged it is sparked it up and I wanted to play with the predlets. After all the games are multiplayer and there is space for two characters. The problem is that as you enter the Pirates of the Caribbean world you are only allowed to take a pirates character with you. So the base starter set does not let you play the actual game levels as multiplayer. So you have bought 3 single player games.
What you need to do is shell out another £25 on top of the £50 already spent to by the “sidekicks” a character from each series. (On the left in the photo above).
Other playsets feature 2 characters from the same experience, Cars, Lone Ranger etc. So then you are buying a multiplayer game.
You can buy individual characters for each game type, and there are sets to collect, and buy extra characters for the same games. You are enticed to do this in game as it points out you don’t have a character by showing a video.
Not allowing Sully to wander around The Pirates levels or have Cap’n Jack in the big city with the incredibles sounds like an attempt at not having some sort of brand pollution. Or some odd technical reason. However that makes no sense when you get to the more interesting part of Infinity which is the toybox.
This is a freeform multiplayer environment where any character and anything from anywhere can be added and created.
It is a metaverse, a shared world with all the user creation tools we expect in virtual worlds. It is a great leap forward too bringing a degree of quality to the experience of building we don’t often see.
I had a flashback to my first Second Life island when it was just flat land and the possibilities were endless about what could be done there and how it would evolve (and change the path of my life as it turned out). Big stuff!
Deja vu flat piece of land and an avatar # inifinity
Cap’n Jack just stood in a field.
Then a quick menu selection and a little bit of racetrack (in the background) and a physical active beach ball with live shadows and all the trimmings was in world with me.
Deja vu flat piece of land and an avatar # inifinity
Then we found that any character could join so Sully was soon in world and before you knew it we had some funny little games going. Predlet 1.0 made an obstacle course, 2.0 made a floating race track. We found ourselves setting little challenges with the basic things we had.
The trouble with this is that there are thousands of pieces to play with, but…. they are all locked away. As you “play” or explore you complete challenges and achievements. Those unlock stars, as does levelling up or playing the main stories. Those stars let you get a random spin in a selection of the devices and objects available. It is painfully slow grind to unlock things. Not being able to pick and it being a random selection gets very annoying. We wanted more vehicles, we got a buggy eventually but lots of things we didn’t want first.
For a creation tool it is missing the ability to just get on with it. For experienced virtual world builder like the predlets, used to Minecraft creative mode it is a ridiculous application of grind. Worthy of Nintendo’s grind tests.
I hope they patch this and let us just select anything from the palette. Mind you they will probably make us buy some more physical product. That after all is what the extra collectible power disc (the one that unlocked a wreck it Ralph backdrop) does. However these are sold in closed packaging so you don’t know what you are getting to end up with “rare” items and swaps for the playground. Something I have never really liked in kids toys.
So Disney have made something really clever, interesting and wonderful and then locked it behind a big paywall or a giant in game fruit machine. All things that can be rectified to make this brilliant!
I should say too that The figures look like they are good quality but Jack Sparrow must have had too much Rum as he broke off his stand. Not sure how much force cause that to happen but characters on stands with just two small bits of plastic feet might make these not as playable with for kids as Skylanders.
Disney infinity
Brand pollution isn’t so bad it it? (Just updated with this vine 🙂 )

It’s just a doorbell

We had a new door fitted here at the family home/offices of Feeding Edge Ltd. With it we needed a new doorbell. It used to be we had a choice of a few mechanical rings and buzzes but the digital age brought MIDI like ringtones. I had always wanted to build a “record your own” doorbell but never got around to it. So I was very happy to wander into Homebase and see the Byron Wirefree portable MP3 door bell unit.
G33k doorbell
It is a normal doorbell, but with a USB port and the ability to play a 10 second mp3. Of course having this choice is actually tricky. What do we do now, what can we put on there. Music is not a great choice as it may be confused with the radio. I did try the hook for Geekin’ by Will.i.am “get your geek on get your get your geek on”. However I then went for a rich set of sounds from Star Trek and used Audacity to edit up a mash up of messages from star fleet and red alerts. It is very effective though I am not sure the entire family share my enthusiasm.
There may be an embarrassment factor to opening the door when the bell has been rung and the red alert is still going off, followed by a self destruct message 🙂 we will see how it goes. I can of course always change it.
A managed to capture a bit of it in a Vine 🙂 You need to click the unmute top left for the full effect otehrwise its just a flashing light 😉

I guess next would be a playlist of sounds and door tones? Any suggestions? I might get the Predlets to record a chorus of “Door! DOOOOR! Dad!!!! DOOOOOR” 🙂

Is this my weirdest article? – Flush 9

Sometimes an idea gets stuck somewhere in the back of your mind. It sits there and occasionally raises its head to bother you. One way to sort it out is to write it down, and even better share it with others. Sometimes though these ideas and thoughts bundle themselves together and if you think at an abstract level you can link them and get them all out in one go.
That is how I ended up writing the latest Flush Magazine article where I go “From Koi carp to the Xbox One in a Parkour style free run of ideas”. It was really about the Xbox DRM sledge hammer solution but it did seem to offer a pattern or a modern fable to consider with technology adoption and replacement.
My words have once again been beautifully presented by @tweetthefashion some fantastic art work and presentation wonderfully in keeping with the odd direction this article took.
Have a look here page 110 on but also don’t forget the rest of the magazine 🙂

Oculus Rift arrived

Yesterday was a very interesting day all around. The main event for me was the arrival of my Oculus Rift development kit. This is a Virtual Reality (VR) headset. We have had these before but not ones that are this cheap (relatively) and that just plug into any machine and work with Unity3d !
It came in a cool case too. Some nice big clicking catches on it like something James Bond would get from Q.
Oculus rift arrived
I had to dash out and get a mini display port to DVI adapter as I had that frustrating moment we have all had at some time when you realize a tiny piece of cable is missing. I only had a VGA adapter that I usually need to projectors at presentation. Handily there is a Mac store in Basingstoke and also Apple kit stocked in the nearby PC world so I had that covered in minutes.
I ran the Tuscany demo straight away. This is a small, but lovely rendered, building in the Italian countryside and on the coast. I was, despite having experienced this sort of stuff alot before suitably amazed and excited by it.
I did not hog it though and got each member of 3 generations in the house to have a go.
I was really happy that the predlets got how cool it was too. There was a suitable amount of bemusement and wonder.

The unit is two screens one for each eye and the ability to track head movements. So these head movements can then inform a game or application that you have moved you view.
The unity 3d integration is the library that is able to talk to the rift, but it is also a couple of prefabs (bundles of reusable code) that lets you change the normal single view camera to one that generates 2 views from slightly different angles to then feed to the rift screens (one per eye). Elegant and simple. It also has a controller prefab that takes the input from the headset movement and feeds that into the unity environment.
So it is not going to take to much to test some of the applications I have and make them rift enabled, though they have to be native application publications not web ones I am assuming.
It was not the only tech of the day though as in the morning Predlet 1.0 went and experienced indoor skydiving at Airkix.

Something I remember well from the TV show 🙂
She had a blast doing that.
I had a go on the iracing sim rig there had there too, this is basically a high end pc with a hydraulic chair and some force feedback steering.
We have yet to try the brush boarding or the skiplex slope (a skiing conveyer belt).
Just to juxta pose those though predlet 1.0 finished her Revell glue together and paint kit of the Titanic. Don’t worry though, it was all perfectly normal as predlet 2.0 was completing levels on Lego Indiana Jones 2 on the Xbox 🙂

InfoQ – virtual worlds interview – me again :)

As I was on the roster as the rather excellent Goto conference I was asked by Ben Linders a few questions on virtual environments and where they fit in the world of software engineering. This turned into a slightly longer interview and has just gone live. It is always interesting to frame the answers about virtual worlds into a slightly different context or industry but of course when it comes to the software industry, the fact that this is software anyway has a nice meta element to the conversation.
The article is live here.
Along with my super g33k bio picture 🙂
epredator
It is also cool that you can now just search “epredator” on infoq and tadah! 🙂
I guess this may seem more of me going on about the same things, but there is a reason for that. These technologies make a huge difference to a lot of use cases. I am getting more calls and questions again about how these may work (post bubble). Ignoring the possibilities for anyone or any industry could be costly this time around. I just want to help 🙂

Here comes #geekweek on Youtube

You may have seen a number of posts and tweets on the interwebs about next week on Youtube (thanks @moehlert who I noticed saying it first). If not then you are in for a treat. Next week is #geekweek 🙂

It says “Come hang out at YouTube Geek Week and celebrate geek culture with a whole week of new vids, series premieres, epic collabs, and top tens from more than 100 channels across YouTube.”
That includes an experimental resurrection of the game/cgi/green screen show called Knightmare
If only we had all the clips of the Cool Stuff Collective super g33k sections online we could have joined in. (I can’t put them up as I don’t own them so just have to make do with the showreels)

Jumping into LEAP

I had originally thought I would not bother with a LEAP controller. However new technology has to be investigated. That is what I do after all 🙂
I ordered the LEAP from Amazon, it arrived very quickly. So whilst I might not have been an early adopter, and was not on the developer programme it is not hard to get hold of one now. It is £69.99 but that is relatively cheap for a fancy peripheral.
Giving LEAP a go
It is interesting the self proclamation on the box. “The remarkably accurate, incredibly natural way to interact with your computer”. My first impressions are that it is quite accurate. However, as with all gesture based devices as there is no tactile feedback you have to sort of feel you way through space to get used to where you are supposed to be.
Leap
However the initial setup demonstration works very well giving you a good sense for how it is going to work.
It comes with a few free apps via Airspace and access to another ecosystem to buy some more.
The first one I clicked on was Google Earth, but it was a less than satisfying experience as it is not that obvious how to control it so you end up putting the world into a Superman style spin before plunging into the ocean.
I was more impressed with the nice target catching game DropChord (which has DoubleFine’s logo on it). This has you trying to intersect a circle with a chord and hit the right targets to some blasting music and glowing visuals. It did make my arms ache after a long game of it though!
What was more exciting for me was to download the Unity3d SDK for LEAP. It was a simple matter or dropping the plugin into a unity project and then importing a few helper scripts.
The main one Leap Unity Bridge can be attached to a game object. You then configure it with a few prefabs that will act as fingers and palms, press run (and if you have the camera point the right way) you see you objects appear as your fingers do.
Many of the apps on Airspace are particle pushing creative expression tools. So creating an object that is a particle generator for fingers immediately gives you the same effect.
Leap unity
It took about 10 minutes to get it all working (6 of those were downloading on my slow ADSL).
The problem I can see at the moment is that pointing is a very natural thing to do, that works great, though of course the pointing it relative to where the LEAP is placed. So you need to have a lot of visual feedback and large buttons (rather like Kinect) in order to make selections. Much of that is easier with touch or with a mouse.
Where it excels though is in visualisation and music generation where you get a sense of trying to master a performance and get to feel you have an entire space to play with, not limiting yourself to trying to select a button or window on a 2d screen which is a bit (no) hit and miss.
I spent a while tinkering with Chordion Conductor that lets you play a synth in various ways. The dials to adjust settings are in the top row and you point and twirl your finger on the dials to make adjustments. It is a fun and interesting experience to explore.
Just watch out where you are seen using the LEAP. You are either aggressively pointing at the screen, throwing gang signs or testing melons for ripeness in a Carry on Computing style.
I am looking forward to seeing if I can blend this with my Oculus Rift and Unity3d when it arrives though 🙂

Drones everywhere

The crazy summer sun meant we had to take a family trip to Basingstoke shopping mall to get out of the heat. There we found that Modelzone was having a closing down sale. Another casualty of the recession. It is a pity as it is a treasure trove of interesting things.
We already have a couple of RC cars including the Beast from Cool Stuff Collective series 1 but I couldn’t help getting a few new RC and IR vehicles for the family to play with in the new garden.
The first was a Nikko RC dirt bike. It is a funny little device as it needs to get up to speed usually by facing the wrong direction. Two stabilising wings near the ground then mean it has trouble on the rough stuff. I did a little vine of it working.

However I also bought a very much reduced Tamco Ev.03 RC helicopter slung with a small video camera and microsd slot.
Ev.03 micro copter and camera
Ev.03 micro copter and camera
They did try and get me to buy the full remote TV version of a copter. RC with a live video feed to the handset but I thought I might as well get a Parrot AR drone if I was going to do that. No the micro copter would do just fine.
It is surprisingly difficult to get to fly in the first place, in part that was because I was trying outdoors in the sunlight. Its small form means it is prone to wind shear and being an IR control the 31C sunlight was causing it some confusion. It manifests itself by rising up on throttle out of shadow to about 10 feet then deciding the sunlight is asking it for more power. So a few times we nearly lost it to the next door neighbours German Shepherds.
However tonight, it was still and stormy, the sun had set and I managed the longest non-crashing, non loss of control flight yet.

Bear in mind this is a simple £30 micro helicopter with a tiny camera on board. The quality I think is pretty amazing.
I don’t think all the apache gunships that fly over Basingstoke will be bothered but I amd now thinking I need a bigger and better RC helicopter/drone arrangement. one that works in sunlight. Also once with a nice API that I can get code doing interesting things or flying it in time with the kinect.
Next I need to work on exciting camera angles like those in the game replays 🙂