Kinect Party making you dissapear- now that’s magic

The wonderful Happy Action Theatre by Double Fine has been rebranded and given away fro free as Kinect Party. It is a very amusing set of Kinect based toys to play with plus some DLC. It sees you and hears in the room and does all sorts of collision detection games like popping a room full of balloons or Augmented reality things that add hats and gadgets to you as you bounce around your living room.
However hidden away are some really clever techniques. The Kinect is scanning the geometry of the room not just tracking the players. This means balloons bounce off your sofa, or pigeons land on tables.
The really clever bit is when as a player you are replaced. Take a look at this picture
The predlets were both in shot, but they get replaced by skeletons. The Skeletons are thinner and have more transparent bits then their human counterparts. The games using the Kinect manages to rebuild the background live behind them, removing them from the scene completely, then adding in a new character. This is not a stick on AR it is much more clever, or at least appears to be.
In another example both predlets were under water. Predlet 2.0 was dead centre of the picture, grabbed a hook and was pulled upwards on the tv screen to be replaced by an approximation of what was behind him. He is there but invisible.
Shortly afterward predlet1.0 did the same thing and voila… gone (but still in the room looking at the screen). Having obscured her Grandad previously behind her in the picture there he is, as if she was invisible.
The screen is done as an underwater scene so there is lots of wobbling of waves that would counter any odd image artefacts, but this is being done on live video on a free application on a console that is nearing the end of its run.
This puts what I wrote in Flush Magazine about the next gen Kinect and how it may deal with removing people from a scene into more context.
(not only is this game/toy clever it is really funny and a great laugh BTW 🙂 )
I hope this puts into context me spamming Facebook with Kinect Party photos, but I loved it when it was Happy Action Theatre and it has got more clever and engaging (and free).
Merry Christmas one and all, I am off to eat some mince pies.

A white christmas, unique 3d printed snowflake from

I just had a great christmas letter through which seemed a fitting way to blog about this time of year and also cool ideas and technology mixing with art. It was a package from Jim “babbage” Purbrick (@JimPurbrick) and it contained this very intriguing, and ornate 3d printed snowflake pendant/medal/badge.
3d printed snowflake
It was, to quote the letter a unique creation. “It was seeded with your name, address and public data about you from the Internet, grown in a computer simulation and printed out on a 3D printer at Build Brighton”.
Wow! What a wonderful way to commemorate christmas and who we all are individually online right now. We are still unique yet part of a digital snow storm of shared ideas.
If you want to know more head on over to to see a little about this project and sign up for more information. These medals are physical achievement logs of digital activity. Wow! I love tech!!! 🙂
Merry Christmas and happy holidays FTW to everyone from all of us (I mean me) at Feeding Edge Ltd 🙂

Playing with physics and a lot more – Gmod + Kinect

I finally got around to trying GMod (Gary’s Mod). This has been around for a while but is now on Steam for Mac and PC with some interesting new features. A good few years back I remember us sitting in a bunker at Wimbledon in some downtime marvelling at the physics engine demo films for Half Life 2 and the Source Engine. Watching wood catch fire, things rolling around, dropping and floating in a high end game engine. Playing with physics is always fun in code or with a toolkit. At the time there wasn’t a toolkit to build with simply, though along came things like Second Life with some basic physic and lots of multiuser features.
It is a while since I have bothered doing anything with my Desktop windows PC other than get Minecraft going for the predlets. However I ordered a windows based Kinect. Having got the xbox one working on the Mac I wanted to do some development with the official Windows SDK. I only had a Vista machine and it turned out I needed to be windows 7 or above so I took the plunge and upgraded to Windows 8. This was moderately straight forward, apart from having to dismantle the machine to find the serial number on the soundcard to find the right driver. I then got the kinect working, downloaded SDK’s and version of development tools. However it was such a mess getting anything to work I started to lose interest!
How can I use the Kinect? Well a quick google and I found that the Gmod was there on Steam and for £5.99 gave me access to a fantastic building toolkit with all the physics and interesting options of the Source Engine. It also mentioned that it now worked with the Kinect. It also works as a multiplayer network. So this is metaverse territory! 🙂
The palette of things you can rez in Gmod is extensive
Once you rez something like a rusty bath you can spin it around in space with the physics tool.
If you let go it drops to the floor, with a satisfying physics engine bounce and crash.
If you want to put a ragdoll physics scientist in the bath you can do that too.
It is these ragdolls that have an extra context menu on them. If you have a Kinect plugged into your windows machine, and have the right drivers (1.6) then you can then control these ragdoll avatars with your motions. Not only that but you can control more than one at the same time. Lots of scope here for animated dance sequences.
The first time it worked was a magical moment, it blended the initial memories I had of the engine, with the buzz of what we have today to experiment with.
The skeletons of the Source avatars do not seem to be the same resolution as the more detail kinect skeleton so this is not perfect for my Choi Kwang Do attempts to instrument the body, but… they do help try out the kinect. The rest of the things we can build, and that the predlets will build is going to be interesting.
Oh, there is also an amusing “minecraftify” option in Gmod that turns all the textures blocky. So worlds are merging.
I have yet to try using the 360 kinect on the Mac with its version of Gmod but there is certainly a lot of exploring to be done.
Happy Holidays 🙂

Flush Magazine, Holodecks, Kinect patents and geek history

The latest edition of the wonderful Flush magazine has just been published. This issue amongst all the other great content in there I have put forward some views on how close we are to a Holodeck with respect to some inventions we already have and some that may be in the pipeline. So have a read and see what you think. Microsoft kinect and projectors and a little bit of geek history feature.

Or you can just link to here though I do recommend reading the whole magazine!
As usual it looks awesome too. I think it is fasciating the journey an idea takes from words and some image suggestions to a a full layout beautifully presented. Thankyou to @tweetthefashion as usual for doing such a great job putting this all together, and a wave to all my fellow contributors.
The iPad edition will hit the shelves very soon too 🙂
Update: I just realised I am in the same Magazine as an interview with Steve Vai too – RAWK!!!!

Black Ops II – Dolly Cameras and heat maps

Amongst all the other features of the current game of the moment Call Of Duty : Black Ops II there are some great tools for exploring replays. Every game that you play is stored away on servers somewhere. In game you can pull one of those games as a replay. In the replay you have full control over the camera views, and can zoom back an forward through time. This replay is a reconstruction from the player data, so it needs the game to be able to see it (or anyone else’s shared replays). It does however allow you to render the replay to an actual movie and put it on youtube. Of course just a first person or 3rd person view of the game might get a bit samey, so hidden away is the ability to set camera positions and have cameras follow a virtual dolly to let us budding action movie directors create this sort of thing.

It seems to be having a few teething troubles as this was twice as long as this when I rendered it 🙂 However you can see the sort of control you can have over the cameras to make mini action machinima 🙂
The Elite web side used to be a subscription only extra add on, but is now open to everyone, this lets you explore the data in more ways. Things like the heatmap view of a level that shows a map view of where things happened and when. With the ability to drill down into the data and see what happened where. Of course this is not for everyone but it is interesting as it gives an insight into what gets captured and stored. Whilst it is just player positions and status over time, that is used to reconstruct the visuals it is a huge amount of data, given the millions of games that have happened already.

As you can see in this example I tend to die more than anything else 🙂 It is still great fun though.

Is the world falling apart?

Ok so it’s a dramatic title, but it is not about any 2012 apocalypse of the breakdown of our social structures because of the greedy few absorbing all the money in the world. No this is just an observation I got to make on the current incarnation of Assassins Creed, number III in the series.
The game is certainly a mammoth production, I have definitely enjoyed exploring the environment, as you should with a free roaming environment. Of course this means hitting the edges of the world. Quite often this is a message that an area is not yet available. However I was a little surprised when I leapt to climb one particular cliff and fell right through it. The great thing about rendering engines is that they obviously have no idea if something is right or wrong. If the collision constraints fail you can end up in some very unusual places.
Glitch in ACIII
I ended up in an ocean, but is clearly ended where the wall I feel through was. With the occlusion rendering backwards it looks like you can see the paths in the trees that are normally branches you leap to and from.
The water simulation was still running, but had a spooky drop off. The world was flat indeed and I had fallen off.
Glitch in ACIII
It’s not really witch space in Elite 🙂 but it was fun for a few minutes. Bugs FTW

Hmmm… Upgrades

After nearly 4 years of faithful service my first Macbook Pro seemed to be getting very slow and very full. It was the machine that I bought on Day 1 of Feeding Edge and it has been to some very interesting places. Not least it sports the Cool Stuff Collective logo as we had to cover up the Apple logo for the TV show.
I have replaced it was another 15″ MBP but not the retina display. They are lovely but it seemed a lot more money for a screen. I ended up with the 2.6Ghz Quad Core, 8Mb RAM and a 720gb Hard drive, plus the dual gfx cards of the intel 4000 and for real performance the nvidia GT 650M 1GB.
It is the first time I have swapped a machine and then migrated. All the previous machines back in the corporate world the transferring of applications was a tiresome job usually involving reinstalling things on windows.
Fingers crossed
I had a Carbon Copy clone ready just in case but I used my incremental backup with the very useful TimeMachine and set up the new machine to be pretty much like the old machine 🙂 This continuity feels like a refurbishment of a much cherished machine rather than a replacement. It’s like the old machine has found new life from somewhere.
There have been the odd thing that needs its licence renewing or signing in again but its been a very simple, very user friendly experience so far.
Next is to flatten the old machines OS and data and make it a vanilla Macbook Pro again so that the predlets can have their own machine too. That looks nice and straight forward as a recovery option just Cmd R on startup.
I really was dreading moving machines, I held off for a year at least because I couldn’t face the hassle. Now I know it is easy and it just works, like most Apple things, then who knows this may get to be a bit more regular. I do try and get kit at the top end so that it does not make itself too obsolete too soon. Mac’s are expensive compared to a windows laptop but for years windows and the machines around it have given me nothing but trouble. The past 4 years has been almost perfect and seamless in the way I get to just do what I need to do.
Well done Apple. 🙂 Hello old friend in a new body.

Curiosity – Killed the cat?

Curiosity went live on the smartphones a few days ago. It is a well named free app/game/art installation/research project from Peter Molyneux’s new company 22Cans. The company name refers to the 22 gaming experiments that they intend to create.
I was intrigued as to what the team was going to come up with and how they would strip things right down to gaming basics but apply it to the dynamics of the devices and of social media. Being an entitled an experiment is also good because it does not set the expectation that anything will work or not, merely that it is worth a try.
Curiosity is basically a giant cube, a shared cube, a cube that each client sees in the same way. The cube is covered with millions of smaller pixel like cubes. Each player can zoom into the cube surface and tap a piece of the surface to chip it away. Underneath is another layer of the cube surface. Everyone has to join in to remove an entire multimillion piece surface with their own efforts to collaboratively clear the level and be able to start on the next one. In a giant social networked version of pass the parcel there is a secret final layer at the centre of the cube, hence the title Curiosity. There is to be one and only one winner of the information in the cube, the person to click the last ever surface cubelet on the last layer. Each layer on teh way down is a different texture and coloured picture. The first layer from Day 1 was black and shiny but was soon replaced with a green blobby type of laval lamp picture.

The basic game mechanic of tapping away with your finger tips for ages and ages, emptying areas or randomly dotting around is certainly not the most taxing game idea. It does though have the pure elements of gaming grind that you find in any RPG and in particular in MMO’s. The visuals are of course basic, a textured cube covered in deliberately wonky tiled cubelets, which you only appreciate close in.
Curiosity day 3
The game lets you play completely anonymously with your fellow tappers, or you hook to Facebook for the usual friend spamming and tracking. Each tap produces a score in the shape of coins. These coins can be amassed to use special tools like bombs to remove the surface more quickly. Save up enough and you get a range of chisels.
So all in all this seems almost completely pointless as a game, it does appeal to a certain compulsion to join in, not so much to expect to be the last person discovering the end point but to see why it is worth bothering at all. This is an intriguing introspection on Curiosity, as I am curious as to how the experiment is going and peoples motivations to try it.
This is where it is very interesting as to what 22Cans are going to find out. No doubt lots of people will try it, like any free game and have a little go. They only have to tap one cubelet away, if enough people do that the cube with be cleared. The number of layers of the cube is obviously just data, so 22Cans can do what they want, unlike pass the parcel this is not a static wrapping.
How people try and maximize their scores is interesting too. A bonus multiplier builds up as long as you are tapping and clearing at a regular rate, stop and its reset, miss and its reset. So zooming in with precision to get a large enough view of the cubelets for fingers not to miss and systemically clearing a screen offers one type of reward, zooming out and fast random scattering an area also works. I am assuming that the context and usage of each player is the sort of data being collected.

I have often pointed out that many games companies do not understand true high volume sites, with the exception of the big MMO guys. The focus on 3 player shards in games is not prepared for the massive influx of small packets of information from hundreds of thousands of people at a time. The launch of Curiosity will certain level up some sys admins. The initial experience was one of the servers being all over the place. It’s free and it’s an experiment remember, so no one should be up in arms at this.
22Cans now have some detailed massive scaling experience, assuming they did not have some already. It is also a game that is both social and anonymous, something that is in my particular area of interest. Pseudo anonymity is always intriguing and Social media can be used to provide ready and willing game players so you can work as a team despite not knowing one another well. This is sort of lacking from the cube world. There is a sense that we are, to quote a much mis-used phrase “in this together” but the sense of others is an occasional server refresh and lots of your cube face disappearing as someone else clears it. You can pay a few of your chip coins to look at friends Facebook stats, but that is mostly buried away. Again this is an experiment so I am guessing they are looking too at how many people are bothered at looking at one anthers stats 🙂
You can of course theorise as to the depth of experiment that this actually is. The fact I am bothering to write about it, to have even downloaded it may itself form a small part of some massive data gathering. The cube has the #curiosity hashtag and other text messages floating across its surface so engagement outside of the game is certainly being explored.
I will certainly be following the next 21 experiments with interest. I suspect many of them will start to cross over into some of the work I have been doing and even one of the patents 😉 as Peter and his team look at how social media can be an operating system for gameplay rather than a conduit or portal for games to be delivered into. I may have to offer them some consulting time 🙂
So get tapping, even if it is just to say how pointless it all is. Of course not tapping or bothering will be valuable data too. Yikes I am wrapping myself in a knot!
UPDATE 9/11/12
This video has appeared which is a great, and honest, behind the scenes admission of the size and scale of dealing with massive amounts of users and data with a small team. It is not a grovelling excuse or a press release it is genuine frustration and indicates the hard work and passion of the team. Keep going 22cans 🙂

Another game another horse – Assassins Creed III

I spent 6 hours the other night playing the news Assassins Creed III game. There is of course much more to do but I thought I would share a little of the experience, whilst trying not to produce any spoilers. The original Assassins Creed was something that looked like a great leap forward (no pun intended on the fact it is free running across rooftops) with some stunning animation, huge backdrops and crowds of people wandering around to add to the atmosphere. I remember it particularly at the time as there were a few colleagues in my corporate world who had not come across games of this type before and who were also coming to terms with virtual worlds. Our virtual worlds looked nothing like AC. Equally I had to point out the millions of pounds and person years of effort that had gone into making things that stunning. Also I often had to point out that the narrative and story is the point in AC and that just because we have things that look like games they are not, they served a different purpose.
Anyway, here we at at AC III, which has had more than 2 other games since the original but this is apparently the main plot line.
It is interesting in that the first 45 mins or so is really a tutorial, a lead into the story before any starting titles. Just like a Bond film usually does. However you get so immersed in what you are doing, enjoying the visuals and the story that it is a shock when you are suddenly faced withe some starting titles so late in.
I had also seen that we had a new character and time to exist in and explore. It was supposed to be a native american, a sort of outdoors hunting ninja style. So it was a little bit weird to spend the first 5 hours of the game as a completely different character. (yes 5 hours more of what is in effect a preamble). This had a plot point and one that I think worked, once you accept the time and effort you need to put in. Eventually though you are set free to roam the American Wilderness, free-running from tree to tree hunting animals. It gets very Red Dead Redemption though once you start riding around on horses.
Another game another horse
After 6 hours the game is opening up, but it is also seemingly following a lot of other plots of films. The main one that stuck in my mind was Star Wars. A lot of “I am your father” and also you go off to be trained by a wise old man. As a native american he decided you need to blend in more so changes your native name to Connor (You still dress like a native american but apparently people are not bothered about that in Boston). Connor, is of course, the surname of John in the terminator films 🙂
It is an interesting historical setting, attempting to blend with the American War of Independence. You meet the main protagonists in the uprising. I got to wander tunnels with Sam Adams and hunt papers for Benjamin Franklin.
In Boston itself it is good to see all the original buildings like Fanueil Hall in place. It has a great atmosphere, just as the previous cities in previous games.
I have seen that the main game is about 20 hours long, which does make me wonder why the first 6 hours have been spent doing the setup up for the next 14. I am sure the pace could have been sharpened a little. However, free roaming games have a certain feel to them where you are quite happy to not advance the story but just hang out. it might be driving in GTA listening to music, sitting playing cards in Read Dead Redemption etc. There seem plenty of self setting challenges in AC III too. The scalability of buildings, the need vast distances you are able to cover in the frontier that pull you away from playing it too quickly and missing something.
It is with out doubt a great achievement in AAA development. In a world where small cartoon birds or fields of slow growing corn has been attracting all the attention we still do have room for blockbusters like this.
I will go explore some more, I hope I get a light sabre soon 🙂

Catalytic Clothing – Clothes that clean the air around us

Catalytic Clothing has to be one of the most exciting and innovative ideas I have ever heard. It may be the best thing to happen to trousers since mine exploded (well ripped) at gadget show live in 2011.
My trousers exploded at gadget show live #gsl2011
An artist and a scientist have got together to create something that is truly amazing it is I first saw this on BBC news this morning in a piece about the Manchester Science Fair.
The aim is to coat clothes with an additive in a washing machine that means that the clothes then are able to suck pollution out of the air. If all out clothes are doing this the effect is going to be very noticeable.
They have also made it an .org not a .com they have not locked it away in commercial patents either as they want to challenge the though process and business models to do good for the planet.
This is one of those ideas that occurs when art and science combine. Leave it to one discipline or the other and things like this rarely happen. When they do they are revolutionary.