The Metaverse is calling again – think bigger

1 comment in metaverse, Uncategorized by

As many people who pop along here will know back in 2006 (and even before that) I have been somewhat passionate in explaining and sharing what can be done with things like game technology, virtual worlds etc to help with human communication, that includes entertainment (which is often regarded as not a serious business), office type business, education, industrial digital twins the list goes on. Metaverse is a handy word to bundle all this together and whilst not tightly defined I think many of us know what we mean. This month I wrote a piece for the BCS which is available to read here and they have nicely highlighted the phrase ““Travelling and actual teleportation aside, do you think that we should be able to find better ways to feel we are with people and to have shared experiences?” Whatever you think the Metaverse is evolving to, just consider if the way you are doing things now is the best it could possibly be given the tech available. Things evolve and move, not always replacing everything behind them but adding.

Having sad that, it is worth reminding everyone that the original work in 2006 in Second Life was mostly about pulling data from other sources into the environment, and doing things with it, this eventually led to building Wimbledon’s 2006 course with the ball trajectory from Hawkeye rendered there.

broker
All about data from elsewhere integrating into SL in 2006

There is an ongoing discussions is about interoperability of Metaverse or virtual world platforms. These range from is it desirable to have objects from world x appear in world y and then often hit the barrier of platform x has a completely different rendering engine to platform y. The former is a style and even a business question, why does an environment of any type exist, real, virtual, augmented, projected, whatever. This then leads to the technical wars around content being “in” a development or build environment. Importing of meshes, textures, animation rigs etc is one way to look at Metaverse evolution but I think it is also worth considering the potential for things like remote rendering, if the unifying standard for content sharing was actually containers, of potentially any size or shape and level of detail, the anything from environment x could appear in environment y and even interact with it to vary degrees depending on permissions or needs. My Nvidia RTX ray traced shiny car could appear in the most basic of 3d environments as I am rendering the car my end, and the virtual world is processing a container and stream. This is after all what we do when we video chat, each of our cameras is doing some work and being hosted by a basic integration layer. Yes I know 3d and collisions and physics and and etc. all make it more complex but it is worth considering that other ways of working can exist to the build and compile we are used to from games. Also, from what I remember of Snowcrash avatars are rendered by the person’s own device, those with worse computing power have more basic avatars in world? Also, we already did some of this back n 06/07 it just takes a different way of thinking.

Talking to thinking, literally, I was invited to join the Games at Work dot Biz podcast again and I was more than happy to give a shout out to a book by Prof Richard Bartle on virtual worlds and our god like powers over them. Checkout the podcast and links are here and on any player you have, give it a rating to help the guys too please.

Stunning Matrix Unreal 5 Engine demo

No comment in Uncategorized by

There is a lot of hype of the new Matrix movie but today a demo/experience rendered in Unreal 5 live on Xbox series x and PS5 went live. The intro movie is fantastic, sometimes you can’t tell real from virtual, other times you can, but that often feels deliberate, toying with the uncanny valley.

If you don’t have an next gen console then there is a video, and it is well worth watching, remembering this is live rendered in Unreal 5 not precanned cut scene.

Many of us in tech have an affinity to the Matrix. I remember the first one, sat in the offices in Hursley building early web sites and shops, engaged in the start of digital transformation. The free character drip screen savers everywhere and even the old clunky web we had clips to watch “I Know Kung Fu” etc. Many of us were gamers too so this blaring of physical and digital was really appealing. I even bought the soundtrack, not on old fashioned CD but on Mini disc 🙂 Its always pushing the envelope and as this video shows, they are still at it! Metaverse FTW 🙂

Matrix Unreal 5

Forza Horizon 5 – Mexico here we come

No comment in games, Uncategorized by

What a bumper time for games it is, and on 9th November the latest of my all time favourite racing games Forza Horizon arrived on the Xbox, The games have always had a large free roaming area to collect, drive, race and photograph some fantastic cars. Each generation gets more jaw dropping as it pushes the limits of what can be done with the graphics, sounds physics. Number 4 in the series was set in the UK, building on a huge map that merged many of key locations and and cities into a manageable terrain. Number 5 has moved to Mexico and even more stunning scenes await there. The game is bundled into Microsoft Xbox Game Pass, but being a fan I bought the full version and all the expansions, knowing full well that I will be playing this on and off for years.

The beauty of Forza Horizon is that “where we are going we don’t need roads”. There are roads and tracks and you can just stick to those but you can also tear across the landscape in even the most unsuitable car possible. This may seem at odds with the precision feel of the driving simulation but it always manages to walk that line between arcade lunacy and pure driving simulator. Why would you go tearing around the scenery, well its for the views like this.

terrain
Mexico desert and volcano

The scenery alters across many different biomes, the time of day and weather also make for great variations and the game itself switches between spring, summer, autumn and winter every week.

Also of note is the radio stations, prerecorded play lists of rock, dance, classical music that have wonderful DJ voice overs that often refer back to things that are happening such as event s just raced or about to come up. It is enjoyable to just pick a car, and casually (or otherwise) drive around the place seeing the sites and smoking up the tunes.

A feature of Forza that I always share and enthuse about is the custom paint and decals for the cars. The game has managed to preserve artwork with each generation of the game so effort in creating these is not wasted. I use the decals as a demonstration of in game advertising and support with both my martial art and my Reconfigure books represented, along with a stylised predator face based on the Wii Mii version. These designs appear with my car in other peoples games and can also be downloaded, though there are some much better painters doing some great work to check out.

Forza horizon 5
Scooby, Choi, Reconfigure
Forza horizon 5
Doughnuts

There are cars from 3 wheelers to high end supercars, over 500 different models and all hyper detailed in and out. There are drag races, giant leaps and even houses to buy.

Forza horizon 5
Drag race
Forza horizon 5
Leap
Forza horizon 5
House

There are lots of online multiplayer angles to join in on, but I really enjoy driving against the Drivatars of friends and family. Here, a single player race is populated by names and cars of people you know driving to some degree in the way they would drive if they were there. This degree of personalisation is always great fun.

If you are looking at these shots and saying, oh it all looks too shiny to be real though, I saw this vehicle parked outside a London train station in a recent (and long time since I have been out) trip.

London nov 21
Shiny

I have already blasted through many of the races and levels, the last game was one of the few I have level capped and “prestiged” on. That really just comes with lots of time more than any particular skill, though doing well in races, performing superb stunts, drifting, speeding and crashing the scenery all ramp up the levels more quickly.

It is also great that I can play this on PC and on Xbox Series X but also now its available as a cloud game. Its juts a pity that our communication infrastructure on the train lines is not up to using that, but its still good if other members of the family are playing something else at home.

See you at the vocano

Forza horizon 5
Mountain lake

Meta, Metaverse, Me

No comment in metaverse by

Well what an interesting day yesterday was as Facebook went all out on being a Metaverse company and renamed itself to Meta. It also marked a point that crosses my straight unbiased industry analyst day job with my constancy of being a metaverse evangelist, a title I had in 2006 and maintain. These comments are mine alone and not that of the company I work for. I have lots more to share and discuss on all things Metaverse, but that’s something that people have to pay for nowadays.

However, I will say that I was really pleased to see a slick presentation on all things Metaverse from a multi billion dollar company like Facebook. Last year the same happened to some degree with Microsoft and Mesh at Ignite. The conversations have moved by many people from, “nah we don’t want to interact like that ever” to “no one company should own all this”. The Metaverse the industry and society needs does, as was said in the Meta keynote, need to be able to let people connect with both the physical and multiple virtual realities for a multitude of reasons and with many available ways to be who we are. I have, for many years, talked about how we have had to adjust to the limitations of technology to allow our communication at distance. We still type on qwerty keyboards designed as a layout in part to stop physical typewriter hammers jamming by spacing out the commonly used letters in words to avoid that issue. Not that we need to get rid of this form of typing, but to hold it up as the only way to interact with technology and data seems a little bit odd doesn’t it?

Back a decade or so ago I created a slide for a presentation on virtual worlds and the metaverse that was aimed at showing how far we might be able to go and why. It was in part a presentation about the fact it is not all avatars and islands. Those work, but there are many more things that come together. There are many forms of input, including neural interfaces (see below at the left), there are combinations of virtual to virtual, virtual to real (AR) and as I said at the end virtual to real to real, which is virtual objects becoming physical again (3d printing etc). It is about the connecting of people, a wetware grid, but threaded by narrative and context. The Meta presentation often showed these as quick interactions, thrown a basket ball, looking at a design etc, but the there is of course a longer thread, a digital thread if you like. It’s all very fractal in its nature, the patterns repeat at any scale.

One thing to note though is that everything feeds back into the entire loop, the arrows are multi directional. You might 3d print a “device” or prop you found in a virtual world interaction, but that itself might be an input device for another experience. Imagine if you 3D printed a modelling clay tool you bought in a virtual world then made a clay sculpture that you took a photo of for Flickr, or even scanned the sculpture in and made it a virtual object as a one off that you sold on an NFT market place which then saw it used as a prop in a virtual world movie, and so on. I used to talk about printing off a penny whistle and joining in a virtual band at an irish pub in Second Life. I hope you get the gist.

One key thing though, and it is slightly annoying Facebook have nicked the word but as you see below the entire loop is the meta loop (c 2009).

meta loop
Describing the Meta loop in 2009 – Its not all avatars and worlds/islands

I know many of us old guard or original gangster, however OG you want to be, might be annoyed at the mega corp going Meta on us and riding high on our hard work persuading the world this is a good idea and the way we are all going. However, it is the way we are going, so we get to say “I told you so”, rather than multi billionaires. Money clearly isn’t everything 🙂 We, and I include all my fellow Eightbar people and surrounding community from back in 2006, we were already riding on top of some Double OG work. It’s the nature of waves of societal acceptance and tech development. The hope is that business and experiences that are born of the Metaverse with thrive and bring entertainment, education, excitement and benefit to the world. By metaverse business I mean not the ones building the underlying tech platforms, but the ones thriving on top of them, but then going on to influence the wave after this just as Facebook and co are today. It’s certainly not going away, so my sons birth certificate from 14 years ago saying father’s occupation “Metaverse Evangelist” might turn out to be of use to him someday.

I mentioned above that the physical world is an important part of the metaverse and in the Facebook/Meta pitch there was an instrumented house where the mugs and teapot that were carried in real life updated their position in the digital model. Well, that around the other way is the premise of my Reconfigure and Cont3ct novels. They are very metaverse, IoT, Quantum AR and VR related, but our hero Roisin gets to manipulate the physical world by altering the digital world. It works for an adventure, but it also keeps the “scifi set this afternoon” concept alive and it is not yet all done and dusted 🙂 Go take a look it’s very reasonably priced and might spark a few ideas on the back of the future that Meta are pushing. More here or see the ads not the right.

What’s all this animated dancing in games (revisited) – BCS presentation

No comment in games, metaverse by

The recording of my BCS Animation and games pitch is now live on the site and on youtube. Unfortunately only the live audience will get to see the larger avatar I was using to deliver this pitch, as the zoom presentation feed is only of the shared screen with a tiny top left insert of the avatar and my dulcet and somewhat stuttering tones tones. It took a few minutes to get revved up and to many I might be stating the obvious but it is surprising how many people don’t get the importance of user generated content and/or expression in virtual worlds and games.

Official site is here but added the youtube below to save a click or two.

Metaverse Mozart t-shirts for invisible people

No comment in Uncategorized by

As you may have noticed I have been in and around the virtual world and metaverse for a long while. I have spent decades helping people understand the basics of virtual worlds and benefits they bring to us all. The pandemic has highlighted the need to do some things differently so it is not a suprise that Metaverse is trending in all sorts of places once again. You don’t have to look far to find replays of the ebullient money money from US TV Jim Cramer “describing” the Metaverse is such odd mixed up sets of keywords and company names that it had me crying with laughter and with sadness.

Just to follow his stream of blurb he went through. I only need 10 minuted to explain it all to him, as do any of us, or even better just logon to a virtual world, anyone of them and talk to someone, experience something. I was reminded of the conversation about the internet, the web, ecommerce, social media and so many other emerging technologies. We always get to this stage of apparently influential people getting it so wrong yet bringing so much attention to something.

To be fair, we all have to learn things, but maybe we don’t all then talk about them to a large TV audience in the context of financial investments until we do understand the words. I would be one of many to be happy to explain what the vision of the metaverse is, what the practical implementation of that is today and why it is some of the words used but not in the same order or context. Also… its not all about NFTs either !

He said (slightly paraphrased):

“It’s Unity with an oculus looking at a t-shirt its Nvidia?”

“It’s a hologram”

“You go into a room to listen to Mozart but listen to Beethoven and these people don’t exist”

I hope my virtual world descriptions on TV (of which there are a few) and possibly the relationship between virtual worlds that form a proper metaverse are not quite on this level. As on my TV showreel page with the opensim conversation, added here from 2011 for completeness. Yes a decade ago on saturday morning kids TV, a live virtual world. Cmon people lets do this thing !

Virtual worlds in 2011

Meanwhile I am off to google something up on the inter webs.

Martial arts in the metaverse

1 comment in ckd by

A good few years ago I started to experiment with body tracking and how it could be used to add another element to my martial art training in Choi Kwang Do. The aim being that if you capture 3D data points of a movement you can recreate that move digitally from any angle and at any speed. Video may be simpler and more immediate but you need multiple cameras, matrix bullet time style, to see moves from every angle. Using the old Microsoft Kinect controller then the newer version 2 (2012 and 2014 even longer ago than I thought 🙂 ). A digital capture with human biomechanical context applied to it could also be scaled up or down to compare different body types and sizes too. A digital mirror could help overlay the optimum moves over the live performed moves and so on. The possibilities are quite vast. What was not quite working though was dealing with the speed of movement using camera technology at the time. Also the kinect rig for people lacked some points such as shoulders, and could get confused by body rotation too. It was a good bit of kit but was more for front facing. Two kinexts would solve some of that but it started to get complex.

The interesting news that just appeared from another martial art is in this video from World Taekwando using body sensors attached to students to control virtual characters for distanced sparring.

Using sensors from startup Refract they federation has officially created this technology showing a great deal of technical know how. It looks as if the sensors are measuring the knee and elbow joints for position and relative position to power the avatar. I am not sure how precise it is as a teaching aid but I would love to try it out and see how it works with my martial art.

Digital humans evolve

No comment in blendedreality, metaverse, unrealengine, vr by

Way back in the dim and distant era of 2009 I was exploring a lot of tools to help me build virtual environments with avatars and characters that could be animated, typically in Unity. 3D modelling is an art in its right and then rigging those models for animation and applying animations to those is another set of skills too. At the time I was exploring Evolver, which in the end was bought by Autodesk in 2011. A decade on and there is a new kid on the block from Epic/Unreal called Metahuman. This cloud based application (where the user interface is also a cloud streamed one) runs in a browser and produces incredibly detailed digital humans. The animation rigging of the body is joined by very detailed facial feature rigging allow these to be controlled with full motion capture live in the development environment of Unreal. Having mainly used Unity there is a lot of similarity in the high level workflow experience of the two, as they are the leading approaches to assembling all sorts of game, film and XR content. However there was a bit of a leaning curve.

I decided to generate a couple of characters and ended up making what to me feels like Roisin and the Commander from my Reconfigure novels. Creating them in the tool plays instant animations and expressions on the faces and is really quite surreal an experience. I installed Unreal on my gaming rig with its RTX gfx card and all teh trimmings and set about seeing what I needed to do to get my characters working.

First there is an essential application called Quixel Bridge that would have been really handy a decade ago as it brokers the transfer of file formats between systems, despite standards being in place there are some quirks when you move complex 3D rigged assets around. Quixel can log directly into the metahuman repository and there is a specific plugin for the editor to import the assets to Unreal. Things in Unreal have a data and control structure called a blueprint that is a kind of configuration and flow model that can be used in a no-code (but still complex) way to get things working. You can still write c++ is needed of course.

My first few attempts to get Roisin to download failed as the beta was clearly very popular. I only took a photo of the screen not a screen cap, a bit low quality but there is more to come.

Metahumans

However, eventually I got a download and the asset was there and ready to go. Unreal has a demo application with two MetaHumans in it showing animation and lip synching and some nice camera work. Running this on my machine was a sudden rush to the future from my previous efforts with a decade old tech for things such as my virtual hospitals and the stuff on the TV slot I had back then.

Roisin ?
Roisin from Reconfigure and Cont3xt in Unreal engine

The original demo video went like this

Dropping into the edits and after a lot of shader compilation I swapped Rosin with the first metahuman by matching the location coordinates and moving the original away. Then in the Sequence controller, the film events list I swapped the target actor from the original to mine and away we go.

This was recorded without the sound as I was just getting to grips with how to render a movie rather than play or compile an application to then screen cap instead. Short and sweet but proves it works. A very cool bit of tech.

I also ran the still image through the amusing AI face animation app Wombo.AI this animates stills rather than the above which is animating the actual 3d model. I am not posting that as they are short audio clips of songs and teh old DMCA takedown bots end to get annoyed at such things.

Now I have plan/pipe dream to see if I can animate some scenes from the books, if not make the whole damn movie/tv series 🙂 There are lots of assets to try and combine in this generation of power tooling. I also had a go at this tutorial, one of many that shows the use of a Live facial animation capture via an iPhone streamed to the metahuman model. I will spare Roisin public humiliation of sounded like me and instead leave it to the tutorial video for anyone wishing to try such a thing.

Lets see where this takes us all 🙂

Guest Appearance – Games At Work dot Biz Ep 311

No comment in games, Uncategorized by

Hot on the heels of my BCS animation and games webinar on the games of 2020 I was delighted to be invited to pop along to my favourite podcast, Games At Work, as a guest to talk about my personal views of some of the thing going on in the tech and games worlds including AR and VR.

To hear us riff on a range of subjects head over to here to website and the show links or look for Games at work dot biz on your favourite podcast repository.

I have had the honour to be on before, the last time was in June 2020, a mentally trying time that the podcast recording really helped with. Its always a blast to record, they kindly had me on years ago too when I first published my Sci-fi Novels Reconfigure and Cont3xt. Given it is now on episode 311 you can tell this podcast is certainly not a fad or a flash in the pan but a wonderfully produced and entertaining experience, despite my ramblings and book pitching. Enjoy.

A look at the games of 2020

No comment in games, Uncategorized by

Yesterday I presented a webinar for the BCS animation and games specialist group that I chair, but open to all, sharing some thoughts on what games made sense and for what reasons on 2020. I am not sure which BCS channel that will appear on but whilst waiting if you want to have a look and listen its all here.

As I say throughout this is all my own thoughts as a gamer and all personally experienced, bought and paid, no promotional activity by anyone other than me mentioning my books in this.

See what you think 🙂