It’s been a while since I posted anything for lots of reasons, that’s an offline conversation. However, this weekend something appeared on my feeds that was just too exciting not to do a quick test with and then share, which I already have on Twitter, LinkedIn, Mastodon and Facebook plus a bit of instagram. So, many channels to look at!
Back in August 2022 I dived into using Midjourney’s then new GenAI for images from text. It was a magical moment in tech for me of which there have been few over the 50+ years of being a tech geek (34 of those professionally). The constant updates to the GenAI and the potential for creating things digitally, both in 2D, movies and eventually 3D metaverse content has been exciting and interesting but there were a few gaps in the initial creation and control, one of which just got filled.
Midjourney released its character constant reference approach to point a text prompt at a reference image, in particular of a person, and to then use that person as a base for what is generated in the prompt. Normally you ask it to generate an image and try and describe the person in text or by a well known person, but accurately describing someone starts to make for very long prompts. Any gamers who have used avatar builders with millions of possible combinations will appreciate that a simple sentence is not going to get these GenAI’s to get the same person in two goes. This matters if you are trying to tell a narrative, such as, oh I don’t know… a sci fi novel like Reconfigure? I had previously written about the fun of trying to generate a version of Roisin from the book in one scene and passing that to Runway.ml where she came alive. That was just one scene, and to try any others would not have given me the same representation of Roisin in situ.
Initial render in midjourney some months ago
The image above was the one I used to then push to runway.ml to see what would happen, and I was very suprised how well it all worked. However, on Friday I pointed the –cref tag in midjourney to this image and asked for some very basic prompts related to the book. This is what I got
Another hacking version this time in a computer room not a forest
A more active shot involving a car
A different style, running at the car but similar to the previous one
Looking to buy some Marmite (a key attribute in the story and life of Roisin)
Another marmite shopping version
A more illustrative style in the snow (sleeves are down)
Another snow stylistic approach (notice sleave up and tattoos)
A more videogame/cell shaded look to the computer use in the bunker.
As you can see it is very close to being the same person, same clothing, different styles and these were all very short prompts. With more care, attention and curation these could be made to be even closer to one another. Obviously a bit of uncanny valley may kick in, but as a way to get a storyboard, sources for a genAi movie or create a graphic novel this is great innovation to help assist my own creative process in ways that there is no other way for me to do this without some huge budget from a Netflix series or a larger publisher. When I wrote the books I saw the scenes and pictures vividly in my head, these are not exactly the same, but they will be in the spirit of those.
Having my books Reconfigure and Cont3xt I am always using them and the story I created as a way to explore other mediums. I started drawing a few years ago to see if I could maybe go manga with it, that included buying some action figure mini drawing mannequins that have some tech and weapon props. I created some meta humans and have a unity based mocap suit from a kickstarter to see if I could produce anime. Audio voice generation has been another thing I tried. Each of these projects would be a significant amount of time, effort and probably cost too, but delving in as a mini proof of concept gives me an appreciation of what would be needed.
Midjourney and the AI image generators have offered another option to explore, an very quickly too. One of the challenges is to get the same character to appear in each generated image (i.e. story board). I decided to sort that out later in this POC. Though I did suggest that the actress to play Roisin should be Ruby Rose to get a potential consistent likeness.
Roisin at the start of Reconfigure in a bit of a last minute situation getting off the grid
Having got this image, which was pretty good for a first attempt, with very little text in the prompt I popped over to runway.ml and tried its new gen-2 image to video generation. This time with NO PROMPT at at all! It decided she should look up and stare into the distance, which in the book she is doing as she is being chased and very aware of her surroundings as she tries to outwit those after the amazing tech she has discovered. They only generate short clips on the free accounts, but those few seconds I found to be quite astounding and bewitching.
GenAI is obviously on a major drive into all sorts of areas, but the ability to potentially use tools like this to create a film version of my books on my own time and budget is emerging as a strong contender, unless Netflix or Prime decide they would like to do it instead 🙂
In 2016 I wrote Cont3xt the follow up to Reconfigure and part of that was an upgrade our lead character gets. She has access to an API that can manipulate the physical world like the virtual, she builds that up into a Unity application for her smart phone in the first book. The second she gets an EyeBlend headset, state of the art (and still just a little ahead of Apple and co’s attempts. So she ports the Unity app and upgrades the messaging system for this high bandwidth device and to enhance the experience. Rather like all the developers are doing right at the moment. Life imitates art 🙂 Read Reconfigure first, but this might be a topical time to check out Cont3xt whilst you wait for the Apple demo in a local store next year. (Just £0.99 each for these adventures 🙂 )
“An EyeBlend? They are not on general release yet? How did you get that?” Her eyes lit up wildly as Roisin took in the news.
“Oh you know, I have a few friends who hack for a living.” Alex replied with an air of comedy superiority.
“You sure do! The EyeBlend is an awesome piece of kit. It does full blended reality applications. It uses field effect projection with live object tracking!” She said enthusiastically. “They call it a hologram, though it really isn’t as such. You can forgive that though as the effect is the same, apparently.” Roisin was on her tech turf again.
Just over two weeks ago I was sitting waiting for my Xbox Series X to arrive on launch day. It got held up for some reason and for a tense moment or seven I thought I might have fell into the over booking of orders trap. The good news though it arrived the following day and here it is.
Xbox …. box
opening up
Installed
Installation and setup was super simple and I left the One X attached too. However I had already moved lots of the key large games that were due a X/S upgrade onto a removable USB drive to save needing to do quite so much downloading, network transfer was an option too but I thought things would be at least playable more quickly. On logging onto the new box the profile and all its favourites and colours etc re-appear making it completely like the older box. Next gen gaming is now very like phone upgrades with the excitement of taking the thing out of the box, logging on and seeing …. oh its exactly the same. The best way to see and feel the different is to dive into an X/S enhanced game, get some ray tracing going as in my last post.
Microsoft has a smart delivery label on some games indicating they know to patch to the fancier version on the Series X. However, for a Series X version to work it has to be on the internal 1Tb internal drive or the 1Tb extension cart (which I also felt obliged to get). So I set about asking all of the 60-100gb games on the USB drive to make their way over to the fast internal drive. That is not an overly speedy process and for obvious reasons is kind of a one at a time gig. I had booked off the rest of the week to use up 2020 holiday and immerse myself in the new console but some of that the was going to be sat sipping in a progress bar.
Whilst I waited it was great timing the Harmonix (of Rockband fame) had released their DJ music mixing game/experience the day before. I had already played it on the One X but now could spark it up (from the USB as it is not “enhanced”) and just get on with enjoying the console. This game is disc flipping brilliant! An array of tunes, from 60’s country to modern EDM are available to put into your set. 4 platters let you drop parts of those tunes onto the decks, e.g drums from one, vocals from another. As you progress you get to mix and match all sorts of elements, fading in new parts, hitting beat markers for scores, muting, looping and adding custom instrument sections. The whole thing keeps everything in time and tune and synch in a really impressive and entertaining way. Most DJ stuff is usually dance music but as with my little mashup below there are some old 80’s tunes too. It won’t win any prizes but, rather like rockbound it makes you feel a musical god when you are doing it. You can play it as a game to progress, hit marks and styles or just tootle around. I have played with a lot of music games and to be able to just put stuff together and it sound right is such a buzz. We don’t all have the musical ability to do these things but it does make you want to do more. This filled all the time I was waiting for things to transfer and I had a blast, and am still. playing it of course 🙂
Once on of the One X versions of a mega game had moved across I launched them. It was Dirt 5 the new mad Codemasters racing game. Duly it announced with a new message that a better version was available did I want to upgrade. Hell yes ! The original was something like 60Gb so I was expecting some smart delivery of a few GB more of textures, instead I got a 70Gb full download. It seems smart delivery is not a delta, but the full thing re downloaded in a new package. This meant the transferring of over a terabyte of games to the USB drive from the One X and then transferring from that to the Series X SSD, hours worth or transfer, was in fact… pointless as far as I could see. I killed all the other transfers and just went to the network to get it to download new version. In this case I started with the launch of Call of Duty Black ops whatever number it is and carried on playing Fuser! I even entered something into a monthly task competition.
Once it had downloaded I launched into Call of Duty Black Ops in the single player story mode. I was constantly amazed by how fast and slick it was, how many great scenes there were visually. I also enjoyed the story and the temporal jumps. I mean I should as Reconfigure starting chapter is form the middle of the book :). It was also set in my era. A very different time for American presidents, though Reagan was previously a hollywood actor, and wanted to create space based defence systems. Interesting to be working for him though.
Reagan
Sunrise
I played the entire campaign through that day. To be able to a) finish a game and b) do it in one sitting is not to say it is too short or anything. The ability to block time off, enjoy and dive in made this like a fantastic boxed set on Netflix. There is of course the multiplayer, but I have to be in teh frame of mind to get a constant beating in that by all the kids.
Another really nice touch was this easter egg (which took a bit of figuring out to get to, ut not too much 🙂 ) As well as some 80’s games to play, really old eight bit glories there was this terminal.
Terminal
Typing on the diplayed keyboard it was clearly a proper version text based operating system from back in the good old days. I listed and changed directories (not sure many modern players will have a clue about that, but they can always look it up on the fancy inter webs). It turns out it has full versions of Zork I, II, Leather Goddesses of Phobos and a few others. I couldn’t;t use the keyboard on the Xbox app, only the slow and annoying onscreen key board, but that was actually part of the fun. I tried one of the games and saved a game, left the console and went back to see if it loaded it, it did! In the middle of the kick ass, next gen first person shooter there was a good old fashioned text based adventure from my youth, utterly brilliant and not the only flashback this month.
There were a stack of other games I have then dived into. In teh house we were already playing Watchdogs:Legion on the previous Xbox, but it was a really nice upgrade to be able to see London in all its next gen (and own futuristic dystopia).
However, The real stand out game has been Assassins Creed : Valhalla. The free-roaming of a beautiful looking saxon Britain it truly eye meltingly lovely. Unlike Call of Duty its an almost never ending set of things to do or complete, constantly attracted way from one task to do another or just to go sight seeing. I particularly liked that over in East Anglia, where I am from, a full version of Burgh Castle exists. The roman walls still stand there today and was a childhood haunt out on the edge of the broads.
`Sunny England
Not so sunny england
More sunny england
Admist all the lovely views there were a few unusual things too. I went to sort out a real work delivery of food and my controller timed out I was met with this amusing error message.
Boring-Squid
Also I unlocked fishing, of course it has fishing. As I tweeted recently.
animal crossing (ac) and assassins creed (ac) are the same game 🙂 It’s all fishing, picking flowers and plants (apart from the actual killing parts of course 🙂 ) #acnh#AssassinsCreedValhalla Spot the difference 🙂 pic.twitter.com/QhebUqIrQ4
I also played this for a while too, one I specifically bought after getting the console.
Yakuza: Like a Dragon
It is as mad and weird as its predecessors, will not be to everyone’s taste but it has made me laugh a lot. The new fighting system is more turn based, but you get used to it.
I have updated a stack of other games, Mortal Kombat:Ultimate was the biggest mess as I tried the moving from the USB drive again as it has lots of standalone pieces, I ended up deleting it all and starting again. Fifa got me confused too as it kept not installing much of an update, only to realise it was not actually available in the new shiny version yet, it just never told me and the X/S icon would relaunch the original One X version every time.
The only other fly in the ointment is that our 3 years old super snazzy high end Samsung TV does not cope with the new 120 hz ability of the Xbox. I also had to double check how to enable full HDR on the HDMI ports as it was not automatically doing that either. All done now though and it all works.
What no PS5? Well, once it all quietens down I will investigate getting one of those, but the Xbox, with its Game Pass Ultimate that covers the PC’s too is just too much ecosystem to ignore as a primary gaming system.
I mentioned I was relieving my childhood, well I also finally signed up to yet another video service – Britbox, as it was bundled for 6 months free on out BT broadband. I had pondered if I wanted old box sets of BBC and other channels shows, the lure of Spitting Image reborn too was tempting. However what finally did it was Blake’s 7, this was such a formative show for me, for career, interests and the sort of Sci-fi that I really like, and also write. Yes its all a bit set wobbly, occasionally long winded and cheesy, but I love it. Avon in the foreground below, played by the late Paul Darrow, as I have written often, is probably one of the reasons I became a techie/programmer. That’s turned out OK it would seem 🙂
I thought it would be interesting to revisit some of the Augmented Reality tools that have Unity3d packages for them. The first I headed for was Vuforia, now owned by PTC. I am using the free version. It all worked straight from the install, though there are a lot of features to tinker with.
I wanted to use an image marker of my own, so naturally I used the book cover. There is a lot of AR and VR in the story so it all makes sense.
For the 3d models I used the current trial of Fuse/Mixamo now part of the Adobe. It lets you build a model and export it in a nice friendly Unity3d fix format. You would be suprised how these various formats for models and animations hide so much complexity and weird tech problems though. Eventually I found a couple of animations that fitted the mood. This is not a full action sequence from the book, but it could be. I have some more vignettes in mind to experiment with. I am just upgrading my windows machine so I can use the Kinect 2.0 for some of my own motion capture again. Finding the right animation, and then trying to edit it is really hard work. The addition of motion, especially in humans, hits a different part of the brain I think. It makes lots of things look not quite right.
So here is the video of augmented reality on a cover of a physical copy of an ebook novel telling the story with lots of augmented reality in it, if thats not too meta. Roisin rather sassily taps her for while the Commander lays down the law to her.
Reconfigure and Cont3xt are available right now to enjoy, and if at all possible, PLEASE write a review on Amazon, it makes a massive difference to the take up of the books.
Wow. It is seven years since I started Feeding Edge Ltd. That is quite a long while isn’t it? The past year has been a more difficult one with less work in the pipeline for most of it. It has meant I have had to take stock and look to do other things, whilst the World catches up. It does seem strange given the dawn of the new wave of Virtual Reality, and Augmented Reality that I have not managed to find the right people to engage my expertise and background in both regular technology and virtual worlds. In part that was because I was focussing on one major contract, when that dried up suddenly there was no where to go. It is starting from zero again to build up and sell who I am and what I do.
My other startup work has always been ticking along under the covers, as we try and work the system to find the right person with the right vision to fund what we have in mind. It is a big a glorious project, but it all takes time. Lots of no, yes but and even a few lets do it, followed by oh hang can’t now other stuff has come up.
On the summer holiday, I had a good long think about whether to give this all up and try and find a regular position back in corporate life, I was hit with a flash of inspiration for the science fiction concept. It was so obvious that I just had to give it a go. That is not to say I would not accept a well paid job with slightly more structure to help pay my way. However, the books flowed out of me. It was an incredibly exciting end to the year. Learning how to write and structure Reconfigure, how to package and build the ebook and the print version. How to release and then try and promote it. I have learned so much doing it that helps me personally, helps my business and also will help in any consulting work I do in the future. I realised too that the products of both Reconfigure and Cont3xt are like a CV for me. They represent a state of the virtual world, virtual reality, augmented reality and Internet of Things industry, combined with the coding and use of game tech that comes directly from my experiences, extrapolated for the purpose of story telling.
Write what you know, and that appears to be the future, in this case the near future.
This year I have also been continuing my journey in Choi Kwang Do. This time with a black suit on as a head instructor. It has led me to give talks to schools on science and why it is important, with a backdrop of Choi Kwang Do as a hook for them. I am constantly trying to evolve as a teacher and a student. Once again the reflective nature of the art was woven into the second book Cont3xt. I did not brand any of the martial arts action in the book as Choi Kwang Do as that may mis-represent the art and I don’t want to do that, but it did influence the start of the story with its more reflective elements, later on a degree of poetic licence kicked in, but the feelings of performing the moves is very real.
I have continued my pursuit of the unusual throughout the year. The books as a product provide, rather like the Feeding Edge logo has in the past, a vehicle to explore ideas.
I still really like my Forza 6 book branded Lambo, demonstrating the concept of digital in world product placement.
If you have read the books, and if not why not? they are only 99p, you will know that Roisin like Marmite. Why not ? I like Marmite, again write what you know. It became a vehicle and an ongoing thread in the stories, and even a bit of a calling card. It is a real world brand, so that can be tricky, but I think I use it in a positive way, as well as showing that not everyone is a fan. So the it is just another real world hook to make the science fiction elements believable. So I was really pleased when i saw that Marmite had a print your own label customisation. It is print on demand Marmite, just as my books are print on demand. It uses the web and the internet to accept the order and the then there is physical delivery. I know its a bit meta but thats the same pattern Roisin uses, just the physical movement of things is a little more quirky 🙂
I have another two jars on the way. One for Reconfigure and one for Roisin herself.
I am sure she will change her own twitter icon from the regular jar to one of these later as @axelweight Yes she does have a Twitter account, she had to otherwise she would not have been able to accidentally Tweet “ls -l” and get introduced to the World changing device @RayKonfigure would she?
All this interweaving of tech and experience, in this case related to the books, is what I do and have always done. I hope my ideas are inspirational to some, and one day obvious to others. I will keep trying to do the right thing, be positive and share as much as possible.
I am available to talk through any opportunities you have, anytime. epredator at feedingedge.co.uk or @epredator
Finally, last but not least, I have to say a huge thank you to my wife Jan @elemming She has the pressure of the corporate role, one that she enjoys but still it is the pressure. She is the major breadwinner. You can imagine how many 99p books you have to sell make any money to pay anything. She puts up with the downs whilst we at for the ups. Those ups will re-emerge, this year has shown that too me. No matter how bleak it looks, something happens to offer hope. I have some new projects in the pipeline, mostly speculative, but with all these crazy ideas buzzing around something will pop one day.
As we say in Choi Kwang Do – Pil Seung! which means certain victory. Happy lucky 7th birthday Feeding Edge 🙂
On Wednesday I embarked on the start of a journey, like many others have taken to try and write a book. A science fiction near future adventure. Currently called Reconfigure. Firstly thankyou for all the advice and mentoring and support. This while Author thing is something that many people have tried at various times with varying degrees of success, so Thankyou for sharing. I am writing in a bit if a frenzy at the moment as I am in some sort of zone. I start at 9:30am and kind of wake from the blitz of typing at 1pm. That leaves some time to decompress and then chase all the other pieces of work and jobs that might end up paying their way at some point.
Whilst not obsessed on the whole word count thing I am following some great advice to just go with it, but to keep it in mind. If there is stuff there, it needs to come out. The flow I am experiencing is very much like those really productive coding sessions. When you are just on it and away you go. I made a plan at the start, a story board with some key moments and discoveries within the story. I am mostly sticking to that, but as things pop up in this voyage of discovery I do pursue them.
The underpinning of the story is technology and approaches I know and that I do all the time. It is working as a substrate on which to grow the more esoteric elements of the story. The unusual limit breaking adventure elements.
Like everything I do there is an element of obsession to try something and see where it goes. Well after five days of blasting through I seem to have something that might just work. At about 25k words so far its feeling about 1/4 or 1/3 through. If it was a TV series, which it would work as one I know, it would be the start of the regular adventures. So writhe now it depends how many scrapes, twists and quirks I throw in on the ever increasing discovery arc.
Just like a good DVD with extras I have a couple of endings. One I really like but just don’t want to do and another that might be a bit of a cheat.
I am aware that finishing the main body is just part of the whole thing. Editing down and making sure they are no continuity errors or spelling/grammar errors will be very time consuming. Still I have no publisher to worry about so I will, as usual, do my own thing and see what happens.
Now time for a bit of background research that extends what is currently the books operating system. 🙂
We just spent the past 2 weeks in a villa in Mallorca on our family holiday. It was, as with all holidays, great fun and a change of scenery and pace. Though I still was on the look out for some interesting new projects and had a few calls to discuss things. It is a time to reflect though.
I spent a lot of time doing my Choi patterns out in the sun, as well as us all swimming, eating and playing games like Exploding Kittens and Forgotten Dessert. We travelled around a bit in the hire car and visited some interesting places. Caves, mountains and beaches. I managed to read an entire book too. I finally go to reading Andy Weir – The Martian. It was an odd dichotomy to read the claustrophobia of being stranded on an unforgiven planet, but having to use maker and engineer wits to overcome the problems the faced. The technical detail in it was superb, the maths and calculations around how much water, oxygen, fuel, soil, potatoes etc that he needed kept whirring in my brain whilst in this baking heat and relaxed family atmosphere.
We were not cut off completely, we had WiFi in the villa. So the predlets were constantly streaming minecraft and other vloggers. Of an evening I found CBS Action on the TV and got the predlets into watching Star Trek The Original Series, followed by MacGyver which they had never seen before.
Somewhere this all seemed to come together in a blinding flash of inspiration and I suddenly realized I had a scifi story in my head. One I needed to write.
I know, its something loads of people do, but I do love writing. I realized that my technical know how spanning so many years had a value in bringing some genuine flavour to any story. Also I specialise in the near future with emerging technology. Often in articles, and in posts and tweets I extrapolate a little further. I have played a lot of games, watched a lot of films, and like to riff on ideas. My book reading is of course not great, I am not an avid reader, but I think that means the things I have read have a bigger impact on me.
So I came back home, sat down and started. Having mused over the idea for the second week of the holiday I thought I best storyboard it first. After all this is like trying to build software. You need to architect it first, based on the requirements. This requirements I had, mostly. The base premise, some of the development and potential end.
Yesterday was just day 1, it may take years but I got 2 chapters worth of 5,500 words in total out. As I wrote it flowed, it was like watching a boxed set on the TV. I didn’t totally know what was going to happen and things cropped up and needed to be addressed. Again this was very much like coding. You just do it, find the flow and ride it. I hope I can continue to find the flow. I didn’t have a specific character in mind but yesterday they just arrived on the virtual paper I was typing into.
Of course there is no money in this, but whilst I wait and chase those customers and even potentially a regular job I might as well try something that I should have done a long time ago.
It seems that despite my wide ranging experience both technically and sharing with people and doing the right thing I am not finding the right avenues to express those talents and get paid properly.
So my plan is to get it done and just self publish on Amazon or some such place. If it works great, if not then its another experience. I also get to keep my tech skills without writing too much software as the book needs to use the right tools and work in the right way. So I figured this is another excuse to keep up to date with everything.
I started off with Feeding Edge thinking I would write the book about the virtual world experiences in corporate life, some great positives to share but also some ridiculous negative human behaviour in big organisations too. It is the latter that stops me writing that factual book. I may do after this fiction on but I think the scars are still to fresh to want to open those up again.
So here we go, lets see what happens on this little experiment. If a massive piece of traditional work appears requiring my full undivided attention, well at least I have started 🙂
The working title of this is “Reconfigure”. I have not checked out if this already is used in places but I am not married to the title. It’s a real world sci-fi thriller. Full of true technical detail and science fact but asking some challenging questions of the world.
Right, time to write 🙂
