The Highlights of today’s Facebook’s Oculus Connect announcement
I attended Oculus Connect via Oculus Venues in Virtual Reality rather than the San Jose McEnery Convention Center in California. It felt engaging to be part of the crowd even though I was only there as an avatar. Before we dive in to the highlights let’s cover off what we didn’t hear… Mark Zuckerberg has been very vocal about aiming to have 1 billion virtual reality users by 2020. That’s only 3 months away or 1 year 3 months away if we are going to stretch it out until the end of the year in 2020. We were told today how much they’ve made from VR Oculus Store content during its lifetime yet (spoiler alert) we weren’t told any numbers around how many HMD units have been sold overall, no breakdown of how well Rift S or Quest is doing. Well other than we are selling Quests like hot pancakes and struggling to meet the demand. Why then were we not told any numbers? We’ll go through some of these points later on in detail but how come when we are looking to support developers with building content & aiming for “critical mass adoption” of virtual reality we are not told how many players are in each team or even what size the playing field looks like in general? If virtual reality is now then share those numbers please.
As it so happens, I do believe that virtual reality is now even if I don’t have the corporate figures to back it up. I’ve been watching the market and community grow with a keen interest this year. The hype for the Oculus Quest and Rift S was the instigator for most of the new faces but we have had other hardware companies come along for their debuts this year too. Social media communities have bloomed too, there’s a handful of communities all around the Oculus Quest by itself, not to mention VR in general or other VR devices. Stepping outside the Oculus bubble a second, other external evidence to show that VR is now is all the amazing work that is being done! It is actually overwhelming now and I feel we are at a point for anybody joining us at entry level, will struggle to know which direction to focus their attention on with what platforms targeting what device. Its an amazing problem to have because it is a side-effect of this recent growth spurt but you get what I’m saying, there is evidence if you look. It would just be more compelling to be backed up by the various headset sales numbers is all…
Perhaps a reason for not mentioning the hardware sales figures is because the Rift S hasn’t been doing so well or as well as expected? I would be surprised if that were true but then again the standalone capability of the Quest is a pull point for most people. Perhaps the difference between the sales figures was too shocking to call-out? One thing we do know is that the Oculus Quest appears to be favoured by customers: “Oculus Store has made over $100m dollars in its lifetime and Oculus Quest accounted for over 20% of that!” That’s an extraordinary stat considering that the Quest is only 4 months old!
First up, we had the announcement of the new Oculus Link which will be released in November this year. This update will allow for Oculus Quest owners/users the ability to play Oculus Rift S games on their Quest simply by connecting to a compatible gaming pc using USB. Oculus will have a customised USB cable for this use too that you can buy and expect to be delivered in November too. Who remembers the controversy around Virtual Desktop’s ability to stream & play games from other platforms to Quest? And what does this mean for SideQuest? There’s still plenty of unique games in platforms outside of the Oculus Store I guess. To me this is the 1st aggressive competitor/market closing manoeuvre I’ve seen from Facebook and one that I am now switched on to. In fact, this triggered me into being alert for the rest of the 2 hour long keynote. Unfortunately, you will see other industry wide similarities and stake claims being announced as we proceed.
Hand Tracking coming to Oculus Quest early 2020!
That’s right! The Quest has the 4 cameras at the front for sensing your external environment as well as picking up the sensors on the existing Touch controllers. Well now it looks as though the research & development team have cracked the Machine Learning requirements for real time hand tracking using the Quest. Although, we have seen real time hand tracking in the industry already so this is not groundbreaking or new, however, absolutely a step in the right direction for complete immersive embodiment. Leap Motion being the most obvious, it was reported that Google and Media Pipe had cracked it too and Vive Cosmos is going to support finger tracking soon as well.
The ability to use simply your hands instead of controllers will open the accessibility door too. I work with elders who sometimes struggle mentally to grasp the concept of working controllers not to mention physically being able to grasp them. Speaking of which, I was hugely excited about hearing more about CTRL-Labs! I had only learned about this company a few hours earlier by watching this mind-blowing interview before the Facebook acquisition was announced. I recommend giving it a watch, it’s truly incredible! They use electrical signals from the nervous system and their modelling systems to make muscle movements through your thoughts! Perfect for accessibility as well as general evolution of interacting with computers & machines. The interview below really brings it to light and their dev kits are already shipping (be prepared to be on a waiting list for a while though given the interest in this groundbreaking technology).
Social VR comes to Facebook through Horizon
I’m a huge fan of social VR and I have never tried Facebook Spaces before. I’m not sure what has happened to Spaces but Horizon is the new thing. A social VR place where you can connect, create, interact and play games all within your VR headset. Learning to build things without coding is always appealing. Would I prefer this to existing platforms? Not sure. The intro video was quite cheesy for my taste… There were similarities to everything that is working well currently within the social VR sector of the industry. There were cross-overs with AltSpace VR and Rec Room with a particular focus on creating art. VR artists are making their way into the spotlight with their outstanding creations. Again I can’t help my thoughts turning towards Facebook taking the things that are working well and incorporating those for themselves. It is how business works I guess but I would be upset or lost if these other platforms were to be swallowed up as a result. Perhaps I’m jumping the gun especially given how early stage Horizon is.
The Evolution of Avatars
My words wouldn’t do this any justice so I found a tweet with a video clip so you can see for yourself
Mixed Reality Capture Shared Spaces and Passthrough+ upgrade
It was briefly mentioned that we will be able to capture not only the VR gameplay footage but also ourselves playing in VR too. The mixed reality Beat Saber videos are extremely effective for sharing fun & engaging content. The ability to do this is coming. So is being able to have shared spaces virtually such as the basketball game photo below were 2 people are physically located separately but are together virtually.
The Passthrough+ on the Oculus Quest will have the ability to switch on and off so that you can flip back between real world and VR whenever you choose to. This is such a simple but useful function to add.
Oculus Media Studio
Media Studio sounded fantastic for content creators, developers and users alike. I’m not entirely sure I grasped all of this correctly though… So in essence for creators/developers it is a dashboard to help you to market your work through word or mouth because users will be able to see their friends playing your stuff through the ‘location’ section. Content creators will have the ability to use the media studio to stream and reference your work. But there will be dashboards to show numbers relative to your product & users. Next was the reason I can’t be sure of the detail beforehand relating to Media Studio. Next was, the newer style Oculus TV. I got lost in my thoughts again at this point, completely lost in my thoughts so can’t report on this other than saying it sounded exactly like Bigscreen VR. It was the ability to watch things together in virtual spaces – so perhaps this was the how the basketball example above worked or how you do that? Not sure, but yeah Oculus TV is being revamped into shared spaces to watch & stream content to. Another reason for Virtual Desktop to be told not to be compatible with streaming on Oculus platforms.
VR for Business
A smarter API and ability to manage multiple headsets simultaneously. Amazing case studies shared about working in virtual environments from remote locations. But the headliner was from Johnson & Johnson, Osso VR and partner’s surgical training outputs. They shared that 83% of newly trained surgeons who used VR training were able to carry on with surgical procedures unguided afterwards compared to 0% of students who received traditional training methods! The evidenced source or published research would be much appreciated if anybody could share that please.
AR Strategy at Facebook
Were we expecting Facebook to make AR glasses? I guess so, I mean AR is all over the many platforms and probably the driver behind the growth in mainstream awareness there too. Spark AR was only mentioned by name during the keynote but nothing more. However, aside from the glasses, we heard how Facebook are looking to do live maps. It works by using crowd source info from connected devices eg smart phones or AR glasses. The video looks impressive but I told you I was triggered and in that moment couldn’t help think about 6D.ai and the amazing work they are doing for smart phone photogrammetry real time mapping. What was exciting was the hologram AR part of their explanation video. Again, it’s nothing new but it is exciting. Yet, another way that Facebook are enforcing themselves as the tech giant that they are in the immersive space.
We heard a Beat Saber announcement about a new Panic At The Disco music pack being released next week and 360 degree gameplay being released next year. Stormland, Asgard’s Wrath, Medal of Honor: Above and Beyond and Vader Immortal 2 all announced. Vader being the only one released with immediate effect & the others can be pre-ordered (not sure Medal of Honor release date). Incidentally, Medal of Honor looked intense!!! You saw a lady pulling the pin out of her grenade controller with her real world TEETH before chucking it into the enemy line. It looks to be so immersive and as close to a war like simulation as you are going to get without getting hurt in real life.
The Future of Hardware
There was quite an interesting talk about the evolution of Half Dome’s. I’ll be honest, I had never heard of these before this talk. The level or detail in the research and prototyping is quite remarkable. Essentially, it the next gen HMD with specific sharp verifocals/lenses for clearer vision within an immersive experience. We watched footage of some of the basic VR intro programs with and without these specially adapted lenses. The Half Dome 3 (the newest one) was crystal clear – there were 6 lenses altogether that help to achieve this result. I listened to this intently but I’m sorry I can’t articulate how genuinely interesting it was!
This was an action packed keynote speech with many different things to take in and digest! The Oculus Quest came out best throughout the messages by being upgraded quite significantly I felt. The Rift S, I actually feel sorry for and think it’s being overlooked – could that be because of the Half Dome coming even though we’re being told that it’s not there yet? Well, what about the Oculus Go? The Go didn’t get mentioned really – only when it was said that we will be able to play our Go games in, yep you guessed it, Quest… I don’t think Go games were coming to Rift S? Surely they must, it’s just through the Oculus Store right? Hopefully you Rift S users will have that at least, not much of a party bag but at least you didn’t go home empty handed… like the Go users have… I dunno what to make of it all. Great to be able to experience all of these technology elements with my Quest – especially hand tracking and easier content creations BUT mixed feelings about the dominating strategy. With any luck I’m just being over-sensitive to it all because I was initially triggered…
Would love to hear your thoughts and ideas if you want to get in touch @TheHappyLass