We all get excited about any new device, be it that shiny new phone, or that amazing looking gadget hitting the store this season,….but have you ever thought about where all this is headed and what this would eventually lead to?
Its easy to get caught up in the moment and hype, but its incredibly important to be prepared for the future, now more than ever as technology advances at a lightning pace.
This is even more paramount if you work in tech and your livelihood depends on it, you maybe a UX professional (like me 🦄)- , a software developer, a software tester, someone who manages tech projects, or even someone who has invested in tech… this will effect your future.
Liquid UX is a concept which I created as one possible scenario to this future.
So what exactly is it?
We see now what I would call an explosion of apps and devices…
…and along with all of these applications and devices, competition arises in every form. Right now having the best UX and CX is key to becoming theking in your space, gone are the days where functionality and functionality alone was king.
In addition to this, we see that these experiences are now more widely found outside our traditional devices like PCs, Macs, and mobile phones (yes, I called mobile phones traditional 😉). You find these devices in every aspect of your life now, the actual percentage % of time a day you spend interacting with these devices is drastically increased over time.
“The actual percentage % of time a day you spend interacting with these devices is drastically increasing over time.”
Thus bringing me to the first key element of Liquid UX….it will comprise of almost constant interaction with the user.
In a nutshell,
Liquid UX is a state in which interfaces will leave physical screens / displays and flow with you on to different mediums and exist in your physical reality. The distinction between the virtual and reality will be blurred so much to an extent which you will not be able to tell the difference. (Unless deliberately made to)
“Liquid UX is a state in which interfaces will leave physical screens / displays and flow with you on to different mediums and exist in your physical reality.”
To further define my idea, I am going to have a set of elements to govern this idea, all of which must be fulfilled to be able to qualify as a liquid UX.
- It will comprise of an almost constant interaction.
- Indistinguishable or highly indistinguishable from reality.
- Will involve all five human senses.
- Will not require a conduit or controller.
- Will be preemptive (user initiation not required)
I think most of these points are self-explanatory, but let me add some context and thoughts about why I think they are important. It is important to note that most of these points intertwine and overlap together, which you would notice when I attempt to explain them.
1. It will comprise of almost constant interaction.
A scene from the movie “Blade Runner 2049”
You live your life as one constant series of experiences, whenever we interact with the virtual world, we make a conscious decision…
- to switch on that device and then interact with the services it provides…
- or a sensor would would in some way initiate this…
- or an attention grabbing notification from these devices would initiate this interaction.
However with the concept of liquid UX, we can hope to see this as more of a constant interaction, where you need not initiate or consciously pull up a device to have an interaction.
It’s always going to be there with you.
Now for some of you (myself included) alarm bells might be starting to ring in your head right now… you would ask…
“But wouldn’t that mean… I have no choice on whether to interact or not?”
“That looks like it is going to violate my freedoms and privacy in some way!”
It is reasonable to think so, however It is important to note that, your choice of what type of virtual entity/experience would be your choice alone, and this at some point will be engaged or activated by you. (Much like downloading an app today)… however…looking at how malicious software operates today, this does open up possibilities for new types of attacks. Again something that we may need to prepare for.
Letter
2. Indistinguishable or highly indistinguishable from reality.
Image from 2019’s Call of Duty Modern Warfare (Game)
With today’s systems, year after year you get huge advancements in how virtual spaces look, with video games leading the way in virtual realities…in some instances almost looking like the real thing.
Virtual reality spaces are in some cases using actual video footage from the world around us to create an even greater effect of reality.
Photo by stephan sorkin on Unsplash
Mixed reality takes all this a step further and merges Augmented Reality (AR) with VR, to overlay virtual objects with the real world. This is probably one of the first steps we see today in the direction I am speaking of.
Promotional image for the Microsoft Hololens 2
However, In my opinion we still can tell the difference with all of those experiences with that of reality, the reason being would be further illustrated in the next point.
3. Will involve all five human senses.
Photo by Nick Torontali on Unsplash
Think about the last time you went to the beach? What defined your experience at the beach?
Was it the breeze you felt on your skin,…. or the texture of sand and the warm waters of the ocean?… or was it the smell or taste of the salty sea?…or the sound of the waves crashing on each other? …..or was it seeing the beauty of the sea?
I bet it was all of this combined as one to create this experience for you. All human experiences are defined with the combination of interconnected senses.
So for an experience to become a liquid UX, I believe it should play on all of our senses. As mentioned in the previous point, this is one key distinguishable fact why virtual and real experiences can be easily told apart.
There have been attempts to give an experience somewhat close to this. With some movie theaters labeling themselves incorrectly as 4/5/6/7/9D, and using VR, or 3D glasses, combined with mechanical chairs and water sprays and other mechanical parts to emulate some experiences. But these again are far from reality, and although they are quite fun, they yet again don’t match the criteria required for all 5 senses.
Which means that it is not enough just emulating the senses, but it should be done in an interconnected, and seamless fashion and it should be indistinguishable from the real thing.
With current advancements technology we have to some aspects saturated the experiences on some sensory channels. For example…
- both Sight and Sound, have very high quality mediums already in existence.
- Touch comes in at third place with some degree of feedback, however these are still quite far off. Haptic feedback on phones and specialty gloves are among these.
- Smell and taste both have leaps and bounds before becoming anything close to a usable state by the masses in virtual realities. However some work has been done in this space and most notable by Andrian David Cheok with devices which stimulate smell and taste. Some devices also exist for smell which come in cartridges which mix together or diffuse a specific smell (triggered via the internet).
4. Will not require a conduit, or controller.
Photo by Nikita Kostrykin on Unsplash — Sony PlayStation gaming console controller
Many experiences today, require some sort of controller or conduit into the virtual world. A very basic example is the mouse and keyboard (which I used to interact with my computer to create this article). the touch screen display on your phone is another example. We have many input devices which reach into the virtual world to interact with it. These however advanced still act as conduits and controllers. We need these devices because we exist and operate in an analogue state and computers require digital inputs.
In a liquid UX world, It would need to be as natural as speaking to another person, and as mentioned in the point before, when all five senses are in play it would not be natural to interact via a controller or conduit.
5. Will be preemptive (user initiation not required)
Photo by BENCE BOROS on Unsplash — Google Assistant Detecting that your home
Most of today’s interactions with the virtual require some sort of initiation. However combined with all of the points above, liquid user experiences will also need to be intelligent enough to understand how people behave and adjust interactions and actions accordingly. This is more into the realm of artificial intelligence. Some digital assistants today like Siri, Google assistant, and Alexa does this in a rudimentary fashion,… eg. they detect when you are home, and adjust devices accordingly, …in addition to this many mainstream devices today exist to detect emotions and facial expressions as well.
Detecting emotions can be quite challenging…. even as humans we have a hard time understanding the people around us. With the current state of facial recognition it is however possible to see some micro facial expressions, but again this still a way to go.
Intel RealSense Stereo Depth Promo
Another type of technology which involves depth sensing and 3D room scanning is increasingly gaining mainstream use. Devices like the Microsoft Hololens, Intels RealSense devices, and other devices, employs various methods to scan and track environments in real time.
Spatial mapping done by Microsoft Hololens
Lets recap…
Lets recap by looking at how liquid User experiences are defined …
“Liquid UX is a state in which interfaces will leave physical screens / displays and flow with you on to different mediums and exist in your physical reality.”
and the points which will need to be fulfilled to qualify as a liquid ux
1. It will comprise of an almost constant interaction.
2. Indistinguishable or highly indistinguishable from reality.
3. Will involve all five human senses.
4. Will not require a conduit, or controller.
5. Will be preemptive (user initiation not required.
Closing thoughts…
I have been immensely fortunate with having the opportunity of playing around and designing experiences with almost all of the technologies mentioned in this article, as well as most digital mediums, screens and devices over the span of 13 years as a UI/UX engineer/designer.
I believe the concept I outlined is a futuristic view of where these experiences are heading to. It is difficult to speculate as to when these sort of experiences will come into being and if they would be exactly as I have described.
However just to throw in my rough estimate, I believe this would take about20 years to come into being…however…
…there are a lot tech advancements going on behind closed doors and it is possible that these would accelerate advancements or “surprise” us even sooner.
Another key factor of announcements/development of these new advancements would be governed by how profitable or how it disrupts existing income streams and profits. Companies may decide to hide / hold on to some of these advancements till they deem it is financially beneficial to them. The same can be said for developments made by the military and government research departments.
The entertainment and creative industries have done excellent work with depicting similar experiences. Games , movies and books have in the past have shown us how worlds with liquid user experiences can look, and a lot of the inspiration for writing article coupled with what I have seen today inspired me to document my thoughts.
Scene from Marvels Iron Man — One of my favorites in terms of depicting Liquid UX
In the future, imagine if your clients asked you to make sure your UX smelt like ‘the ocean’, or if they ask you to make it feel ‘colder’,…. how do you prepare for such a scenario? …..How will our role as creators and engineers learn to adapt to such an environment?
In a later article I hope to talk about how you can learn to derive inspiration for all your designs and work, and how to help you creatively come up with solutions to problems, and also how you could prepare for a ‘liquid UX’ world.
By reading this article I hope that all of this helped you to start thinking and dreaming of the future as I have. Thanks a lot for reading!
Originally published on Medium.
