Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Google I/O 2018 Marks a New Era for IoT Devices

DZone's Guide to

Google I/O 2018 Marks a New Era for IoT Devices

With Google I/O behind us, let's see how Google is pushing forward in the realms of IoT and AI, and how devices and virtual assistants will evolve.

· IoT Zone ·
Free Resource

If Google I/O 2017 was all about Google’s restructuring effort and the resonance of artificial intelligence brewing in Google Labs, I/O 2018 was more about humanizing those AI efforts by integrating them into its line of products, particularly Google Assistant, which powers Google Home and is an integral part of a bunch of other Google and non-Google devices.

google IO main

Google Assistant itself was the successor to Google Now. It enabled Android users, for the first time, to engage in a two-way conversation with their Android devices, something iOS users were already enjoying with Siri.

An Experience Beyond Devices: Google Assistant

google IO talk

During I/O 2016 while introducing Google Assistant, CEO Sundar Pichai called it, “The future of computing as an ambient experience that extends beyond devices.” He was quite right. Two of the very big Google launches at the event — Google Allo, a messaging app with a resident chatbot, and Google Home, a smart speaker to rival Amazon Echo powered by Alexa — were both powered by Google Assistant, an outcome of Google’s continual efforts in natural language processing, deep learning, and text-to-speech over the years.

Regardless the device, Google Assistant can book tickets, order spaghetti on a Sunday from your favorite restaurant, remind you of a meeting with the boss, give you the height of Mount Everest, and give you the temperature today and many days to come. All a person has to say is the hotword: ‘Hey Google’ followed by a command.

Continued Conversations With Google Assistant

To be a great conversation partner, the Assistant needs to deeply understand the social dynamics of conversation. For example, let’s be honest, it gets a bit annoying to say ‘Hey Google’ every time a user wants to get the Assistant’s attention.

Google realized it shouldn’t be so hard. Therefore, they introduced Continued Conversations to Google Assistant at the I/O 2018 event.

Now a person doesn’t have to say ‘Hey Google’ every time they want to wake the Assistant up. It now understands the context of conversation going on and can figure out pronouns. In the example below, it could understand that the user points to the Warriors when saying ‘they’.

Google Assistant 1

A person can now have a natural back-and-forth conversation with the assistant without having to repeat ‘Hey Google’ for every follow-up request. Even more helpful, the Assistant can understand when you are talking to it versus when you are talking to somebody else. Continued Conversation had been a top feature, and Google will be rolling it out as an update in the coming weeks.

Continued Conversation, however, didn’t solve the problem entirely. The Assistant still couldn’t handle complex commands.

Multiple Actions in a Single Command

With Multiple Actions, you can ask the Assistant multiple things at once. You can ask it to raise the temperature of your Nest and tell the temperature outside.

Google Assistant 2

In this image above, Google Assistant could process multiple commands at a time: turn on the Warriors game and start the popcorn machine.

While this sounds really natural to us humans, it’s very difficult for computers to understand. Even though executing multiple commands looks very similar to single commands, the assistant has to break them apart to form the two requests in the linguistics. It’s called coordination reduction.

Engaging in a two-way conversation with the Assistant is one thing, but engaging in an all-out telephonic conversation is another. Google attempted that successfully during the 2018 event.

Merging Multiple Actions and Continued Conversations to Create the Perfect Voice-Controlled Coffee Maker

In the fall of 2016, we collaborated with a coffee maker that wanted to create a coffee machine that could acknowledge voice commands via Google Assistant in Google Home. We agreed, and in the past week, they sent us a couple of their coffee machines. This was the first time we were working on the Internet of Things at the hardware level.

We used a Raspberry Pi to connect the coffee machine with Google Home. Everything worked fine. Here is what the series of commands looked like on Google Assistant to brew a cup of coffee via voice commands to our connected Google Home.

Google Assistant 3

If you look closely, the person had to say OK Google three times just to have a cup of coffee. So, I reimagined the entire setup of the Google Home-connected coffee maker with Multiple Actions and Continued Conversations in the picture. Google Home with Multiple Actions could understand more in a single command. Like, a person could tell it to brew a cup of coffee and dim the lights in a single command.

Google Assistant 4

Continued Conversation ensured that the user doesn’t have to repeat OK Google every time to activate the Google Home device.

This how I postulated the conversation flow to go.

Google Duplex: Google Assistant Would Fix an Appointment Over a Phone Call

Google Assistant 7

Did you know in the U.S., 60% of small businesses don’t have an online booking system set up? To book an appointment with them, a person has to call them manually and talk to the front desk, which can get annoying at times.

Google is testing a feature where its assistant can talk to a human and fix an appointment. The assistant can actually understand the nuances of conversation. Google has been working on this technology for many years — it’s called Google Duplex. Google Duplex is an outcome of Alphabet’s various investments over the years, particularly in natural language understanding, deep learning, and text-to-speech.

The best part is that the assistant carries the call in the background without interrupting the user and sends a confirmation notification when the appointment has been taken care of.

Google Assistant 5

Google is working hard to get this technology right. It is a technological breakthrough for businesses as well as users. It’ll save time for people and generate a lot of value for businesses.

Business Benefits of Google Duplex

Let’s us assume you sell an app-based on-demand delivery solution to businesses. You receive a lot of leads every day that are interested in buying your product, but want to see it in action before making the decision. You have a nice demo to show your solution in action, but do not have the staff to call each lead and fix an appointment. This is leading to business losses.

Google Assistant 6

With Google Duplex, you can simply upload the spreadsheet containing your leads for the day and ask it to call each of them and fix appointments. By the end of the day, you’ll have an updated spreadsheet with the time of appointment beside each lead. You can show them the demo while the assistant is busy fixing appointments for the next set of leads.

Google Is Bringing IoT Closer to AI

With the updated Google Assistant, Google is bringing its AI efforts closer to common people and small businesses as it continues to give its products a human touch. In the future, we will see smarter IoT devices, just what Google Home has become. Google Assistant is emerging from being a Google product to being an entire device-independent platform that will power conversational IoT devices in the future.

The time is not far when we will have Google Assistant-enabled ACs, thermostats, refrigerators, and other IoT devices. So what do you think of Google Assistant as the ultimate IoT platform? It’s already on our phones, TVs, tablets, wearables, and speakers.

Together, all our Google Assistant-enabled devices will work in unison and can be controlled from one another. I can ask the Assistant on my Pixel to turn on the AC in the living room. Likewise, I can ask the Google Assistant on my AC to ring my Pixel.

Topics:
google io ,iot ,ai ,natural language

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}