In addition to presenting the new Google TV Streamer, Google took the opportunity to inform us in advance of what will happen in the future. Apply Gemini models to Nest cameras, the smart homespeakers and Assistant.
Google’s idea is this: Nest cameras accurately describe what they see so that later you can ask specific questions while watching the activity, such as “Did the kids do their homework?” or “Did the mailman drop off a package while I wasn’t there?”
Cameras of the future understand what they see
Nest cameras are the ones that will get the most amazing improvements with the introduction of Gemini. Google announced that improvements to Gemini’s multimodal models for processing videos, images, and text will eventually allow them to understand more broadly what they see and hearemphasizing the most important thing.
Google gives us an example: instead of detecting movements, people or faces, the camera will describe the specific action with details like “the dog is digging in the garden”. Nest’s eye will see everything that’s happening in your home, with the advantage that you can then perform specific searches in the Google Home app when reviewing camera activity. Some possible searches that Google indicates are:
Did the children leave their bikes at the entrance?
Did the courier truck come by today?
Did my dog get near the cookies?
Gemini will also be seen in Google Home Script Editorwhere it will help you program the perfect automation without you having to write a single line of code. Gemini will try to offer you an automation that meets what you asked for, taking into account the capabilities of the smart devices you have at home.
Additionally, on Nest smart speakers, Google Assistant will have new voices This will make the interaction more like a conversation. Gemini will allow said assistant to understand you better, converse naturally, and easily return to the topic or ask other related questions.
Half surprising, half dystopian, the union of Gemini, the House and the Nest will take place little by little, with a trial for a limited number of Nest Aware subscribers by the end of the year. Nest Aware is the subscription to Nest cameras and devices that add more intelligence and video storage for 6 dollars per month.
In Xataka Android | Why Google’s AI is called Gemini. This is the story behind its name
