Site icon Canadian Technology Magazine

Google Gemini’s NEW Features Are UNBELIEVABLE 👀 (New Screenshare Feature & Google Labs)

Sofia Alvarez
google laboratorio

google laboratorio

These updates change how you interact with Gemini (voice, camera, and screenshare), how you design and iterate on visuals, and how you personalize learning materials. I’ll show you how each feature works, why it matters, and practical ways you can use them today — including a live demo of filling out an IRS Form using Gemini’s new screenshare voice workflow. If you want to jump into AI automation and practical use cases, I’ve included resources and a call to action at the end.

Table of Contents

Overview: What Google Just Launched 🚀

At a glance, here are the highlights I cover in detail below:

Why These Updates Matter 🌟

There are a few recurring themes in these updates:

Put simply: Gemini is moving from a text/chat assistant to a context-aware collaborator you can speak to, show, and co-design with.

Deep Dive: AI Studio Screenshare with Gemini 2.5 Flash 🎙️

This is the big one. Head to ai.studio.google.com and click on Stream. If you have access, you’ll see a fresh entry for Gemini 2.5 Flash native audio preview (the build shows 0925 — it literally shipped yesterday when I recorded). This lets you:

System instructions, voices, and settings

Before you start, you can add system instructions to set context. For example, in my demo I told Gemini: “You’re a helpful agent that can help me fill out IRS form 8802 for my business.” You can also adjust voice type, media resolution, coverage (which enables Gemini to send audio or videos when speech isn’t detected), dialogue behavior (effective dialogue and proactive dialogue), and function calling.

These controls are more than cosmetic. They determine how Gemini interprets tone, whether it filters irrelevant noise (super useful in a noisy coffee shop), and whether it can call predefined functions automatically (think: fetch data, compute, or open a tool).

How it works — a real demo: filling out IRS Form 8802

I pulled up a gnarly IRS form (Form 8802 — United States residency certification) and used screenshare + voice. This is the exact type of tedious, confusing paperwork that benefits enormously from a hands-on assistant.

Here’s the interaction in practice: I shared the Chrome tab showing the PDF, spoke to Gemini, and asked what “appointee information” meant. Gemini responded clearly: the appointee section is for someone else (an accountant or attorney) to contact the IRS on your behalf; if you’re handling everything yourself, leave it blank.

“If you’re handling everything yourself, you can leave that section blank. Does that clarify things for you?”

Gemini’s response was precise, context-aware, and referenced exactly the part of the document I was showing it. Importantly, the chat history remains available for review later — you can scroll back to confirm instructions instead of keeping the source doc open the whole time.

Why this is a game-changer

Mixboard Lab: A Better Pinterest for Creatives 🎨

Visit labs.google.com and open Mixboard. This lab is designed to supercharge creativity by combining generation, curation, and editing in a single workspace.

What Mixboard does

In my test, Mixboard produced tailored visuals and allowed granular edits. Want a thumbnail concept for a YouTube video? Mixboard can give you several variations, let you overlay text, remove the background, and produce final exports — all in one place.

Why Mixboard matters to creators and marketers

Learn Your Way: Reimagining Textbooks for Every Learner 📚

One of the most exciting education-forward updates is “Learn Your Way.” This tool aims to personalize textbook content to the learner — converting PDFs into immersive lessons, slides, audio narratives, and mind maps tailored to a student’s interests and grade.

How to try it

Currently Learn Your Way is on a waitlist. You can sign up to get early access. Once inside, upload a PDF (textbook, lecture notes, or study guide) and configure the learner profile. For instance:

Output types

Learn Your Way generates multiple deliverables from the same source PDF:

In the demos, Learn Your Way transformed a chapter on “economic systems” into a personalized 28-slide presentation for a high schooler who likes movies, using film-based examples to explain concepts. That kind of contextualization is a powerful pedagogical shift — it makes abstract concepts relatable.

Why educators and parents should care

Stitch.withgoogle.com: Design at the Speed of Light 🧩

Stitch received a major overhaul that streamlines app and web design with AI-generated UI, code snippets, and Figma exports. Tell Stitch what you’re building, and it will generate design slides, components, code, and variants.

How I used Stitch in a demo

My prompt: “Create an app that accepts a TikTok link and returns a transcript.” I let Stitch generate designs with no sketch input. It then produced a full set of screens and asked whether to proceed with designing slides. From there I was able to:

Modes and fidelity

Stitch offers:

You can inspect design history, learn from community examples, and use starter prompts. For teams building quickly, Stitch dramatically reduces design-to-prototype time.

Nano Banana and Small but Mighty Changes 🍌

Early in the update roundup I mentioned improvements to Nano Banana. While the transcript only referenced it briefly, Google is iterating rapidly on lighter-weight agent workflows and helper models (often nicknamed “nano” models). Expect:

Think of Nano Banana (or similar micro-agents) as the difference between opening a full IDE versus a quick utility: they’re optimized for speed and single-purpose tasks that support larger workflows.

Function Calling, Grounding, and Proactive Dialogue — The Under-the-Hood Upgrades ⚙️

Some of these features are settings you can toggle, but they’re critical for making conversational AI actually useful in production workflows:

Together, these features reduce hallucinations, improve reliability, and make the assistant behave more like a helpful teammate than a black-box response generator.

Practical Use Cases: How I’m Using These Tools Now 🔧

Here are concrete workflows where I see these tools adding immediate value:

  1. Paperwork and forms: Use screenshare + Gemini to walk through legal documents, tax forms, or contracts. Show the field, ask a question, and get context-aware guidance.
  2. Creative campaigns: Ideate in Mixboard for ad concepts, pull variants, and export final images for A/B testing.
  3. Product design: Prototype in Stitch, export Figma, and hand off to engineers with generated code snippets and interaction flows.
  4. Education and training: Convert corporate SOPs or textbooks into audio lessons and slides with Learn Your Way for faster employee onboarding.
  5. Micro-automation: Use Nano Banana-style agents to perform single-step tasks (file conversion, quick translations, short summaries) inside larger pipelines.

Reality Check: Jobs, Automation, and How to Stay Ahead 🧭

Big-picture context is important. As I mentioned in the video, Goldman Sachs released a startling projection that AI could impact over 300 million jobs in the next 12 months. Whether you agree with the timeframe or not, the direction is clear: AI will change work.

“They think in the next 12 months, AI is gonna replace over 300 million jobs.”

If you’re worried or excited (you should be productively nervous), here’s my take: learn to use these tools rather than fear them. I built AI Automation School for exactly that reason — to teach people how to automate workflows, create AI agents, and monetize AI skills without needing to be a full-stack engineer.

My strong recommendation: invest time learning practical AI workflows, not just theory. Tools like Gemini, Mixboard, Stitch, and Learn Your Way are designed to be used, and early adopters will have a competitive advantage.

Resources and How to Get Started Today 🧭

Quick starter list:

Suggested assets to include on a blog post about this topic:

FAQ — Your Questions Answered ❓

Is the screenshare feature available to everyone?

Access depends on rollout and your Google account permissions. Some features (like Learn Your Way) are on a waitlist. If you don’t see the options yet, check ai.studio.google.com periodically and join waitlists when available.

How secure is sharing my screen with Gemini?

Gemini runs within Google’s infrastructure and includes privacy and security controls, but you should always avoid sharing sensitive personal data (SSNs, passwords, bank account numbers) when testing new features. Use redaction or masked data for demos. For production workflows, consult Google’s documentation and your organization’s security policies.

Can Gemini actually fill forms for me automatically?

Gemini can guide you and generate suggested text for fields. With function calling and careful automation, you can script form-filling workflows, but always review automated inputs before submission, especially with regulated forms like tax or legal documents.

What’s the difference between Mixboard and Pinterest?

Conceptually similar, but Mixboard is generative and editable. Pinterest is curation-first; Mixboard generates images tailored to your prompt and lets you edit or regenerate variations inline.

Is Learn Your Way better than a human teacher?

It’s complementary. Learn Your Way personalizes content and automates lesson creation, but pedagogy, motivational support, and social learning aspects still benefit from human teachers. Use Learn Your Way to augment instruction and reduce prep time.

Can Stitch export production-ready code?

Stitch provides code snippets and Figma exports to jumpstart development. For production, you should treat outputs as a scaffold and have engineers refine performance, accessibility, and backend integration.

Meta Description & Tags 🏷️

Meta Description: Google Gemini’s latest updates include screenshare with Gemini 2.5 Flash, Mixboard, Learn Your Way, and Stitch redesign — practical AI tools to boost productivity and creativity.

Tags: Google Gemini, Gemini 2.5, AI Studio screenshare, Mixboard, Learn Your Way, Stitch, AI design, AI education, AI Automation School, Rob The AI Guy

Conclusion + Call to Action 📣

Google’s latest updates push Gemini into the realm of a true multimodal collaborator. Screenshare with natural voice interaction turns tedious tasks (like filling IRS forms) into guided workflows. Mixboard and Stitch compress creative and product design cycles. Learn Your Way could transform education by personalizing lessons to how students actually learn. These are not incremental changes — they’re structural improvements that will shape how people use AI daily.

If you want to get ahead, start experimenting with these tools, sign up for waitlists, and learn to build automated workflows. If you want a guided path, check out AI Automation School where I teach practical automations, agent-building, and workflow audits. There’s also a special launch pricing if you want a head start.

Want me to walk through a live app build using Stitch or show how to automate a form-filling pipeline with Gemini? Leave a comment or join the community, and I’ll make a step-by-step tutorial.

 

Exit mobile version