Microsoft unveils Copilot Vision, Gemini Live-like feature for Windows PC
The Copilot Vision can see what the user is viewing on the PC screen and intuitively offer suggestions or retrieve any particular information related to the query.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Geeky Gadgets
2 days ago
- Geeky Gadgets
How to use Copilot Vision : Professionals and Educators Guide 2025
Have you ever wished your computer could truly understand what you need—without endless clicks, menus, or instructions? With Copilot Vision in Microsoft Copilot, that wish is no longer a distant dream. Imagine seamlessly navigating your workday by simply sharing your screen and giving voice commands, while an AI assistant handles the heavy lifting in real time. Whether you're managing a complex project in OneNote, solving math equations step by step, or delivering a polished lesson as an educator, Copilot Vision transforms how you interact with technology. This isn't just a tool; it's a smarter, more intuitive way to work, learn, and collaborate. In this how-to by Mike Tholfsen, you'll learn the full potential of Copilot Vision, from its AI-powered screen sharing to its ability to generate automatic transcripts of your sessions. We'll explore how it integrates with tools like Microsoft Edge and OneNote, making even the most intricate tasks feel effortless. Along the way, you'll discover features that cater to educators, students, and professionals alike—like personalized learning support and real-time feedback. Whether you're new to Copilot Vision or looking to master its advanced capabilities, this guide, inspired by insights from Mike Tholfsen, will help you unlock a more productive, hands-free workflow. After all, the future of work and learning isn't just about doing more—it's about doing it smarter. Getting Started with Copilot Vision To begin using Copilot Vision, access it through the Consumer Copilot app on your Windows device. If the app is not pre-installed, you can download it from the Microsoft Store. Once installed, activate Copilot Vision to start sharing windows and interacting with the AI assistant. The interface is designed to be intuitive, allowing you to focus on your work while the AI manages technical details in the background. To ensure a smooth experience, verify that your device meets the system requirements for the app. Once activated, you can immediately begin exploring its features, such as voice-activated commands and real-time content analysis, which are tailored to streamline your workflow. Key Features of Screen Sharing One of the most notable features of Copilot Vision is its ability to share specific windows with the AI assistant. This functionality allows the AI to analyze and respond to the content displayed in real time, making it a powerful tool for multitasking. For example, you can share your Microsoft Edge browser or a OneNote document and use voice commands to: Navigate tools and menus effortlessly without manual input. Request explanations or clarifications on visible content for better understanding. Receive constructive feedback to refine your work or ideas. This hands-free interaction not only saves time but also enhances productivity by allowing you to focus on critical tasks while the AI handles routine operations. The seamless integration of screen sharing with voice commands ensures a fluid and efficient workflow. Using Copilot Vision for Smarter Work & Learning Watch this video on YouTube. Discover other guides from our vast content that could be of interest on Copilot Vision. Enhanced OneNote Integration Copilot Vision is particularly effective when paired with OneNote, offering a range of features that benefit both educators and students. The AI assistant recognizes toolbar functions, including those in Class Notebook, and provides step-by-step guidance on their use. This integration allows educators to: Distribute pages to students quickly and efficiently. Organize and manage student notebooks with minimal effort. Access detailed explanations of advanced features to maximize functionality. For students, this integration simplifies the learning process by offering personalized support and guidance. Whether you're navigating OneNote for the first time or exploring its advanced tools, Copilot Vision ensures you can unlock its full potential without requiring extensive training. Math Tutoring and Visual Learning Copilot Vision excels in supporting math-focused tasks, offering robust tutoring capabilities that break down complex problems into manageable steps. For example, it can guide you through solving equations like the Pythagorean theorem by providing clear, step-by-step instructions. Additionally, it supports: Drawing and annotating graphs or shapes to enhance visual understanding. Offering interactive tools for solving complex mathematical concepts. These features are invaluable for subjects that demand detailed explanations and visual aids. By combining interactive problem-solving tools with AI-driven guidance, Copilot Vision makes learning math more engaging and accessible, catering to a wide range of educational needs. Automatic Transcript Creation Another significant feature of Copilot Vision is its ability to automatically record and generate transcripts of all interactions. This functionality is particularly useful in educational and professional settings, where revisiting explanations or instructions can reinforce understanding. The transcript ensures that no detail is overlooked, providing a reliable reference for: Reviewing key points discussed during a session. Tracking progress and identifying areas for improvement. Sharing detailed records with team members or students for collaboration. By offering a comprehensive record of interactions, Copilot Vision supports continuous learning and ensures that users can revisit important details whenever needed. Applications in Education Copilot Vision is designed to enhance collaboration and learning experiences, making it an invaluable tool for educators and students alike. Its AI-powered tools and real-time feedback create an interactive environment that fosters engagement and productivity. Key educational applications include: Improving lesson delivery with AI-guided tools that simplify complex topics. Providing personalized support to students during assignments or projects. Facilitating content sharing and annotation for group activities. By integrating AI assistance with collaborative features, Copilot Vision transforms traditional learning methods into dynamic, interactive experiences. Its ability to adapt to various educational scenarios ensures that both teachers and students can benefit from its capabilities. Availability and Regional Support Copilot Vision is available globally, although access may vary depending on your region. Microsoft provides localized support to ensure users can understand and use the feature effectively in their area. This approach ensures that Copilot Vision is accessible to a diverse audience, making it a valuable tool for users worldwide. To check availability in your region, visit the Microsoft website or consult the app's settings for localized options. By offering tailored support, Microsoft ensures that users can maximize the benefits of Copilot Vision regardless of their location. Media Credit: Mike Tholfsen Filed Under: AI, Guides Latest Geeky Gadgets Deals Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.
Mint
5 days ago
- Mint
How to use Copilot Vision on Windows to get real time assistance across any app
Copilot Vision is a new AI feature from Microsoft for Windows that can see your screen and act as a real-time digital assistant. It can interpret what's happening on the screen and even guide you step by step across any app. Here are all the features, availability and how to use Copilot Vision on Windows. Real-time guidance: Copilot Vision can see what's on your screen and provide you with summaries, explain the error messages and draft email replies based on the context. Multi-app navigation: You can share two apps at once so Copilot can help you switch tasks and provide insights that span both windows. Highlight feature: If you ask Copilot to show you how to do any task in an app, it will visually highlight where to click inside any app, just like a personal tutor. Versatile assistance: No matter if you are gaming, editing photos or planning a trip, Copilot Vision can offer suggestions, improve your workflow and even help you pack for the trip. Launch the Copilot app from the taskbar or the Start menu. In the composer window, hit the 'glasses' icon in the corner. A pop-up will open asking permission to access the screen or an open app. Choose the apps you want Copilot to analyse. You can share up to two apps at once, so Copilot can connect info between them and give you contextual help. If you don't know how to use Photoshop, you can ask Copilot to help you with any specific feature, like changing the saturation in an image. Copilot will visually highlight the exact steps to find that feature in Photoshop. If you get an error message on the screen, you can share the screen with Copilot and ask it how to get rid of that error. Want to draft a reply to an email? Just ask Copilot to draft a reply by sharing the screen in the Edge browser. According to Microsoft's official blog post, Copilot Vision is available now in the US for Windows 10 and 11, and will soon be available to other countries. The feature may need a Copilot Pro subscription, which is $20 a month.
Phone Arena
5 days ago
- Phone Arena
Microsoft rolls out the Copilot feature that can watch your every move
A couple of months ago, we talked about Microsoft's new Copilot Vision feature for Windows and now, it is officially here. This new AI-powered tool gives Copilot the ability to actually see what is on your screen and interact with it in real time. Right now, Copilot Vision with Highlights is rolling out to users in the US, with Microsoft planning to bring it to more countries outside of Europe soon. But don't expect it to launch in the EU anytime soon – stricter regulations in the region, like the Digital Markets Act (which already delayed Apple Intelligence there) and the new EU AI Act, are likely keeping it off the table for now. This new feature builds on Microsoft's Copilot assistant by letting the AI actually see and interact with what is on your screen. Basically, you can share an app or your screen and Copilot can then help you with stuff like learning a new app, giving real-time tips while gaming or even analyzing a webpage or photo you are looking at. When you turn it on, Copilot Vision basically becomes your second set of eyes. It watches what you are doing and can chime in with answers, insights, or guidance – kind of like a smart buddy who's always there when you need help staying focused or figuring something out. Whether you are working, browsing or knee-deep in a project, it is built to keep things flowing smoothly. Video credit – Microsoft The best part? It is completely free (at least for now). You won't need a Copilot Pro subscription to try it out, though it is still part of Microsoft's experimental Copilot Labs projects. You will find it inside the Copilot app and you activate it using a little glasses icon – from there, you can choose which app or browser window to share, similar to how screen sharing works in a Microsoft Teams call. It's worth noting that this is an opt-in feature. You have to specifically allow Copilot to see your apps – it's nothing like Microsoft Recall, which automatically takes snapshots in the background once it is turned on. This update pushes Copilot closer to becoming a full-on digital sidekick. I mean, Microsoft clearly wants it to be your go-to assistant for everyday tasks. That said, it is fair to raise a few eyebrows about security. Even though Copilot Vision only activates when you allow it and doesn't interact with anything unless you give it the go-ahead, there are still concerns – especially for anyone working with sensitive data. Personally, I'd skip using it for anything private or confidential. Games and maybe some photo editing? Sure. But beyond that? Not really worth the risk, especially considering how attractive Microsoft is as a target for hackers. Copilot Vision is available on both Windows 10 and Windows 11, but let's not forget Microsoft's been pushing hard for people to switch to the newer OS. So, while it is technically supported on Windows 10 for now, that probably won't last much longer – just like the OS itself.
