AI DOCTOR? Google Unveils System For Real-Time Medical Video Consultations

Google has introduced AMIE Video, an advanced medical artificial intelligence system designed to conduct clinical consultations through live video. Built on Google's Gemini models and Project Astra, the system can simultaneously process a patient's voice, video feed, and visual behavior during a conversation, identifying potential indicators such as distress, changes in breathing, or difficulty moving.

Unlike text-based medical AI tools, AMIE Video aims to replicate a remote doctor visit more closely, enabling natural conversation with patients while guiding them through virtual physical examinations. The system operates through multiple AI agents working concurrently - one managing dialogue, another building an overall medical picture, and another analyzing video and audio in real time.

In a controlled study of 100 clinical scenarios involving 300 consultations, physicians assessed AMIE Video and determined it achieved expert-level performance on several measures. Google stressed that AMIE Video remains a research system not intended for actual patient care at this stage. Testing has occurred only in simulated environments with actors playing patients, not in real clinical settings.

Deployment for medical use would require additional research and likely regulatory approval as a medical device. The technology currently show how artificial intelligence could eventually reshape telemedicine by analyzing not only patient statements but also what is observable and audible during a medical consultation.