Be My Eyes AI offers GPT-4-powered support for blind Microsoft customers

The tech giant is utilizing Be My Eyes’ visual right-hand instrument to assist with blinding clients and rapidly resolve issues without a human specialist.

Microsoft is chipping away at offering a superior client support experience fueled by OpenAI’s ChatGPT-4 for its outwardly weakened clients through an organization called Be My Eyes, an organization that assists outwardly hindered people with handling regular errands with the assistance of located volunteers.

Microsoft is incorporating a computerized visual right-hand instrument, Be My Eyes Made—Be My Man-made Intelligence—into its Microsoft Inability Answer Work area, permitting outwardly disabled Microsoft clients to determine specialized issues or perform errands like refreshing programming without requiring the help of a call center specialist. In the wake of testing the apparatus recently on Microsoft clients, Be My Eyes said the device settled requests shortly overall, which is not exactly a portion of the typical call time with human specialists. Moreover, simply 10% decided to converse with a human client care delegate subsequent to communicating with the man-made intelligence instrument.

Be My Simulated Intelligence utilizes OpenAI’s GPT-4 vision model to create depictions of a photograph the individual has taken, similar to directions for setting up another PC or an item mark. Through artificial intelligence-based regular language discussions, the apparatus likewise gives logical, counsel-based direction to help clients through different issues.

Be My Eyes was likewise momentarily referenced. “OpenAI is pleased to work with Be My Eyes,” said Brad Lightcap, the COO of OpenAI. “They’ve utilized our computer-based intelligence models to improve the regular routines of individuals with low vision or visual deficiency, essentially.”

Microsoft’s Be My Eyes is the organization’s most recent push toward making its items more open. Recently, at its yearly Microsoft Capacity Highest point, the organization presented “Availability Collaborator” for Microsoft 365, which tells you continuously while you’re reviewing distant substances.

Be My Eyes Ties OpenAI's GPT-4 Into Its Accessibility Service — and Aims to Improve Blind Users' CX

The Be My AI vision-model-powered image description system is now being extended beyond the app and into specific customer relations sites.

Assistive service Be My Eyes, which links blind and low-vision users with seeing volunteers and staff, has announced a partnership with Microsoft to bring artificial intelligence (AI) image query support to its customer service platform — claiming "stunning results" from what it's calling Be My AI.

"Our new AI-powered accessible customer service model is producing remarkable results for not only one of the world's largest and most innovative companies but also for a community of blind and low vision consumers," claims Mike Buckley, Be My Eyes' chief executive officer.

"Be My AI is the customer service gold standard for companies that want to assist blind and low vision consumers, and we are incredibly thankful to Microsoft for their leadership, willingness to partner on Accessible CX [Custom Experience] solutions and their help communicating the benefits of Be My AI to other enterprises so we can advance our mission to make the world more accessible."

Launched in 2015, Be My Eyes connects volunteers and staff with blind and low-vision users via a smartphone app. Video is streamed from the phone, and the volunteer or staff member describes what they can see and answers any questions that crop up. For its users, the service is invaluable — but it also struggles to scale, requiring one volunteer or staff member per active user at any given time.

That's where Be My AI comes in. Developed based on OpenAI's GPT-4 vision model, the artificial intelligence system analyses visuals and provides text-based responses — not replacing the volunteers and staff but complementing them, while also making the service more available to deaf-blind users by supporting Braille display systems. Should the AI fail to answer a query, the user can then be routed through to a human as with the original implementation.

"The large and growing number of blind and low vision people globally, roughly equivalent to the population of the United States, means every company, non-profit, academic institution, and public sector organization has both a moral and business imperative to better serve our community," says Mark Riccobono, President of the National Federation of the Blind.