A new personal AI assistant is being tested with human support for some of its phone based tasks, allowing trained contractors to make calls on behalf of users.
The assistant is designed to handle everyday activities such as contacting businesses, making appointments, checking product availability and requesting service quotes. The human support system was introduced internally as an additional option while the company continues to improve the AI calling feature.
The trial has raised privacy concerns among some employees, particularly over the possibility of sensitive information being exposed to outside call centre workers. Questions were also raised about whether users would be clearly informed when a person was handling a call instead of the AI system.
The company has temporarily rolled back the feature while it reviews the concerns and works on additional safety and privacy measures. It has said the calling service will only be expanded when appropriate safeguards and disclosures are in place.
The test highlights one of the challenges facing personal AI systems as they move beyond providing answers and begin carrying out tasks involving real world businesses and other people.