General Motors Tests ‘Eyes Off’ Driving with Candy Crush in Simulated Reality

General Motors is pushing the boundaries of autonomous driving technology with a revolutionary testing program that allows drivers to completely divert their attention from the road. At the automaker’s Global Technical Center in Warren, Michigan, engineers are exploring what happens when humans truly hand over control to their vehicles.

In a striking demonstration, senior researcher Akilesh Rajavenkatanarayanan played Candy Crush on a tablet mounted in a Cadillac Lyriq while the vehicle navigated through complex driving scenarios. However, this wasn’t happening on public roads. Instead, the entire experience unfolded inside an advanced simulated driving environment at GM’s sprawling technical facility.

Virtual Testing, Real-World Implications

The testing program utilizes actual hundreds of volunteer drivers who climb inside genuine GM vehicles, including the all-electric Cadillac Lyriq and other popular models. These participants experience a full range of driving conditions: regular roadway navigation, hill climbing, construction zones, rain, and interactions with nearby traffic. Nevertheless, the world surrounding them exists entirely within a sophisticated simulation system.

The vehicle itself is real, equipped with production-level sensors and autonomous driving systems. Furthermore, the drivers are real people, recruited from the general public to provide authentic reactions and feedback. Yet the environment they navigate is completely virtual, allowing GM engineers to test scenarios that would be too dangerous, expensive, or impractical to recreate on actual roads.

Maureen August, senior manager at GM Research Development, oversees these simulations from a control room packed with monitoring equipment. Consequently, every aspect of the vehicle’s performance and the driver’s behavior can be tracked, measured, and analyzed in real time.

The ‘Eyes Off’ Revolution

The most remarkable aspect of this testing program is the “Eyes free active” mode displayed on the Lyriq’s dashboard. This feature represents a significant leap beyond current hands-free driving systems available in today’s vehicles. While existing technologies like GM’s Super Cruise require drivers to keep their eyes on the road, this experimental system allows complete visual disengagement.

During the demonstration on Friday, September 18, 2026, the vehicle maintained safe operation while the researcher focused entirely on his tablet game. In other words, the car took full responsibility for navigation, obstacle avoidance, and decision-making without any visual input from the human occupant.

This capability marks a transition from Level 2 autonomous systems (which require constant driver supervision) toward Level 3 or higher automation (where the vehicle can handle driving tasks independently under certain conditions). As a result, the technology could transform how people use their time during commutes and long-distance travel.

Why Simulation Matters

Traditional road testing of autonomous vehicles requires millions of miles to validate safety across diverse conditions. Moreover, rare but critical scenarios-such as a child running into the street or a vehicle running a red light-occur too infrequently to rely on chance encounters during testing. Therefore, simulation provides a controlled environment where engineers can repeatedly test edge cases.

The control room at GM’s Warren facility features displays showing data streams and video feeds from the simulated drives. Engineers can instantly adjust parameters, introduce unexpected obstacles, or modify weather conditions. Subsequently, they can observe how both the vehicle and the human occupant respond.

This approach also addresses ethical concerns about testing unproven autonomous systems on public roads. By validating technology in simulation first, GM reduces the risk to other motorists, pedestrians, and cyclists. Additionally, the company can iterate designs more rapidly than would be possible with physical prototypes alone.

The Road Ahead for Autonomous Technology

General Motors has invested heavily in autonomous vehicle development through its Cruise division and internal research programs. The company aims to deliver vehicles that can handle increasingly complex driving tasks with minimal human intervention. In contrast to the fully autonomous robotaxi approach pursued by some competitors, GM appears to be developing a graduated system that allows drivers to delegate tasks based on conditions.

The Cadillac Lyriq, serving as the test platform for this technology, represents GM’s push into the premium electric vehicle market. Equipped with advanced sensor arrays and computing power, the Lyriq provides a glimpse of how luxury vehicles might function in the coming years. Furthermore, technologies validated in premium models often trickle down to mainstream vehicles over time.

Industry experts note that regulatory approval remains a significant hurdle for true “eyes off” driving systems. Current federal guidelines require driver attentiveness even with advanced assistance features. Nevertheless, testing programs like GM’s help build the safety case needed to convince regulators that higher levels of automation can operate safely.

Beyond the Steering Wheel

The image of a researcher playing Candy Crush while a vehicle drives itself might seem trivial, but it represents a profound shift in the human-machine relationship. For more than a century, driving has demanded continuous attention. However, as vehicles become more capable, the question shifts from “Can we do this?” to “What should humans do instead?”

GM’s testing program explores these questions by observing how real people behave when freed from driving responsibilities. Do they work, read, sleep, or play games? Understanding these behaviors helps engineers design safer systems that account for human nature. Ultimately, the goal is not just a car that can drive itself, but a transportation experience that safely integrates human and machine capabilities.

As the automotive industry races toward an autonomous future, facilities like GM’s Global Technical Center in suburban Detroit serve as laboratories where that future takes shape. Through simulation, real volunteers, and cutting-edge technology, engineers are writing the next chapter of personal mobility-one virtual mile at a time.