New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's New Patent Aims to Reduce Gaming Latency with AI and Sensors

A recently filed Sony patent reveals a potential solution to reduce input latency in future gaming hardware. The patent, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," utilizes an AI model combined with additional sensors to predict user inputs and streamline command execution.

Sony's current PlayStation 5 Pro, featuring PlayStation Spectral Super Resolution (PSSR), already addresses upscaling. However, newer technologies like frame generation often introduce latency, impacting responsiveness. Competitors AMD and Nvidia have addressed this with Radeon Anti-Lag and Nvidia Reflex, respectively, and Sony's patent suggests a similar approach.

As noted by Tech4gamers, the patent addresses the delay between user input and system processing. Sony's solution involves a machine-learning AI model that anticipates the next user input. This prediction is aided by an external sensor, such as a camera monitoring the controller, to detect impending button presses. The patent specifically mentions using camera input as input to the machine learning model.

Alternatively, the sensor could be integrated into the controller itself, possibly utilizing analog buttons – a technology Sony has historically championed.

While the patent's specifics may not directly translate to the PlayStation 6, it demonstrates Sony's commitment to reducing latency without sacrificing responsiveness. This is particularly relevant given the increasing popularity of frame generation technologies like FSR 3 and DLSS 3, which often add latency.

The benefits of this technology would be most apparent in fast-paced games like twitch shooters, where high frame rates and low latency are crucial. However, the ultimate implementation of this patent in future hardware remains uncertain.