Novel motion forecasting framework can deliver safer and smarter self-driving cars

With self-driving cars expected to hit British roads next year (2026), a new motion forecasting framework developed by the University of Surrey and Fudan University, China, promises to make autonomous cars both safer and smarter.

Researchers have combined their expertise to create RealMotion – a novel training system that seamlessly integrates historical and real-time scene data with contextual and time-based information, paving the way for more efficient and reliable autonomous vehicle technology.

Driverless cars are no longer a futuristic dream. Robotaxis are already operating in parts of the USA and China, and self-driving vehicles are expected to be on UK roads as early as next year. However, the real question on everyone's mind is: how safe are they?

While AI operates differently from human drivers, there are still challenges to overcome. That's why we developed RealMotion – to equip the algorithm with not only real-time data but also the ability to integrate historical context in space and time, enabling more accurate and reliable decision-making for safer autonomous navigation. Dr Xiatian Zhu, Senior Lecturer in People-Centred AI

Existing motion forecasting methods typically process each driving scene independently, overlooking the interconnected nature of past and present contexts in continuous driving scenarios. This limitation hinders the ability to accurately predict the behaviours of surrounding vehicles, pedestrians and other agents in ever-changing environments.

In contrast, RealMotion creates a clearer understanding of different driving scenes. Integrating past and present data enhances the prediction of future movements, addressing the inherent complexity of forecasting multiple agents' movements.

Extensive experiments conducted using the Argoverse dataset, a leading benchmark in autonomous driving research, highlight RealMotion's accuracy and performance. Compared to other AI models, the framework achieved an 8.60% improvement in Final Displacement Error (FDE) - the distance between the predicted final destination and the true final destination. It also demonstrated significant reductions in computational latency, making it highly suitable for real-time applications.

With self-driving cars reaching British roads imminently, ensuring people’s safety is paramount. The development of RealMotion by Dr Zhu and his team offers a significant advance on existing methods. By equipping autonomous vehicles to perceive their surroundings in real-time, and also leverage historical context to make informed decisions, RealMotion paves the way for safer and more intelligent navigation of our roads. Professor Adrian Hilton, Director Surrey Institute for People-Centred AI | Director of Centre for Vision, Speech and Signal Processing

While researchers encountered some limitations, the team plans to continue its research to further improve RealMotion's capabilities and overcome any challenges. The framework has the potential to play a critical role in shaping the next generation of autonomous vehicles, ensuring safer and more intelligent navigation systems for the future.

###

Notes to editors

To find more details, visit surrey.ac.uk/ai or follow @peoplecentredai