DeeperSense will develop an acoustic-to-visual system that can transfer low resolution acoustic sonar data into representations and visualizations of the environment that surrounds an underwater robot.
The main objective of DeeperSense is to significantly improve the environment perception capabilities of service robots and therefore improving their performance and reliability, achieving new functionality, and opening up new applications for robotics. DeeperSense adopts a novel approach of using Artificial Intelligence and data-driven Machine Learning / Deep Learning to combine the capabilities of non-visual and visual sensors with the objective to improve their joint capability of environment perception beyond the capabilities of the individual sensors. DeeperSense will focus on underwater robotics as a domain to demonstrate and verify this approach as it is considered one of the most challenging application areas for robot operation and environment perception. The project implements Deep Learning solutions for three use cases that were selected for their societal and environmental relevance and are driven by concrete end-user and market needs. During the project, comprehensive training data will be generated, where the developed algorithms will be trained upon and verified both in the lab and in extensive field trials. The trained algorithms will be optimized to run on the on-board hardware of underwater vehicles, thus enabling real-time execution in support of the autonomous robot behaviour. Both, the algorithms and the data will be made publicly available through online repositories embedded in European research infrastructures. The DeeperSense consortium consists of renowned experts in robotics and marine robotics, artificial intelligence, and underwater sensing. The research and technology partners are complemented by end-users from the three use case application areas. Among others, the dissemination strategy of DeeperSense has the objective to bridge the gap between the European robotics and AI communities and thus strengthen European science and technology.
- DeeperSense
- Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
- 2021 - 2023
- Government
- Multi-modal learning, GANs, image-to-image translation, marine perception