The structure of the project

How is the work setup and organized?

Project management and monitoring

The goal of this workpackage is to:

  • set goals for each WP with the aim of ensuring that the agreed project objectives and deliverables are achieved
  • provide a central point of communication for the project with the European Commission
  • facilitate communication and co-operation between project participants
  • maintain accurate records of cost and effort
  • ensure quality in project work
  • anticipate and manage changes related to the project Technical & Innovation Management
  •  prepare and deliver periodic management reports and technical progress reports as required
  • perform quality controls of the deliverables
  • seek out and exploit potential market opportunities for the technical advancements
  • prepare the Steering Committee meetings and the review meetings
  • manage contract and consortium agreement related issues

Requirements and specifications

The goal of this workpackage is to:

  • Define the requirements (functional, performance-related, hardware-related, etc.) of the OpenDR toolkit
  • Define the specifications (intefaces, functionality, interoperability, etc.) of the OpenDR toolkit
  • Define the requirements of deep active percepion algorithms (data collection, inteface, etc.)
  • Define the requirements and specifications of the use cases (agri-food, healthcare, robotics, agile production)
  • Define the requirements and specifications of the simulations that will be developed for training deep learning algorithms for the use cases
  • Define the data management plan (DMP)

Deep human centric active perception and cognition

The goal of this workpackage is to provide novel, lightweight, deep learning-based approaches for a broad range of topics related to humancentric active perception and cognition:

  • person/face/body part active detection/recognition and pose estimation
  • person/face/body part tracking and human activity recognition
  • social signal analysis and recognition
  • active speech and biosignal analysis
  • active multi-modal humancentric perception and cognition
  • human intention prediction

Deep environment active perception and cognition

The goal of this workpackage is to provide lightweight deep learning methods for deep environment active perception and cognition namely:

  • object detection/recognition, semantic scene segmentation and understanding, pose estimation
  • 2D/3D object localization and tracking
  • SLAM and 3D scene reconstruction
  • robust/redundant multi-modal sensor fusion

Deep robot action and decision making

The goal of this workpackage is to provide lightweight deep learning methods for deep robot action and decision making, namely:

  • deep reinforcement learning and related control methods
  • deep planning and navigation methods that can be trained in end-to-end fashion
  • enable robots to decide on actions based on observations in WP3, as well as to learn from observations
  • enable efficient and effective human robot interaction

Simulation environments and data

The goal of this workpackage is to:

  • provide a simulation framework for generating sensor and actuator data aimed at training OpenDR tools
  • integrate the OpenDR framework in the Webots robot simulator to provide a quick prototyping tool to robotics developers willing to use OpenDR

Integration

The goal of this workpackage is to:

  • integrate OpenDR toolkit in simulation environment and to ensure its portability across various systems
  • integrate OpenDR toolkit

Evaluation

The goal of this workpackage is to:

  • evaluate the developed toolkit under different application scenarios using datasets, simulation environments and real world applications
  • evaluate the developed toolkit in the specific use cases in real world conditions

Dissemination and Exploitation

The goal of this workpackage is to:

  • monitor the project achievements and compare to the state of the art
  • monitor the transmitter market and respective business models in order to align OpenDR
  • disseminate research results
  • collaborate with established initiatives, active on the same theme
  • establish links with robotics DIHs
  • Co-ordinate the intellectual property rights generated within the project

Ethics requirements

The goal of this workpackage is to ensure compliance with the ‘ethics requirements’.