It is an organisation for a project "Using AI for the co-synthesis of control systems and robotic hand designs to enable functional grasping of tools and manipulation objects." The project is being developed at ITMO University.
This project aims to simplify the integration of robotic hands into robotic cells by developing AI-based methods for co-optimizing control and design of robotic hands.
The project focuses on functional grasps, which refer to robotic gripping strategies that go beyond relatively simple pick-and-place tasks. To grasp an object at a special area and to get a specific orientation of an object such that it can be used as a tool. Unlike basic pick-and-place, functional grasps require tight integration of perception, mechanics, and control to ensure the object is not only stable but also functionally ready for its intended task.
Co-Design methodology is used to modify mechanics to get better performence of the control system. Optimized hands topology and finger shapes (e.g., soft pads, curved surfaces) paired with control policies to enhance dexterity, especially in underactuated or compliant hands.
- Synergistic optimization of finger geometry and control policies for functional grasping.
- Emphasis on underactuated systems (~6 DoF) instead of costly fully actuated hands (~16 DoF), reducing weight, size, and cost.
- AI algorithms to jointly optimize hardware and software for diverse industrial tasks.
Open-source methods enabling cost-effective, task-aware robotic grasping in manufacturing.
The currently active core developers are:
- Yefim Osipov-Sigachev (ITMO University) works on Isaac Grasp Env a reinforcement learning environment for functional grasping
- Kirill Zharkov (ITMO University) works on iCEM MPC Expert, a framework for robotic grasping using iterative Cross-Entropy Method (iCEM) with Model Predictive Control (MPC)
- Mikhail Chaikovskii (ITMO University) works on AffordanceLabeling needed to generate object datasets with affordances
- Olga Borisova (ITMO University): responsible on grasps samples using DexGraspNet
- Egor Rakshin (ITMO University): responsible on hands design and its models in models_hub
- Rahaf Alshaowa (ITMO University) works of functional grasping in Functional Classification of Point Clouds
- Ivan Borisov (ITMO University) is a scientific supervisor