This website uses cookies primarily for visitor analytics. Certain pages will ask you to fill in contact details to receive additional information. On these pages you have the option of having the site log your details for future visits. Indicating you want the site to remember your details will place a cookie on your device. To view our full cookie policy, please click here. You can also view it at any time by going to our Contact Us page.

Artificial intelligence teaches microrobots to swim

08 August 2022

The development of AI-powered robotic swimmers marks a substantial leap in the progression of microswimming capability.

(Image: Shutterstock)
(Image: Shutterstock)

Researchers from Santa Clara University, New Jersey Institute of Technology and the University of Hong Kong have been able to teach microrobots how to swim via deep reinforcement learning.

There has been tremendous interest in developing artificial microswimmers that can navigate the world similarly to naturally occurring swimming microorganisms, like bacteria. Such microswimmers provide promise for a vast array of future biomedical applications, such as targeted drug delivery and microsurgery. Yet, most artificial microswimmers to date can only perform relatively simple manoeuvres with fixed locomotory gaits.

In the researchers' study, published in Communications Physics, they reasoned microswimmers could learn – and adapt to changing conditions – through AI. Much like humans learning to swim require reinforcement learning and feedback to stay afloat and propel in various directions under changing conditions, so too must microswimmers, though with their unique set of challenges imposed by physics in the microscopic world.

"Being able to swim at the micro-scale by itself is a challenging task," said On Shun Pak, Associate Professor of mechanical engineering at Santa Clara University. 

"When you want a microswimmer to perform more sophisticated manoeuvres, the design of their locomotory gaits can quickly become intractable."

By combining artificial neural networks with reinforcement learning, the team successfully taught a simple microswimmer to swim and navigate in any arbitrary direction. When the swimmer moves in certain ways, it receives feedback on how good the particular action is. The swimmer then progressively learns how to swim based on its experiences interacting with the surrounding environment.

"Similar to a human learning how to swim, the microswimmer learns how to move its 'body parts' – in this case, three microparticles and extensible links – to self-propel and turn," said Alan Tsang, Assistant Professor of mechanical engineering at the University of Hong Kong. 

"It does so without relying on human knowledge but only on a machine learning algorithm."

The AI-powered swimmer is able to switch between different locomotory gaits adaptively to navigate toward any target location on its own.

As a demonstration of the powerful ability of the swimmer, the researchers showed that it could follow a complex path without being explicitly programmed. They also demonstrated the robust performance of the swimmer in navigating under the perturbations arising from external fluid flows.

"This is our first step in tackling the challenge of developing microswimmers that can adapt like biological cells in navigating complex environments autonomously," said Yuan-nan Young, professor of mathematical sciences at New Jersey Institute of Technology.

Such adaptive behaviours are crucial for future biomedical applications of artificial microswimmers in complex media with uncontrolled and unpredictable environmental factors.

"This work is a key example of how the rapid development of artificial intelligence may be exploited to tackle unresolved challenges in locomotion problems in fluid dynamics," said Arnold Mathijssen, an expert on microrobots and biophysics at the University of Pennsylvania, who was not involved in the research. 

"The integration between machine learning and microswimmers in this work will spark further connections between these two highly active research areas."


Print this page | E-mail this page

Minitec