论文标题
通过增强学习可编程对超声群的控制
Programmable Control of Ultrasound Swarmbots through Reinforcement Learning
论文作者
论文摘要
在声学上,现有的治疗和诊断程序将变得较小,而新方法将变得更少,而新方法将可用。基于微泡的声学驱动的微型机器人导航是靶向药物输送的一种有前途的方法。先前的研究已使用声学技术在体外和体内操纵微泡,以使用微创手术输送药物。尽管对于声学动力的微型机器人已经实现了许多高级功能和复杂的控制,但仍有许多挑战仍有待解决。为了开发下一代的智能微型/纳米机器人,非常需要对微纳米机器人进行准确的识别并自主控制其动态运动。在这里,我们使用强化学习控制策略来学习微型机器人动态并通过声学力量来操纵它们。结果证明了微流体在微流体环境中的首次自动声音导航。利用第二辐射力的益处,微泡成群形成大型群,然后沿所需的轨迹驱动。将超过1万图像用于训练来研究微泡的意外动态。由于这项工作,微型机器人得到了验证以受到控制,说明了良好的鲁棒性并为微型机器人提供计算智能,这使他们能够在非结构化的环境中独立导航而无需外部帮助。
Powered by acoustics, existing therapeutic and diagnostic procedures will become less invasive and new methods will become available that have never been available before. Acoustically driven microrobot navigation based on microbubbles is a promising approach for targeted drug delivery. Previous studies have used acoustic techniques to manipulate microbubbles in vitro and in vivo for the delivery of drugs using minimally invasive procedures. Even though many advanced capabilities and sophisticated control have been achieved for acoustically powered microrobots, there remain many challenges that remain to be solved. In order to develop the next generation of intelligent micro/nanorobots, it is highly desirable to conduct accurate identification of the micro-nanorobots and to control their dynamic motion autonomously. Here we use reinforcement learning control strategies to learn the microrobot dynamics and manipulate them through acoustic forces. The result demonstrated for the first time autonomous acoustic navigation of microbubbles in a microfluidic environment. Taking advantage of the benefit of the second radiation force, microbubbles swarm to form a large swarm, which is then driven along the desired trajectory. More than 100 thousand images were used for the training to study the unexpected dynamics of microbubbles. As a result of this work, the microrobots are validated to be controlled, illustrating a good level of robustness and providing computational intelligence to the microrobots, which enables them to navigate independently in an unstructured environment without requiring outside assistance.