论文标题
生物学启发设计的生成预训练的变压器
Generative Pre-Trained Transformers for Biologically Inspired Design
论文作者
论文摘要
自然界中的生物系统已经发展了数百万年,以适应环境和生存。他们开发的许多功能对于解决现代行业的技术问题可能是鼓舞人心的和有益的。这导致了一种新型的逐拟设计形式,称为生物风格的设计(BID)。尽管已证明出价作为设计方法有益,但生物学与工程之间的差距不断阻碍设计师有效地应用该方法。因此,我们探讨了人工智能(AI)的最新进展,以弥合差距。本文提出了一种基于预训练的语言模型(PLM)的生成设计方法,以自动检索和映射生物学类比,并以自然语言的形式产生出价。最新的生成预训练的变压器,即GPT-3,用作基本PLM。根据问题空间表示的松弛,从PLM识别并微调了三种类型的设计概念生成器。机器评估器也经过微调,以评估生成的投标概念中域之间的相关性。然后通过案例研究对该方法进行测试,该案例研究将对微型模型应用于生成和评估受自然启发的轻加权飞行汽车概念。结果表明,我们的方法可以以良好的性能生成投标概念。
Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. This leads to a novel form of design-by-analogy called bio-inspired design (BID). Although BID as a design method has been proven beneficial, the gap between biology and engineering continuously hinders designers from effectively applying the method. Therefore, we explore the recent advance of artificial intelligence (AI) for a computational approach to bridge the gap. This paper proposes a generative design approach based on the pre-trained language model (PLM) to automatically retrieve and map biological analogy and generate BID in the form of natural language. The latest generative pre-trained transformer, namely GPT-3, is used as the base PLM. Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation. Machine evaluators are also fine-tuned to assess the correlation between the domains within the generated BID concepts. The approach is then tested via a case study in which the fine-tuned models are applied to generate and evaluate light-weighted flying car concepts inspired by nature. The results show our approach can generate BID concepts with good performance.