论文标题
帮助我写一首诗:教学调音作为合作诗写作的工具
Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing
论文作者
论文摘要
培训大型语言模型(LLMS)的最新工作遵循自然语言指示,为自然语言界面设计打开了令人兴奋的机会。在LLM在计算机辅助创造力领域的先前成功的基础上,我们旨在研究LLM是否可以通过协作提高用户生成内容的质量。我们提出了Copoet,这是一种合作诗歌写作系统。与自动完成用户的文本相反,Copoet由指定所需文本的属性的用户指令控制,例如编写有关“ Love”的句子或以“ Fly”结尾的句子。我们系统的核心组成部分是一种语言模型,对诗歌写作的各种说明集合进行了微调。我们的模型不仅与接受说明的公开LLM竞争(指令),而且还可以满足看不见的作品说明。一项与15名合格人群工人的研究表明,用户成功地用Copoet写下诗歌,讲述了从君主制到气候变化的各种主题。此外,第三方评估者比没有系统的书面评估者更喜欢书面诗。
Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of LLMs in the realm of computer-assisted creativity, we aim to study if LLMs can improve the quality of user-generated content through collaboration. We present CoPoet, a collaborative poetry writing system. In contrast to auto-completing a user's text, CoPoet is controlled by user instructions that specify the attributes of the desired text, such as Write a sentence about `love' or Write a sentence ending in `fly'. The core component of our system is a language model fine-tuned on a diverse collection of instructions for poetry writing. Our model is not only competitive with publicly available LLMs trained on instructions (InstructGPT), but is also capable of satisfying unseen compositional instructions. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from Monarchy to Climate change. Further, the collaboratively written poems are preferred by third-party evaluators over those written without the system.