A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development

Abstract

ChatGPT, an artificial intelligence generated content (AIGC) model developed by OpenAI, has attracted world-wide attention for its capability of dealing with challenging language understanding and generation tasks in the form of conversations. This paper briefly provides an overview on the history, status quo and potential future development of ChatGPT, helping to provide an entry point to think about ChatGPT. Specifically, from the limited open-accessed resources, we conclude the core techniques of ChatGPT, mainly including large-scale language models, in-context learning, reinforcement learning from human feedback and the key technical steps for developing Chat-GPT. We further analyze the pros and cons of ChatGPT and we rethink the duality of ChatGPT in various fields. Although it has been widely acknowledged that ChatGPT brings plenty of opportunities for various fields, mankind should still treat and use ChatGPT properly to avoid the potential threat, e.g., academic integrity and safety challenge. Finally, we discuss several open problems as the potential development of ChatGPT.

Keywords

Affiliated Institutions

• Fudan University CN
• Swinburne University of Technology AU
• East China University of Science and Technology CN
• University of Chinese Academy of Sciences CN
• Beijing Academy of Artificial Intelligence CN
• Chinese Academy of Sciences CN
• Shandong Institute of Automation CN

Related Publications