◆  Industrial speech, by Fuzheng Zhang

Topic: 「KwaiYii」 Foundation Models: Decoding Information and Embraceing Intelligence

Date and Time: Oct.14

Short Bio: Dr. Zhang Fuzheng, the head of Kuaishou's Natural Language Processing Center and Audio Center, is also in charge of the 「Kwai-Yii」Foundation Models Project. He has long been involved in the construction of AI technologies such as Natural Language Processing, multimodal processing, and knowledge graphs, as well as their specific applications in business scenarios. He has published over 60 papers in top-tier conferences and journals in related fields like KDD, WWW, ACL, EMNLP, and has more than 10,000 Google Scholar citations. He has served as reviewers for relevant academic activities for an extended period. Dr. Zhang has been named on Stanford University's "The World's Top 2% Scientists List", the "AI 2000 Most Influential Scholars in Artificial Intelligence for the Year 2023," and the "2019 Benchmark Figures in Knowledge Graphs for Artificial Intelligence in China".

Abstract: With the release of ChatGPT and GPT-4, large-scale foundation models are demonstrating accelerated iterative cycles and substantial improvements in capabilities even at high performance levels. These models are exhibiting performance that surpasses average human levels and, in some domains, even reaches the pinnacle of human capability, signaling the potential for immense social and commercial impact. 「KwaiYii」is a series of large-scale foundation models, including Large Language Models (LLMs), domain-specific large models, and multi-modal large models, developed from scratch by the Kuaishou AI team. 「KwaiYii」excels in foundational technology and have achieved state-of-the-art results in the majority of authoritative Chinese and English benchmarks such as MMLU, C-Eval, CMMLU, and HumanEval, all while being comparable in size to other available models. Featuring excellent language comprehension and generation capabilities, 「KwaiYii」supports a wide array of tasks, including content creation, information consultation, mathematical logic, code writing, and multi-turn dialogue. Human evaluations indicate that 「KwaiYii」has reached industry-leading standards, particularly in Chinese language contexts.

◆  Industrial speech, by Tianhuang Su

Topic: New Breeno: AI Assistant Powered by Large Language Models

Date and Time: Oct.14

Short Bio: Su Tianhuang is the Head of Natural Language Processing and Pretraining Team in OPPO Breeno Intelligent Center. Breeno is the AI assistant on OPPO smartphones and IoT devices. Tianhuang graduated from Sun Yat-sen University, and joined OPPO in 2020 after working as an algorithm engineer in Baidu. His main research interests include natural language proccessing, dialog conversation and search engine, and has published papers in top conferences and journals such as KDD, etc. Currently, he is committed to leading Breeno's NLP and Pretraining team to realize a smarter dialog system with Large Language Models.

Abstract: In this talk, a general introduction to Breeno, the AI assistant on OPPO smartphones and IoT devices, will be given first. Then Tianhuang will share the two stages of how Breeno adopts large language models in its dialog system. The first stage refers to OBERT series based on bert architecture for natural language understanding, and the secord stage AndesGPT series are based on decoder-only architecture. In addition, he will share serveral useful skills (e.g. universal represetation) for project engineering on dialog system.