AlayaDB.AI: The Data Foundation for Large Model Era
Bo Tang
Abstract
In the large model era, vectors—serving as metadata for large models—are being applied across various aspects of these models, such as Retrieval-Augmented Generation (RAG), sparse attention, and KV caching. Our team has taken vectors as the entry point to develop an ultra-efficient LLM inference infrastructure. In this talk, I will introduce two research work: AlayaLite and AlayaJet, and briefly discuss the key challenges in building AlayaDB.AI, the data foundation for the large model era.
Biography
Dr. Bo Tang is a tenured associate professor at Southern University of Science and Technology. His research interests are big data/large model systems. He always published at top-tier conference and journals (e.g., SIGMOD, PVLDB, TODS). His research outputs have been widely used in leading IT companies (e.g., Microsoft, Tencent, and Huawei). He won Huawei Spark Award (3 times). He is awarded SIGMOD China Rising Star at 2021 and sponsored by NSFC excellent young researcher grant at 2024.