Shi Named AI2050 Early Career Fellow
ECE Assistant Professor Weiyan Shi was selected as an AI2050 Early Career Fellow by Schmidt Sciences, a prestigious honor recognizing exceptional researchers shaping the future of Artificial Intelligence. Shi will receive a $500,000 grant to support her foundational research in AI. Her work focuses on advancing the safety and effectiveness of Large Language Models (LLMs), including mitigating mode collapse and rethinking persuasion to challenge AI safety. She is among a select group of 27 researchers chosen globally for this highly competitive program.
Schmidt Sciences is a nonprofit organization founded in 2024 by Eric and Wendy Schmidt that works to accelerate scientific knowledge and breakthroughs with the most promising, advanced tools to support a thriving planet. The organization prioritizes research in areas poised for impact including AI and advanced computing, astrophysics, biosciences, climate, and space—as well as supporting researchers in a variety of disciplines through its science systems program.
AI2050 Project:
If unchecked, AI’s increasing persuasive ability could lead to harmful outcomes, especially with emerging AI agents that can plan and use tools. To safeguard against this significant risk, Shi’s project addresses three critical areas: (1) investigate how AI agents might be used to persuade in potentially harmful ways, to inform better defense mechanisms; (2) develop methods to continuously monitor their evolving persuasive capabilities as an early-warning system; (3) create tools to empower users to identify and protect themselves from unwanted AI influence. Ultimately, this research aims to ensure AI develops as a trustworthy and beneficial technology for everyone.