For a hands-on learning experience to develop LLM applications, join our LLM Bootcamp today.
First 6 seats get an early bird discount of 30%! So hurry up!

Building and Maintaining High-Performance AI

Agenda

It is a significant challenge to develop high-performance models, and then to ensure that model performance is maintained in production. Additionally, models often decay due to changes in real-world environments. Everyone wants a high-performing model. But what does that mean? What should you be measuring? How can you identify when your model may be degrading or encountering potential issues because of data or concept drift? What are the root causes of these issues and how can you iterate to improve your model? The lecture will cover conceptual foundations as well as a demonstration of concepts with actual models.

This talk will cover:

– What points in ML model development should you be testing?
– What types of performance testing should be done?
– What types of drift should you test for?
– How can you systematically test, debug, and monitor your models?

Anupam Datta
Anupam Datta

Co-Founder, President, and Chief Data Scientist, TruEra

Anupam Datta is Co-Founder, President, and Chief Scientist of TruEra. He is also a former Professor of Electrical & Computer Engineering and Computer Science at Carnegie Mellon University. His research focuses on enabling real-world complex systems to be accountable for their behavior, especially as they pertain to privacy, fairness, and security. His work has helped create foundations and tools for accountable data-driven systems. Specific results include an accountability tool chain for privacy compliance deployed in industry, automated discovery of gender bias in the targeting of job-related online ads, principled tools for explaining decisions of artificial intelligence systems, and monitoring audit logs to ensure privacy compliance.

We are looking for passionate people willing to cultivate and inspire the next generation of leaders in tech, business, and data science. If you are one of them get in touch with us!