Enterprise LLM Applications – Not Just a Technological Challenge

Enterprises are scampering to build large language model applications. While building POCs they have a humbling realization: Deploying LLM applications to production is incredibly hard. We will discuss UX design, human behavior, and ethical, social, legal, and cultural challenges in the operationalization of LLM applications. For most enterprises, these non-technological challenges are a bigger barrier to adoption than the technology itself.

This introductory tutorial will introduce the audience to prevalent approaches to building a custom large language model application. We will present a canonical architecture for an LLM application and various available commercial and open-source tools and technologies available to build these applications.