Optimizing infrastructure for LLMs - Episode 235

In this episode, we explore the infrastructure that is needed for LLMs, the key components to building it, and common challenges. We also talk about why LLMs hallucinate and how to reduce the frequency of that from occurring. Joining us in the discussion this week is Trey Doig, CTO and co-founder of Pathlight, which is a generative AI company.