The new AI app stack

Practical AI: Machine Learning, Data Science, LLM - A podcast by Changelog Media

Categories:

Technology

Recently a16z released a diagram showing the "Emerging Architectures for LLM Applications." In this episode, we expand on things covered in that diagram to a more general mental model for the new AI app stack. We cover a variety of things from model "middleware" for caching and control to app orchestration.