Self-hosted LLMs: Why and How

October 12, 2023 3:00 PM
(ET)

There has recently been increased interest in developing against self-hosted LLMs, as opposed to relying on managed services. In this webinar, we discuss where this interest typically comes from and how Shakudo helps you achieve your LLM self-hosting goals.

Attendees will learn:

  • The high-level difference between self-hosted and managed LLM services
  • Common reasons to move from managed to self-hosted
  • Common pitfalls/challenges in working with self-hosted models
  • A few example workflows involving product development based on self-hosted LLMs
  • How Shakudo covers a lot of the challenges, letting users focus on developing impactful products while reaping the benefits of a self-hosted LLMs

Attendees will learn:

  • The high-level difference between self-hosted and managed LLM services
  • Common reasons to move from managed to self-hosted
  • Common pitfalls/challenges in working with self-hosted models
  • A few example workflows involving product development based on self-hosted LLMs
  • How Shakudo covers a lot of the challenges, letting users focus on developing impactful products while reaping the benefits of a self-hosted LLMs

Speakers

Jeremie Zumer
Jeremie is a Machine Learning Engineer at Shakudo, with experience developing deep learning techniques to solve bioinformatics problems. Previous work includes dialogue systems for automated agents at Microsoft and peptide identification by deep learning at IRIC.