AI in Focus - Livestream Series

Session 8: Setting up a local LLM and replacing Open AI

Register today

Join the session

Which LLM is right for the job, continued

In this session, we review thoughtbot's AI Ethics guide in the context of exploring LLMs suggesting tags on blog posts. We'll discuss how this type of problem used to be best solved as a classification problem, and how we can also use embeddings to solve this type of problem without hitting an LLM every time.

We'll then work on the implementation against OpenAI using our existing generic prompt class to send the available tags, the article markdown, and a prompt to get tag suggestions, formatted as a JSON array.

Meet Chad

  • Chad Pytel, CEO and Developer

    Chad Pytel, CEO and Developer

    In addition to working with clients, Chad is responsible for the overall strategy for thoughtbot.

    Chad, along with thoughtbot, has produced top-quality applications with hundreds of clients, from one-person startups to Fortune 500 enterprises, universities, and non-profits, for more than 20 years, and are the creators of many popular open-source projects.