Lots of updates to the chatbots demo repository during and after class tonight. We’ve now got:

  • High performance model hosting with llama.cpp
  • A web app UI for our chatbots using Gradio
  • Better documentation