PyData Vermont 2024

Imagine what you could do if you could tune Large Language Models (LLMs) with contributions from across your community. There are many popular open LLMs, just look at Hugging Face. Up until now, if a developer wanted to contribute a change to an open LLM, the only practical option was to publish a fork of the model which results in many forks but no version of the model having all or many of the community’s changes. In this session we learn about a new, novel technique using the InstructLab open source project to enable incremental, community contributions to instruction-tune a LLM.