Prompt Version Control

How to iterate to perfection with version controlled prompts

Summary

In this video, I discuss the concept of prompt versions and why they are important for improving the quality of our applications. I explain how prompt versions are automatically saved in the Boogie Prompt Editor and how they can help us iterate and experiment with different model types and wording. I also demonstrate how to create and compare different prompt versions using A-B testing. By the end of the video, viewers will understand how to use prompt versions to optimize their prompts for better application performance.

00:00 Introduction

00:27 Auto-saving in the Boogie Prompt Editor

01:17 Renaming and marking versions

02:01 Manually saving and creating new versions

02:48 A-B testing and comparing prompt versions

03:52 Logging inference data and loading historic examples

04:49 Running examples and evaluating outputs

05:30 Next steps: Deploying prompt versions