LMQL is a SQL-like programming language for interacting with LMs. It takes a declarative approach to specifying the output constraints for a language model, with a SQL flavor.

Microsoft created a project called guidance which is an LLM-agnostic language to “interleave generation, prompting, and logical control into a single continuous flow matching how the language model actually processes the text”. It’s based on Handlebars templates and provides in-template notion for system and user messages.

kor is a prototype used to extract structured data from language model responses. It takes a more object oriented approach and is Python-specific.

rebuff is a multilayer prompt injection defense library that continuously improves and adapts based on previous attacks.