
Structured queries separate prompts and data into two channels.
(1) a secure front-end that formats a prompt and user data into a special format, and
(2) a specially trained LLM that can produce highquality outputs from these inputs. (augment standard instruction tuning datasets with examples that also include instructions in the data portion of the query, and fine-tune the model to ignore these.)