Skip to main content

Prompt Leakage

Held-out prompts must not be copied into lesson files. QuarkLM can learn held-out facts through fact-style lessons, but it should not train on the exact held-out evaluation prompt forms.

The self-improvement report audits protected prompt leakage for:

  • held-out facts
  • held-out ownership prompts

The expected result is zero leaked protected prompts.