Has prompt injection

Definition

The prompt injection test (built with Llama) checks for prompt injection, malicious strings and jailbreak attempts in the input data of your system.

Taxonomy

Task types: LLM.
Availability: and .

Why it matters

Prompt injection is a type of attack that exploits an AI system and deviates it from its intended behavior.
It is important to detect and prevent prompt injection attacks to ensure the reliability and security of your system.

Test configuration examples

If you are writing a tests.json, here are a few valid configurations for the character length test:

[
  {
    "name": "No prompt injection",
    "description": "Asserts that the input data has no prompt injection attempts",
    "type": "integrity",
    "subtype": "hasPromptInjectionCount",
    "thresholds": [
      {
        "insightName": "hasPromptInjectionCount",
        "measurement": "hasPromptInjectionPercentage",
        "operator": "<=",
        "value": 0.0
      }
    ],
    "subpopulationFilters": null,
    "mode": "development",
    "usesValidationDataset": true,
    "usesTrainingDataset": false,
    "usesMlModel": false,
    "syncId": "b4dee7dc-4f15-48ca-a282-63e2c04e0689"
  }
]

[
  {
    "name": "No prompt injection",
    "description": "Asserts that the input data has no prompt injection attempts",
    "type": "integrity",
    "subtype": "hasPromptInjectionCount",
    "thresholds": [
      {
        "insightName": "hasPromptInjectionCount",
        "measurement": "hasPromptInjectionPercentage",
        "operator": "<=",
        "value": 0.0
      }
    ],
    "subpopulationFilters": null,
    "mode": "monitoring",
    "usesProductionData": true,
    "evaluationWindow": 3600,
    "delayWindow": 0,
    "syncId": "b4dee7dc-4f15-48ca-a282-63e2c04e0689"
  }
]

Harmfulness

Ill-formed rows

⌘I

​Definition

​Taxonomy

​Why it matters

​Test configuration examples

Definition

Taxonomy

Why it matters

Test configuration examples