Skip to content

Red Team Scan Test Library#7567

Open
stkillen wants to merge 5 commits intomainfrom
features/613791
Open

Red Team Scan Test Library#7567
stkillen wants to merge 5 commits intomainfrom
features/613791

Conversation

@stkillen
Copy link
Copy Markdown
Contributor

@stkillen stkillen commented Apr 7, 2026

Summary

Adds a new Red Team Scan Test Library that enables AI test apps to run automated adversarial red team scans against copilot/agent features using the Azure AI Red Teaming Agent.

Test apps add a dependency on this library, configure a scan (risk categories, attack strategies, custom seed prompts), then iterate through adversarial queries in a repeat..until loop feeding each to their AI feature. After all attacks are processed, the scan returns a scorecard with Attack Success Rate (ASR) and per-attack details and creates a run in Foundry.

See README for example usage and more info.

Work Item(s)

Fixes AB#613791

@stkillen stkillen requested review from a team as code owners April 7, 2026 11:03
@github-actions github-actions bot added this to the Version 29.0 milestone Apr 7, 2026
Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AL Documentation Audit

Documentation gaps were detected in the following apps:

  • Red-Team-Scan-Test-Library: 74% documentation coverage

To generate documentation, run /al-docs init or /al-docs update using GitHub Copilot CLI or Claude Code.
This review is for awareness to help keep documentation in sync with code changes. It is okay to dismiss this request.

nikolakukrika
nikolakukrika previously approved these changes Apr 7, 2026
@github-actions github-actions bot added the Build: scripts & configs Build scripts and configuration files label Apr 8, 2026
aholstrup1
aholstrup1 previously approved these changes Apr 8, 2026
@github-actions
Copy link
Copy Markdown

⚠️ Stale Status Check Deleted

The Pull Request Build workflow run for this PR was older than 72 hours and has been deleted.

📋 Why was it deleted?

Status checks that are too old may no longer reflect the current state of the target branch. To ensure this PR is validated against the latest code and passes up-to-date checks, a fresh build is required.


🔄 How to trigger a new status check:

  1. 📤 Push a new commit to the PR branch, or
  2. 🔁 Close and reopen the PR

This will automatically trigger a new Pull Request Build workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AL: Tools Build: scripts & configs Build scripts and configuration files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants