Skip to content

[curriculum-eval] side-quest-01-02-environment-reference.md: checkpoint_quality — 0.0 checkpoint score, low active learning on 1225-word reference [Content truncated due to length] #2530

Description

@github-actions

File: workshop/side-quest-01-02-environment-reference.md
Overall Score: 5.3 / 10.0 (corpus mean: 6.1)

Flagged Dimensions:

Dimension Score Benchmark Delta
checkpoint_quality 0.0 10.0 −10.0
active_learning 2.4 10.0 −7.6
cognitive_load 7.9 10.0 −2.1
scaffolding 5.0 10.0 −5.0

Root Cause (≤ 2 sentences):
This 1,225-word glossary page achieves only 0.73 activity density (2 code blocks and 7 checklist items across 1,225 words) because its primary content is a reference table of 9 tool definitions, which requires reading but almost no doing. Without a checkpoint and with activity density well below the 3.0 ideal, learners receive no formative signal that they have absorbed the material.

Evidence (quoted from the file):

"Knowing which name maps to which role helps you follow workshop instructions without stopping to wonder what 'the terminal' or 'Codespaces' means in context."

The page ends with a "Verify your tools are ready" shell-command block but has no structured checkpoint checklist to confirm the learner's environment is actually ready.

Learning Science Rationale:
Mayer's Active Processing Principle holds that learners engage in deeper encoding when they do something with new information rather than passively reading it. A reference page that lists 9 tool definitions without a retrieval task (checkpoint checklist, matching exercise, or a short "run these commands and verify the output" activity) produces shallow encoding — learners recognise terms on the page but cannot recall them when they appear in context two steps later.

Improvement Prompt (for an agent):

In workshop/side-quest-01-02-environment-reference.md, add a "## :white_check_mark: Checkpoint" section at the end of the file with at least 4 specific checklist items. Items should require the learner to demonstrate active knowledge: for example, (1) confirm gh --version returns a version number, (2) confirm gh aw --version works, (3) confirm gh copilot --version is accessible, and (4) state in one sentence the difference between the gh-aw CLI extension and the GitHub Copilot CLI. Each item should be phrased as a past-tense action (e.g., "- [ ] I ran gh --version and saw a version number"). Do not simply list definitions already present in the glossary table.

Expected Score After Fix: 6.8 / 10.0

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔬 Curriculum Quality Evaluator · 78.6 AIC · ⌖ 6.91 AIC · ⊞ 6.2K ·

  • expires on Aug 8, 2026, 1:11 PM UTC

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions