Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Feb 11, 2026

Agents weren't discovering project-related safe outputs (update-project, create-project-status-update) because the workflow frontmatter was stripped during runtime-import.

Changes

  • Frontmatter preservation: Modified runtime_import.cjs to preserve frontmatter instead of stripping it
  • Visibility wrapper: Frontmatter is wrapped in <workflow-configuration> tags with YAML code blocks for agent visibility
  • Test updates: Updated 3 tests to expect frontmatter preservation instead of removal
  • Simpler approach: Removed complex Go-based categorization logic in favor of letting agents see the actual YAML configuration

Before/After

Before:

---
safe-outputs:
  update-project:
    project: "https://github.com/orgs/my-org/projects/1"
---
# Instructions
(frontmatter stripped, agent doesn't see configuration)

After:

<workflow-configuration>
```yaml
safe-outputs:
  update-project:
    project: "https://github.com/orgs/my-org/projects/1"

Instructions

(agent can see the configuration directly)


This simpler approach puts control in workflow authors' hands - they can see their own configuration and write instructions accordingly, rather than relying on automated categorization that may not match their intent.

<!-- START COPILOT CODING AGENT TIPS -->
---

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more [Copilot coding agent tips](https://gh.io/copilot-coding-agent-tips) in the docs.

Copilot AI and others added 2 commits February 11, 2026 14:30
- Add buildSafeOutputsPrompt function that generates context-aware prompts
- Categorize safe output tools to help agents understand available capabilities
- Include "Projects" category when update-project, create-project, or create-project-status-update are enabled
- Add comprehensive tests for new prompt generation logic
- Recompile all 146 workflows with enhanced prompts

Co-authored-by: mnkiefer <[email protected]>
Copilot AI changed the title [WIP] Investigate workflow for agent tool usage Make safe outputs prompt context-aware for project tools Feb 11, 2026
Copilot AI requested a review from mnkiefer February 11, 2026 14:39
@mnkiefer
Copy link
Contributor

@copilot This is overkill. It would be enough if the instructions of workflow markdown file itself could see/know about the frontmatter above it.

Copy link
Contributor Author

Copilot AI commented Feb 11, 2026

@copilot This is overkill. It would be enough if the instructions of workflow markdown file itself could see/know about the frontmatter above it.

You're right - I've reverted the complex categorization. Instead, I'll make the frontmatter visible to the agent by not stripping it during runtime-import, so the agent can see what safe-outputs are configured directly from the YAML. This is much simpler and puts control in the workflow author's hands.

- Preserve frontmatter in runtime-import instead of stripping it
- Wrap frontmatter in <workflow-configuration> tags for agent visibility
- Update tests to expect frontmatter preservation
- Simpler approach: let workflow authors see their own config instead of complex categorization

Co-authored-by: mnkiefer <[email protected]>
Copilot AI changed the title Make safe outputs prompt context-aware for project tools Make workflow frontmatter visible to agents for simpler tool discovery Feb 11, 2026
@pelikhan pelikhan closed this Feb 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants