Manual Testing Checklist for Orchestre Commands

This checklist ensures all Orchestre commands properly invoke MCP tools and handle various scenarios correctly.

Pre-requisites

• [ ] Orchestre MCP server installed in Claude Code
• [ ] API keys configured (GEMINI_API_KEY, OPENAI_API_KEY)
• [ ] Test project directory ready

Command Tests

1. /create Command

Test: Create with all parameters

/create cloudflare-hono my-api ./projects/api

Expected:

• [ ] Project created at ./projects/api/my-api
• [ ] .orchestre directory structure created
• [ ] CLAUDE.md files created
• [ ] Template-specific files created (wrangler.toml, etc.)
• [ ] All commands available immediately via MCP (v5.0+)

Test: Create with template only

/create cloudflare-hono

Expected:

• [ ] Project created with derived name
• [ ] All structure created correctly

Test: Invalid template

/create invalid-template

Expected:

• [ ] Error message listing available templates
• [ ] No files created

Test: Existing directory

/create cloudflare-hono existing-project

Expected:

• [ ] Error about existing directory
• [ ] Suggestion to use different name or /initialize

2. /initialize Command

Test: Initialize current directory

/initialize

Expected:

• [ ] .orchestre directory created if missing
• [ ] .claude/commands populated
• [ ] Existing files preserved
• [ ] Success message with command list

Test: Initialize specific path

/initialize ./my-project

Expected:

• [ ] Initialization at specified path
• [ ] All structures created correctly

Test: Already initialized

/initialize
/initialize  # Run again

Expected:

• [ ] Message about already initialized
• [ ] Commands refreshed/updated

3. /orchestrate Command

Test: With requirements file

echo "Build a task management API" > requirements.md
/orchestrate requirements.md

Expected:

• [ ] Requirements file read
• [ ] Analysis performed (complexity score shown)
• [ ] Plan generated with phases
• [ ] CLAUDE.md updated with plan
• [ ] Plan saved to .orchestre/plans/

Test: Missing requirements file

/orchestrate missing.md

Expected:

• [ ] Error about missing file
• [ ] Suggestions for creating requirements

Test: Direct requirements

/orchestrate "Build a simple blog platform"

Expected:

• [ ] Requirements processed directly
• [ ] Analysis and plan generated

4. /review Command

Test: Review recent changes

/review

Expected:

• [ ] Recent git changes identified
• [ ] Files read and reviewed
• [ ] Multi-LLM consensus presented
• [ ] Issues categorized by priority

Test: Review specific files

/review src/index.js src/utils.js

Expected:

• [ ] Specified files reviewed
• [ ] Comprehensive analysis provided

Test: Review by pattern

/review src/**/*.ts

Expected:

• [ ] Matching files found (max 10)
• [ ] All files reviewed together

Test: No files found

/review non-existent-pattern

Expected:

• [ ] Error about no files found
• [ ] Suggestions for valid patterns

Error Handling Tests

API Key Missing

Remove API keys and test each command:

• [ ] /orchestrate - Should fail with API key error
• [ ] /review - Should fail with API key error

Network Issues

Disconnect network and test:

• [ ] Commands should handle network errors gracefully
• [ ] Helpful error messages provided

Integration Tests

Full Workflow

1. [ ] /create cloudflare-hono test-project
2. [ ] cd test-project
3. [ ] Create requirements.md
4. [ ] /orchestrate requirements.md
5. [ ] /execute-task "First task from plan"
6. [ ] Make some code changes
7. [ ] /review
8. [ ] /status

Expected:

• [ ] Smooth flow between commands
• [ ] Context preserved between steps
• [ ] CLAUDE.md files updated throughout

Performance Tests

Large Files

• [ ] /review with files > 10KB - Should skip
• [ ] /orchestrate with very long requirements - Should handle

Many Files

• [ ] /review src/**/* in large project - Should limit to 10 files

Success Criteria

• [ ] All commands parse arguments correctly
• [ ] MCP tools are invoked properly
• [ ] Error messages are helpful and actionable
• [ ] File structures are created as expected
• [ ] No regression in existing functionality

Notes

Document any issues or unexpected behavior here:

---

Last tested: [Date] Tested by: [Name] Version: 3.4.0