Skip to content

Conversation

chris-sanders
Copy link
Owner

Summary

  • Removed failing MCP protocol tests that were testing FastMCP's protocol handling rather than our application logic
  • Updated testing strategy documentation to explain our direct tool testing approach
  • Cleaned up unused MCPTestClient and related test infrastructure

Problem

The MCP protocol E2E tests were failing with "Invalid request parameters" (JSON-RPC error -32602) due to incompatibility between our custom MCPTestClient and FastMCP 1.12.2. These tests:

  • Were excluded from CI pipeline
  • Provided no additional value over direct tool testing
  • Created maintenance burden and confusion about test suite health

Solution

After investigation, I recommended and implemented removing these tests because:

  1. They tested FastMCP's protocol layer, not our business logic
  2. All functionality is already tested via direct tool calls
  3. The MCP SDK is well-tested by its maintainers
  4. Maintaining a custom test client for protocol testing adds complexity without value

Test plan

  • Verify all remaining tests pass
  • Confirm direct tool tests provide complete coverage
  • Review testing strategy documentation for clarity

Remove failing MCP protocol tests that were testing FastMCP's protocol
handling rather than our application logic. These tests:
- Failed with "Invalid request parameters" errors
- Were excluded from CI pipeline
- Provided no additional value over direct tool testing
- Created maintenance burden and confusion

Updated testing strategy documentation to explain our approach of
testing tools directly rather than through the protocol layer.
@chris-sanders chris-sanders merged commit 707bce7 into main Jul 29, 2025
6 checks passed
@chris-sanders chris-sanders deleted the task/mcp-protocol-tests branch July 29, 2025 20:59
chris-sanders added a commit that referenced this pull request Aug 11, 2025
* Start task: mcp-protocol-tests

* Remove MCP protocol tests and update testing strategy

Remove failing MCP protocol tests that were testing FastMCP's protocol
handling rather than our application logic. These tests:
- Failed with "Invalid request parameters" errors
- Were excluded from CI pipeline
- Provided no additional value over direct tool testing
- Created maintenance burden and confusion

Updated testing strategy documentation to explain our approach of
testing tools directly rather than through the protocol layer.

* Complete task: mcp-protocol-tests
chris-sanders added a commit that referenced this pull request Aug 11, 2025
* Start task: mcp-protocol-tests

* Remove MCP protocol tests and update testing strategy

Remove failing MCP protocol tests that were testing FastMCP's protocol
handling rather than our application logic. These tests:
- Failed with "Invalid request parameters" errors
- Were excluded from CI pipeline
- Provided no additional value over direct tool testing
- Created maintenance burden and confusion

Updated testing strategy documentation to explain our approach of
testing tools directly rather than through the protocol layer.

* Complete task: mcp-protocol-tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant