All runs are failing after new release (last night) v0.14.0

[mherbertecifm]

I have an action job configured like this;

name: Shippie 🚢

on:
  pull_request:
    branches: [develop]

jobs:
  run_code_review:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v3
        with:
          fetch-depth: 0

      - name: Shippie 🚢
        uses: mattzcarey/shippie@v0.10.0
        with:
          GITHUB_TOKEN: ${{ github.token }}
          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
          MODEL_STRING: "openai:gpt-4o"

I even have this configured to use v0.10.0, but it seems that shippie is pulling latest - that's a different issue, but it kinda leads into this breakage.

the config above has not changed. all PRs were being processed without error - until now.

here's the log snippet

...
...
installed shippie@0.14.0 with binaries:
 - shippie

2380 packages installed [19.92s]
INFO	Using GitHub platform provider.
INFO	Shippie collects anonymous usage data to help improve the product. You can opt out by setting --telemetry false when running Shippie.
INFO	Running agentic review (max retries: 3)...
ERROR	No MCP configuration found in .shippie/mcp.json or .cursor/mcp.json
ERROR	Cannot start clients: MCP config not loaded
INFO	Attempt 1/3...
ERROR	Review failed with error:

 AI_APICallError  This model's maximum context length is 128000 tokens. However, your messages resulted in 784547 tokens (783388 in the messages, 1159 in the functions). Please reduce the length of the messages or functions., AI_APICallError, , https://api.openai.com/v1/chat/completions, [object Object], 400, [object Object], {
  "error": {
    "message": "This model's maximum context length is 128000 tokens. However, your messages resulted in 784547 tokens (783388 in the messages, 1159 in the functions). Please reduce the length of the messages or functions.",
    "type": "invalid_request_error",
    "param": "messages",
    "code": "context_length_exceeded"
  }
}, false, [object Object]
error stack:
...
...

this would imply that the MCP config is required?

[mattzcarey]

Hey so sorry thats failing. The MCP errors shouldnt cause any actual issue. Error wasn't the correct naming, I'll sort that.

Regards the APICallError. The model is probably trying to read a file which is too long. I have a todo to make a context window manager which should help mitigate some of these issues. Can you run the action with the --debug flag to see the tools called?

I would advise you to pin the action version to a published tag and also to upgrade to gpt-4.1-mini as it's cheaper than 4o and better at instruction following.

[mattzcarey]

Tracking progress in issue #424

[mherbertecifm]

Thanks @mattzcarey

ok, so using gpt-4.1-mini helped with - uses: mattzcarey/shippie@v0.10.0, however when I updated that to use uses: mattzcarey/shippie@v0.14.0, I consistently get a failed run with the following logs...

...
INFO	Running agentic review (max retries: 3)...
ERROR	No MCP configuration found in .shippie/mcp.json or .cursor/mcp.json
ERROR	Cannot start clients: MCP config not loaded
INFO	Attempt 1/3...
ERROR	Review failed with error:

 TypeError  Failed to parse URL from /chat/completions, TypeError: Invalid URL
error stack:
  • undici	
	internal/deps/undici/undici:13510
  • index.js	async postToApi
	/node_modules/@ai-sdk/provider-utils/dist/index.js:627
error: "shippie" exited with code 1
Error: Process completed with exit code 1.

here's the debug snippet

...
INFO	Running agentic review (max retries: 3)...
DEBUG	No .shippie/mcp.json found or error reading it: Error: ENOENT: no such file or directory, open '/home/runner/work/ionic-otg/ionic-otg/.shippie/mcp.json'
DEBUG	No .cursor/mcp.json found or error reading it: Error: ENOENT: no such file or directory, open '/home/runner/work/ionic-otg/ionic-otg/.cursor/mcp.json'
ERROR	No MCP configuration found in .shippie/mcp.json or .cursor/mcp.json
ERROR	Cannot start clients: MCP config not loaded
DEBUG	Tools: [
  'read_file',
  'read_diff',
  'suggest_change',
  'submit_summary',
  'fetch',
  'glob',
  'grep',
  'ls',
  'bash',
  'thinking'
]
INFO	Attempt 1/3...
ERROR	Review failed with error:

 TypeError  Failed to parse URL from /chat/completions, TypeError: Invalid URL
error stack:
  • undici	
	internal/deps/undici/undici:13510
  • index.js	async postToApi
	/node_modules/@ai-sdk/provider-utils/dist/index.js:627
Error: Process completed with exit code 1.

[mattzcarey]

#426 should solve your issue. Github actions defaulting config to an empty string wasn't on my bingo card. Can you paste the debug logs for the BaseURL ? is it an empty string?

[mherbertecifm]

for now I will continue to use mattzcarey/shippie@v0.10.0

[mattzcarey]

please update to latest. v0.14.1.

[mattzcarey]

Hey, v0.14.2 release fixes the github action.yml parsing and adds it as a test to CI to stop this happening again.

[mherbertecifm]

thank you! I'll check it out.

[mherbertecifm]

@mattzcarey I'm afraid to say v0.14.2 didn't work - different error: error: lockfile had changes, but lockfile is frozen (see below). reverted back to mattzcarey/shippie@v0.10.0 is working.

2025-05-22T13:27:49.3433206Z ##[group]Run mattzcarey/shippie@v0.14.2
2025-05-22T13:27:49.3433497Z with:
2025-05-22T13:27:49.3433844Z   GITHUB_TOKEN: ***
2025-05-22T13:27:49.3434707Z   OPENAI_API_KEY: ***
2025-05-22T13:27:49.3434927Z   MODEL_STRING: openai:gpt-4.1-mini
2025-05-22T13:27:49.3435164Z   DEBUG: ***
2025-05-22T13:27:49.3435344Z   REVIEW_LANGUAGE: English
2025-05-22T13:27:49.3435543Z   MAX_STEPS: 25
2025-05-22T13:27:49.3435719Z   TELEMETRY: ***
2025-05-22T13:27:49.3435902Z ##[endgroup]
2025-05-22T13:27:49.3555288Z ##[group]Run oven-sh/setup-bun@v2
2025-05-22T13:27:49.3555545Z with:
2025-05-22T13:27:49.3555733Z   bun-version: latest
2025-05-22T13:27:49.3555933Z   no-cache: false
2025-05-22T13:27:49.3556106Z ##[endgroup]
2025-05-22T13:27:49.4832683Z Downloading a new version of Bun: https://bun.sh/download/latest/linux/x64?avx2=***&profile=false
2025-05-22T13:27:50.4845209Z [command]/usr/bin/unzip -o -q /home/runner/work/_temp/3e8e041c-770b-4c61-ae3b-d9bcecb3660c.zip
2025-05-22T13:27:51.2241765Z [command]/home/runner/.bun/bin/bun --revision
2025-05-22T13:27:51.2283730Z 1.2.14+6a363a38d
2025-05-22T13:27:51.2416523Z ##[group]Run bun install --frozen-lockfile
2025-05-22T13:27:51.2416899Z �[36;1mbun install --frozen-lockfile�[0m
2025-05-22T13:27:51.2569065Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-05-22T13:27:51.2569494Z ##[endgroup]
2025-05-22T13:27:51.2729442Z bun install v1.2.14 (6a363a38)
2025-05-22T13:27:51.2936082Z [23.15ms] migrated lockfile from package-lock.json
2025-05-22T13:27:51.3016843Z error: lockfile had changes, but lockfile is frozen
2025-05-22T13:27:51.3017839Z note: try re-running without --frozen-lockfile and commit the updated lockfile
2025-05-22T13:27:51.3056231Z ##[error]Process completed with exit code 1.

[mattzcarey]

ahh whatttt I cant replicate that locally or in github. I hate this action.yml config.

This line is weird [23.15ms] migrated lockfile from package-lock.json hmm working on something now.

[mattzcarey]

Hmm I may have misunderstood how they work. Please try 0.14.3 for me :)

[mherbertecifm]

no worries. I'll keep you posted.