Adds testing Railway deployment to CI

[infomiho]

Closes #2994

[sodic]

I know it's still a draft, just FYI.

My idea here was to use the same smoke test job with a matrix for all providers (only Railway and Fly at the time). It's the same test, the only thing that changes are the inputs.

I'm not 100% sure that's possible but just a heads up to try it out.

[infomiho]

Yep yep, I'll optimize once I get it to work 😄

We still have the blocker of not being able to clean up Railway apps after they are created using the CLI.

[infomiho]

@sodic ready for another look, I've split it up into multiple jobs now

[infomiho]

Here I save the client and the server hostnames used in the smoke_test_app job. I save this file in this job and then later on restore it in the smoke_test_app job.

I ended up doing this because if I used job outputs, I'd have to have extra steps that map e.g. fly_server_hostname into SERVER_HOSTNAME (for Fly) and railway_server_hostname into SERVER_HOSTNAME (for Railway) in the smoke_test_app job. We'd need to add a new mapping step for each new provider we added, so this is was a nice way to avoid it. Just save it into a file that the next job reads from.

Saving it into a file means that we just save it here and the smoke_test_app doesn't need extra steps to load it since it's always saved into $DEPLOY_INFO_DIR.

[cloudflare-workers-and-pages]

Deploying wasp-docs-on-main with    Cloudflare Pages

Latest commit:	53c40a7
Status:	✅  Deploy successful!
Preview URL:	https://535ebd3c.wasp-docs-on-main.pages.dev
Branch Preview URL:	https://miho-railway-deployment-test.wasp-docs-on-main.pages.dev

View logs

[Copilot]

Pull Request Overview

This PR adds support for testing Railway deployment to the CI pipeline alongside the existing Fly.io deployment testing. The changes enable the CI to deploy and test applications on both platforms to ensure deployment compatibility.

Key changes:

• Added Railway deployment support to the CI workflow with matrix strategy for both Fly and Railway providers
• Introduced a new smoke testing script to verify deployed applications work correctly
• Implemented proper cleanup procedures for Railway deployments using GraphQL API calls

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File	Description
scripts/smoke-test-deployed-test-app.sh	New bash script for smoke testing deployed applications with retry logic and health checks
.github/workflows/test-deploy.yaml	Extended CI workflow to support both Fly and Railway deployments using matrix strategy

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[infomiho]

The smoke test on Railway is still failing even after 5 mins - I have to investigate if we can do anything.