Skip to content

TOW 966 add CLI regression tests and improve integration test - #108

Merged
socksy merged 12 commits into
feature/tow-967-fix-run-errors-responsesfrom
chore/tow-966-add-regression-tests-and-improve-integration-test
Sep 29, 2025
Merged

socksy merged 12 commits into
feature/tow-967-fix-run-errors-responsesfrom
chore/tow-966-add-regression-tests-and-improve-integration-test

Conversation

@socksy

@socksy socksy commented Sep 26, 2025 •

Copy link
Copy Markdown
Contributor

tests!

@socksy
socksy force-pushed the chore/tow-966-add-regression-tests-and-improve-integration-test branch from cd1c027 to 8b13b53 Compare September 27, 2025 00:11
@socksy
socksy changed the base branch from develop to feature/tow-965-make-mcp-server-do-what-it-says-it-does September 27, 2025 00:11
@socksy
socksy force-pushed the chore/tow-966-add-regression-tests-and-improve-integration-test branch 2 times, most recently from 422875d to ba95ac2 Compare September 27, 2025 04:17
@socksy
socksy changed the base branch from feature/tow-965-make-mcp-server-do-what-it-says-it-does to feature/tow-967-fix-run-errors-responses September 27, 2025 04:30
@socksy
socksy force-pushed the feature/tow-967-fix-run-errors-responses branch from e5669f1 to c89a1a4 Compare September 27, 2025 04:38
- Fix the validation error tests' expectation of being deployed or not
- check for "nonexistent_param" and return proper error model for
undeployed and invalid params errors (cli is not matching http statuses!)
hmm this mock server is getting pretty featureful, when can it replace prod?
The mock server is stateful and with multiple tests running either after
another (was getting issues with hello world being deployed when it
shouldn't have been), and also with parallel workers, I think it's
better we scope each test with their own unique hello_world app name.
`test_app` remains non-unique - it needs to be expected to be there (I
guess I could put it in the context, but it doesn't need to be yet so
🤷).

Other alternative was resetting the mock DB but I figured that might
lead to race conditions and it was better if this stuff was just as
idempotent as possible
@socksy
socksy force-pushed the chore/tow-966-add-regression-tests-and-improve-integration-test branch from ba95ac2 to f606e63 Compare September 27, 2025 04:45

@bradhe bradhe left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great!

- make sure we can access the app names across steps in a scenario
- move to @step everywhere so we can use @when or @then without it
  complaining
- make sure we deploy apps that are supposed to exist in advance
- hardcode in the predeployed app, to really communicate that this app
  is a special case (maybe can be replaced with actual deploying later)
@socksy
socksy force-pushed the chore/tow-966-add-regression-tests-and-improve-integration-test branch from 17a8758 to fa9ef7c Compare September 29, 2025 15:06
@socksy
socksy merged commit e3ff0c1 into feature/tow-967-fix-run-errors-responses Sep 29, 2025
5 checks passed
@socksy
socksy deleted the chore/tow-966-add-regression-tests-and-improve-integration-test branch September 29, 2025 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants