Skip to content

testserver: match cloud for model description and VS target_qps clears - #6807

Open
denik wants to merge 1 commit into
mainfrom
denik/testserver-clear-fidelity
Open

denik wants to merge 1 commit into
mainfrom
denik/testserver-clear-fidelity

Conversation

@denik

@denik denik commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

The local fake server was more lenient than the real API for two field clears, so the field-removal invariant marked them CANNOT_REMOVE based on the cloud failure (models.description, vector_search_endpoints.target_qps) even though they passed locally. This makes the fake server reproduce the cloud behavior, so the local suite catches these directly instead of relying on the nightly cloud run.

  • MLflow UpdateModel now returns 400 "Description cannot be empty" when the description is absent/empty (the direct engine drops the emptied value via omitempty).
  • Vector Search PatchEndpoint only applies target_qps when the request actually sends it, so removing it from config leaves the old value in place (drift) — matching the real backend.

Adds resources/models/clear-description-rejected and resources/vector_search_endpoints/drift/target_qps_removed to lock in the behavior. Also stops resources/models/readplan-permissions from clearing a description (which the real backend rejects with the same 400) so it focuses on permission removal.

This pull request and its description were written by Isaac.

…absent

Make the fake server match cloud for two clears the direct engine can't apply, so
the local suite catches them instead of only the nightly cloud run:

- MLflow UpdateModel now returns 400 "Description cannot be empty" when the
  description is absent/empty (the CLI drops the emptied value via omitempty), and
- VectorSearchEndpoint PATCH only applies target_qps when the request actually
  sends it, so removing it from config leaves the old value in place (drift).

Adds resources/models/clear-description-rejected and
resources/vector_search_endpoints/drift/target_qps_removed to lock in the behavior,
and stops resources/models/readplan-permissions from clearing a description (which
the real backend rejects) so it focuses on permission removal.

Co-authored-by: Isaac <[email protected]>
@github-actions github-actions Bot added the DABs DABs related issues label Sep 23, 2026
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 2fa8faa

Run: 35841917700

Env ✅​pass 🙈​skip Time
✅​ aws linux 276 18 4:09
✅​ aws windows 278 16 5:37
✅​ azure linux 275 18 4:06
✅​ azure windows 277 16 6:40
✅​ gcp linux 276 18 4:04
✅​ gcp windows 278 16 5:18
Top 3 slowest tests (at least 2 minutes):
duration env testname
6:37 azure windows TestAccept
5:34 aws windows TestAccept
5:14 gcp windows TestAccept

@denik
denik marked this pull request as ready for review September 23, 2026 09:41
@denik
denik requested review from a team as code owners September 23, 2026 09:41

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants