Repository navigation
Run CI tests on VSTS for PRs from core contributors of extension #1302
Description
The core contributors of the extension have to wait for the tests to pass before we can merge the tests (sometimes the tests take forever, sometimes they need to be re-run - due to flaky tests).
All of this slows down the time taken to merge a PR.
Solution:
- Run tests on VSTS (all platforms)
- Once tests pass, merge the PR
- If tests fail on Master (AppVeyor or Travis), then
- Restart tests
- Worst case, identify the problem (identify why tests pass on VSTS and not on AppVeyor/Travis)
- No changes to external contributors
Brett Cannon (@brettcannon) Mikhail Arkhipov (@MikhailArkhipov)
Thoughts
Activity
[-]Run CI tests on VSTS for core contributors of extension[/-][+]Run CI tests on VSTS for PRs from core contributors of extension[/+]brettcannon commentedon Apr 5, 2018
We should set up VSTS to get the 3-platform coverage anyway.
DonJayamanne commentedon Jun 4, 2018
Closing as we've commenced work on this, and tracked in a separate issue.