Development record
A fixed test budget can hide behind an earlier test warming something up: TestAPreflightPastItsBoundIsKilledWithItsGroup's two-second bound passed for months because another test ran make first, and failed every time once the macOS suite was sharded, since a cold make on a fresh runner goes through xcrun. Sharding is likely to surface more of these.
issueopenminoriss-2611040712399867
A fixed test budget can hide behind an earlier test warming something up: TestAPreflightPastItsBoundIsKilledWithItsGroup's two-second bound passed for months because another test ran make first, and failed every time once the macOS suite was sharded, since a cold make on a fresh runner goes through xcrun. Sharding is likely to surface more of these.
Frontmatter
| id | iss-2611040712399867 |
|---|---|
| type | issue |
| lifecycle | open |
| severity | minor |
.abcd/work/issues/open/iss-2611040712399867-a-fixed-test-budget-can-hide-behind-an.md
open on GitHub ↗ · commit history ↗