From 899fdf49b9c98dad9ec558ef3a550f984b8eec30 Mon Sep 17 00:00:00 2001 From: Raimund Andree Date: Wed, 21 Oct 2026 07:36:49 +0000 Subject: [PATCH] docs(coverage): record the CI run of the tests-only round The CI of #129 ran the new tests on the GitHub runner (windows-2025, run 39551726767): the four configurations gave the counts of the local run with no failure, and each of the 29 test files has the same number of executed and skipped cases as in the local run. The report said that the runner had not run the tests yet; it now gives the result and states the one thing that is still open, that the new cases ran on Windows Server 2025 only. The Evidence CSV lists the log and the four NUnit files of the run, whose retention on GitHub ends. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: AI Assistant --- ...ty-Gate-Test-Round-2026-10-20-Evidence.csv | 6 ++++++ .../Quality-Gate-Test-Round-2026-10-20.md | 20 +++++++++++++------ 2 files changed, 20 insertions(+), 6 deletions(-) diff --git a/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20-Evidence.csv b/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20-Evidence.csv index e544efc..4d76506 100644 --- a/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20-Evidence.csv +++ b/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20-Evidence.csv @@ -55,6 +55,12 @@ "round1\suite\round1-three-20261020-141224\elevated-Desktop-summary.md","155","3304B0A67528DEB418424848E623401B0B69E35FD289CF0A9763FA048B552A21" "round1\suite\round1-three-20261020-141224\elevated-Desktop.log","222407","F171888AEE1BCA0719987878B730A6CAAE658BA69B0FCBC0C4CC6D0AEF0F30B5" "round1\suite\round1-three-20261020-141224\elevated-Desktop.xml","726954","46DC96B84FD78F89313E62BC4701E644396384D203EA9E93DDC66CDAEEBD57C9" +"round1\suite\runner-39551726767\build-and-test-job.log","1600975","AE4120B3F41A4F4AA92FF5CE69A913B8CD980207A4B8B6D95547E099698A7311" +"round1\suite\runner-39551726767\delta-runner-vs-baseline.txt","21762","D6B1BD04B235E4A18004091792B5B826A64B8B367DA593EE04B1F0AE721DECCA" +"round1\suite\runner-39551726767\PowerShell7-BasicUser.xml","757904","1099C8001C48BDBD75E3D14BB4920068A7E02878F94F3C66F4BD8210FDA00D49" +"round1\suite\runner-39551726767\PowerShell7.xml","744278","027F1186B07A8ECE493971D1BC618F855FA897A7AFC52C60834B624A000C869B" +"round1\suite\runner-39551726767\WindowsPowerShell-BasicUser.xml","757780","0F1BFAFA8E792A5A9B685A630961EE9FA08224FD3E450241E797A0F14CF7E0D5" +"round1\suite\runner-39551726767\WindowsPowerShell.xml","744212","C5A91240315624288AAE9B084D7E898F2B9274E393DEBEC7005E186741966555" "round1\tables-draft\Quality-Gate-Test-Round-2026-10-20-ParameterSets.csv","21329","2F08E25C342A84B59F48073A3B319231C9EE3D4C8534859A69F0D675E58EFE6F" "round1\worklist-access.md","17983","4EDD989E5BF768D55EEE0E4516D474B18BB88AE2815D8D4DBEA62C50EDF323C4" "round1\worklist-audit.md","10359","89EC64925D8967155702BA8142893DB358238CA37D612E34D70CD468C3DFF995" diff --git a/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20.md b/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20.md index d503b42..571032e 100644 --- a/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20.md +++ b/Tests/Coverage/Quality-Gate-Test-Round-2026-10-20.md @@ -17,7 +17,7 @@ cmdlet is. - **The tests.** 89 new `It` blocks, which run as 121 cases per configuration, in the four `ParameterSets.*.Tests.ps1` files. The suite goes from 1,494 to 1,615 cases per configuration, with no failure in Windows PowerShell 5.1 and - PowerShell 7, elevated and as a basic user. + PowerShell 7, elevated and as a basic user, on the host and on the CI runner. - **The parameter sets.** 38 of 64 are closed (7 before). 31 sets changed to closed, among them the one that was open (`Test-Path2`). The one set that had no judgement, `Set-NTFSSecurityDescriptor`, is now partly closed. 26 sets have @@ -103,8 +103,14 @@ the counts per test file between this run and the last run before the round `master` has 1,494 cases per configuration, with 26, 291, 57, and 322 skipped. An earlier run with the audit, access, and items batches (1,590 cases) was also -green in all four configurations. The CI of the pull request runs the same -steps on a GitHub runner; I did not run that. +green in all four configurations. + +The CI of the pull request (#129) ran the same steps on a GitHub runner +(`windows-2025`, run 39551726767, 14 minutes). Its four configurations gave the +counts of the table above with no failure, and each of the 29 test files has +the same number of executed and skipped cases as in the local run. So the new +cases that need a drive mapping, the administrative share, or a symbolic link +ran there too: the runner user is a local administrator. ## What is left @@ -188,9 +194,10 @@ explained, not tested. ## Checks not run, and limits -- The CI on a GitHub runner did not run these tests yet; the pull request does. - Cases that need a drive mapping, an administrative share, or a symbolic link - skip where the token lacks them and can behave differently on a runner. +- The new cases ran on Windows Server 2025 only, on the host and on the runner. + The suite of the rc8 acceptance ran on six machine classes, but before these + cases existed, so they have not run on Windows Server 2019 or 2022 or on + Windows 11. - No lab run: the product bytes did not change. The acceptance of rc8 of 2026-10-20 stands for them. - No independent review agent ran on the four batches. I read the diffs of all @@ -226,5 +233,6 @@ branch `ai/tests-round-1`. | `round1\suite\rc8suite-20261020-093109` | the last run of the four CI configurations before the round (1,494 cases per configuration) | | `round1\suite\round1-three-20261020-141224`, `round1\suite\round1-four-20261020-142909` | the runs with three and with all four batches (1,590 and 1,615 cases), each with the NUnit file, the log, and the summary of the four configurations | | `round1\suite\delta-four-vs-baseline.txt` | the output of `Measure-RoundSuiteDelta.ps1`: the new cases per file and configuration, and the 30 and 1 that skip | +| `round1\suite\runner-39551726767` | the CI run of #129 on the GitHub runner: the log of the job `Build and test`, the four NUnit files of the artifact `test-results`, and the output of `Measure-RoundSuiteDelta.ps1` for them (GitHub deletes logs and artifacts after its retention period) | | `round1\tables-draft` | the draft of the ParameterSets CSV | | `scripts` | `Build-Worklists.ps1`, `Build-RoundTables.ps1` (the CSV of this round), `Invoke-RoundJob.ps1`, `Invoke-Build.ps1`, `Run-FocusedPester.ps1`, `Start-FocusedRuns.ps1` (the helper with the quoting defect, fixed), `Run-FullSuite.ps1`, `Run-CiConfiguration.ps1`, `Measure-RoundSuiteDelta.ps1` |