Stabilize unit tests on Windows and promote ci-kubernetes-unit-windows-master to release-informing

[marosset]

What would you like to be added?

SIG-Windows maintains periodic and PR jobs for running unit tests on a Windows machine.
https://prow.k8s.io/?job=ci-kubernetes-unit-windows-master is the periodic job.

Historically this jobs took a long time to run (~2 hours) and had many known failures.
Over the past several releases many of the known issues have been resolved (and several bugs were fixed during the process) as well as infrastructure improvements bringing to bring the job duration down to ~25 minutes.

I would like to see the number of unit test failures on Windows driven down to 0 and also put the ci-kubernetes-unit-windows-master job on a path to become release informing.

Why is this needed?

It is important that the ci-kubernetes-unit-windows-master job because release informing because we've observed unit test failures in Windows specific code paths have a tendency to sneak in over time and having the test pass be marked as release informing would both provide prompt notification for such regressions and priority/motivation for fixing them.

Tracking

• k8s.io/kubernetes/pkg/kubelet
  • TestAllocatedResourcesMatchStatus
• k8s.io/kubernetes/pkg/kubelet/apis/config/validation
  • unit tests - fixing k8s.io/kubernetes/pkg/kubelet/apis/config/validation unit test failures on Windows #130122
  • TestValidateKubeletConfiguration
• k8s.io/kubernetes/pkg/kubelet/eviction
  • fixing k8s.io/kubernetes/pkg/kubelet/eviction unit tests on Windows #130125
  • TestMemoryPressure_VerifyPodStatus
• k8s.io/kubernetes/pkg/kubelet/kuberuntime
  • Fixing k8s.io/kubernetes/pkg/kubelet/kuberuntime unit tests on Windows #130182
  • TestToKubeContainerStatusWithResources
  • TestComputePodActionsForPodResize
• k8s.io/kubernetes/pkg/proxy/winkernel
  • Fixing k8s.io/kubernetes/pkg/proxy/winkernel unit tests #130286
  • TestNoopEndpointSlice
• k8s.io/kubernetes/pkg/scheduler/metrics
  • Fixing k8s.io/kubernetes/pkg/scheduler/metrics unit tests when run on… #130184
  • TestInFlightEventAsync
• k8s.io/kubernetes/pkg/util/filesystem
  • Fixing k8s.io/kubernetes/pkg/util/filesystem unit tests for Windows #130245
  • TestWindowsChmod
  • TestDeleteFilePermissions
• k8s.io/kubernetes/cmd/kubeadm/app/util/dryrun
  • Fixing k8s.io/kubernetes/cmd/kubeadm/app/util/dryrun unit tests on Windows #130287
  • TestPrintDryRunFiles
• k8s.io/kubernetes/cmd/kubeadm/app/util/staticpod
  • Fixing k8s.io/kubernetes/cmd/kubeadm/app/util/staticpod unit tests on Windows #130289
  • TestReadMultipleStaticPodsFromDisk
• k8s.io/kubernetes/cmd/kubemark/app
  • TestHollowNode

[k8s-ci-robot]

This issue is currently awaiting triage.

If a SIG or subproject determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[marosset]

/sig windows
/area testing

[k8s-ci-robot]

@marosset: The label(s) area/testing cannot be applied, because the repository doesn't have them.

In response to this:

/sig windows
/area testing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[yujuhong]

SIG-Windows maintains periodic and PR jobs for running unit tests on a Windows machine.

Does the unit tests run per PR? Fixing unit test failures post-PR merge is a hassle.

[marosset]

SIG-Windows maintains periodic and PR jobs for running unit tests on a Windows machine.

Does the unit tests run per PR? Fixing unit test failures post-PR merge is a hassle.

we can run the unit tests against PRs.
I'm hesitant to turn that on until they get cleaned up.

I can start triggering the job on PRs that fix until tests to verify they get fixed.
WDYT?