Proposal for a kata green CI and maintainership - updates
Hi everyone. Last month we presented to the community the idea of a kata green CI https://docs.google.com/document/d/1vWCKYAQrxAFcuuxm60CBkqcO70SpmWoAqh_Hx4Gv5Jc/edit#heading=h.1hlxsk6xwa3i which basically focused on reducing the amount of kata CI jobs running to those *which are stable* (less than 5% false positives) and *have maintainers*. Since then Gabriela and Wainer worked to create a daily baseline set of jobs http://jenkins.katacontainers.io/view/Daily%20baseline/ which contain almost all the jobs agreed upon in the corresponding github issue Salvador opened https://github.com/kata-containers/ci/issues/403.
The goal in the upcoming 3 weeks is to review the stability of the jobs on the daily baseline tab (which run on the main branch) and work with the maintainers to fix any instability issues or to agree on removing them. As we also pointed out, any jobs which are not part of the daily baseline are expected to be removed from the kata CI http://jenkins.katacontainers.io/.
*How can you help this effort?*
- If you have jobs on the daily baseline please look at them to see their past few runs and in case there are failures start working on fixing them. You have a mapping from the daily baseline jobs to the kata CI jobs and owners written at the beginning of the page (daily baseline tab) http://jenkins.katacontainers.io/view/Daily%20baseline/ - If you have a job which is part of the kata CI and has not been added to the daily baseline you still have a chance to reach out to us to add it (assuming you are willing to maintain it and fix problems) - Join our meetings on Tuesdays 10AM EST (1 hour before the kata architecture meeting) to review the status of the kata CI and raise any issues you have. For those who didn't get the meeting invite this is the google meet: - https://meet.google.com/tna-zzpo-cmw
Comments and questions are welcomed.
Thanks.
Hi everyone. Going back to this thread. We now have *15 jobs on the daily baseline*:
http://jenkins.katacontainers.io/view/Daily%20baseline/
Out of the 15 jobs we have 5 jobs that are still not stable and relevant job owners are working to stabilize them. Our goal is to converge this effort by the end of next week, 5th of November.
As we previously pointed out, we plan on moving out of the kata CI ( http://jenkins.katacontainers.io/) any jobs that aren't part of the daily baseline and don't have an owner (The CI contains 77 jobs at the moment). If you still would like your CI job to be added to the daily baseline list and be responsible for it please let us know.
Thanks.
On Tue, Oct 19, 2021 at 9:11 AM Ariel Adam aadam@redhat.com wrote:
Hi everyone. Last month we presented to the community the idea of a kata green CI https://docs.google.com/document/d/1vWCKYAQrxAFcuuxm60CBkqcO70SpmWoAqh_Hx4Gv5Jc/edit#heading=h.1hlxsk6xwa3i which basically focused on reducing the amount of kata CI jobs running to those *which are stable* (less than 5% false positives) and *have maintainers*. Since then Gabriela and Wainer worked to create a daily baseline set of jobs http://jenkins.katacontainers.io/view/Daily%20baseline/ which contain almost all the jobs agreed upon in the corresponding github issue Salvador opened https://github.com/kata-containers/ci/issues/403.
The goal in the upcoming 3 weeks is to review the stability of the jobs on the daily baseline tab (which run on the main branch) and work with the maintainers to fix any instability issues or to agree on removing them. As we also pointed out, any jobs which are not part of the daily baseline are expected to be removed from the kata CI http://jenkins.katacontainers.io/.
*How can you help this effort?*
- If you have jobs on the daily baseline please look at them to see
their past few runs and in case there are failures start working on fixing them. You have a mapping from the daily baseline jobs to the kata CI jobs and owners written at the beginning of the page (daily baseline tab) http://jenkins.katacontainers.io/view/Daily%20baseline/
- If you have a job which is part of the kata CI and has not been
added to the daily baseline you still have a chance to reach out to us to add it (assuming you are willing to maintain it and fix problems)
- Join our meetings on Tuesdays 10AM EST (1 hour before the kata
architecture meeting) to review the status of the kata CI and raise any issues you have. For those who didn't get the meeting invite this is the google meet: - https://meet.google.com/tna-zzpo-cmw
Comments and questions are welcomed.
Thanks.
Ariel,
On Wed, Oct 27, 2021 at 6:57 AM Ariel Adam aadam@redhat.com wrote:
Hi everyone. Going back to this thread. We now have 15 jobs on the daily baseline:
Nice progress!
Out of the 15 jobs we have 5 jobs that are still not stable and relevant job owners are working to stabilize them. Our goal is to converge this effort by the end of next week, 5th of November.
As we previously pointed out, we plan on moving out of the kata CI (http://jenkins.katacontainers.io/) any jobs that aren't part of the daily baseline and don't have an owner (The CI contains 77 jobs at the moment). If you still would like your CI job to be added to the daily baseline list and be responsible for it please let us know.
The 77 number seems quite off and gives the impression we're running 77 different CIs right now, which we don't.
For instance, the CIs we run now are: jenkins-ci-s390x-ubuntu-20-04 jenkins-ci-ARM-ubuntu-18-04 jenkins-ci-centos-8 jenkins-ci-debian-10 jenkins-ci-fedora-32-crio jenkins-ci-fedora-32-crio-k8s-e2e-minimal jenkins-ci-firecracker-ubuntu-18-04 jenkins-ci-pmem-ubuntu-18-04 jenkins-ci-qat-ubuntu-18-04 jenkins-ci-ubuntu-18-04-initrd jenkins-ci-ubuntu-1804-clh-containerd-k8s-e2e-minimal jenkins-ci-ubuntu-1804-cloud-hypervisor-k8s-containerd-2.0 jenkins-ci-ubuntu-1804-containerd-k8s-e2e-minimal jenkins-ci-ubuntu-20-04 jenkins-ci-ubuntu-clh-crio-18-04 jenkins-metrics-ubuntu-20-04 jenkins-vfio-host:ubuntu18-04-vm:fedora32
You mentioned we have 15 baselines, that gives us a reduction of 2 CIs, instead of 62. Reducing the number of things we maintain is good, even if by only 1,
While here, all the baseline CIs are for the "kata-containers" project. Is the plan to replicate those to the "tests" project as well? It'd be good to be consistent on what we're testing. This would increase the numbers we have from 15 to 30 CIs.
Last but not least, is there an easy way for folks to see which CIs are being removed (from the ones we normally run)?
Best Regards,
Hi,
Regarding to the two questions
While here, all the baseline CIs are for the "kata-containers"
project. Is the plan to replicate those to the "tests" project as well? It'd be good to be consistent on what we're testing. This would increase the numbers we have from 15 to 30 CIs.
Right now, the baseline is already using the latest from the test repository to test the latest commits from the kata containers repository, I think that what we have is covering both sides instead of doing duplications.
Last but not least, is there an easy way for folks to see which CIs are being removed (from the ones we normally run)?
Yes, https://github.com/kata-containers/ci/issues/403, all the jobs from that list that does not have an owner will be remove.
Regards, Gabriela
-----Original Message----- From: Fabiano Fidêncio fabiano@fidencio.org Sent: Wednesday, October 27, 2021 1:58 AM To: Ariel Adam aadam@redhat.com Cc: kata-dev kata-dev@lists.katacontainers.io Subject: Re: [kata-dev] Proposal for a kata green CI and maintainership - updates
Ariel,
On Wed, Oct 27, 2021 at 6:57 AM Ariel Adam aadam@redhat.com wrote:
Hi everyone. Going back to this thread. We now have 15 jobs on the daily baseline:
Nice progress!
Out of the 15 jobs we have 5 jobs that are still not stable and relevant job owners are working to stabilize them. Our goal is to converge this effort by the end of next week, 5th of November.
As we previously pointed out, we plan on moving out of the kata CI (http://jenkins.katacontainers.io/) any jobs that aren't part of the daily baseline and don't have an owner (The CI contains 77 jobs at the moment). If you still would like your CI job to be added to the daily baseline list and be responsible for it please let us know.
The 77 number seems quite off and gives the impression we're running 77 different CIs right now, which we don't.
For instance, the CIs we run now are: jenkins-ci-s390x-ubuntu-20-04 jenkins-ci-ARM-ubuntu-18-04 jenkins-ci-centos-8 jenkins-ci-debian-10 jenkins-ci-fedora-32-crio jenkins-ci-fedora-32-crio-k8s-e2e-minimal jenkins-ci-firecracker-ubuntu-18-04 jenkins-ci-pmem-ubuntu-18-04 jenkins-ci-qat-ubuntu-18-04 jenkins-ci-ubuntu-18-04-initrd jenkins-ci-ubuntu-1804-clh-containerd-k8s-e2e-minimal jenkins-ci-ubuntu-1804-cloud-hypervisor-k8s-containerd-2.0 jenkins-ci-ubuntu-1804-containerd-k8s-e2e-minimal jenkins-ci-ubuntu-20-04 jenkins-ci-ubuntu-clh-crio-18-04 jenkins-metrics-ubuntu-20-04 jenkins-vfio-host:ubuntu18-04-vm:fedora32
You mentioned we have 15 baselines, that gives us a reduction of 2 CIs, instead of 62. Reducing the number of things we maintain is good, even if by only 1,
While here, all the baseline CIs are for the "kata-containers" project. Is the plan to replicate those to the "tests" project as well? It'd be good to be consistent on what we're testing. This would increase the numbers we have from 15 to 30 CIs.
Last but not least, is there an easy way for folks to see which CIs are being removed (from the ones we normally run)?
Best Regards, -- Fabiano Fidêncio
_______________________________________________ kata-dev mailing list kata-dev@lists.katacontainers.io http://lists.katacontainers.io/cgi-bin/mailman/listinfo/kata-dev
participants (3)
-
Ariel Adam
-
Cervantes Tellez, Gabriela
-
Fabiano Fidêncio