Gabriela Cervantes
6328181762
metrics: Add k8s sysbench documentation
...
This PR adds k8s sysbench documentation at general density documentation.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 20:28:37 +00:00
Gabriela Cervantes
8933d54428
metrics: Add FIO to gha run script
...
This PR adds FIO to gha run script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:51:11 +00:00
Gabriela Cervantes
8a584589ff
metrics: Add DAX FIO README
...
This PR adds DAX FIO README information.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:42:44 +00:00
Gabriela Cervantes
21f5b65233
metrics: Add FIO information in storage general README
...
This PR adds FIO information in storage general README.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:33:39 +00:00
Gabriela Cervantes
69f05cf9e6
metrics: Add FIO general README
...
This PR adds FIO general README information.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:30:05 +00:00
Gabriela Cervantes
87d41b3dfa
metrics: Add FIO test to gha for kata metrics CI
...
This PR adds FIO test to gha for kata metrics CI.
Fixes #7502
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 16:50:16 +00:00
Gabriela Cervantes
5a1b5d3672
metrics: Add sysbench pod yaml
...
This PR adds the sysbench pod yaml for the sysbench performance test.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 20:03:15 +00:00
Gabriela Cervantes
ad413d1646
metrics: Add sysbench dockerfile
...
This PR adds sysbench dockerfile.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 19:58:10 +00:00
Gabriela Cervantes
1512560111
metrics: Add sysbench performance test
...
This PR adds the sysbench performance test for kata CI.
Fixes #7485
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 19:54:12 +00:00
Gabriela Cervantes
bee1a628bd
metrics: Fix json result for tensorflow
...
This PR fixes the json result for tensorflow.i
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 17:02:16 +00:00
Gabriela Cervantes
51cd99c927
metrics: Round axelnet and resnet results
...
This PR rounds the axelnet and resnet results in order to extract
properly the result.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
3b883bf5a7
metrics: Fix atoi invalid syntax
...
This PR will avoid to have the strconv.atoi parsing error when we
are retrieving the results from the json.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
f9dec11a8f
checkmetrics: Move checkmetrics to gha-run script
...
This PR moves the checkmetrics to gha-run script to gathered
tensorflow information.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
53af71cfd0
checkmetrics: Add AlexNet value for qemu
...
This PR adds AlexNet value for qemu for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
a435d36fe1
checkmetrics: Add Resnet value for qemu
...
This PR adds the Resnet value for qemu for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
a79a3a8e1d
checkmetrics: Add alexnet value for clh
...
This PR adds the AlexNet value for clh for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
3c32875046
checkmetrics: Add Resnet value for clh
...
This PR adds the checkmetrics Resnet value for clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
08dfaa97aa
metrics: General improvements to the tensorflow script
...
This PR adds general improvements to the tensorflow script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
63b8534b41
metrics: Enable Tensorflow metrics for kata CI
...
This PR enables the Tensorflow benchmark metrics for kata CI.
Fixes #7395
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Aurélien
e8f8641988
Merge pull request #7132 from sprt/aks-volume-tests
...
tests: Add `k8s-volume` and `k8s-file-volume` tests to GHA CI
2023-07-28 08:58:03 -07:00
Fabiano Fidêncio
68b9acfd02
Merge pull request #7474 from GabyCT/topic/upboo
...
metrics: Update boot time for kata metrics
2023-07-28 17:55:43 +02:00
David Esparza
f89abcbad8
Merge pull request #7473 from GabyCT/topic/addfioreport
...
metrics: Add FIO report files for kata metrics
2023-07-28 09:37:21 -06:00
Fabiano Fidêncio
8353aae41a
ci: k8s: Rework get_nodes_and_pods_info()
...
The amount of info we've added seemed unnecessary, and ends up making
our lives even harder when trying to find errors.
Let's just rely on the kata-debug container to collect the needed info
for us.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-07-28 10:04:33 +02:00
Fabiano Fidêncio
6ad5d7112e
ci: k8s: Do not gather node info before running the tests
...
It's been proven to not be useful, and ends up making things more
confusing due to the amount of logs printed.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-07-28 10:04:33 +02:00
Fabiano Fidêncio
5261e3a60c
ci: k8s: Group messages to improve readability
...
Right now is getting way too easy to get lost in the logs.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-07-28 10:04:33 +02:00
Fabiano Fidêncio
9cc6b5f461
ci: k8s: Get logs from kata-deploy
...
Let's make sure we can debug kata-deploy in case something goes wrong
during its execution.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-07-28 10:04:33 +02:00
Fabiano Fidêncio
9d285c6226
ci: k8s: Let kata-deploy take care of the runtimeclasses
...
By doing this we can test the change done for the daemonset. :-)
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-07-28 10:04:33 +02:00
Fabiano Fidêncio
a274333248
kata-deploy: Change default values of DEBUG
...
This can be easily done as there was no official release with the
previous values.
The reason we're doing so is because when using `yq` to replace the
value, even when forcing `--tag '!!str' "yes"`, the content is placed
without quotes, causing errors in our CI.
While here, we're also removing the fallback value for DEBUG, as it is
**always** set in the kata-deploy.yaml file.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-07-28 09:50:39 +02:00
Aurélien Bombo
6222bd9103
tests: Add k8s-file-volume test
...
This imports the k8s-file-volume test from the tests repo and modifies
it slightly to set up the host volume on the AKS host.
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-27 14:07:55 -07:00
Aurélien Bombo
187a72d381
tests: Add k8s-volume test
...
This imports the k8s-volume test from the tests repo and modifies it
slightly to set up the host volume on the AKS host.
Fixes : #6566
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-27 14:06:43 -07:00
Gabriela Cervantes
0c84270357
metrics: Add boot time value for qemu
...
This PR adds the boot time value and limit for qemu.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 20:06:24 +00:00
Gabriela Cervantes
6520dfee37
metrics: Update boot time for kata metrics
...
This PR updates the boot time limit for kata metrics.
Fixes #7475
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 19:14:19 +00:00
Gabriela Cervantes
ff22790617
metrics: Update runtime and configuration paths
...
This PR updates the runtime and configuration paths for kata containers.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 17:14:03 +00:00
Gabriela Cervantes
a5d4e33880
metrics: Add compare virtiofsd dax script
...
This PR adds the compare virtiofsd dax script for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 16:53:50 +00:00
Gabriela Cervantes
5e937fa622
metrics: Update general FIO tests
...
This PR updates general FIO tests by adding the recent date of a change.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 16:47:17 +00:00
Gabriela Cervantes
b0bea47c53
metrics: Add makefile to report generator
...
This PR adds the makefile to report generator for the FIO test.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 16:42:11 +00:00
Gabriela Cervantes
73c57b9a19
metrics: Add FIO report files for kata metrics
...
This PR adds FIO report files for kata metrics.
Fixes #7472
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 16:39:35 +00:00
David Esparza
ba8a8fcbf2
Merge pull request #7442 from GabyCT/topic/addgofilesfio
...
metrics: Add FIO benchmark for metrics tests
2023-07-27 10:20:43 -06:00
Gabriela Cervantes
662f87539e
metrics: Add general FIO makefile
...
This PR adds a general FIO makefile for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-26 20:46:02 +00:00
Fabiano Fidêncio
f28af98ac6
Merge pull request #7453 from sprt/fix-ci-node-debugger
...
tests: Fix `k8s-job` test
2023-07-26 22:27:21 +02:00
Aurélien Bombo
6daeb08e69
tests: k8s: Clean up node debuggers after running
...
This deletes node debugger pods after execution since their presence may
affect tests that assume only test workloads pods are present.
For example, in `k8s-job` we wait for *any* pod to be in the `Succeeded`
state before proceeding, which causes failures.
Fixes : #7452
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-26 10:19:07 -07:00
Gabriela Cervantes
37641a5430
metrics: Add example config for fio jobs
...
This PR adds example config for fio jobs.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-26 16:03:12 +00:00
Aurélien Bombo
4703434b12
tests: k8s: Allow using custom resource group
...
This simply allows setting a custom resource group when debugging
locally, so as to prevent name collisions and not pollute the namespace.
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-25 15:45:44 -07:00
Aurélien Bombo
350f3f70b7
tests: Import common.bash
in run_kubernetes_tests.sh
...
Not sure why this works in GHA, but the `info` call on line 65 would
fail locally.
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-25 15:45:44 -07:00
Aurélien Bombo
d7f04a64a0
tests: k8s: Leave runtimeclass_workloads/
alone
...
Makes it so that `setup.sh` doesn't make changes in
`runtimeclass_workloads/` directly. Instead we treat that as a template
directory and we use the new directory `runtimeclass_workloads_work/` as
a work dir.
This has two advantages:
* Allows rerunning tests without the assumption that `setup.sh` must be
idempotent. E.g. the `set_runtime_class()` step would break.
* Doesn't pollute your git environment with a bunch of changes when
developing.
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-25 15:45:44 -07:00
Aurélien Bombo
bdde6aa948
tests: k8s: Split deployment and testing commands
...
This splits deploying Kata and running the tests into separate commands
to make it possible to rerun tests locally without having to redeploy
Kata each time.
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-25 15:44:46 -07:00
Aurélien Bombo
91a0b3b406
tests: aks: Simply delete cluster when cleaning up
...
If we're going to delete the cluster anyway, no need to call
kata-cleanup.
Fixes : #7454
Signed-off-by: Aurélien Bombo <abombo@microsoft.com >
2023-07-25 15:44:46 -07:00
Gabriela Cervantes
3c1044d9d5
metrics: Update FIO paths for k8s runner
...
This PR updates the FIO paths for k8s runner.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-25 20:50:03 +00:00
Gabriela Cervantes
6177a0db3e
metrics: Add env files for FIO
...
This PR adds the env files for FIO for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-25 17:48:45 +00:00
Gabriela Cervantes
a45900324d
metrics: Add fio exec
...
This PR adds fio exec for the FIO benchmark.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-25 17:36:08 +00:00