Liu Wenyuan
61fe20cf9a
gha: Fix some of gha metrics failure for StratoVirt
...
Update the Speed & Density metric tests baseline for StratoVirt
and re-enable them, and skip other metric tests temporarily.
Fixes : #8656
Signed-off-by: Liu Wenyuan <liuwenyuan9@huawei.com >
2023-12-15 17:45:01 +08:00
Gabriela Cervantes
37633d3cc2
metrics: Fix iperf parallel bandwidth limit
...
This PR fixes the iperf parallel bandwidth limit for the kata
metrics CI.
Fixes #8530
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-11-29 19:59:45 +00:00
Liu Wenyuan
c77e990c3e
tests: Enable tests for StratoVirt hypervisor
...
This commit enables StratoVirt hypervisor to be tested in kata GHA,
incluing k8s, metrics, cri-containerd, nydus and so on.
Meanwhile, adding some unit tests for StratoVirt to make sure it works.
Fixes : #7794
Signed-off-by: Liu Wenyuan <liuwenyuan9@huawei.com >
2023-11-16 20:47:26 +08:00
David Esparza
c232869af9
metrics: removes double-quotes in checkemtrics when parsing results
...
This PR removes double quotes in jq output to return raw strings
as input of checkmetrics tool.
Fixes : #8331
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-10-30 09:43:03 -06:00
David Esparza
1626253d9e
metrics: FIO ci test enablement
...
This PR enables the new FIO test based on the containerd client
which is used to track the I/O metrics in the kata-ci environment.
Additionally this PR fixes the parsing of results.
Fixes : #8199
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-10-30 09:42:54 -06:00
Gabriela Cervantes
8d66ef5185
metrics: Increase qemu jitter value
...
This PR increases qemu jitter value.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-27 17:31:07 +00:00
Gabriela Cervantes
5600e28b54
metrics: Increase jitter value for clh
...
This PR increases jitter value for clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-27 17:30:19 +00:00
Gabriela Cervantes
e90440ae24
metrics: Add qemu latency value limit
...
This PR adds the qemu latency value limit for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-26 17:30:09 +00:00
Gabriela Cervantes
a74a8f8a9d
metrics: Add latency value limits for kata CI
...
This PR adds latency value limits for kata CI.
Fixes #8067
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-26 17:29:07 +00:00
Gabriela Cervantes
9aa8d1c917
metrics: Add parallel bandwidth limit for qemu
...
This PR adds the parallel bandwidth limit for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-18 21:08:54 +00:00
Gabriela Cervantes
af59d4bf4a
metrics: Enable parallel bandwidth iperf limit
...
This PR enables the parallel bandwidth iperf limit for kata metrics.
Fixes #7989
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-18 16:32:11 +00:00
Gabriela Cervantes
cd4fd1292a
metrics: Add iperf cpu utilization limit for qemu
...
This PR adds the iperf cpu utilization limit for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-14 17:17:47 +00:00
Gabriela Cervantes
df5cd10ea0
metrics: Add iperf value for cpu utilization
...
This PR adds the iperf value for cpu utilization for kata metrics.
Fixes #7936
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-14 16:06:49 +00:00
Gabriela Cervantes
49e2fa189c
metrics: Increase jitter value for qemu
...
This PR increases the jitter value for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-13 22:36:09 +00:00
Gabriela Cervantes
49234433a7
metrics: Increase value limit for jitter in clh
...
This PR increases the value limit for jitter in clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-13 21:27:08 +00:00
Gabriela Cervantes
0aa073967d
metrics: Add iperf bandwidth value for qemu
...
This PR adds the iperf bandwidth value for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-12 20:57:14 +00:00
Gabriela Cervantes
615c1cbf19
metrics: Add iperf bandwidth value for kata metrics
...
This PR adds the iperf bandwidth value for kata metrics.
Fixes #7924
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-12 19:30:24 +00:00
David Esparza
a58ea66592
metrics: this PR skips the FIO test temprarily to fix issues
...
FIO test is showing ongoing issues when running in k8s.
Working on running FIO on the ctr client which has been
shown to be stable.
Fixes : #7920
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-09-12 10:23:57 -06:00
Gabriela Cervantes
438fbf9669
metrics: Add write 95 percentile for FIO for qemu
...
This PR adds the write 95 percentile for FIO for qemu for
checkmetrics for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-05 22:50:31 +00:00
Gabriela Cervantes
024b4d2ffe
metrics: Add write 95 percentile FIO value
...
This PR adds the write 95 percentile FIO value for checkmetrics
for kata metrics.
Fixes #7842
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-05 21:00:05 +00:00
Gabriela Cervantes
e98e5cdea2
metrics: Add checkmetrics to gha run script
...
This PR adds the checkmetrics to gha run script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-05 17:05:03 +00:00
Gabriela Cervantes
c1edfe5511
metrics: Add checkmetrics value for qemu for iperf
...
This PR adds the checkmetrics value for qemu for iperf benchmark.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-05 16:04:52 +00:00
Gabriela Cervantes
6a79ecedf9
metrics: Add jitter value for clh
...
This PR adds jitter value for clh for iperf metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-09-05 16:04:52 +00:00
Gabriela Cervantes
a7b59a5bf9
metrics: Add limit for 90 percentile for qemu value
...
This PR adds the limit for 90 percentile for qemu value for
FIO kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-30 13:53:38 +00:00
Gabriela Cervantes
99db6568e9
metrics: Add limit for write 90 percentile value for clh
...
This PR adds the limit for write 90 percentile value for clh for
FIO metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-30 13:53:38 +00:00
Gabriela Cervantes
c8dd3c0737
metrics: Fix memory footprint qemu limit
...
This PR fixes the memory footprint qemu limit for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-29 22:51:21 +00:00
Gabriela Cervantes
8877ec62fb
metrics: Fix memory inside limits for kata metrics
...
This PR fixes the memory inside limit for clh for kata metrics due
to the recent changes that we had in the script which impacted
in the performance measurement.
Fixes #7786
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-29 21:38:18 +00:00
Gabriela Cervantes
e8a5119343
metrics: Fix check results for tensorflow benchmark
...
This PR fixes the check results for tensorflow benchmark now
that we change the name of the test.
Fixes #7684
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-17 19:52:45 +00:00
David Esparza
542012c8be
Merge pull request #7503 from GabyCT/topic/ghafio
...
metrics: Add FIO test to gha for kata metrics CI
2023-08-02 10:05:09 -06:00
Gabriela Cervantes
ad6e53c399
metrics: Modify boot time values
...
This PR modifies boot time values limit.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 23:34:15 +00:00
Gabriela Cervantes
bee1a628bd
metrics: Fix json result for tensorflow
...
This PR fixes the json result for tensorflow.i
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 17:02:16 +00:00
Gabriela Cervantes
51cd99c927
metrics: Round axelnet and resnet results
...
This PR rounds the axelnet and resnet results in order to extract
properly the result.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
3b883bf5a7
metrics: Fix atoi invalid syntax
...
This PR will avoid to have the strconv.atoi parsing error when we
are retrieving the results from the json.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
53af71cfd0
checkmetrics: Add AlexNet value for qemu
...
This PR adds AlexNet value for qemu for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
a435d36fe1
checkmetrics: Add Resnet value for qemu
...
This PR adds the Resnet value for qemu for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
a79a3a8e1d
checkmetrics: Add alexnet value for clh
...
This PR adds the AlexNet value for clh for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
3c32875046
checkmetrics: Add Resnet value for clh
...
This PR adds the checkmetrics Resnet value for clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
0c84270357
metrics: Add boot time value for qemu
...
This PR adds the boot time value and limit for qemu.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 20:06:24 +00:00
Gabriela Cervantes
6520dfee37
metrics: Update boot time for kata metrics
...
This PR updates the boot time limit for kata metrics.
Fixes #7475
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-27 19:14:19 +00:00
David Esparza
01450deb6a
Revert "metrics: Replace backslashes used to escape double quoted key in jq expr."
...
This reverts commit 468f017e21
.
Fixes : #7385
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-07-19 10:07:11 -06:00
David Esparza
468f017e21
metrics: Replace backslashes used to escape double quoted key in jq expr.
...
This PR uses squared brackets in a jq expression to access
key values corresponding to metric results in json format.
The values are the data inputs into the checkmetrics tool.
Fixes : #7319
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-07-14 18:41:41 +00:00
Gabriela Cervantes
9e048c8ee0
checkmetrics: Add blogbench read value for qemu
...
This PR adds the blogbench read value for qemu.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-12 20:38:27 +00:00
Gabriela Cervantes
2935aeb7d7
checkmetrics: Add blogbench write value for qemu
...
This PR adds the blogbench write value for qemu limit.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-12 20:37:27 +00:00
Gabriela Cervantes
02031e29aa
checkmetrics: Add blogbench read value for clh
...
This PR adds the blogbench read value for clh limit.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-12 20:37:27 +00:00
Gabriela Cervantes
107fae033b
checkmetrics: Add blogbench write value for clh
...
This PR adds the blogbench write value limit for clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-12 20:37:27 +00:00
Gabriela Cervantes
310e069f73
checkmetrics: Enable checkmetrics for memory inside test
...
This PR enables the checkmetrics to include the memory inside
container test.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-10 17:05:13 +00:00
Gabriela Cervantes
2be342023b
checkmetrics: Add memory usage inside container value for qemu
...
This PR adds the memory usage inside container value for qemu.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-07 16:28:28 +00:00
Gabriela Cervantes
6ca34f949e
checkmetrics: Add memory inside container value for clh
...
Add memory inside container value for clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-07 16:28:28 +00:00
Gabriela Cervantes
6acce83e12
metrics: Fix the call to check_metrics function
...
This PR fixes the call to check_metrics function as KATA_HYPERVISOR
is not needed to be passed.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-06 17:22:49 +00:00
Gabriela Cervantes
5a61065ab7
checkmetrics: Add checkmetrics value for memory usage in qemu
...
This PR adds the checkmetrics value for memory usage in qemu.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-05 19:22:12 +00:00