kata-containers/tests/metrics/machine_learning
stevenhorsman 58672068ff shellcheck: Fix shellcheck SC2145
> Argument mixes string and array. Use * or separate argument.

- Swap echos for printfs and improve formatting
- Replace $@ with $*
- Split arrays into separate arguments

Signed-off-by: stevenhorsman <steven@uk.ibm.com>
2025-03-04 09:35:46 +00:00
..
mobilenet_v1_bfloat16_fp32_dockerfile metrics: General improvements to mobilenet tensorflow test 2023-08-07 16:50:00 +00:00
onednn-dockerfile metrics: Add onednn benchmark. 2024-04-09 09:05:51 -06:00
openvino-dockerfile metrics: Add openvino benchmark. 2024-04-09 09:05:51 -06:00
pytorch_dockerfile tests: Add Pytorch Dockerfile 2023-07-12 16:34:17 +00:00
resnet50_fp32_dockerfile metrics: Update packages needed for ResNet50 FP32 Dockerfile 2024-01-22 16:15:36 +00:00
resnet50_int8_dockerfile metrics: Update packages for TensorFlow ResNet Int8 Dockerfile 2024-01-29 16:11:09 +00:00
tensorflow_nhwc_dockerfile metrics: Use a specific python version to run tensorflow benchmark 2024-01-11 22:15:31 +00:00
onednn.sh metrics: Update openVINO and oneDNN tests references 2024-09-05 15:39:21 +00:00
openvino.sh metrics: Update openVINO and oneDNN tests references 2024-09-05 15:39:21 +00:00
pytorch.sh shellcheck: Fix shellcheck SC2145 2025-03-04 09:35:46 +00:00
README.md docs: Add oneDNN benchmark information to metrics README 2024-08-27 16:32:50 +00:00
tensorflow_mobilenet_v1_bfloat16_fp32.sh shellcheck: Fix shellcheck SC2145 2025-03-04 09:35:46 +00:00
tensorflow_nhwc.sh shellcheck: Fix shellcheck SC2145 2025-03-04 09:35:46 +00:00
tensorflow_resnet50_fp32.sh shellcheck: Fix shellcheck SC2145 2025-03-04 09:35:46 +00:00
tensorflow_resnet50_int8.sh shellcheck: Fix shellcheck SC2145 2025-03-04 09:35:46 +00:00

Kata Containers TensorFlow Metrics

Kata Containers provides a series of performance tests using the TensorFlow reference benchmarks (tf_cnn_benchmarks). The tf_cnn_benchmarks containers TensorFlow implementations of several popular convolutional models https://github.com/tensorflow/benchmarks/tree/master/scripts/tf_cnn_benchmarks.

Currently the TensorFlow benchmark on Kata Containers includes test for the AxelNet and ResNet50 models.

Running the test

Individual tests can be run by hand, for example:

$ cd metrics/machine_learning
$ ./tensorflow_nhwc.sh 25 60

Kata Containers Pytorch Metrics

Based on a suite of Python high performance computing benchmarks that uses various popular Python HPC libraries using Python https://github.com/dionhaefner/pyhpc-benchmarks.

Running the Pytorch test

Individual tests can be run by hand, for example:

$ cd metrics/machine_learning
$ ./pytorch.sh 40 100

Kata Containers TensorFlow MobileNet Metrics

MobileNets are small, low-latency, low-power models parameterized to meet the resource constraints of a variety of use cases. They can be built upon for classification, detection, embeddings and segmentation similar to how other popular large scale models, such as Inception, are used. MobileNets can be run efficiently on mobile devices with Tensorflow Lite.

Kata Containers provides a test for running MobileNet V1 inference using Intel-Optimized TensorFlow.

Running the TensorFlow MobileNet test

Individual test can be run by hand, for example:

$ cd metrics/machine_learning
$ ./tensorflow_mobilenet_benchmark.sh 25 60

Kata Containers TensorFlow ResNet50 Metrics

ResNet50 is an image classification model pre-trained on the ImageNet dataset. Kata Containers provides a test for running ResNet50 inference using Intel-Optimized TensorFlow.

Running the TensorFlow ResNet50 test

Individual test can be run by hand, for example:

$ cd metrics/machine_learning
$ ./tensorflow_resnet50_int8.sh 25 60

Kata Containers OpenVINO Benchmark

This is a toolkit around neural networks using its built-in benchmarking support and analyzing the throughput and latency for various models.

Running the OpenVINO test

Individual test can be run by hand, for example:

$ cd metrics/machine_learning
$ ./openvino.sh

Kata Containers oneDNN Benchmark

This is a test of the Intel oneDNN as an Intel optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality.

Running the oneDNN test

Individual test can be run by hand, for example:

$ cd metrics/machine_learning
$ ./onednn.sh