[example] llama3 (#5631)

* release llama3 * [release] llama3 * [release] llama3 * [release] llama3 * [release] llama3
2025-09-01 17:17:05 +00:00 · 2024-04-23 18:48:07 +08:00
parent 4de4e31818
commit f4c5aafe29
11 changed files with 26 additions and 4 deletions
--- a/examples/language/llama2/README.md
+++ b/examples/language/llama2/README.md
@@ -1,4 +1,10 @@
 # Pretraining LLaMA-1/2/3: best practices for building LLaMA-1/2/3-like base models
+### LLaMA3
+<p align="center">
+<img src="https://raw.githubusercontent.com/hpcaitech/public_assets/main/examples/images/LLaMA3-70B-H100.png" width=600/>
+</p>
+
+- 70 billion parameter LLaMA3 model training accelerated by 18%

 ### LLaMA2
 <p align="center">
--- a/examples/language/llama2/benchmark.py
+++ b/examples/language/llama2/benchmark.py
--- a/examples/language/llama2/requirements.txt
+++ b/examples/language/llama2/requirements.txt
--- a/examples/language/llama2/scripts/benchmark_70B/3d.sh
+++ b/examples/language/llama2/scripts/benchmark_70B/3d.sh
--- a/examples/language/llama2/scripts/benchmark_70B/gemini.sh
+++ b/examples/language/llama2/scripts/benchmark_70B/gemini.sh
--- a/examples/language/llama2/scripts/benchmark_70B/gemini_auto.sh
+++ b/examples/language/llama2/scripts/benchmark_70B/gemini_auto.sh
--- a/examples/language/llama2/scripts/benchmark_7B/gemini.sh
+++ b/examples/language/llama2/scripts/benchmark_7B/gemini.sh
--- a/examples/language/llama2/scripts/benchmark_7B/gemini_auto.sh
+++ b/examples/language/llama2/scripts/benchmark_7B/gemini_auto.sh
--- a/examples/language/llama2/test_ci.sh
+++ b/examples/language/llama2/test_ci.sh