EmbeddedLLM
/

Phi-3-mini-4k-instruct-062024-int4-onnx-directml

Text Generation

text-generation-inference

Model card Files Files and versions Community

ssyok commited on Jul 19

Commit

e8b5dfc

•

1 Parent(s): cd85391

Update README.md

Files changed (1) hide show

README.md +10 -10

README.md CHANGED Viewed

@@ -50,16 +50,16 @@ We measured the performance of DirectML on AMD Ryzen 9 7940HS /w Radeon 78
 | Prompt Length | Generation Length | Average Throughput (tps) |
 |---------------------------|-------------------|-----------------------------|
-| 128 | 128  | 53.46686 |
-| 128 | 256  | 53.11233 |
-| 128 | 512 | 57.45816 |
-| 128 | 1024 | 33.44713 |
-| 256 | 128  | 76.50182 |
-| 256 | 256  | 66.68873 |
-| 256 | 512 | 70.83862 |
-| 256 | 1024 | 34.64715 |
-| 512 | 128  | 85.10079 |
-| 512 | 256  | 68.64049 |
 | 512 | 512 | - |
 | 512 | 1024 | -  |
 | 1024 | 128  | - |

 | Prompt Length | Generation Length | Average Throughput (tps) |
 |---------------------------|-------------------|-----------------------------|
+| 128 | 128  | - |
+| 128 | 256  | - |
+| 128 | 512 | - |
+| 128 | 1024 | - |
+| 256 | 128  | - |
+| 256 | 256  | - |
+| 256 | 512 | - |
+| 256 | 1024 | - |
+| 512 | 128  | - |
+| 512 | 256  | - |
 | 512 | 512 | - |
 | 512 | 1024 | -  |
 | 1024 | 128  | - |