Update README.md
Browse files
README.md
CHANGED
@@ -56,10 +56,43 @@ autoawq 0.2.6
|
|
56 |
autoawq_kernels 0.0.7
|
57 |
```
|
58 |
|
59 |
-
## Running the AWQ
|
60 |
|
61 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
62 |
|
|
|
63 |
|
64 |
# Original model card: Flow-Judge-v0.1
|
65 |
|
|
|
56 |
autoawq_kernels 0.0.7
|
57 |
```
|
58 |
|
59 |
+
## Running the AWQ model
|
60 |
|
61 |
+
First install the flow judge library
|
62 |
+
```shell
|
63 |
+
git clone https://github.com/flowaicom/flow-judge
|
64 |
+
cd flow-judge
|
65 |
+
pip install -e ".[vllm]"
|
66 |
+
```
|
67 |
+
|
68 |
+
Quickstart with Python:
|
69 |
+
```python
|
70 |
+
from flow_judge.models.model_factory import ModelFactory
|
71 |
+
from flow_judge.flow_judge import EvalInput, FlowJudge
|
72 |
+
from flow_judge.metrics import RESPONSE_CORRECTNESS_BINARY
|
73 |
+
from IPython.display import Markdown, display
|
74 |
+
|
75 |
+
# Create a model using ModelFactory
|
76 |
+
model = ModelFactory.create_model("Flow-Judge-v0.1-AWQ")
|
77 |
+
|
78 |
+
# Initialize the judge
|
79 |
+
judge = FlowJudge(
|
80 |
+
metric=RESPONSE_CORRECTNESS_BINARY,
|
81 |
+
model=model
|
82 |
+
)
|
83 |
+
|
84 |
+
# Prepare evaluation input
|
85 |
+
eval_input = EvalInput(
|
86 |
+
inputs=[{"question": "What is the capital of France?"}],
|
87 |
+
output="The capital of France is Paris."
|
88 |
+
)
|
89 |
+
|
90 |
+
# Perform evaluation
|
91 |
+
result = judge.evaluate(eval_input)
|
92 |
+
print(result)
|
93 |
+
```
|
94 |
|
95 |
+
Discover more at our repository [https://github.com/flowaicom/flow-judge](https://github.com/flowaicom/flow-judge)
|
96 |
|
97 |
# Original model card: Flow-Judge-v0.1
|
98 |
|