sariola commited on
Commit
2a98223
1 Parent(s): 7aa3619

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -2
README.md CHANGED
@@ -56,10 +56,43 @@ autoawq 0.2.6
56
  autoawq_kernels 0.0.7
57
  ```
58
 
59
- ## Running the AWQ file
60
 
61
- TBD
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
 
 
63
 
64
  # Original model card: Flow-Judge-v0.1
65
 
 
56
  autoawq_kernels 0.0.7
57
  ```
58
 
59
+ ## Running the AWQ model
60
 
61
+ First install the flow judge library
62
+ ```shell
63
+ git clone https://github.com/flowaicom/flow-judge
64
+ cd flow-judge
65
+ pip install -e ".[vllm]"
66
+ ```
67
+
68
+ Quickstart with Python:
69
+ ```python
70
+ from flow_judge.models.model_factory import ModelFactory
71
+ from flow_judge.flow_judge import EvalInput, FlowJudge
72
+ from flow_judge.metrics import RESPONSE_CORRECTNESS_BINARY
73
+ from IPython.display import Markdown, display
74
+
75
+ # Create a model using ModelFactory
76
+ model = ModelFactory.create_model("Flow-Judge-v0.1-AWQ")
77
+
78
+ # Initialize the judge
79
+ judge = FlowJudge(
80
+ metric=RESPONSE_CORRECTNESS_BINARY,
81
+ model=model
82
+ )
83
+
84
+ # Prepare evaluation input
85
+ eval_input = EvalInput(
86
+ inputs=[{"question": "What is the capital of France?"}],
87
+ output="The capital of France is Paris."
88
+ )
89
+
90
+ # Perform evaluation
91
+ result = judge.evaluate(eval_input)
92
+ print(result)
93
+ ```
94
 
95
+ Discover more at our repository [https://github.com/flowaicom/flow-judge](https://github.com/flowaicom/flow-judge)
96
 
97
  # Original model card: Flow-Judge-v0.1
98