Update README.md

README.md

@@ -19,7 +19,23 @@ This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-intermediate-ste
 
 ## Model description
 
-More information needed
+```py
+import torch
+from transformers import pipeline, AutoTokenizer, TextStreamer
+import re
+tokenizer = AutoTokenizer.from_pretrained("TheBossLevel123/TinyAITA")
+pipe = pipeline("text-generation", model="TheBossLevel123/TinyAITA", torch_dtype=torch.bfloat16, device_map="auto")
+
+streamer=TextStreamer(tokenizer)
+```
+```py
+prompt = 'AITA for XYZ?'
+outputs = pipe(prompt, max_new_tokens=1024, do_sample=True, temperature=0.9, streamer=streamer, eos_token_id=tokenizer.encode("<|im_end|>"))
+if outputs and "generated_text" in outputs[0]:
+    text = outputs[0]["generated_text"]
+    print(f"Prompt: {prompt}")
+    print("")
+    print(text)```
 
 ## Intended uses & limitations