Update README.md

README.md

@@ -14,7 +14,7 @@ tags:
 This repository contains [**AWS Inferentia2**](https://aws.amazon.com/ec2/instance-types/inf2/) and [`neuronx`](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/) compatible checkpoints for [upstage/SOLAR-10.7B-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-v1.0).
 You can find detailed information about the base model on its [Model Card](https://huggingface.co/upstage/SOLAR-10.7B-v1.0).
 
-This model card also includes instructions for how to compile other SOLAR models with other settings if this combination isn't quite what you are looking for.
+This model card also includes instructions for how to compile other SOLAR models with other settings if this combination isn't what you are looking for.
 
 This model has been exported to the `neuron` format using specific `input_shapes` and `compiler` parameters detailed in the paragraphs below.  
 
@@ -26,7 +26,10 @@ Please refer to the 🤗 `optimum-neuron` [documentation](https://huggingface.co
 
 ## Set up the environment
 
-First, use the [DLAMI image from Hugging Face](https://aws.amazon.com/marketplace/pp/prodview-gr3e6yiscria2).  It has most of the utilities and drivers preinstalled.  However, you may need to update to version 2.16 to use these binaries.
+First, use the [DLAMI image from Hugging Face](https://aws.amazon.com/marketplace/pp/prodview-gr3e6yiscria2).  It has most of the utilities and drivers preinstalled, but hasn't been updated to 2.16 as of 1/13/24.  
+However, you will need version 2.16 to use these binaries. 2.16 shows a significant performance increase over 2.15 for Llama based models.
+
+The commands below will update your 2.15 libraries to 2.16.
 
 ```
 sudo apt-get update -y \
@@ -67,10 +70,11 @@ Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
 [{'generated_text': 'Hi, my name is ***** ***** I am calling from ***** ***** and I am calling to see if you have any questions about your ***** ***** account.\nHi, my name is ***** ***** I am calling from ***** ***** and I am calling to see if you have any questions about your ***** ***** account.\nHi, my name is ***** ***** I am calling from ***** ***** and I am calling to see if you have any questions about your ***** ***** account.\nHi, my name is ***** ***** I am calling from ***** ***** and I am calling to see if you have any questions about your ***** ***** account.\nHi, my name is ***** ***** I am calling from ***** ***** and I am calling to see if'}]
 ```
 
-##Compiling for different instances or settings
+## Compiling for different instances or settings
 
 If this repository doesn't have the exact version or settings, you can compile your own.
 
+```
 from optimum.neuron import NeuronModelForCausalLM
 #num_cores should be changed based on the instance.  inf2.24xlarge has 6 neuron processors (they have two cores each) so 12 total
 input_shapes = {"batch_size": 1, "sequence_length": 4096}
@@ -81,6 +85,7 @@ model.save_pretrained("SOLAR-10.7B-v1.0-neuron-24xlarge-2.16-8core-4096")
 from transformers import AutoTokenizer
 tokenizer = AutoTokenizer.from_pretrained("upstage/SOLAR-10.7B-v1.0")
 tokenizer.save_pretrained("SOLAR-10.7B-v1.0-neuron-24xlarge-2.16-8core-4096")
+```
 
 This repository contains tags specific to versions of `neuronx`. When using with 🤗 `optimum-neuron`, use the repo revision specific to the version of `neuronx` you are using, to load the right serialized checkpoints.