Code (Ran in Colab):

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g")
model = AutoModelForCausalLM.from_pretrained("anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g")

Paraphrase a tweet

def paraphrase_tweet(tweet):
input_ids = tokenizer.encode(tweet, return_tensors="pt")
output = model.generate(input_ids, max_length=200, num_return_sequences=1, early_stopping=True)
paraphrase = tokenizer.decode(output[0], skip_special_tokens=True)
return paraphrase

Example usage

tweet = "I'm so excited about the new project launch!"
paraphrased_tweet = paraphrase_tweet(tweet)
print("Original tweet:", tweet)
print("Paraphrased tweet:", paraphrased_tweet)

Error:

HTTPError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py in hf_raise_for_status(response, endpoint_name)
285 try:
--> 286 response.raise_for_status()
287 except HTTPError as e:

13 frames
HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g/resolve/main/pytorch_model-00001-of-00006.bin

The above exception was the direct cause of the following exception:

EntryNotFoundError Traceback (most recent call last)
EntryNotFoundError: 404 Client Error. (Request ID: Root=1-660c06ee-62d9a69b3cb8f87c199b9271;4b518daf-2105-40b8-96e1-b87d919e5d5f)

Entry Not Found for url: https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g/resolve/main/pytorch_model-00001-of-00006.bin.

The above exception was the direct cause of the following exception:

OSError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/transformers/utils/hub.py in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs)
450 if revision is None:
451 revision = "main"
--> 452 raise EnvironmentError(
453 f"{path_or_repo_id} does not appear to have a file named {full_filename}. Checkout "
454 f"'https://huggingface.co/{path_or_repo_id}/{revision}' for available files."

OSError: anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g does not appear to have a file named pytorch_model-00001-of-00006.bin. Checkout 'https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g/main' for available files.