SRDdev

/

QABERT-small

like 0

Hey @kev703in ,
The model max new tokens length is 512 and as far as the context length I am not sure , but it takes around 2 small paragraphs like below.

Note: This model is for educational understanding only and may not perform well in all situations. Use discretion when relying on its output for critical tasks.

Paragraphs

Generative pre-trained transformers (GPT) are a type of large language model (LLM)[1][2][3] and a prominent framework for generative artificial intelligence.[4][5] They are artificial neural networks that are used in natural language processing tasks.[6] GPTs are based on the transformer architecture, pre-trained on large data sets of unlabelled text, and able to generate novel human-like content.[2][3] As of 2023, most LLMs have these characteristics[7] and are sometimes referred to broadly as GPTs.[8]

The first GPT was introduced in 2018 by OpenAI.[9] OpenAI has released very influential GPT foundation models that have been sequentially numbered, to comprise its "GPT-n" series.[10] Each of these was significantly more capable than the previous, due to increased size (number of trainable parameters) and training. The most recent of these, GPT-4, was released in March 2023.[11] Such models have been the basis for their more task-specific GPT systems, including models fine-tuned for instruction following—which in turn power the ChatGPT chatbot service.[1]

Thanks, it seems context length is also 512. i got the the context limit exceeded error.