---
license: llama2
language: fr
pipeline_tag: text-generation
inference: false
tags:
- LLM
- llama-2
- finetuned
---

<p align="center" width="100%">
<img src="assets/logo.png" alt="Vigogne" style="width: 30%; min-width: 300px; display: block; margin: auto;">
</p>

# LLaMandement-13B: A Llama-2-based French Models for Summarization of French Legislative Proposals.

LLaMandement-13B is a French chat LLM, based on [LLaMA-2-13B](https://ai.meta.com/llama), optimized to summarize of French Legislative Proposals.

## Model Details

- **Developed by:** [DGFIP](https://www.impots.gouv.fr/presentation-de-la-dgfip-overview-dgfip) : 
- **Model type:** An auto-regressive language model based on the transformer architecture
- **License:** Llama 2 Community License Agreement
- **Finetuned from model:** [Llama 2](https://arxiv.org/abs/2307.09288)
- **Repository:** https://gitlab.adullact.net/dgfip/projets-ia/llamandement
- **Paper:** [Technical Report](https://arxiv.org/abs/2401.16182)

## Prompt Template


The prompt for LLaMandement-13B is based on alpaca template :

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{instruction}

### Response:
```

## How to Get Started with the Model

- Command line interface: https://github.com/lm-sys/FastChat
- APIs (OpenAI API, Huggingface API): https://github.com/lm-sys/FastChat/tree/main#api  


## Citation
```
@article{gesnouin2024llamandement,
  title={LLaMandement: Large Language Models for Summarization of French Legislative Proposals},
  author={Gesnouin, Joseph and Tannier, Yannis and Da Silva, Christophe Gomes and Tapory, Hatim and Brier, Camille and Simon, Hugo and Rozenberg, Raphael and Woehrel, Hermann and Yakaabi, Mehdi El and Binder, Thomas and others},
  journal={arXiv preprint arXiv:2401.16182},
  year={2024}
}
```