Update README.md
Browse files
README.md
CHANGED
@@ -15,6 +15,8 @@ tags:
|
|
15 |
|
16 |
# Regional bengali text to IPA transcription - byT5-small
|
17 |
|
|
|
|
|
18 |
This is a fine-tuned version of the [google/byt5-small](https://huggingface.co/google/byt5-small) for the task of generating IPA transcriptions from regional bengali text.
|
19 |
This was done on the dataset of the competition [“ভাষামূল: মুখের ভাষার খোঁজে“](https://www.kaggle.com/competitions/regipa/overview) by Bengali.AI.
|
20 |
|
@@ -56,6 +58,12 @@ from transformers import pipeline
|
|
56 |
device = "cuda" if torch.cuda.is_available() else "cpu"
|
57 |
|
58 |
pipe = pipeline("text2text-generation", model="smji/ben2ipa-byt5small", device=device)
|
|
|
|
|
|
|
|
|
|
|
|
|
59 |
```
|
60 |
|
61 |
## Credits
|
|
|
15 |
|
16 |
# Regional bengali text to IPA transcription - byT5-small
|
17 |
|
18 |
+
## A word of caution: the model is constantly being updated! You may see jumps in performance
|
19 |
+
|
20 |
This is a fine-tuned version of the [google/byt5-small](https://huggingface.co/google/byt5-small) for the task of generating IPA transcriptions from regional bengali text.
|
21 |
This was done on the dataset of the competition [“ভাষামূল: মুখের ভাষার খোঁজে“](https://www.kaggle.com/competitions/regipa/overview) by Bengali.AI.
|
22 |
|
|
|
58 |
device = "cuda" if torch.cuda.is_available() else "cpu"
|
59 |
|
60 |
pipe = pipeline("text2text-generation", model="smji/ben2ipa-byt5small", device=device)
|
61 |
+
|
62 |
+
|
63 |
+
"""
|
64 |
+
Texts must be in the format of: <district> <contents>
|
65 |
+
"""
|
66 |
+
outputs = pipe(texts, max_length=1024, batch_size=batch_size)
|
67 |
```
|
68 |
|
69 |
## Credits
|