Update README.md

README.md

@@ -7,4 +7,38 @@ sdk: static
 pinned: false
 ---
 
-Edit this `README.md` markdown file to author your organization card.
+# Welcome to the 🧨 `diffusers` organization! 
+`diffusers` is the go-to library for state-of-the-art pretrained diffusion models for multi-modal generative AI. You can use it on [GitHub](https://github.com/huggingface/diffusers).
+
+In this organization, you can find some utilities and models the diffusers team has made for you 🫶 
+
+## 🆕 SDXL ControlNets
+The `diffusers` team is training ControlNets for Stable Diffusion XL
+
+### Small sized ControlNets
+
+The team is experimenting with training smaller ControlNets that can still retain their control capabilities. This is the [training script used](https://github.com/huggingface/diffusers/blob/7b93c2a882d8e12209fbaeffa51ee2b599ab5349/examples/research_projects/controlnet/train_controlnet_webdataset.py).
+Check out some of the models released, and please provide us with feedback on what you thought about them on our [Discord server](https://t.co/1n75wi976V?amp=1)
+
+| ControlNet                             | Size in fp16  |
+|-----------------------------------|---------------|
+| [`controlnet-canny-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-small) | 320MB         |
+| [`controlnet-canny-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-mid) | 545MB         |
+| [`controlnet-depth-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-small) | 320MB         |
+| [`controlnet-depth-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-mid) | 545MB         |
+
+### Full sized ControlNets
+
+The team has also trained full sized ControlNets - as big as the SDXL model (5GB in fp32). We have provided a [ControlNet training script and guide here](https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md)
+
+| ControlNet                             |
+|-----------------------------------|
+| [`controlnet-canny-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0) |
+| [`controlnet-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0) |
+
+### Utilities
+- [Convert Stable Diffusion XL weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sdxl-to-diffusers)
+- [Convert Stable Diffusion weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sd-to-diffusers)
+- [Convert diffusers models to `safetensors` format](https://huggingface.co/spaces/diffusers/convert)
+
+More coming soon ✨