Updated the demo and API docs for the latest API release with support of clothing-only images (on ghost mannequins or flat lay photos)

README.md

@@ -4,7 +4,7 @@ emoji: 👗
 colorFrom: indigo
 colorTo: purple
 sdk: gradio
-sdk_version: 5.6.0
+sdk_version: 5.9.0
 app_file: app.py
 pinned: false
 short_description: Diffusion-based multi-modal virtual try-on pipeline demo

app.py

@@ -133,7 +133,7 @@ with gr.Blocks(theme=gr.themes.Soft(), delete_cache=(3600, 3600)) as app:
                 clothing_image = gr.Image(label="Clothing Image", sources=["upload"], type="numpy")
 
                 clothing_image_examples = gr.Examples(
-                    inputs=clothing_image, examples_per_page=12, examples=get_examples("clothing")
+                    inputs=clothing_image, examples_per_page=18, examples=get_examples("clothing")
                 )
 
             with gr.Tab("Prompt"):
@@ -175,7 +175,7 @@ with gr.Blocks(theme=gr.themes.Soft(), delete_cache=(3600, 3600)) as app:
 
                 avatar_image_examples = gr.Examples(
                     inputs=avatar_image,
-                    examples_per_page=12,
+                    examples_per_page=18,
                     examples=get_examples("avatar"),
                 )
 
@@ -224,7 +224,7 @@ with gr.Blocks(theme=gr.themes.Soft(), delete_cache=(3600, 3600)) as app:
                 background_image = gr.Image(label="Background Image", sources=["upload"], type="numpy")
 
                 background_image_examples = gr.Examples(
-                    inputs=background_image, examples_per_page=12, examples=get_examples("background")
+                    inputs=background_image, examples_per_page=18, examples=get_examples("background")
                 )
 
             with gr.Tab("Prompt"):

docs/API.md

@@ -21,11 +21,13 @@
     * [Image-based virtual try-on with background](#image-based-virtual-try-on-with-background)
     * [Avatar from a text prompt](#avatar-from-a-text-prompt)
     * [Clothing from a text prompt](#clothing-from-a-text-prompt)
+    * [Modifying clothing](#modifying-clothing)
     * [Modifying avatar's body](#modifying-avatars-body)
     * [Txt2Img](#txt2img)
     * [Other creative possibilities](#other-creative-possibilities)
   * [Performance](#performance)
   * [Known Issues and Limitations](#known-issues-and-limitations)
+  * [Changelog](#changelog)
 <!-- TOC -->
 
 ## Summary
@@ -114,7 +116,7 @@ For best results clothing reference images should meet a number of requirements:
 - Maximum file size: **12 MB**
 - Minimum image size: **256x256**
 - Recommended image size: **768x1024 and above**
-- Clothing should be **dressed on a person**. Some flat lay clothing photos might work, but currently it's not guaranteed
+- For best results clothing should be **dressed on a person** or **on a ghost mannequin**. Some flat lay clothing photos might work too, but currently it's not guaranteed.
 - **Single person** on the image (though multiple persons might also work)
 - **Frontal** photo, though some degree of rotation is fine
 - **Good lighting** conditions and **high image quality** as it directly affects the result
@@ -124,8 +126,8 @@ To summarize: the better is the clothing image the better is the final result.
 
 Examples of good clothing images:
 
-| <img src="images/clothing_image_01.jpg" width="240"> | <img src="images/clothing_image_02.jpg" width="240"> | <img src="images/clothing_image_03.jpg" width="240"> | <img src="images/clothing_image_04.jpg" width="240"> |
-|------------------------------------------------------|------------------------------------------------------|------------------------------------------------------|------------------------------------------------------|
+| <img src="images/clothing_image_01.jpg" width="240"> | <img src="images/clothing_image_02.jpg" width="240"> | <img src="images/clothing_image_03.jpg" width="240"> | <img src="images/clothing_image_04.jpg" width="240"> | <img src="images/clothing_image_05.jpg" width="240"> | <img src="images/clothing_image_06.jpg" width="240"> |
+|------------------------------------------------------|------------------------------------------------------|------------------------------------------------------|------------------------------------------------------|------------------------------------------------------|------------------------------------------------------|
 
 ### Clothing prompt
 
@@ -243,6 +245,7 @@ user avatar) while maintaining the avatar and the background.
 | Clothing Image                                       | Avatar Image                                       | Result Image                                             |
 |------------------------------------------------------|----------------------------------------------------|----------------------------------------------------------|
 | <img src="images/clothing_image_01.jpg" width="240"> | <img src="images/avatar_image_02.jpg" width="240"> | <img src="images/image_based_result_01.jpg" width="240"> |
+| <img src="images/clothing_image_05.jpg" width="240"> | <img src="images/avatar_image_02.jpg" width="240"> | <img src="images/image_based_result_02.jpg" width="240"> |
 
 ### Image-based virtual try-on with background
 
@@ -283,6 +286,15 @@ Similarly, you can specify clothing with a text prompt while providing an avatar
 | a sheer blue sleeveless mini dress  | <img src="images/avatar_image_02.jpg" width="240"> | <img src="images/clothing_prompt_result_01.jpg" width="240"> |
 | a colorful t-shirt and black shorts | <img src="images/avatar_image_03.jpg" width="240"> | <img src="images/clothing_prompt_result_02.jpg" width="240"> |
 
+### Modifying clothing
+
+It's possible to modify clothing to some extent using a clothing image and a clothing prompt simultaneously:
+
+| Clothing Image                                       | Clothing prompt   | Avatar Image                                       | Result Image                                                       |
+|------------------------------------------------------|-------------------|----------------------------------------------------|--------------------------------------------------------------------|
+| <img src="images/clothing_image_06.jpg" width="240"> | (long sleeves)+++ | <img src="images/avatar_image_03.jpg" width="240"> | <img src="images/clothing_modification_result_01.jpg" width="240"> |
+| <img src="images/clothing_image_03.jpg" width="240"> | shorts+++         | <img src="images/avatar_image_04.jpg" width="240"> | <img src="images/clothing_modification_result_02.jpg" width="240"> |
+
 ### Modifying avatar's body
 
 If you specify clothing and avatar images to be the same while providing an avatar prompt it's possible to change
@@ -315,9 +327,9 @@ replace the background in a creative way:
 It's also possible to use a combination of clothing image, clothing prompt, avatar image and a background to add some
 accessories:
 
-| Clothing Image                                       | Clothing Prompt          | Avatar Image                                         | Background Image                                       | Result Image                                                     |
-|------------------------------------------------------|--------------------------|------------------------------------------------------|--------------------------------------------------------|------------------------------------------------------------------|
-| <img src="images/avatar_image_02.jpg" width="240">   | a (light brown purse)+++ | <img src="images/avatar_image_02.jpg" width="240">   | <img src="images/background_image_03.jpg" width="240"> | <img src="images/accessory_result_01.jpg" width="240">           |
+| Clothing Image                                       | Clothing Prompt          | Avatar Image                                         | Background Image                                       | Result Image                                           |
+|------------------------------------------------------|--------------------------|------------------------------------------------------|--------------------------------------------------------|--------------------------------------------------------|
+| <img src="images/avatar_image_02.jpg" width="240">   | a (light brown purse)+++ | <img src="images/avatar_image_02.jpg" width="240">   | <img src="images/background_image_03.jpg" width="240"> | <img src="images/accessory_result_01.jpg" width="240"> |
 
 ## Performance
 
@@ -337,5 +349,14 @@ As any generative model, our models are not perfect (though we constantly work o
 - Currently, we do not support trying on a single garment, only the full look.
 - Hats and sunglasses are not currently transferred, but we are working on it.
 - Backgrounds might lack some clarity as currently we focus more on clothing.
-- In case of a specified background a hairstyle might change.
+- In case of a specified background a hairstyle might slightly change.
 - Body shape of the avatar might change towards smaller sizes.
+
+## Changelog
+
+The changelog below contains major API updates focusing on new features and other improvements.
+
+- **2024-12-15**: New API release brings support for clothing on ghost mannequins and (partially) flat lay clothing 
+  photos.
+
+- **2024-11-07**: Initial public API release.