{"id":54,"date":"2023-01-26T16:15:34","date_gmt":"2023-01-26T22:15:34","guid":{"rendered":"https:\/\/promptphantom.com\/?p=54"},"modified":"2023-01-28T11:05:59","modified_gmt":"2023-01-28T17:05:59","slug":"the-beginners-guide-to-img2img-in-stable-diffusion","status":"publish","type":"post","link":"https:\/\/promptphantom.com\/the-beginners-guide-to-img2img-in-stable-diffusion\/","title":{"rendered":"The Beginner&#8217;s Guide to Img2Img in Stable Diffusion"},"content":{"rendered":"<h3 class=\"wp-block-heading\" id=\"part-2-using-img2img-in-the-stable-diffusion-web-ui\"><em>Part 2: Using IMG2IMG in the Stable Diffusion Web UI <\/em><\/h3>\n\n\n<p>In <a data-type=\"post\" data-id=\"15\" href=\"https:\/\/promptphantom.com\/the-complete-beginners-guide-to-the-stable-diffusion-interface\/\" target=\"_blank\" rel=\"noreferrer noopener\">Part 1<\/a> of this tutorial series, we reviewed the controls and work areas in the Txt2img section of Automatic1111\u2019s Web UI. If you haven\u2019t read that yet, I suggest you do so before moving onto this part. Now it\u2019s time to examine the controls and parameters related to Img2img generation.<\/p>\n\n\n<div role=\"navigation\" aria-label=\"Table of Contents\" class=\"simpletoc wp-block-simpletoc-toc\"><h2 style=\"margin: 0;\"><button type=\"button\" aria-expanded=\"false\" aria-controls=\"simpletoc-content-container\" class=\"simpletoc-collapsible\">Table of Contents<span class=\"simpletoc-icon\" aria-hidden=\"true\"><\/span><\/button><\/h2><div id=\"simpletoc-content-container\" class=\"simpletoc-content\"><ul class=\"simpletoc-list\">\n\n<li><a href=\"#technical-details\">Technical Details<\/a>\n\n<\/li>\n<li><a href=\"#img2img\">Img2img<\/a>\n\n<\/li>\n<li><a href=\"#img2img-upload-window\">Img2img Upload Window<\/a>\n\n<\/li>\n<li><a href=\"#interrogate-clip-feature\">Interrogate CLIP Feature<\/a>\n\n\n<ul><li>\n<a href=\"#adding-artist-names-in-clip\">Adding Artist Names in CLIP<\/a>\n\n<\/li>\n<\/ul>\n<li><a href=\"#resizing-options\">Resizing Options<\/a>\n\n<\/li>\n<li><a href=\"#denoising-strength\">Denoising Strength<\/a>\n\n\n<ul><li>\n<a href=\"#weighing-prompt-vs-source\">Weighing Prompt vs Source<\/a>\n\n<\/li>\n<\/ul>\n<li><a href=\"#inpainting-amp-outpainting\">Inpainting &amp; Outpainting<\/a>\n\n\n<ul><li>\n<a href=\"#a-bit-of-drawing-required\">A Bit of Drawing Required<\/a>\n\n<\/li>\n<li><a href=\"#denoising-strength-is-vital-for-inpainting\">Denoising Strength is Vital for Inpainting<\/a>\n\n<\/li>\n<\/ul>\n<li><a href=\"#batch-img2img\">Batch Img2Img<\/a>\n\n<\/li>\n<li><a href=\"#web-ui-extra-features\">Web UI Extra Features<\/a>\n\n\n<ul><li>\n<a href=\"#extras-tab\">Extras Tab<\/a>\n\n\n<\/li>\n\n<li><a href=\"#png-info-tab\">PNG Info Tab<\/a>\n\n<\/li>\n<li><a href=\"#checkpoint-merger\">Checkpoint Merger<\/a>\n\n<\/li>\n<li><a href=\"#create-aesthetic-embedding\">Create Aesthetic Embedding<\/a>\n\n<\/li>\n<li><a href=\"#settings\">Settings<\/a>\n\n<\/li>\n<li><a href=\"#extensions\">Extensions<\/a>\n\n<\/li>\n<\/ul>\n<li><a href=\"#conclusion\">Conclusion<\/a>\n<\/li><\/ul><\/div><\/div>\n\n<h1 class=\"wp-block-heading\" id=\"technical-details\">Technical Details<\/h1>\n\n\n<p>Just like the previous entry in this guide, I will be using Automatic1111\u2019s Web UI running on my own computer. Furthermore, I\u2019m running Stable Diffusion locally on a computer with the following specs:<\/p>\n\n\n\n<ul>\n<li><strong>CPU:<\/strong> AMD Ryzen 5 3600<\/li>\n\n\n\n<li><strong>RAM: <\/strong>16GB<\/li>\n\n\n\n<li><strong>GPU: <\/strong>NVIDIA GeForce RTX 3060 with 12GB of VRAM<\/li>\n<\/ul>\n\n\n\n<p><em>Quick Note<\/em><em>: <\/em><em>A<\/em><em>ll my example images in this guide were done at 512&#215;512 pixels unless stated otherwise.<\/em><\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"img2img\">Img2img<\/h1>\n\n\n<p>The basis of latent diffusion image generation up to this point has been centered around the creation of images by using text descriptions alone. But now the real fun begins, because with Img2img features we can use a pre-existing picture to influence and control our AI-assisted creations!<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"385\" src=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Input-Area-1024x385.jpg\" alt=\"\" class=\"wp-image-55\" srcset=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Input-Area-1024x385.jpg 1024w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Input-Area-300x113.jpg 300w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Input-Area-768x288.jpg 768w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Input-Area-1536x577.jpg 1536w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Input-Area.jpg 1813w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>When you open the Web UI, you\u2019ll see several tabs near the top; the second one says \u201cimg2img\u201d. Let\u2019s click on that and have a look around. As you peruse the Img2img work area, you\u2019ll notice that most of the parameter controls from the Txt2img section are present: steps, methods, size, etc. But we do have a few new controls and features. We\u2019ll inspect each one; they include:<\/p>\n\n\n\n<ul>\n<li>The Img2img Upload Window<\/li>\n\n\n\n<li>Interrogate CLIP<\/li>\n\n\n\n<li>Resizing<\/li>\n\n\n\n<li>Denoising Strength<\/li>\n<\/ul>\n\n\n<h1 class=\"wp-block-heading\" id=\"img2img-upload-window\">Img2img Upload Window<\/h1>\n\n\n<p>On the left side of your screen, you will now see a second image window that says \u201cDrop Image Here or Click to Upload\u201d. This is where a source image can be loaded in, from which we can create countless variations or modifications. You still need to add a text prompt, and one that matches your source image at least vaguely. But what Stable Diffusion will do is look at the uploaded picture and make it\u2019s own version of that visual including any additions you\u2019ve mentioned in your prompt.<\/p>\n\n\n\n<p>Let\u2019s start this guided process by picking a photo from which to work. The image I\u2019m loading into my interface is a free stock photo taken from the site Pexels. You can download the same image <a href=\"https:\/\/www.pexels.com\/photo\/wet-road-in-between-trees-3090955\/\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a> if you want to follow along.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full\"><img decoding=\"async\" width=\"640\" height=\"960\" src=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/pexels-michael-foster-3090955.jpg\" alt=\"\" class=\"wp-image-56\" srcset=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/pexels-michael-foster-3090955.jpg 640w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/pexels-michael-foster-3090955-200x300.jpg 200w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><figcaption class=\"wp-element-caption\"><a href=\"https:\/\/www.pexels.com\/photo\/wet-road-in-between-trees-3090955\/\" data-type=\"URL\" data-id=\"https:\/\/www.pexels.com\/photo\/wet-road-in-between-trees-3090955\/\" target=\"_blank\" rel=\"noreferrer noopener\">Photo <\/a>by Michael Foster from Pexels<\/figcaption><\/figure>\n\n\n<h1 class=\"wp-block-heading\" id=\"interrogate-clip-feature\">Interrogate CLIP Feature<\/h1>\n\n\n<p>To the right of the text prompt boxes, and just to the left of the \u201cGenerate\u201d button, you will see a new button named \u201cInterrogate CLIP\u201d. This very nifty addition will inspect an image that you upload into the prior window and spit out a text prompt that the AI thinks will match the image.<\/p>\n\n\n\n<p><strong>Now keep in mind that this interrogation is not perfect and you will likely want to tweak it for accuracy. But it\u2019s a very useful command that allows us to learn a little bit about how Stable Diffusion interprets image data.<\/strong><\/p>\n\n\n\n<p>Using the stock photo I selected, I ran \u201cInterrogate CLIP\u201d and got the following text prompt:<\/p>\n\n\n\n<pre class=\"wp-block-verse\"><em>a road in the middle of a forest with trees in the background and a yellow sign on the side of the road, by Dan Smith<\/em><\/pre>\n\n\n<h2 class=\"wp-block-heading\" id=\"adding-artist-names-in-clip\">Adding Artist Names in CLIP<\/h2>\n\n\n<p>The interrogation mostly fits the photo, but it will often add an artist name to the prompt&#8230;and usually I\u2019ll find that the artist name doesn\u2019t really match the style of the photo. In this case, Stable Diffusion is suggesting an art style by \u201cDan Smith\u201d. As far as I can find, Dan Smith is a graphic illustrator. I would prefer a photographic medium for my img2img variation, so I\u2019ll be replacing \u201cDan Smith\u201d with the name of a well-known photographer: Inga Seliverstova<\/p>\n\n\n\n<p>There are a few other modifiers I would add to this prompt depending on what kind of art medium or style I want from my output image. I will add the following terms to my prompt:<\/p>\n\n\n\n<ul>\n<li>\u201crealistic photo of\u201d to inform Stable Diffusion that the image should resemble photographs over other formats of art or imagery<\/li>\n\n\n\n<li>\u201c50mm lens\u201d in lead Stable Diffusion towards more photos in it\u2019s model training that used a narrow focal length<\/li>\n\n\n\n<li>\u201cautumn\u201d to specify that the image should have a warm color palette with red, yellow, orange leaves<\/li>\n<\/ul>\n\n\n\n<p>My prompt now looks like this:<\/p>\n\n\n\n<pre class=\"wp-block-verse\"><em>realistic photo of a road in the middle of an autumn forest with trees in the background and a yellow sign on the side of the road, by Inga Seliverstova, 50mm lens<\/em><\/pre>\n\n\n\n<p>Now before I generate an image from this new prompt, we need to review a few more controls in the Img2img work area.<\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"resizing-options\">Resizing Options<\/h1>\n\n\n<p>Just below the Upload Window, you\u2019ll see three bubble buttons related to resizing and cropping. The button that you select will determine how Stable Diffusion crops your source image to match the image size of the desired output.<\/p>\n\n\n\n<ul>\n<li><strong>Just resize<\/strong> means the AI will squash or stretch the image to match your output dimensions; this will usually cause distortion to the results.<\/li>\n\n\n\n<li><strong>Crop and resize<\/strong> means the AI will cut down the source image to match the aspect ratio of your output dimensions and then resize; this will deliver the best results if your input and output dimensions will be in different aspect ratios.<\/li>\n\n\n\n<li><strong>Resize and fill <\/strong>will adjust the output image to match the dimensions of your input image and then any extra space on the top, bottom, or sides will be filled with pixels of color from your image.<\/li>\n<\/ul>\n\n\n\n<p><strong>I always select Crop and resize for my images if they are not both square. <\/strong>It delivers the best results without distorted dimensions or extra noise borders.<\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"denoising-strength\">Denoising Strength<\/h1>\n\n\n<p>Next, we\u2019ll skip down past the step, size, batch, and CFG scale controls and instead look at \u201cDenoising strength\u201d. But what exactly does that term mean, and why is it important?<\/p>\n\n\n\n<p><strong>Denoising strength tells the AI how closely it should match the source image.<\/strong> If you select \u201c0\u201d, Stable Diffusion will generate an almost-exact image compared to your input; at \u201c1\u201d, the image it generates will have nothing to do with the input photo. The strength of denoising you choose will depend on how similar you want your output image to be when compared back to your source.<\/p>\n\n\n\n<p>Let\u2019s start generating variations to show you how low and high denoising strengths alter your results:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><img decoding=\"async\" width=\"500\" height=\"500\" class=\"wp-image-57\" style=\"width: 500px;\" src=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00567-1331767675-Denoising-0.png\" alt=\"\" srcset=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00567-1331767675-Denoising-0.png 512w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00567-1331767675-Denoising-0-300x300.png 300w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00567-1331767675-Denoising-0-150x150.png 150w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><\/td><td><img loading=\"lazy\" decoding=\"async\" width=\"500\" height=\"500\" class=\"wp-image-58\" style=\"width: 500px;\" src=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00568-3739786560-Denoising-half.png\" alt=\"\" srcset=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00568-3739786560-Denoising-half.png 512w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00568-3739786560-Denoising-half-300x300.png 300w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00568-3739786560-Denoising-half-150x150.png 150w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><\/td><td><img loading=\"lazy\" decoding=\"async\" width=\"500\" height=\"500\" class=\"wp-image-59\" style=\"width: 500px;\" src=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00569-616231958-Denoising-1.png\" alt=\"\" srcset=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00569-616231958-Denoising-1.png 512w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00569-616231958-Denoising-1-300x300.png 300w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/00569-616231958-Denoising-1-150x150.png 150w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><\/td><\/tr><tr><td><strong>Prompt: <\/strong><em>realistic photo of a road in the middle of an autumn forest with trees in the background and a yellow sign on the side of the road, by Inga Seliverstova, 50mm lens<\/em><br>Resizing: Crop and resize<br><strong>Steps: <\/strong>20<br><strong>Sampler: <\/strong>Euler<br><strong>Size:<\/strong> 512&#215;512<br><strong>CFG Scale<\/strong>: 7<br><strong>Denoising Strength:<\/strong> 0<\/td><td>Prompt: <em>realistic photo of a road in the middle of an autumn forest with trees in the background and a yellow sign on the side of the road, by Inga Seliverstova, 50mm lens<\/em><br><strong>Resizing:<\/strong> Crop and resize<br><strong>Steps:<\/strong> 20<br><strong>Sampler:<\/strong> Euler<br><strong>Size:<\/strong> 512&#215;512<br><strong>CFG Scale:<\/strong> 7<br><strong>Denoising Strength:<\/strong> 0<\/td><td><strong>Prompt:<\/strong> <em>realistic photo of a road in the middle of an autumn forest with trees in the background and a yellow sign on the side of the road, by Inga Seliverstova, 50mm lens<\/em><br><strong>Resizing: <\/strong>Crop and resize<br><strong>Steps:<\/strong> 20<br><strong>Sampler: <\/strong>Euler<br><strong>Size: <\/strong>512&#215;512<br><strong>CFG Scale:<\/strong> 7<br><strong>Denoising Strength: <\/strong>0<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n<h2 class=\"wp-block-heading\" id=\"weighing-prompt-vs-source\">Weighing Prompt vs Source<\/h2>\n\n\n<p>The higher a denoising number we used, the more our output image was based on the text prompt rather than the input image. You\u2019ll also notice that, even at a strength of \u201c0\u201d, the image we got back was not an exact carbon copy: the winding road sign is clearly disfigured.<\/p>\n\n\n\n<p>As you\u2019ll learn on your Stable Diffusion journey, diffusion image generation has a few weakness\u2014especially when it comes to drawing words, symbols, and fingers.<\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"inpainting-amp-outpainting\">Inpainting &amp; Outpainting<\/h1>\n\n\n<p>Another flabbergasting feature of Stable Diffusion is it\u2019s ability to paint in new features to a pre-existing image&#8230;or at least to try!<\/p>\n\n\n\n<p><strong>Inpainting<\/strong> is the process by which the AI will add new subject matter into an image through the use of masking. <strong>Outpainting<\/strong> is the process by which it will expand an image and add more to the scene.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"a-bit-of-drawing-required\">A Bit of Drawing Required<\/h2>\n\n\n<p><strong>While these features sound amazingly useful, they require more skill than other aspects of Stable Diffusion. That\u2019s because a high quality inpaint or outpaint will usually require you to edit the image slightly and then return it to Stable Diffusion. You don\u2019t need extraordinary painting skill for this, but it will require a photo editing software.<\/strong><\/p>\n\n\n\n<p>Stay tuned for my in-depth guide just about inpainting and outpainting if you want to learn more. But just so you know the basics about the tool, let\u2019s review its features.<\/p>\n\n\n\n<p>Click over to the \u201cInpaint\u201d tab to the right of \u201cImg2img\u201d just above the Upload Window. Now upload the stock photo again. You will see a black paintbrush tool appear over the image. This is how you can mask a section of the image to paint over it.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"897\" height=\"639\" src=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Masking-1.jpg\" alt=\"\" class=\"wp-image-60\" srcset=\"https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Masking-1.jpg 897w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Masking-1-300x214.jpg 300w, https:\/\/promptphantom.com\/wp-content\/uploads\/2023\/01\/SD-Auto1111-Img2img-Masking-1-768x547.jpg 768w\" sizes=\"(max-width: 897px) 100vw, 897px\" \/><\/figure>\n\n\n\n<p>You\u2019ll notice that a few more selection bubbles have appeared below the image.<\/p>\n\n\n\n<ul>\n<li><strong>Mask blur<\/strong> is essentially the amount of feathering around the masked selection. Is smooths out the transition between the inpainted part and the original image.<\/li>\n\n\n\n<li><strong>Draw mask<\/strong> will allow you to use the paintbrush and select your masked area inside of Stable Diffusion; <strong>Upload mask <\/strong>will instead let you upload an image with a mask for finer detailed selection.<\/li>\n\n\n\n<li><strong>Inpaint masked<\/strong> will apply the inpainting changes to the area you masked with the paintbrush tool. <strong>Inpaint not masked<\/strong> will keep that masked area in tact but change the rest of the image based on your prompt modifiers. This is useful if you only want to keep a small portion of your image completely the same. You only have to paint a single small area and invert the effect, rather than painting in 90% of the entire image!<\/li>\n\n\n\n<li><strong>Masked <\/strong><strong>C<\/strong><strong>ontent<\/strong> changes what the AI should put into the masked area that\u2019s being replaced:\n<ul>\n<li><strong>Fill<\/strong> will erase the masked content and regenerate completely new content in it\u2019s place<\/li>\n\n\n\n<li><strong>Original<\/strong> instructs the AI to use the original content as a basis for what will replace it.<\/li>\n\n\n\n<li>Latent Noise will base the new content on colorful noise and then work it from a bunch of pixels into a full image through the process of denoising. <strong>For beginners, all you really need to know is that Denoising Strength must be set at or near 1.0 for Latent Noise to work. Otherwise, you just get colorful pixels.<\/strong><\/li>\n\n\n\n<li><strong>Latent Nothing<\/strong> is very similar to Latent Noise, but instead of starting with a bunch of colored pixel the AI will start with black fill.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n<h2 class=\"wp-block-heading\" id=\"denoising-strength-is-vital-for-inpainting\">Denoising Strength is Vital for Inpainting<\/h2>\n\n\n<p>If you remember just one thing about inpainting, let it be this: <strong>the Denoising strength setting will have a major impact on your results. <\/strong><strong>Set it too low, and the AI will just smudge the image where you masked. Set it too high, and it may not blend right.<\/strong><\/p>\n\n\n\n<p>If you go with \u201coriginal\u201d as the content option, a good starting level would be 0.8 denoising with mask blur at 4. When using latent filler the denoising needs to be up at 1.<\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"batch-img2img\">Batch Img2Img<\/h1>\n\n\n<p>The last to explore in Img2img is the Batch tab. This allows you to generate multiple images in one click from multiple source images. For the most part, this tab is useful for producing animations. You can input the frames of a video clip that\u2019s been converted to jpgs, add a prompt that changes the art style, and then batch out the sequence images with a new look. From there, the AI-modified sequence can be re-stitched into a video.<\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"web-ui-extra-features\">Web UI Extra Features<\/h1>\n\n\n<p>That covers the 2 primary features of Stable Diffusion. However, the story is not over. Besides image generation, this particular Web UI has several other goodies baked into the pie. Let\u2019s briefly explore those add-ons and utility pages.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"extras-tab\">Extras Tab<\/h2>\n\n\n<p>The Extras tab has two features: upscaling and face restoration.<\/p>\n\n\n\n<ul>\n<li><strong>Upscaling<\/strong> is when an AI increases the resolution of an image. If you were to simply make a small picture bigger in Photoshop, the result would be blurry and pixelated. Upscaling uses machine learning to instead fill in the details of the image based on what it sees in the small version. The result is a full-sized image that actually looks high resolution, with no pixelation or blur.<\/li>\n\n\n\n<li><strong>Face Restoration<\/strong> is a specialty AI script made to improve facial features. If you have an old photograph that\u2019s torn or worn, then face restoration will deduce what the face should look like and fill in the damaged parts. Likewise, Stable Diffusion sometimes gives incorrect anatomy to portraits. Like eyes missing pupils or that are too big for the head, etc. Face restore also works on these images by \u201ccorrecting\u201d the construction of your AI faces.<\/li>\n<\/ul>\n\n\n<h3 class=\"wp-block-heading\" id=\"using-upscale\">Using Upscale<\/h3>\n\n\n<p>The <strong>Scale By\/To<\/strong> settings are how you operate the upscaler. You can select 2 upscalers to run on the same image. The Web UI comes with several upscale models already installed, but you can add more as well. Certain upscalers work better for certain types of images (photorealism, paintings, etc).<\/p>\n\n\n\n<ul>\n<li>The <strong>Resize slider <\/strong>lets you choose how much bigger you want the upscaled image. A setting of 2 will make the output image 2 times bigger than it\u2019s source.<\/li>\n\n\n\n<li>Upscale models are listed next. You may want to experiment with different models to find the one you prefer. I personally use a custom model named 4x_Valar for many of my AI images. You can browse through and download different models from <a href=\"https:\/\/upscale.wiki\/wiki\/Model_Database\">this database<\/a>.<\/li>\n<\/ul>\n\n\n<h3 class=\"wp-block-heading\" id=\"how-do-you-install-an-upscale-model-in-stable-diffusion\">How Do You Install an Upscale Model in Stable Diffusion<\/h3>\n\n\n<p>Models are installed simply by downloading the python file (usually a PTH or YML extension) and placing them in the following subfolders of your Web UI directory:<\/p>\n\n\n\n<ul>\n<li>stable-diffusion-webui\\models\\ESRGAN<\/li>\n<\/ul>\n\n\n<h2 class=\"wp-block-heading\" id=\"png-info-tab\">PNG Info Tab<\/h2>\n\n\n<p>This section allows you to view the parameters used in an AI-generated image. This data is encoded into the image output and can be read back. In the left hand browse area that says \u201cSource\u201d, simply add an AI image. On the right hand side, you will be shown the following settings used when generating that image:<\/p>\n\n\n\n<ul>\n<li>Prompt<\/li>\n\n\n\n<li>Steps<\/li>\n\n\n\n<li>Sampler<\/li>\n\n\n\n<li>CFG scale<\/li>\n\n\n\n<li>Seed<\/li>\n\n\n\n<li>Size<\/li>\n\n\n\n<li>Model hash<\/li>\n<\/ul>\n\n\n\n<p>This feature is incredibly handy for reverse engineering an image. If you generated something but can\u2019t remember the prompt you entered? No problem, PNG Info will remind you. Found a cool AI image online and you want to see how it was prompted? This tab can do that, too.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"checkpoint-merger\">Checkpoint Merger<\/h2>\n\n\n<p>This tab allows you to blend different models together to create a new model. However, the blending can be finicky. The output checkpoint isn\u2019t always usable; it takes some trial and error to get a successful blend.<\/p>\n\n\n\n<p>The merger feature also allows you to convert a regular pickle file into a SafeTensors file. SafeTensors are safer to use on a home computer, as the name suggests. If you want to know why, please read <a href=\"https:\/\/promptphantom.com\/is-it-safe-to-download-stable-diffusion-checkpoint-models-from-the-internet\/\" data-type=\"post\" data-id=\"65\" target=\"_blank\" rel=\"noreferrer noopener\">my guide<\/a> all about <strong>pickle file dangers<\/strong>.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"create-aesthetic-embedding\">Create Aesthetic Embedding<\/h2>\n\n\n<p>Aesthetic embeddings are a custom embedding created by <a href=\"https:\/\/github.com\/vicgalle\/stable-diffusion-aesthetic-gradients\" target=\"_blank\" rel=\"noreferrer noopener\">Victor Gallego<\/a>. Unlike a textual inversion, they do not require training. Instead, you just point to a folder full of images. Stable Diffusion will then bias it\u2019s output towards the visual style of that aesthetic embedding (when the feature is enabled on a prompt).<\/p>\n\n\n\n<p>Aesthetic embeddings are valuable for tweaking an output image to more closely resemble a certain artist of art style. It\u2019s not meant as a replacement for textual inversions or custom models, because it does not work for objects. It\u2019s basically a style enhancer.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"settings\">Settings<\/h2>\n\n\n<p>The settings tab allows you to tweak Stable Diffusion\u2019s background settings and image saving directions. From this section, you can modify:<\/p>\n\n\n\n<ul>\n<li>How and where Stable Diffusion saves generated images<\/li>\n\n\n\n<li>How the upscaler handles requests (like tile size, etc)<\/li>\n\n\n\n<li>How strongly face restoration applies when added<\/li>\n\n\n\n<li>VRAM usage<\/li>\n\n\n\n<li>CLIP Interrogation<\/li>\n\n\n\n<li>User Interface preview settings<\/li>\n<\/ul>\n\n\n\n<p>Most of these Settings panels you won\u2019t need to mess with. At most, you may want to change with Face Restoration model to use as default and how strongly it should weigh into generations.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"extensions\">Extensions<\/h2>\n\n\n<p>Lastly, the Extensions tab lists all of the add-ons you have installed into the Web UI. From here, you can install new scripts or update the ones you already have.<\/p>\n\n\n<h1 class=\"wp-block-heading\" id=\"conclusion\">Conclusion<\/h1>\n\n\n<p>By now, you should understand all the basic features of Stable Diffusion. Which puts you light years ahead of the public majority! The only thing left to do is experiment to your heart\u2019s content.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Part 2: Using IMG2IMG in the Stable Diffusion Web UI In Part 1 of this tutorial series, we reviewed the controls and work areas in the Txt2img section of Automatic1111\u2019s Web UI. If you haven\u2019t read that yet, I suggest you do so before moving onto this part. Now it\u2019s time to examine the controls [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":62,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"iawp_total_views":840,"footnotes":""},"categories":[4,3],"tags":[8,6],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/posts\/54"}],"collection":[{"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/comments?post=54"}],"version-history":[{"count":5,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/posts\/54\/revisions"}],"predecessor-version":[{"id":819,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/posts\/54\/revisions\/819"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/media\/62"}],"wp:attachment":[{"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/media?parent=54"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/categories?post=54"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/promptphantom.com\/wp-json\/wp\/v2\/tags?post=54"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}