Krita AI Diffusion - Generative AI For Krita
Generate images effortlessly within Krita
5K+ Designer Like It
What is Krita AI Diffusion?
Krita AI Diffusion is an innovative plugin that seamlessly integrates the power of Stable Diffusion, a cutting-edge AI model for image generation, into the open-source digital painting software Krita, enabling artists to leverage text prompts and selection tools to inpaint, outpaint, refine, and generate new artwork directly within their familiar Krita workspace, offering both local and cloud-based processing options for efficient and flexible AI-assisted creative workflows.
Krita AI Diffusion Features
Inpaint
Use Krita's selection tools to mark an area and remove or replace existing content in the image. Simple text prompts can be used to steer generation.
Outpaint
Extend your canvas, select a blank area and automatically fill it with content that seamlessly blends into the existing image.
Generate
Create new images from scratch by decribing them with words or existing images. Supports SD1.5 and SDXL.
Refine
Use the strength slider to refine existing image content instead of replacing it entirely. This also works great for adding new things to an image by painting a (crude) approximation and refining at high strength!
Live Painting
Let AI interpret your canvas in real time for immediate feedback.Watch Video}
Control
Guide image creation directly with sketches or line art. Use depth or normal maps from existing images or 3D scenes. Transfer character pose from snapshots. Control composition with segmentation maps.
Resolutions
Work efficiently at any resolution. The plugin will automatically use resolutions appropriate for the AI model, and scale them to fit your image region.
Upscaling
Upscale and enrich images to 4k, 8k and beyond without running out of memory.
Job Queue
Depending on hardware, image generation can take some time. The plugin allows you to queue and cancel jobs while working on your image.
History
Not every image will turn out a masterpiece. Preview results and browse previous generations and prompts at any time.
Strong Defaults
Versatile default style presets allow for a simple UI which covers many scenarios.
Customization
Create your own presets - select a Stable Diffusion checkpoint, add LoRA, tweak samplers and more.
Krita Plugin Installation Guide
Follow the steps below to install the Krita AI Diffusion plugin and start generating images effortlessly within Krita.
Install Krita
If you haven't yet, go and install Krita! Required version: 5.2.0 or newer
Download KritaInstall the plugin
Start Krita and install the plugin via Tools ▸ Scripts ▸ Import Python Plugin from File...
Point it to the ZIP archive you downloaded in the previous step.
This will delete any previous install of the plugin. If you are updating from version 1.14 or older, please read the guide on updating.
Check Krita's official documentation for more options.
Update GuideKrita's official documentationRestart Krita
Restart Krita and create a new document or open an existing image.
Enable Plugin
To show the plugin docker: Settings ‣ Dockers ‣ AI Image Generation.
Configure Plugin
In the plugin docker, click 'Configure' to start local server installation or connect.
Wall of Love
If you enjoy using Krita AI Diffusion, please share your experience on Twitter with the hashtag
Frequently Asked Questions
Have a question? Check out some of the common queries below.
How do I install the Generative AI plugin in Krita?
Download the plugin from the official GitHub release page, then in Krita navigate to Tools ▸ Scripts ▸ Import Python Plugin from File... and select the downloaded ZIP file. After installation, restart Krita and enable the plugin docker through Settings ‣ Dockers ‣ AI Image Generation.
Which operating systems are supported by the Generative AI plugin?
The plugin supports Windows, Linux, and MacOS. Additional requirements like Python and venv must be installed on Linux and MacOS, typically available through the system's package manager.
What are the hardware requirements for the Generative AI plugin?
A powerful graphics card with at least 6 GB of VRAM is recommended. The plugin supports NVIDIA GPUs via CUDA, AMD GPUs via DirectML on Windows and ROCm on Linux, Apple M1/M2 via MPS on macOS, and CPUs, although CPU usage is significantly slower.
Can I generate images from scratch with the Generative AI plugin?
Yes, the plugin allows you to create new images from scratch using text prompts or existing images. Features such as inpaint, outpaint, and refine help control and direct the generative process.
How do I connect to a remote server using the Generative AI plugin?
You can use an existing installation of the ComfyUI backend or install it manually. If the server is running locally or remotely before you start Krita, the plugin will automatically try to connect.
Is there a way to guide image creation with sketches?
Yes, the plugin allows you to guide image creation using sketches or line art. You can also utilize depth or normal maps from existing images or 3D scenes to influence the composition.
What image resolutions can the Generative AI plugin handle?
The plugin supports upscaling to 4k, 8k, and beyond, enabling enhancement of image quality and detail without overwhelming system resources.
How can I contribute to the Generative AI plugin project?
Contributions are welcome, and you can begin by reviewing the contributing guide on the project's GitHub page. This may involve improving existing features, adding new functionalities, or addressing bugs.
What does the 'Inpaint' feature do in the plugin?
The 'Inpaint' feature allows you to select an area in your image to either remove or replace content, using simple text prompts to guide the AI in generating new content that matches the surrounding image.
What is 'Outpaint' and how does it work?
The 'Outpaint' feature enables you to extend your canvas and fill the new areas with content that blends seamlessly with the existing artwork. This is useful for expanding scenes or adding new elements to your compositions.
What does the 'Refine' feature entail?
The 'Refine' feature lets you adjust the strength of the AI's effect on existing content, allowing for subtle modifications or more extensive enhancements without completely replacing elements.
Are there any specific plugins for object selection?
Yes, a separate plugin called 'AI segmentation tools' can be used in conjunction with the Generative AI plugin to facilitate easier selection and manipulation of objects within the image.
Help Us Keep Innovating
If this tool enhances your creative workflow, consider supporting our efforts by buying us a coffee.