Paint-Anything: Unified Any-Color Control for Image Generation and Editing
Paint-Anything introduces a novel approach for precise, any-color control in image generation and editing tasks. It leverages a shared hex-prompt interface, allowing users to specify exact 24-bit hex color values for objects within images, addressing a critical need in professional design workflows.
Reading in Plain English mode — toggle below to switch
Paint-Anything introduces a novel approach for precise, any-color control in image generation and editing tasks. It leverages a shared hex-prompt interface, allowing users to specify exact 24-bit hex color values for objects within images, addressing a critical need in professional design workflows.
Imagine colors not just as labels, but as points in a 3D vector space (like RGB). Paint-Anything learns to navigate this space precisely using hex codes, much like how a GPS coordinate system allows for exact location targeting, rather than just 'near the park'.
How Paint-Anything Achieves Precise Color Control
- 11. **Hex-Prompt Interface Learning:** The system learns to associate 24-bit hex color values directly with color semantics, creating a unified interface for both image generation and editing tasks.
- 22. **Object-Level Color Supervision:** A new dataset, Paint-500K, is constructed from real images, providing object-level color labels. This involves object grounding and perceptual color labeling.
- 33. **Pure-Color Anchors for Fidelity:** To overcome the imprecision of real-image color labels (due to shadows, etc.), 'pure-color anchors' are introduced. These are synthetic images where pixels exactly match their paired hex values, used during high-noise training steps.
- 44. **Benchmarking Color Fidelity:** A new benchmark, Any Color Benchmark (ACBench), is developed to quantitatively measure the model's ability to generate and edit images with precise hex color fidelity.
C_hₑₓ = (R, G, B)
$C_{hex}$ represents a 24-bit hexadecimal color value, which is decomposed into its red ($R$), green ($G$), and blue ($B$) components, each ranging from 0 to 255.
A graphic designer can specify that a car in a generated image must be exactly '#FF0000' (pure red) or edit an existing image to change a specific object to '#00FFFF' (cyan), ensuring precise brand color adherence without manual color correction.
By unifying color control through a hex-prompt interface and leveraging a novel training strategy with pure-color anchors, Paint-Anything achieves unprecedented precision in object-level color specification for image generation and editing.