Appearance Pointers: A New Way to Control Image Generation with Precision

Rahul Sajnani, Yulia Gryaditskaya, Radomír Měch, Srinath Sridhar, Matheus Gadelha · July 21, 2026

A new paper from researchers at Brown University, Adobe Research, and other institutions introduces "appearance pointers," a technique that gives users fine-grained control over image generation using diffusion transformers (DiTs). Unlike text prompts alone, which often fail to specify exact locations for materials, objects, or styles, appearance pointers align text or image inputs with user-defined masks. This allows the model to apply specific appearances to precise regions without retraining the base model.

The key innovation is a region correspondence network that generates compact tokens, refined by a spatial aggregation mechanism. This enables multiple regional descriptions without significantly increasing computational load. The approach is modality-agnostic, meaning it works with both text and image inputs.

Why it matters: Creative professionals—designers, artists, and advertisers—often need to control exactly where a texture or object appears in an image. Current methods are either limited to text or require retraining. Appearance pointers offer a simple, extensible solution that matches or outperforms state-of-the-art methods across various metrics.

Practical implications: This could streamline workflows in graphic design, gaming, and film production, reducing the need for manual editing. Economically, it lowers the barrier for high-quality visual content creation, potentially impacting industries from e-commerce to entertainment.