/2 min read
context engineering, or: how i got consistent art out of a diffusion model without training anything
by Akshat Kushwaha · updated
the first few generated panels were good enough to make me optimistic and inconsistent enough to make that optimism useless.
the character changed shape. the style drifted. details that looked stable in one image quietly disappeared in the next. this is the normal failure mode when you ask a model to remember an aesthetic system it was never trained to hold.
so i stopped treating each prompt as a fresh request and wrote a production bible instead. it defined the character's silhouette, palette, proportions, setting, emotional range, and the specific things the model should not improvise. then i used reference images and a repeatable prompt structure for every panel.
the result was a 75-panel graphic novel with a recognisable visual language. that result matters, but the boundary matters more: it worked because Nybble was designed around simple geometry and a silhouette the model could reproduce. a character with a specific human face, complex lighting, and lots of subtle expressions is a different problem.
specification came before generation#
the useful lesson is not “prompting replaces training.” it does not. it is that consistency starts with deciding what must remain consistent.
a production bible makes the decisions visible before a model starts inventing them for you. it tells you which details are structural, which ones may vary, and how you will recognise a panel that belongs. without that, you are mostly collecting attractive accidents.
context engineering is a real tool. it has sharp edges. in a constrained visual system, detailed references and procedural rules can take you further than people expect. outside that boundary, fine-tuning, editing, or a human artist may be the right answer.
the point is to know the boundary before you promise consistency. design for what the tool can reliably do, not for what the demo made you hope it could do.
bits&bytes is at gobitsnbytes.org. We're India's independent teen-led builder network. Come ship something.
drafted with an LLM, then reviewed and edited by me before it went up.
0 responses
leave something useful, or usefully sharp.