2 min read

Omni-Reference --oref

Hi everyone! Today we’re beginning testing of a new image reference system we call the Omni-Reference , this system can duplicate much of the previous functionality of ‘character references’ in V6 but it's also capable of much more.

What is Omni-Reference

  • Omni-reference can be best thought of as a system of saying “put THIS in my image
  • It can work for characters, objects, vehicles, or non-human creatures

How to Use Omni-Reference

  • On web: Update your model version to V7 in the settings menu. Drag an image into the prompt bar and drop it into the bin that says 'Omni-reference'. There's a slider icon to control the strength
  • On Discord: Type --oref url where the url directs to an image. Use the omni-weight parameter (--ow) to control the strength

About Omni-Reference Weighing

  • There's a ‘omni-weight’ parameter called –-ow (theres a slider in the web ui) which controls how strictly it adheres to your image reference. This parameter goes from 0 to 100 to 1000 (100 is default)
  • If you want to change the style of the image (such as photo to anime) you should lower the weight (ie: -–ow 25)
  • If you want to make sure that a character's face is extremely visible (or that their clothes are preserved) you should try something higher like –-ow 400
  • Both -–stylize and -–exp compete for influence over the image with omni-reference. So if you have a high stylize or exp value, you must also use a higher corresponding omni-weight value a person –stylize 1000 –-ow 400 --exp 100 –-oref person.png.
  • Please note: If you aren't using extremely high stylize and exp you should probably never want go over 'moderate' values of ow like --ow 400 or things may actually be worse

More about Omni-Reference

  • Omni-reference should work with personalization, stylization, style references, and moodboards
  • If you want a character to hold a sword in an image please make sure you say that in your prompt a character holding a sword –-oref sword.png
  • If you want to style transfer a character and have a low omni-weight please make sure to over-specify the parts of your character you want to preserve a anime woman with blonde hair and red suspenders --oref url –-ow 25
  • It’s somewhat untested but if you have two characters (or object/character/etc) in your omni-reference image (either in the same image or just in two images side by side) and you refer to them both in your prompt can often get those two characters in your resulting image too

We know this is all a bit experimental. Honestly, there are SO MANY ways to use this feature. It’s hard for us to know what works well, what doesn’t work well, and what people want to use or improve most.

We need your help to test this! And your feedback to know what you want us to improve. Please give us your thoughts on Discord in #ideas-and-features and please show off what you’re doing along with the original reference images in #oref-showcase

Thanks everyone and have fun! ❤️