Guides

What Preferences is

Pairwise voting: people pick the one they like more, and every choice ranks the generators and describes the voter's taste.

One choice, three results#

Preferences shows two items side by side and asks one question: which do you prefer? Each answer ranks the items and the generators that produced them with Bradley-Terry, describes the voter's taste, and, for text, becomes a contrastive pair that ster can train on.

Voting needs no account. The web app at app.preferences.wisent.com and the preferences command line are the same product: the same arenas, the same rankings, the same profile.

  • Public arenas anyone can vote in, anonymously, with a cookie and no sign-in.
  • Rankings per category, over items and over the generators that produced them, computed from the choices as they arrive.
  • A taste profile per voter and category: the attributes your choices lean towards, and one deterministic sentence that says what they add up to.
  • ster contrastive-pair export from text categories, for your own choices with an account, or for any voter with the operator bearer.
  • Private arenas bound to a Wisent organization: only members of that organization see them or the items inside them.
  • An operator path for generator runs: submit a run manifest, let people vote, rank the submission, and feed the winner back into the generator that made it.

Vocabulary#

One word per concept, used the same way in the API, the command line and the web app.

A voter is whoever answers pairs, anonymous or signed in. An operator is whoever holds the operator bearer, read by the vault role PREFERENCES_TOKEN_ROLE names: the credential behind creating arenas and categories, submitting runs, ranking submissions, hiding items and exporting another voter's pairs.

The eight words the product is made of
TermMeaning
itemOne thing to look at: an SVG, a PNG, a line of text or a fragment of HTML, stored with the generator and candidate id that produced it.
categoryA set of items of one kind (image, text or html) inside an arena. Ranking and profiling both happen per category.
generatorWhat made an item: wisent-logo-generator, a marketing asset generator, a model, a person. The thing a ranking of generators is about.
pairTwo items of one category, served to one voter at one moment.
choiceWhat the voter did with a pair: left, right, tie or skip, and how many milliseconds it took.
arenaA named collection of categories. Public, or private to one Wisent organization.
rankingThe Bradley-Terry order of a category, over items or over generators, with a 95% interval per subject.
profileOne voter's leans in one category, and the sentence that describes them.

What is free and what is paid#

Voting in public arenas and every public ranking are free and need no account. Paid: a private arena bound to your Wisent organization, where the items, the pairs and the rankings are visible only to its members, and the personal model path, where your profile becomes a steering vector for a model that shares your taste.