Guides
What Preferences is
Pairwise voting: people pick the one they like more, and every choice ranks the generators and describes the voter's taste.
One choice, three results#
Preferences shows two items side by side and asks one question: which do you prefer? Each answer ranks the items and the generators that produced them with Bradley-Terry, describes the voter's taste, and, for text, becomes a contrastive pair that ster can train on.
Voting needs no account. The web app at app.preferences.wisent.com and the preferences command line are the same product: the same arenas, the same rankings, the same profile.
- Public arenas anyone can vote in, anonymously, with a cookie and no sign-in.
- Rankings per category, over items and over the generators that produced them, computed from the choices as they arrive.
- A taste profile per voter and category: the attributes your choices lean towards, and one deterministic sentence that says what they add up to.
- ster contrastive-pair export from text categories, for your own choices with an account, or for any voter with the operator bearer.
- Private arenas bound to a Wisent organization: only members of that organization see them or the items inside them.
- An operator path for generator runs: submit a run manifest, let people vote, rank the submission, and feed the winner back into the generator that made it.
Vocabulary#
One word per concept, used the same way in the API, the command line and the web app.
A voter is whoever answers pairs, anonymous or signed in. An operator is whoever holds the operator bearer, read by the vault role PREFERENCES_TOKEN_ROLE names: the credential behind creating arenas and categories, submitting runs, ranking submissions, hiding items and exporting another voter's pairs.
| Term | Meaning |
|---|---|
item | One thing to look at: an SVG, a PNG, a line of text or a fragment of HTML, stored with the generator and candidate id that produced it. |
category | A set of items of one kind (image, text or html) inside an arena. Ranking and profiling both happen per category. |
generator | What made an item: wisent-logo-generator, a marketing asset generator, a model, a person. The thing a ranking of generators is about. |
pair | Two items of one category, served to one voter at one moment. |
choice | What the voter did with a pair: left, right, tie or skip, and how many milliseconds it took. |
arena | A named collection of categories. Public, or private to one Wisent organization. |
ranking | The Bradley-Terry order of a category, over items or over generators, with a 95% interval per subject. |
profile | One voter's leans in one category, and the sentence that describes them. |
What is free and what is paid#
Voting in public arenas and every public ranking are free and need no account. Paid: a private arena bound to your Wisent organization, where the items, the pairs and the rankings are visible only to its members, and the personal model path, where your profile becomes a steering vector for a model that shares your taste.