The Litter Tray

Tutorial

Write a plain-language rule

The tray calls it an AI rule: a policy in your own words, and a rule that uses Shadow Mode.

The pictures are illustrations of the product's screens. The step diagrams below show the surrounding flow.

An illustration of the Rules screen, with each saved rule's current behaviour.
  1. Step one

    Where rules live

    The Rules page lists everything that decides what happens to a comment, and why: the built-in rules that ship with the tray, and yours. Two things are true of every rule on it. Only AI rules cost anything, and nothing on this page can ever post, reply, or reject. The owner starts with one link: New custom rule.

  2. Step two

    Choose the kind

    Four kinds are offered. Text and pattern rules are free and need no AI at all: a word or phrase, or an RE2 pattern. A filter rule is free too; it filters a verdict an AI rule has already paid for. The AI rule is the plain-language one: it reads new comments against a policy you write, and it is the only kind that costs anything. This walkthrough follows the AI rule.

  3. Step three

    Write the policy

    The heart of the form is one field, Policy text: what the rule is looking for, in your words. Your words sit inside a fixed safety wrapper, and the wrapper is not yours to change: the fencing, the instruction to treat a comment as data, and the answer format are the tray's. You also pick who the rule protects, and set the confidence it must reach to hold; below that, and for anything aimed at somebody you did not tick, the rule flags the comment for your judgement instead of holding it.

  4. Step four

    It arrives switched off

    Create rule saves it disabled, on purpose, and the page says so: created, and disabled until you enable it, so try it against some sample text first. A rule you have not yet previewed does not start acting because a form defaulted to on.

  5. Step five

    Preview against sample text

    The rule's own page has a preview box: paste some text and see what the rule would do. The preview asks the real classifier and reports back on the same page: it would hold that comment, flag it for your judgement, or leave it alone. Nothing is held, nothing is recorded against anyone, nothing rings. A preview reads only what you paste; it never runs against your real comments.

  6. Step six

    Turn it on, and it asks first

    Turn the rule on and it goes to work, but only on comments first seen since the rule was written: it never sweeps your archive or judges anything that arrived before it existed. When it matches, its hold is a proposal you approve in the review queue: a rule you wrote always uses Shadow Mode, because only the built-in policy can ever earn automatic, category by category. Editing the policy later saves a new version that asks first again.