AutoMassChecks

The Auto-Mass-Check rule-QA infrastructure

UPDATE: this is no longer in use.

We now have a set of scripts tied into BugZilla which will automatically take rules that have been uploaded, check them into SVN for our NightlyMassCheck runs, collate the results, and post them to the bug they came from.

Here's how to use it.

For Contributors

Simply include the rules you want checked, in the comment text. Note that meta rules must be accompanied by their sub-rule dependencies, unless those are already checked into SVN trunk in one of the main rule files.

If you want to make the auto-mass-check script's job easier, wrap the rules in three curly braces, like so:

  your descriptive text goes here...

  {{{
    ... rules go here..
  }} }

  ... more descriptive text

(note: do not include the space between the closing braces. that's required since this wiki page will display incorrectly without it!

Rules which fail a spamassassin --lint check will not be checked in or mass-checked.

The rules submitted will be renamed to use this format for their names: T_MC_rulename_bbug_ccmt, where rulename is the original rulename used in the comment, bug is the bug number, and cmt is the comment number.

The results of the mass-check should show up within 24 hours -- it takes quite a long time, as the mass-checks are synchronized to kick off only once daily, and time must be given for all the NightlyMassCheck contributors to finish their mass-checks before the results are collated. However, partial results can often be seen here as they arrive, and that's updated every two hours.

For SpamAssassin Committers

A comment will not be mass-checked until a committer vets it and approves its use, by adding a subsequent comment to that bug containing the string NEEDSMC.

The NEEDSMC 'command' can be extended with optional additional arguments to control exactly which comments are mass-checked, as follows:

  NEEDSMC start-end

This will mass-check comments starting at comment number start, ending on comment number end, inclusive.

  NEEDSMC start

This will mass-check comments starting with comment number start until the comment containing 'NEEDSMC'.

  NEEDSMC

This will mass-check comments starting with comment 0, until the comment containing 'NEEDSMC'. If a previous 'NEEDSMC' has mass-checked a set of comments already, those will be skipped (based on the 'DONEMC' line found in the auto-mass-checker output comment).

The Results

A sample of the results can be seen on this bug.