Parsoid/Parser Unification/Confidence Framework - MediaWiki

The Parsoid Confidence Framework is a mechanism for transparently evaluating the readiness of Parsoid Read Views on diverse wikis. This guide describes the goals of the framework and the metrics used in order to allow insight into the decisions of the Content Transform Team to deploy Parsoid as the default wikitext parser on a given wiki.

An overview and summaries of the reports are at Parsoid/Parser Unification/Confidence Framework/Reports.

Detailed results for current and planned deployments are within sub-pages:

Parsoid began as part of the VisualEditor project, and has been used in production as part of VisualEditor, mobile apps, and tools like Flow and Content Translation since 2012. The Confidence Framework was developed alongside the first deployment of Parsoid Read Views in 2024, part of the Parser Unification project. As described on the updates page, the first deployments were to Wikivoyage wikis, followed by Incubator wiki and newly-created wikis. As the rollout of Parsoid Read Views progresses, the Confidence Framework will continue to be developed to reflect newly-uncovered challenges.

In particular, there is a plan to incorporate performance metrics into the Confidence Framework in the future to ensure it properly reflects Parsoid readiness for large-page-view wikis.

Although the framework is built from numeric metrics, it is not meant to blindly set cutoffs. Instead, the metrics are used to prompt product questions and investigation when they seem atypical.

These are the current metrics used for decision making:

• Supported extensions coverage
• Visual diff coverage
• Qualitative Reports

Based on the combination of the metrics, every wiki can be given one of the following confidence scores about enabling Parsoid Read Views:

• Not confident at all
• Not confident
• Somewhat confident (that means this wiki can be considered the next target, and that its metrics should be investigated)
• Confident
• Extremely confident

• Boilerplate text for a Parsoid Read Views rollout announcement
• 2004 email regarding Wikitech DiscussionTools rollout
• 2004 emails regarding Wikimedia Incubator and Wikivoyage rollouts