Skip to main content

1a - Applications Audit

Contractor: axess lab

Main Contact: Eric Eggert – Principal Accessibility Specialist

Start date: 1 July 2026

End data: 31 August 2026

Abstract

This is the foundation milestone of the entire programme. Its outputs will define the evidence base, test protocols, and acceptance criteria that all subsequent milestones depend on. The contractor for this milestone must be an independent external accessibility specialist with no prior vested interest in Joomla's current conformance claims.

Joomla currently aims for WCAG 2.1 AA conformance since Joomla 4, but this has never been independently validated. WCAG 2.2 introduces additional success criteria not yet fully addressed.

Scope of Work

Deliverable 1: Expert WCAG 2.2 AA Audit

Commission and complete an expert manual and automated, but not AI based WCAG 2.2 AA and ATAG audit of Joomla's admin interface (Atum template) and default frontend template (Cassiopeia)

including but not limited to:

  • Navigation and landmark structure
  • Editor, Forms and form controls
  • Dialogs and modal interactions
  • Tables and data presentation
  • Media manager
  • Installer and update flows
  • Authentication

All findings must be categorised by severity (critical, major, or minor) and mapped to the relevant WCAG 2.2 success criteria.

Deliverable 2: Baseline Metrics

Establish quantifiable, repeatable measurements of Joomla's current accessibility state, including:

  • Automated violation count from axe-core scans of core admin views
  • Task-completion benchmarks for key user journeys using assistive technologies (see Browser Matrix for details)

Metrics documented in a format that can be re-run identically at project close, to allow direct before-and-after comparison for STF reporting.

Deliverable 3: Accessibility Test Protocols and Acceptance Criteria

Define the test protocols and acceptance criteria to be used across all subsequent milestones, including:

  • Which assistive technology and browser combinations are in scope
  • Pass and fail thresholds
  • Regression test approach

Minimum AT/browser matrix: (see Browser Matrix for details)

Deliverable 4: Public Publication of Audit Report and Baseline Metrics

Deliver the full audit report and baseline metrics before the remediation plan is drafted in Milestone 1b.

Deliverable 5: Documentation and Milestone Report

Establish the programme documentation framework and produce the milestone completion report in the format agreed with OSM at kick-off.

[Browser Matrix]

Desktop:

  • NVDA + Chrome and Firefox (may be tested as a combined pass)
  • JAWS + Edge
  • VoiceOver + Safari (macOS)

Mobile (minimum one combination):

  • VoiceOver + Safari (iOS) or TalkBack + Chrome (Android)

References

  1. RFP on OpenSourceMatters
TODO

This page is unfinished, please use the Edit this Page link at the bottom of this page to help make it more useful.