Monitoring website accessibility

Evaluating current approaches and a proposal for improvements

Authors

DOI:

https://doi.org/10.17411/jacces.v13i2.485

Abstract

The introduction of WCAG 2.0 and the European Web Accessibility Directive marked significant milestones in the realm of web accessibility evaluation. However, even with the passage of considerable time, persistent challenges continue to impact the assessment of web accessibility. In this article, we aim to address these ongoing hurdles and provide comprehensive suggestions for accessibility assurance to achieve efficiency, consistency, and transparency in the processes of preparing accessibility statements, monitoring, and self-assessment. The proposed solutions include a centralised system for preparing accessibility statements, a centralised government template for feedback mechanisms, simplified self-assessment based on nine general criteria, and in-depth monitoring by experts and individuals with disabilities. Centralising all accessibility statements would facilitate monitoring updates and accessibility achievements, enabling mass verification by the bodies in charge of monitoring the Web Accessibility Directive and the public. The centralised government template for feedback mechanisms provides benefits such as automatic form completion and shared responsibility for addressing reported inaccessible content. Simplified, centralised, and automated monitoring allows for efficient tracking of accessibility status and verification of updates using an automated software environment. Links to results can be shared with public sector bodies and inspectors, enhancing transparency and comparison. In-depth monitoring requires complete analysis and recommendations for improvements, in which experts and individuals with disabilities are involved. Proper education and training of website administrators are crucial for ensuring quality and meeting accessibility criteria. By implementing these proposals, the goal of inclusive access to information and services can be achieved for all users.

References

Abou-Zahra, S. (2018). 2018 Update on W3C/WAI Accessibility Conformance Testing (ACT) for WCAG. In ICT Accessibility Testing Symposium: Mobile Testing, 508 Revision, and Beyond (p. 93). Retrieved 20/07/2023 from https://www.ictaccessibilitytesting.org/wp-content/uploads/2019/05/Proceedings-of-the-2018-ICT-Accessibility-Testing-Symposium.pdf#page=97

Acosta-Vargas, P., Luján-Mora, S., & Salvador-Ullauri, L. (2016). Evaluation of the web accessibility of higher-education websites. In 2016 15th International Conference on Information Technology Based Higher Education and Training (ITHET) (pp. 1-6). IEEE. https://doi.org/10.1109/ITHET.2016.7760703

Altinier, A., Oncins, E., Sauberer, G., & Mehigan, T. (2022). Demystifying Digital Accessibility and Fostering Inclusive Mindsets. Compliance with the European Standard for Digital Accessibility EN 301 549. In 2022 European Conference on Software Process Improvement (EuroSPI) (pp 595-609). https://doi.org/10.1007/978-3-031-15559-8_42

axe DevTools pro. (2023). Deque’s People-First Approach to Computer Vision in axe DevTools Retrieved 29/07/2023 from https://www.deque.com/blog/deques-people-first-approach-to-computer-vision-in-axe-devtools/

Bhagat, S., & Joshi, P. (2019, April). Evaluation of accessibility and accessibility audit methods for e-governance portals. In Proceedings of the 12th International Conference on Theory and Practice of Electronic Governance (pp. 220-226). https://doi.org/10.1145/3326365.3326394

Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023). Accessibility of university websites worldwide: a systematic literature review. Universal Access in the Information Society, 22(1), 133-168. https://doi.org/10.1007/s10209-021-00825-z C

Council of the European Union. (2022). Infographic - Disability in the EU: facts and figures. Retrieved 20/07/2023 from https://www.consilium.europa.eu/en/infographics/disability-eu-facts-figures/#:~:text=Challenges faced by people with,have some form of disability.

Danish Agency for Digital Government. (2023). Tools, test methodology and score (orig. Værktøj, testmetode og score). Retrieved 20/07/2023 from https://digst.dk/digital-service/webtilgaengelighed/monitorering/vaerktoej-testmetode-og-score/

DigiToegankelijk. (2023). Dashboard DigiToegankelijk. Retrieved 20/07/2023 from https://dashboard.digitoegankelijk.nl/

European Commission. (2016). Directive (EU) 2016/2102 of the European Parliament and of the Council of 26 October 2016 on the accessibility of the websites and mobile applications of public sector bodies. Retrieved 20/07/2023 from https://eur-lex.europa.eu/legal-content/GA/TXT/?uri=CELEX:32016L2102

European Commission. (2018). Commission Implementing Decision (EU) 2018/1523 of 11 October 2018 establishing a model accessibility statement in accordance with Directive (EU) 2016/2102 of the European Parliament and of the Council on the accessibility of the websites and mobile applications of public sector bodies. Retrieved 20/07/2023 from https://eur-lex.europa.eu/eli/dec_impl/2018/1523/oj#:~:text=Commission%20Implementing%20Decision%20(EU)%202018,(Text%20with%20EEA%20relevance.)

European Comission. (2018a). Commission Implementing Decision (EU) 2018/1524 of 11 October 2018 establishing a monitoring methodology and the arrangements for reporting by Member States in accordance with Directive (EU) 2016/2102 of the European Parliament and of the Council on the accessibility of the websites and mobile applications of public sector bodies (notified under document C(2018) 6560). Retrieved 20/07/2023 from https://eur-lex.europa.eu/eli/dec_impl/2018/1524/oj

European Commission. (2021). Commission Implementing Decision (EU) 2021/1339 of 11 August 2021 amending Implementing Decision (EU) 2018/2048 as regards the harmonised standard for websites and mobile applications. Retrieved 20/07/2023 from https://eur-lex.europa.eu/eli/dec_impl/2021/1339/oj

European Commission. (2022). Web Accessibility Directive - Monitoring reports. Retrieved 20/07/2023 from https://digital-strategy.ec.europa.eu/en/library/web-accessibility-directive-monitoring-reports

European Commission. (2023). Web Accessibility. Retrieved 20/07/2023 from https://digital-strategy.ec.europa.eu/en/policies/web-accessibility

European Comission. (2023a). Latest changes to accessibility standard. Retrieved 20/07/2023 from https://digital-strategy.ec.europa.eu/en/policies/latest-changes-accessibility-standard#requirements-all

European Telecommunications Standards Institute (ETSI). (2021). Harmonised European Standard “Accessibility requirements for ICT products and services” EN 301 549 V3.2.1 (2021-03). Retrieved 20/07/2023 from https://www.etsi.org/deliver/etsi_en/301500_301599/301549/03.02.01_60/en_301549v030201p.pdf

Eurostat. (2023). Functional and activity limitations statistics. Retrieved 20/07/2023 from https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Functional_and_activity_limitations_statistics#Self-reported_long-standing_limitations_in_usual_activities_due_to_health_problems

Evinced. (2023). Accessibility at scale. Retrieved 20/07/2023 from https://www.evinced.com/

Fischer D. (2019). What could "simplified monitoring" of the implementation of the Web Accessibility Directive mean? Retrieved 20/07/2023 from https://team-usability.de/en/teamu-blog-post/simplified-monitoring.html

Kollotzek, G., Zimmermann, G., Ableitner, T., & Nebe, A. M. (2021). Comparison of Manual Evaluation Methods for Assessing the Accessibility of Websites based on EN 301 549. In CHIRA (pp. 24-35). https://doi.org/10.5220/0010647000003060

Manca, M., Palumbo, V., Paternò, F., & Santoro, C. (2023). The transparency of automatic web accessibility evaluation tools: design criteria, state of the art, and user perception. ACM Transactions on Accessible Computing, 16(1), 1-36. https://doi.org/10.1145/3556979

Martins, B., & Duarte, C. (2022). Large-scale study of web accessibility metrics. Universal Access in the Information Society, 1-24. https://doi.org/10.1007/s10209-022-00956-x

Rajh, N., & Debevc, M. (2022, August). Analysis of web accessibility evaluation tools and guidelines for monitoring according to the Directive (EU) 2016/2102. In Proceedings of the 10th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (pp. 195-202). https://doi.org/10.1145/3563137.3563148

Republika Slovenija. (2021). Poročilo Republike Slovenije o metodologiji spremljanja v skladu z Direktivo (EU) 2016/2102 evropskega parlamenta in sveta o dostopnosti spletišč in mobilnih aplikacij organov javnega sektorja za leti 2020 - 2021. Retrieved 20/07/2023 from https://view.officeapps.live.com/op/view.aspx?src=https%3A%2F%2Fwww.gov.si%2Fassets%2Fministrstva%2FMJU%2FDID%2FZDSMA%2FPorocilo-po-ZDSMA-za-leti-2020-2021.docx&wdOrigin=BROWSELINK

Siteimprove. (2023). Get web and content performance insights 90% faster. Retrieved 20/07/2023 from https://www.siteimprove.com/

UPowerWAD. (2021). Erasmus+ Project “Users Power the Web Accessibility Directive”. Retrieved 20/07/2023 from https://upowerwad.fk13.tu-dortmund.de/

Uutylsinet. (2020). WAI-Tools Documentation of Pilot Monitoring. Retrieved 20/07/2023 from https://www.uutilsynet.no/english/wai-tools-documentation-pilot-monitoring/177

Uutylsinet. (2023) Norwegian Authority for Universal Design of ICT on accessibility statements, in norwegian language. Retrieved 20/07/2023 from https://www.uutilsynet.no/tilgjengelighetserklaering/om-tilgjengelegheitserklaering/1128

World Wide Web Consortium (W3C). (2017). Contacting Organizations about Inaccessible Websites. Retrieved 20/07/2023 from https://www.w3.org/WAI/teach-advocate/contact-inaccessible-websites/#report

World Wide Web Consortium (W3C). (2018). Web content accessibility guidelines (WCAG) 2.1. Retrieved 20/07/2023 from https://www.w3.org/TR/WCAG21/

World Wide Web Consortium (W3C). (2020). ACT Rules Community. ACT Implementations. Retrieved 20/07/2023 from https://act-rules.github.io/pages/implementations/overview/

World Wide Web Consortium (W3C). (2020a). ACT Rules Community Group. Retrieved 20/07/2023 from https://www.w3.org/community/act-r/

World Wide Web Consortium (W3C). (2020b). ACT Rules. Retrieved 20/07/2023 from https://act-rules.github.io/rules/

World Wide Web Consortium (W3C). (2020c). Web Accessibility Initiative - Advanced Decision Support Tools for Scalable Web Accessibility Assessments (WAI-Tools) Project. Retrieved 20/07/2023 from https://www.w3.org/WAI/about/projects/wai-tools/

cover

Downloads

Published

2023-11-30

How to Cite

Debevc, M., Škraba, T., Cerovac, B., Kožuh, I., & Rajh, N. (2023). Monitoring website accessibility: Evaluating current approaches and a proposal for improvements. Journal of Accessibility and Design for All, 13(2), 162–187. https://doi.org/10.17411/jacces.v13i2.485