Executive Summary

Tiki Profiles Tester is a tool to automate the testing of Tiki Profiles for various Tiki versions. And thus, it helps the Tiki community detect issues, like Smoke testing.

How to see in action

It catches profile validation errors and adds them as information on this dashboard: https://tikiwiki.gitlab.io/ci-helpers/tiki-profiles-tester/

Code

• https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester

Status

As of 2023-02-14, this is in beta. Please expect some refinements in coming months.

How to update

• It runs it is planned that it will run once per week. It also runs anytime someone modifies the code. As of 2023-02-14, it takes about 30 minutes to run all tests.
• profiles
• Tiki versions

Thank yous

• Thank you xavidp for the original idea and code: https://github.com/xavidp/TikiProfilesTester (a sample report)
• Thank you xorti and SoftStart for the modern and future-proof implementation
• Thank you GitLab for letting us use free CPU: https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester/-/blob/master/.gitlab-ci.yml

How and where to report bugs

As of 2023-02-14, you can reach out to Marc Laporte.

Questions

• What should be domain name for https://tikiwiki-ci.gitlab.io/tiki-profiles-tester/?
  • profiles-tester.tiki.org ?
  • tiki-profiles-tester.tiki.org ?
  • something else?

Ideas for the future

• Run for each commit, as part of the CI
• Run other tests like TikiTests
• Visit wiki pages like the ones generated by http://profiles.tiki.org/Test_All_Plugins
• Have a way to test a specific branch / merge request (will save time from developers who are reviewing merge requests)
• System Features
• Alert specific people of errors
• Connect to GlitchTip