QIT CLI 0.10.0 Release Notes

What's New

Improved Plugin Activation Testing

• Enhanced Pre-Activation Step Handling
  The activation testing process now explicitly runs the pre-activation step for all plugins in the activation stack. This ensures that the default bootstrap behavior occurs at the appropriate time during the setup phase.

• Better Multi-Plugin Testing Support
  This update improves compatibility testing scenarios involving multiple plugins, particularly when running activation tests with additional plugins that have custom tests configured.

Enhanced Group Management Features

• JSON Output Support for Group Fetch
  Added a new --json flag to the group:fetch command that allows retrieving test group information in raw JSON format.

• Improved Group Management UX

  • Test group information is now displayed when clearing a group
  • When attempting to enqueue a new test while a completed test group exists, the system will:
    1. Display the existing completed group
    2. Clear it automatically
    3. Proceed with the new test enqueuing

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback is invaluable and helps us continuously enhance the QIT CLI tool.

What's Changed

• Explicitly run plugin pre_activation tests in the context of Activation Tests by @MrJnrman in #296
• Using ubuntu-latest for workflow by @Abdalsalaam in #297
• Activation test snapshots and error ignores by @Luc45 in #298
• Snapshots for sync 9.9.0-beta.1 and 9.8.5 by @Luc45 in #299
• Added Group json option by @MrJnrman in #300

New Contributors

• @Abdalsalaam made their first contribution in #297

Full Changelog: 0.9.1...0.10.0

QIT CLI 0.9.1 Release Notes

Minor release to ignore some PHP debug log entries in the Activation Test that are not coming from the SUT, and might cause the test to become a Warning instead of a Success.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Updated snapshots by @MrJnrman in #279
• Update Snapshots by @MrJnrman in #281
• Sync 9.8.0-beta.1 by @Luc45 in #283
• Normalize snapshots for Woo API test type by @Luc45 in #284
• 9.8.1 snapshots by @Luc45 in #286
• Ignore notices that are not coming from the SUT on Activation Test type by @Luc45 in #288
• Snapshot tweaks by @Luc45 in #289
• Snapshots for Woo 9.8.2 sync by @Luc45 in #292
• Handle Plugin-Theme dependency by @Luc45 in #290
• Self-test enh: allow to use --one-of-each to test that all test types are working by @Luc45 in #293
• Show all output on self test by @Luc45 in #294
• Fix logic that skips auto-activating theme is SUT is theme by @Luc45 in #295

Full Changelog: 0.9.0...0.9.1

QIT CLI 0.9.0 Release Notes

We are excited to announce the release of QIT CLI version 0.9.0! This update introduces powerful new features for managing grouped and batched tests, making it easier to organize and execute multiple tests in a coordinated manner.

What's New

Test Grouping and Batching

• Group Management: Organize related tests into logical groups for coordinated execution
• Batch Processing: Execute multiple tests without grouping for parallel processing
• New Commands:
  • group:register - Register test groups with custom identifiers
  • group:run - Execute registered test groups
  • group:fetch - Retrieve group information from remote
  • group:show - Display current group status and details

Enhanced Test Execution

• Local and Remote Coordination: Seamlessly run both local and remote tests in a single group
• Automatic Test Management: Local tests run sequentially without additional user input
• Group Status Tracking: Monitor the progress and completion status of all tests in a group
• Flexible Grouping Options: Use --skip-grouping for batch processing without logical grouping

Add a test to a group

qit run:activation your-extension --group --extension_set compatibility

Register a test group

qit group:register --group-identifier commit-1234567890

Execute a group of tests

qit group:run

Documentation

For detailed information about the new grouping and batching features, please visit our group tests documentation.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Fix extension set resolution by @singerb in #275
• Update from ubuntu-20.04 to ubuntu-latest by @Luc45 in #276
• Also account for ts spec files by @Luc45 in #277
• Normalize activation test self-test snapshots by @Luc45 in #278
• Add Group Test Support by @MrJnrman in #261

Full Changelog: 0.8.8...0.9.0

QIT CLI 0.8.8 Release Notes

Bug Fixes and Improvements

Another batch of bug fixes mainly around Custom Tests architecture.

Please keep in mind that the support policy of QIT CLI is to only support the latest version. Make sure to always be on the latest version, especially on CI workflows. Some updates are required and the tool might exit early with an update prompt if you are not on the latest version.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Fix latest version requirement and update notification by @Luc45 in #270
• Remove working directory awareness by @Luc45 in #271
• Cache undefined versions for 1h instead of 1m by @Luc45 in #272
• Add some directory awareness to bootstrapped bash scripts by @Luc45 in #274
• Fix run:e2e --up_only and --codegen by @Luc45 in #273

Full Changelog: 0.8.7...0.8.8

QIT CLI 0.8.7 Release Notes

This release is all about squashing bugs!

Bug Fixes and Improvements

This PR includes several bug fixes for the QIT CLI, especially around test types that uses the Custom Tests platform, such as run:e2e, run:activation, and env:up.

• Fix WP.org Download Slug Ambiguity: Resolves issues when the same slug exists as both a plugin and a theme.
• Automatically Activate Theme: When spinning up a test environment with a single --theme argument, that theme (and its parent, if it’s a child theme) is now automatically activated.
• Fix Plugin’s Custom PHPStan Neon File: Ensures PHPStan uses the correct custom neon configuration.
• Improve qit get Command: Removes unnecessarily long columns for cleaner output.
• Display Errors with --json: Ensures errors are properly displayed in JSON output.
• Skip Fetching Custom Tests for Non-WCCOM: Custom tests are fetched only for extensions hosted on WooCommerce.com.
• Correct SUT Path for Zip Files: Sets the proper path for SUT when a zip file is used.
• Fix String Plugin in Config File: Addresses incorrect handling of string-based plugin definitions.
• Tolerate Missing Docker: QIT will now gracefully handle environments without Docker installed.
• Allow Unknown Slugs: Permits extension slug lookups even if the slug is not recognized initially.
• Log Slow Requests: Adds visibility into requests that take longer than expected.
• Self-Tests Around PHPStan Neon Files: Adds internal tests to validate and maintain these configuration files.
• Stop Printing Console Errors to Stdout: Reduce verbosity on console log when running tests that emits a lot of console warnings/errors.
• Increase Notification Timeout: Raises notify timeout for better reliability.
• Change Working Directory Before Scripts: Switches the working directory as needed when running scripts.
• Remove ConfigurationProcessor: Simplifies early setup by removing extra configuration processing.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Fix WPORG download slug ambiguity by @Luc45 in #257
• Activate theme automatically when a single --theme argument is passed by @Luc45 in #258
• Activate theme with parent by @Luc45 in #259
• Set correct SUT path for zip file by @Luc45 in #267
• Don't fetch custom tests for extensions that are not hosted on WCCOM by @Luc45 in #266
• Tolerate missing docker by @Luc45 in #265
• Remove ConfigurationProcessor to make the early setup more straightforward by @Luc45 in #263
• Display errors when --json is passed by @Luc45 in #264
• Self-tests around PHPStan neon files by @Luc45 in #268
• Fix string plugin in config file by @Luc45 in #262
• Make sure automatic dependency resolution don't override manually defined dependencies by @Luc45 in #269

Full Changelog: 0.8.6...0.8.7

QIT CLI 0.8.6 Release Notes

What’s New

Improve qit get command by removing some verbose output and making sure the display is rendered correctly without breaking links.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Increase docker pull timeout to 10 min by @Luc45 in #253
• Add key to snapshots by @Luc45 in #252
• Sync 9.8.0 snapshots by @Luc45 in #255
• Improve qit get command by removing some long columns by @Luc45 in #256

Full Changelog: 0.8.5...0.8.6

QIT CLI 0.8.5 Release Notes

What’s New

Ignoring more deprecation warnings when using extension sets, and better control over Playwright tests via tag filtering.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Add Playwright test tag support by @MrJnrman in #249
• Update snapshots for PHPStan level by @singerb in #251
• Filter deprecated query monitor logs in the CLI too by @singerb in #250

Full Changelog: 0.8.4...0.8.5

QIT CLI 0.8.4 Release Notes

What’s New

Ignoring some common deprecation warnings when using extension sets.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Snapshot updates for Activation Tests by @Luc45 in #244
• Snapshot changes for sync 9.7.0-rc.1 by @Luc45 in #246
• PHPStan Snapshots by @Luc45 in #245
• Allow to use integer zero as value for required option built from schema by @Luc45 in #248
• Adds ignoring to the log parsing for some common deprecation warnings by @singerb in #247

Full Changelog: 0.8.3...0.8.4

QIT CLI 0.8.3 Release Notes

What’s New

Extension set support in local activation tests.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Snapshot changes for 9.7.0-beta.1 by @Luc45 in #240
• CTRF Json by @Luc45 in #241
• Update mocked schema for unit tests by @Luc45 in #243
• Add extension set support to activation tests by @singerb in #242

New Contributors

• @singerb made their first contribution in #242

Full Changelog: 0.8.2...0.8.3

QIT CLI 0.8.2 Release Notes

What’s New

Fixes and improvements to error handling

Several bug fixes and error handling improvements.

Support and Feedback

If you have any questions, encounter issues, or have suggestions, please visit our GitHub Issues Page. Your feedback helps us continually improve QIT.

What's Changed

• Fix Woo Extension ID-to-Slug Conversion Bug and Refactor RunE2ECommand for Readability by @Luc45 in #228
• Fix activation test and dependencies by @Luc45 in #229
• Fix PHP 8.4 deprecation by @Luc45 in #230
• Add command to get multiple test results in one request by @Luc45 in #231
• Self-test script rewrite by @Luc45 in #232
• Sync 9.6.0 snapshots by @Luc45 in #234
• 9.6.0-beta.2 sync by @Luc45 in #235
• Detect parse errors by @Luc45 in #237
• Sync 9.6.0 snapshots by @Luc45 in #239
• Refactor extension and test download logic with separate endpoints by @Luc45 in #238

Full Changelog: 0.8.1...0.8.2