Skip to content

Commit b1076bb

Browse files
--timings-type=testname doesnt quite work as we expected (circleci#8914)
* Update rerun-failed-tests.adoc * fix lint errors --------- Co-authored-by: Rosie Yohannan <[email protected]>
1 parent 3c488cd commit b1076bb

File tree

1 file changed

+7
-3
lines changed

1 file changed

+7
-3
lines changed

jekyll/_cci2/rerun-failed-tests.adoc

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ NOTE: You can specify the timing type similar to `circleci tests split --split-b
9696

9797
After updating your configuration, run the job that runs tests again and make sure that the same number of tests are being executed as before the config.yml change.
9898

99-
Then, the next time you encounter a test failure on that job, click the "Rerun failed tests" button. If the `--verbose` setting is enabled, you should see output similar to the following the next time you click btn:[Rerun failed tests] with this job on CircleCI:
99+
Then, the next time you encounter a test failure on that job, select btn:[Rerun failed tests]. If the `--verbose` setting is enabled, you should see output similar to the following the next time you select btn:[Rerun failed tests] with this job on CircleCI:
100100

101101
```sh
102102
Installing circleci-tests-plugin-cli plugin.
@@ -633,7 +633,7 @@ On a rerun, if the parallel run is running tests, `no_files_here` will be popula
633633
[#approval-jobs]
634634
=== Approval jobs
635635

636-
If your workflow has an approval job, and a failed job containing failed tests that you wish to rerun, you will not be able to click btn:[Rerun failed tests] until the workflow has terminated. This means that you must cancel the approval job before you can click btn:[Rerun failed tests].
636+
If your workflow has an approval job, and a failed job containing failed tests that you wish to rerun, you will not be able to select btn:[Rerun failed tests] until the workflow has terminated. This means that you must cancel the approval job before you can select btn:[Rerun failed tests].
637637

638638
[#Error-can-not-rerun-failed-tests-no-failed-tests-could-be-found]
639639
=== Error: can not rerun failed tests: no failed tests could be found
@@ -692,7 +692,7 @@ If you run into issues, comment on the https://discuss.circleci.com/t/product-la
692692

693693
---
694694

695-
**Question:** Are tests that my test runner reported as "Skipped" or "Ignored" rerun when I click btn:[Rerun failed tests]?
695+
**Question:** Are tests that my test runner reported as "Skipped" or "Ignored" rerun when I select btn:[Rerun failed tests]?
696696

697697
**Answer:** No, only test files/classnames that have at least one test case reported as "Failed" will be rerun.
698698

@@ -720,3 +720,7 @@ circleci tests glob ".cypress/**/*.spec.js" | circleci tests run --command="xarg
720720
----
721721

722722
---
723+
724+
**Question:** Can I use `timings-type=testname`?
725+
726+
**Answer:** In order to use `timings-type=testname`, the test runner/framework must be able to take in as *input* a list of *test names* (as opposed to *classnames* or *file names*). Most test frameworks (including RSpec) do not accept as input a list of test names. If the test framework accepts as input a list of test names, pipe the test names into `circleci tests run` instead of piping in test file/class names via `circleci tests glob`. This will enable CircleCI to find the historical test data for individual test names and split the test names into logical groups.

0 commit comments

Comments
 (0)