'Surefire with JUnit: Disabled tests are added to enabled test sets

I'm using Surefire 3.0.0-M5 with JUnit 5.8.1 and I've encountered strange behavior regarding @Disabled tests. When running tests, disabled tests are added as skipped to the report of the enabled test. If I use reuseForks=false then each test class runs in a separate JVM and skipped tests from other classes are not showing in enabled tests. But this way I don't see the reports of the skipped tests at all.

I tried debugging surefire and found out that testSetStartingListener is not called for disabled tests and so all of the skipped tests are getting into the report of the non-skipped test set (in my case a test set is always a single class).

Is this the intended behavior? I feel like skipped test sets should still be reported separately.

Note: @Disabled is applied to the class, not to the method



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source