Fork me on GitHub

Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
1062 0 0 151 85.8% 14742 s

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 819 0 0 138 83.2% 10904 s
org.apache.maven.surefire.its.jiras 243 0 0 13 94.7% 3838 s

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

- Class Tests Errors Failures Skipped Success Rate Time
JUnit47ConcurrencyIT 1 0 0 0 100% 20.56 s
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 23.44 s
IncludesExcludesIT 3 0 0 0 100% 65.25 s
CheckTestFailIfNoTestsIT 3 0 0 0 100% 49.86 s
TestNgSuccessPercentageIT 1 0 0 0 100% 22.24 s
UseIsolatedClassLoaderIT 1 0 0 0 100% 19.47 s
TestMultipleMethodPatternsIT 180 0 0 87 51.7% 483.8 s
JUnit47WithCucumberIT 2 0 0 0 100% 45.38 s
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.4% 413.7 s
TestMultipleMethodsIT 3 0 0 0 100% 67.87 s
CheckTestNgListenerReporterIT 9 0 0 0 100% 203.2 s
EnvironmentVariableIT 1 0 0 0 100% 23.71 s
SystemPropertiesTestIT 2 0 0 0 100% 46.14 s
SmartStackTraceIT 1 0 0 0 100% 20.35 s
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 20.76 s
AbstractTestCaseIT 1 0 0 0 100% 21.73 s
JUnit44HamcrestIT 1 0 0 0 100% 17.49 s
TimeoutForkedTestIT 1 0 0 0 100% 29.29 s
ForkCountTestNGIT 8 0 0 0 100% 232.6 s
SiblingAggregatorIT 1 0 0 0 100% 18.57 s
JUnitPlatformIT 30 0 0 0 100% 414.2 s
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 23.00 s
CheckTestNgBeforeMethodIT 1 0 0 0 100% 22.13 s
PlainOldJavaClasspathIT 1 0 0 0 100% 19.55 s
ClasspathScopeFilteringIT 1 0 0 0 100% 25.21 s
LongWindowsPathIT 1 0 0 1 0% 0.059 s
XmlReporterRunTimeIT 1 0 0 0 100% 132.8 s
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 20.91 s
MultiModuleProjectWithJPMSIT 1 0 0 1 0% 0.005 s
AggregateReportIT 1 0 0 0 100% 34.82 s
ForkCountMultiModuleIT 4 0 0 0 100% 101.7 s
PojoSimpleIT 1 0 0 0 100% 21.24 s
CrashDetectionIT 3 0 0 0 100% 66.24 s
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 20.46 s
JUnit47RerunFailingTestWithCucumberIT 6 0 0 0 100% 147.9 s
Surefire1602IT 1 0 0 0 100% 48.09 s
JUnitPlatformStreamCorruptionIT 3 0 0 1 66.7% 44.03 s
JUnit4RunListenerIT 2 0 0 0 100% 40.50 s
ClasspathFilteringIT 1 0 0 0 100% 22.10 s
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 129.4 s
CheckSingleTestIT 4 0 0 0 100% 255.4 s
CheckTestNgExecuteErrorIT 1 0 0 0 100% 25.39 s
EnvironmentVariablesIT 3 0 0 0 100% 63.56 s
DefaultConfigurationIT 1 0 0 0 100% 23.44 s
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 118.4 s
JUnit48TestCategoriesIT 8 0 0 0 100% 176.1 s
CheckTestFailIfNoTestsForkCountIT 6 0 0 0 100% 115.5 s
NoRunnableTestsInClassIT 1 0 0 0 100% 20.99 s
TestMethodPatternIT 14 0 0 0 100% 324.7 s
JUnit47RedirectOutputIT 2 0 0 0 100% 44.71 s
JUnit4IgnoreIT 2 0 0 0 100% 45.03 s
JUnitPlatformEnginesIT 171 0 0 0 100% 667.5 s
TestSingleMethodIT 9 0 0 0 100% 176.9 s
CheckTestNgSuiteXmlIT 3 0 0 0 100% 67.69 s
ResultCountingIT 3 0 0 0 100% 69.93 s
AdditionalClasspathIT 2 0 0 0 100% 46.90 s
IncludesExcludesFromFileIT 6 0 0 0 100% 121.3 s
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 25.41 s
ClassPathOrderIT 1 0 0 0 100% 24.37 s
ArgLinePropertiesIT 1 0 0 0 100% 128.8 s
JUnitPlatformRerunFailingTestsIT 7 0 0 0 100% 368.9 s
ForkConsoleOutputIT 4 0 0 0 100% 83.59 s
ModulePathIT 2 0 0 2 0% 0.013 s
WorkingDirectoryIT 4 0 0 0 100% 144.9 s
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 33.34 s
FailFastTestNgIT 8 0 0 0 100% 319.5 s
JUnit47ParallelIT 59 0 0 0 100% 583.6 s
RunOrderIT 12 0 0 0 100% 354.5 s
RunOrderParallelForksIT 12 0 0 0 100% 351.8 s
ConsoleOutputIT 8 0 0 0 100% 237.1 s
TwoTestCasesIT 4 0 0 0 100% 158.3 s
FailFastJUnitIT 14 0 0 0 100% 582.0 s
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 22.43 s
UnicodeTestNamesIT 1 0 0 0 100% 30.34 s
WorkingDirectoryMissingIT 1 0 0 0 100% 20.61 s
ForkCountIT 8 0 0 0 100% 247.3 s
CheckTestNgListenersIT 1 0 0 0 100% 20.43 s
Junit5ModulePathIT 2 0 0 2 0% 0.028 s
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 20.75 s
CheckTestNgJdk14IT 1 0 0 0 100% 19.72 s
ReportersIT 1 0 0 0 100% 22.58 s
JUnit4VersionsIT 19 0 0 0 100% 373.2 s
JUnit4RerunFailingTestsIT 5 0 0 0 100% 389.6 s
AssumptionFailureReportIT 1 0 0 0 100% 22.40 s
CheckTestNg740ParallelIT 2 0 0 0 100% 53.17 s
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 20.14 s
Java9FullApiIT 3 0 0 3 0% 0.132 s
UmlautDirIT 4 0 0 0 100% 106.5 s
CheckTestNgVersionsIT 4 0 0 0 100% 96.93 s
ArgLineIT 1 0 0 0 100% 177.0 s
PlexusConflictIT 2 0 0 0 100% 42.08 s
JUnitDepIT 4 0 0 0 100% 85.44 s
CheckTestNgReportTestIT 3 0 0 0 100% 84.14 s
TestNgGroupsIT 5 0 0 0 100% 109.3 s

org.apache.maven.surefire.its.jiras

- Class Tests Errors Failures Skipped Success Rate Time
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 10.17 s
Surefire740TruncatedCommaIT 1 0 0 0 100% 12.65 s
Surefire801ForkNeverClassLoaderIT 1 0 0 0 100% 42.86 s
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 22.43 s
Surefire832ProviderSelectionIT 1 0 0 0 100% 13.32 s
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 19.43 s
Surefire1712ExtractedModulenameWithoutASMIT 1 0 0 1 0% 0.177 s
Surefire1964IT 2 0 0 0 100% 20.06 s
Surefire613TestCountInParallelIT 1 0 0 0 100% 13.05 s
Surefire1967CheckTestNgMethodParallelOrderingIT 3 0 0 0 100% 37.95 s
SpockIT 1 0 0 0 100% 45.44 s
Surefire772BothReportsIT 3 0 0 0 100% 34.12 s
Surefire1426JvmCrashShouldNotBeIgnoredIT 1 0 0 0 100% 16.11 s
Surefire1144XmlRunTimeIT 1 0 0 0 100% 23.38 s
Surefire1993JpmsProvidingModulesIT 1 0 0 1 0% 0.027 s
Surefire1179IT 1 0 0 0 100% 27.98 s
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 36.95 s
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 20.64 s
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 18.04 s
Surefire1364SystemPropertiesIT 10 0 0 0 100% 120.7 s
Surefire1367AssumptionLogsIT 4 0 0 0 100% 53.43 s
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 18.12 s
Surefire1585IT 2 0 0 0 100% 20.20 s
Surefire2006ShadefireTransformersIT 1 0 0 0 100% 11.05 s
Surefire1643IT 1 0 0 0 100% 32.20 s
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 51.19 s
Surefire1053SystemPropertiesIT 2 0 0 0 100% 36.64 s
Surefire141PluggableProvidersIT 4 0 0 0 100% 110.1 s
Surefire1787JUnit5IT 10 0 0 0 100% 145.0 s
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 46.15 s
Surefire817SystemExitIT 1 0 0 0 100% 12.40 s
Surefire847AdditionalFailureIT 1 0 0 0 100% 12.88 s
Surefire673MockitoIT 1 0 0 0 100% 14.65 s
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 37.34 s
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 59.38 s
Surefire772SpecifiedReportsIT 3 0 0 0 100% 34.14 s
Surefire772NoSurefireReportsIT 4 0 0 0 100% 44.76 s
Surefire1570ModularFailsafeIT 1 0 0 1 0% 0.039 s
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 12.32 s
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 18.55 s
Surefire1914XmlReportingParameterizedTestIT 3 0 0 0 100% 40.05 s
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 10.69 s
Surefire2190JUnitIT 1 0 0 1 0% 0.053 s
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 187.7 s
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 89.06 s
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 9.973 s
Surefire1264IT 2 0 0 0 100% 41.16 s
Surefire2143ParameterizedSkippedIT 2 0 0 0 100% 26.61 s
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 14.55 s
Surefire2065IT 3 0 0 0 100% 37.13 s
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 15.88 s
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 36.83 s
Surefire1278GroupNameEndingIT 1 0 0 0 100% 21.56 s
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 10.74 s
Surefire828EmptyGroupExprIT 4 0 0 0 100% 45.84 s
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 11.91 s
Surefire1881IT 1 0 0 0 100% 15.58 s
Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT 1 0 0 0 100% 13.31 s
Surefire1095NpeInRunListenerIT 3 0 0 0 100% 52.68 s
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 45.54 s
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 42.33 s
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 61.01 s
Surefire1146RerunFailedAndParameterizedIT 1 0 0 0 100% 87.87 s
Surefire809GroupExpressionsIT 6 0 0 0 100% 59.47 s
Surefire2117XmlReportingNestedIT 3 0 0 0 100% 44.34 s
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 11.61 s
Surefire995CategoryInheritanceIT 7 0 0 0 100% 44.83 s
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 12.11 s
Surefire2036IT 1 0 0 0 100% 10.53 s
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 15.18 s
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 23.70 s
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 11.93 s
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 12.57 s
Surefire2032NestedSkippedIT 1 0 0 0 100% 13.26 s
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 11.87 s
Surefire162CharsetProviderIT 1 0 0 0 100% 7.014 s
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 14.33 s
Surefire44InnerClassTestIT 1 0 0 0 100% 10.43 s
Surefire979WrongClassLoaderIT 1 0 0 0 100% 11.27 s
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 66.57 s
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 49.96 s
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 47.83 s
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 24.77 s
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 19.75 s
Surefire500PuzzlingErrorIT 1 0 0 0 100% 12.23 s
Surefire1733JUnitIT 1 0 0 1 0% 0.012 s
Surefire1744AlwaysIncludeOutputLogsIT 1 0 0 0 100% 9.927 s
Surefire1934OutErrElementsIT 2 0 0 0 100% 21.98 s
Surefire1360PropertiesElementIT 2 0 0 0 100% 36.62 s
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 24.63 s
Surefire1265Java9IT 1 0 0 1 0% 0.102 s
Surefire697NiceSummaryIT 1 0 0 0 100% 14.08 s
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 11.01 s
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 14.81 s
Surefire1534ReuseForksFalseWithJavaModuleIT 3 0 0 3 0% 0.030 s
Surefire946KillMainProcessInReusableForkIT 6 0 0 0 100% 179.4 s
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.3% 10.75 s
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 149.8 s
Surefire1733TestngIT 1 0 0 1 0% 0.013 s
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 19.19 s
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 16.07 s
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 12.77 s
Surefire1737IT 1 0 0 0 100% 4.951 s
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 25.47 s
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT 1 0 0 0 100% 21.85 s
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 55.03 s
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 9.484 s
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 11.15 s
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 58.38 s
Surefire943ReportContentIT 2 0 0 0 100% 27.94 s
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 31.27 s
Surefire1211JUnitTestNgIT 2 0 0 0 100% 41.43 s
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 53.23 s
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 15.27 s
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 43.99 s
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 24.74 s
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 37.97 s
Surefire1202RerunAndSkipIT 2 0 0 0 100% 59.19 s
Surefire257NotRerunningTestsIT 1 0 0 0 100% 15.53 s
Surefire34SecurityManagerIT 3 0 0 1 66.7% 20.75 s

Test Cases

[Summary] [Package List] [Test Cases]

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 10.15 s

JUnit47ConcurrencyIT

test47 20.55 s

Surefire740TruncatedCommaIT

testRussianLocaleReport 12.64 s

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 23.27 s

Surefire801ForkNeverClassLoaderIT

testShouldBeOkWithForkNever 42.86 s

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 22.42 s

IncludesExcludesIT

testPathBasedIncludesExcludes 22.33 s
testIncludesExcludes 21.29 s
testRegexIncludesExcludes 21.59 s

CheckTestFailIfNoTestsIT

failIfNoTests 17.33 s
dontFailIfNoTests 15.26 s
jUnit48CategoriesFailWhenNoTests 17.18 s

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 13.31 s

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 19.42 s

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 22.20 s

UseIsolatedClassLoaderIT

testUseSystemClassLoader 19.46 s

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 19.91 s
shouldMatchExactClassAndMethodCharacters[0] 22.25 s
shouldMatchExactClassAndMethodWildcard[0] 22.98 s
testSuccessTwo[0] 17.51 s
simpleNameTest[0] 15.90 s
simpleNameTestWithJavaExt[0] 19.79 s
regexClass[0] 16.77 s
shouldNotRunExcludedClasses[0] 25.29 s
shouldNotRunExcludedMethods[0] 17.70 s
simpleNameTestWithJavaExtWildcardPkg[0] 8.535 s
shouldMatchMultiplePatterns[0] 10.25 s
shouldMatchExactClassAndMethodsPostfix[0] 10.99 s
simpleNameTestWithWildcardPkg[0] 12.60 s
shouldMatchWildcardPackageAndClassAndMethod[0] 12.49 s
shouldMatchExactClassAndMultipleMethods[0] 11.87 s
fullyQualifiedTest[0] 12.78 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 11.73 s
negativeTest[0] 0 s
- skipped -
testRegexSuccessTwo[0] 11.72 s
shouldMatchExactClassAndMethodsWildcard[0] 11.15 s
shouldMatchMultiplePatternsComplex[0] 9.548 s
simpleNameTestAsParallel[0] 0 s
- skipped -
matchSimpleClassAndMethodWithWildcardPkg[0] 7.839 s
shouldMatchMultiplePatternsAsParallel[0] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[0] 6.403 s
shouldMatchSimpleClassNameAndMethod[0] 5.720 s
shouldMatchExactClassAndMethodPostfix[0] 4.362 s
shouldMatchMultiplePatternsComplexAsParallel[0] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[0] 4.649 s
regexClassAndMethod[0] 3.564 s
shouldNotRunExcludedClassesAndMethods[1] 3.149 s
shouldMatchExactClassAndMethodCharacters[1] 2.942 s
shouldMatchExactClassAndMethodWildcard[1] 2.558 s
testSuccessTwo[1] 2.791 s
simpleNameTest[1] 2.704 s
simpleNameTestWithJavaExt[1] 3.061 s
regexClass[1] 2.715 s
shouldNotRunExcludedClasses[1] 2.681 s
shouldNotRunExcludedMethods[1] 2.865 s
simpleNameTestWithJavaExtWildcardPkg[1] 2.964 s
shouldMatchMultiplePatterns[1] 3.046 s
shouldMatchExactClassAndMethodsPostfix[1] 2.244 s
simpleNameTestWithWildcardPkg[1] 2.356 s
shouldMatchWildcardPackageAndClassAndMethod[1] 2.085 s
shouldMatchExactClassAndMultipleMethods[1] 2.059 s
fullyQualifiedTest[1] 2.486 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 2.241 s
negativeTest[1] 0 s
- skipped -
testRegexSuccessTwo[1] 2.015 s
shouldMatchExactClassAndMethodsWildcard[1] 2.077 s
shouldMatchMultiplePatternsComplex[1] 2.525 s
simpleNameTestAsParallel[1] 2.716 s
matchSimpleClassAndMethodWithWildcardPkg[1] 2.735 s
shouldMatchMultiplePatternsAsParallel[1] 2.646 s
shouldNotRunExcludedClassesIfIncluded[1] 2.319 s
shouldMatchSimpleClassNameAndMethod[1] 2.647 s
shouldMatchExactClassAndMethodPostfix[1] 2.055 s
shouldMatchMultiplePatternsComplexAsParallel[1] 2.478 s
matchSimpleClassAndMethodWithJavaExt[1] 2.311 s
regexClassAndMethod[1] 2.528 s
shouldNotRunExcludedClassesAndMethods[2] 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters[2] 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard[2] 0 s
- skipped -
testSuccessTwo[2] 0 s
- skipped -
simpleNameTest[2] 2.579 s
simpleNameTestWithJavaExt[2] 2.672 s
regexClass[2] 2.568 s
shouldNotRunExcludedClasses[2] 1.982 s
shouldNotRunExcludedMethods[2] 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg[2] 2.458 s
shouldMatchMultiplePatterns[2] 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix[2] 0 s
- skipped -
simpleNameTestWithWildcardPkg[2] 1.714 s
shouldMatchWildcardPackageAndClassAndMethod[2] 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods[2] 0 s
- skipped -
fullyQualifiedTest[2] 2.059 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] 0 s
- skipped -
negativeTest[2] 1.446 s
testRegexSuccessTwo[2] 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard[2] 0 s
- skipped -
shouldMatchMultiplePatternsComplex[2] 0 s
- skipped -
simpleNameTestAsParallel[2] 0 s
- skipped -
matchSimpleClassAndMethodWithWildcardPkg[2] 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel[2] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[2] 1.635 s
shouldMatchSimpleClassNameAndMethod[2] 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix[2] 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel[2] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[2] 0 s
- skipped -
regexClassAndMethod[2] 0 s
- skipped -
shouldNotRunExcludedClassesAndMethods[3] 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters[3] 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard[3] 0 s
- skipped -
testSuccessTwo[3] 0 s
- skipped -
simpleNameTest[3] 1.912 s
simpleNameTestWithJavaExt[3] 1.916 s
regexClass[3] 1.710 s
shouldNotRunExcludedClasses[3] 2.197 s
shouldNotRunExcludedMethods[3] 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg[3] 2.468 s
shouldMatchMultiplePatterns[3] 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix[3] 0 s
- skipped -
simpleNameTestWithWildcardPkg[3] 2.476 s
shouldMatchWildcardPackageAndClassAndMethod[3] 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods[3] 0 s
- skipped -
fullyQualifiedTest[3] 1.851 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3] 0 s
- skipped -
negativeTest[3] 1.728 s
testRegexSuccessTwo[3] 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard[3] 0 s
- skipped -
shouldMatchMultiplePatternsComplex[3] 0 s
- skipped -
simpleNameTestAsParallel[3] 2.214 s
matchSimpleClassAndMethodWithWildcardPkg[3] 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel[3] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[3] 1.808 s
shouldMatchSimpleClassNameAndMethod[3] 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix[3] 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel[3] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[3] 0 s
- skipped -
regexClassAndMethod[3] 0 s
- skipped -
shouldNotRunExcludedClassesAndMethods[4] 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters[4] 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard[4] 0 s
- skipped -
testSuccessTwo[4] 0 s
- skipped -
simpleNameTest[4] 2.062 s
simpleNameTestWithJavaExt[4] 1.658 s
regexClass[4] 2.090 s
shouldNotRunExcludedClasses[4] 1.748 s
shouldNotRunExcludedMethods[4] 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg[4] 1.787 s
shouldMatchMultiplePatterns[4] 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix[4] 0 s
- skipped -
simpleNameTestWithWildcardPkg[4] 1.826 s
shouldMatchWildcardPackageAndClassAndMethod[4] 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods[4] 0 s
- skipped -
fullyQualifiedTest[4] 1.758 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4] 0 s
- skipped -
negativeTest[4] 2.019 s
testRegexSuccessTwo[4] 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard[4] 0 s
- skipped -
shouldMatchMultiplePatternsComplex[4] 0 s
- skipped -
simpleNameTestAsParallel[4] 0 s
- skipped -
matchSimpleClassAndMethodWithWildcardPkg[4] 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel[4] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[4] 1.677 s
shouldMatchSimpleClassNameAndMethod[4] 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix[4] 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel[4] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[4] 0 s
- skipped -
regexClassAndMethod[4] 0 s
- skipped -
shouldNotRunExcludedClassesAndMethods[5] 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters[5] 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard[5] 0 s
- skipped -
testSuccessTwo[5] 0 s
- skipped -
simpleNameTest[5] 2.012 s
simpleNameTestWithJavaExt[5] 1.790 s
regexClass[5] 1.746 s
shouldNotRunExcludedClasses[5] 2.034 s
shouldNotRunExcludedMethods[5] 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg[5] 1.955 s
shouldMatchMultiplePatterns[5] 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix[5] 0 s
- skipped -
simpleNameTestWithWildcardPkg[5] 1.912 s
shouldMatchWildcardPackageAndClassAndMethod[5] 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods[5] 0 s
- skipped -
fullyQualifiedTest[5] 2.210 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5] 0 s
- skipped -
negativeTest[5] 1.866 s
testRegexSuccessTwo[5] 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard[5] 0 s
- skipped -
shouldMatchMultiplePatternsComplex[5] 0 s
- skipped -
simpleNameTestAsParallel[5] 1.778 s
matchSimpleClassAndMethodWithWildcardPkg[5] 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel[5] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[5] 2.014 s
shouldMatchSimpleClassNameAndMethod[5] 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix[5] 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel[5] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[5] 0 s
- skipped -
regexClassAndMethod[5] 0 s
- skipped -

Surefire1712ExtractedModulenameWithoutASMIT

test 0 s
- skipped -

JUnit47WithCucumberIT

testWithParallelClasses 23.66 s
testWithoutParallel 21.70 s

Surefire1964IT

shouldFilterTests 10.03 s
shouldFilterTestsInPluginProcess 10.02 s

Surefire613TestCountInParallelIT

testParallelBuildResultCount 13.04 s

Surefire1967CheckTestNgMethodParallelOrderingIT

testNgParallelOrderingWithEarlyVersion6 11.75 s
testNgParallelOrderingWithVersion6 12.93 s
testNgParallelOrdering 13.26 s

SpockIT

test 45.44 s

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 23.69 s
shouldMatchExactClassAndMethodCharacters[0] 20.80 s
shouldMatchExactClassAndMethodWildcard[0] 113.1 s
testSuccessTwo[0] 17.57 s
simpleNameTest[0] 8.239 s
simpleNameTestWithJavaExt[0] 9.554 s
regexClass[0] 13.27 s
shouldNotRunExcludedClasses[0] 61.37 s
shouldNotRunExcludedMethods[0] 13.10 s
simpleNameTestWithJavaExtWildcardPkg[0] 11.64 s
shouldMatchMultiplePatterns[0] 8.645 s
shouldMatchExactClassAndMethodsPostfix[0] 7.380 s
simpleNameTestWithWildcardPkg[0] 6.453 s
shouldMatchWildcardPackageAndClassAndMethod[0] 5.284 s
shouldMatchExactClassAndMultipleMethods[0] 4.669 s
fullyQualifiedTest[0] 4.548 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 3.489 s
negativeTest[0] 0 s
- skipped -
testRegexSuccessTwo[0] 3.176 s
shouldMatchExactClassAndMethodsWildcard[0] 2.787 s
shouldMatchMultiplePatternsComplex[0] 2.741 s
simpleNameTestAsParallel[0] 2.845 s
matchSimpleClassAndMethodWithWildcardPkg[0] 2.711 s
shouldMatchMultiplePatternsAsParallel[0] 3.111 s
shouldNotRunExcludedClassesIfIncluded[0] 2.620 s
shouldMatchSimpleClassNameAndMethod[0] 2.575 s
shouldMatchExactClassAndMethodPostfix[0] 2.792 s
shouldMatchMultiplePatternsComplexAsParallel[0] 2.914 s
matchSimpleClassAndMethodWithJavaExt[0] 2.829 s
regexClassAndMethod[0] 2.184 s
shouldNotRunExcludedClassesAndMethods[1] 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters[1] 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard[1] 0 s
- skipped -
testSuccessTwo[1] 0 s
- skipped -
simpleNameTest[1] 2.427 s
simpleNameTestWithJavaExt[1] 2.109 s
regexClass[1] 2.163 s
shouldNotRunExcludedClasses[1] 2.651 s
shouldNotRunExcludedMethods[1] 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg[1] 2.110 s
shouldMatchMultiplePatterns[1] 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix[1] 0 s
- skipped -
simpleNameTestWithWildcardPkg[1] 1.971 s
shouldMatchWildcardPackageAndClassAndMethod[1] 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods[1] 0 s
- skipped -
fullyQualifiedTest[1] 2.353 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 0 s
- skipped -
negativeTest[1] 2.279 s
testRegexSuccessTwo[1] 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard[1] 0 s
- skipped -
shouldMatchMultiplePatternsComplex[1] 0 s
- skipped -
simpleNameTestAsParallel[1] 2.829 s
matchSimpleClassAndMethodWithWildcardPkg[1] 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel[1] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[1] 2.408 s
shouldMatchSimpleClassNameAndMethod[1] 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix[1] 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel[1] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[1] 0 s
- skipped -
regexClassAndMethod[1] 0 s
- skipped -
shouldNotRunExcludedClassesAndMethods[2] 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters[2] 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard[2] 0 s
- skipped -
testSuccessTwo[2] 0 s
- skipped -
simpleNameTest[2] 2.444 s
simpleNameTestWithJavaExt[2] 2.317 s
regexClass[2] 2.527 s
shouldNotRunExcludedClasses[2] 2.028 s
shouldNotRunExcludedMethods[2] 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg[2] 2.463 s
shouldMatchMultiplePatterns[2] 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix[2] 0 s
- skipped -
simpleNameTestWithWildcardPkg[2] 2.193 s
shouldMatchWildcardPackageAndClassAndMethod[2] 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods[2] 0 s
- skipped -
fullyQualifiedTest[2] 2.655 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] 0 s
- skipped -
negativeTest[2] 2.208 s
testRegexSuccessTwo[2] 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard[2] 0 s
- skipped -
shouldMatchMultiplePatternsComplex[2] 0 s
- skipped -
simpleNameTestAsParallel[2] 2.764 s
matchSimpleClassAndMethodWithWildcardPkg[2] 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel[2] 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded[2] 2.668 s
shouldMatchSimpleClassNameAndMethod[2] 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix[2] 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel[2] 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt[2] 0 s
- skipped -
regexClassAndMethod[2] 0 s
- skipped -

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 11.76 s
testSkippedFailsafeReportGeneration 11.90 s
testReportGeneration 10.46 s

TestMultipleMethodsIT

testJunit48Provider4 27.35 s
testJunit44 20.23 s
testJunit48Provider47 20.27 s

Surefire1426JvmCrashShouldNotBeIgnoredIT

mavenShouldFail 16.11 s

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 27.57 s
testNgListenerReporter[1: TestNG 5.7] 21.53 s
testNgListenerReporter[2: TestNG 5.10] 24.51 s
testNgListenerReporter[3: TestNG 5.13] 22.91 s
testNgListenerReporter[4: TestNG 5.14.6] 18.79 s
testNgListenerReporter[5: TestNG 5.14.9] 19.87 s
testNgListenerReporter[6: TestNG 6.0] 27.20 s
testNgListenerReporter[7: TestNG 6.14.3] 19.42 s
testNgListenerReporter[8: TestNG 7.0.0] 21.20 s

Surefire1144XmlRunTimeIT

testXmlRunTime 23.37 s

EnvironmentVariableIT

environmentVariable 23.60 s

Surefire1993JpmsProvidingModulesIT

verify 0 s
- skipped -

SystemPropertiesTestIT

testSystemProperties 23.33 s
testSystemPropertiesNoFork 22.81 s

Surefire1179IT

suiteXmlForkCountTwoReuse 27.98 s

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 20.54 s
timeoutInForkWithNoBuildFail 16.41 s

Surefire1080ParallelForkDoubleTestIT

test 20.63 s

SmartStackTraceIT

misg 20.34 s

CheckTestNgGroupThreadParallelIT

testNgGroupThreadParallel 20.66 s

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 18.04 s

Surefire1364SystemPropertiesIT

junit47InProcessParallel 20.92 s
junit47Forked 13.28 s
junit47InProcess 8.229 s
testNg 11.64 s
junit3Forked 10.47 s
junit47ForkedParallel 11.89 s
junit4Forked 10.78 s
testNgInProcess 13.21 s
junit4InProcess 10.25 s
junit3InProcess 10.00 s

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 25.63 s
shouldSeeLogsParallelInPlugin 6.857 s
shouldSeeLogsParallelForked 8.303 s
shouldSeeLogsForked 12.62 s

AbstractTestCaseIT

abstractTestCase 21.52 s

JUnit44HamcrestIT

testJUnit44Hamcrest 17.48 s

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 18.10 s

Surefire1585IT

shouldRunWithJupiterApi 9.054 s
shouldRunWithVintage 11.14 s

Surefire2006ShadefireTransformersIT

shadefireShouldBeUsed 11.03 s

TimeoutForkedTestIT

testTimeoutForked 29.28 s

Surefire1643IT

shouldNotMixResults 32.20 s

ForkCountTestNGIT

testForkNever 20.18 s
testForkOncePerThreadSingleThread 24.93 s
testForkCountOneNoReuse 26.55 s
testForkCountTwoNoReuse 35.62 s
testForkCountTwoReuse 32.62 s
testForkOncePerThreadTwoThreads 26.14 s
testForkCountOneReuse 20.23 s
testForkOnce 20.72 s

SiblingAggregatorIT

testSiblingAggregator 18.57 s

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 19.44 s
nonParallelCreatesCorrectReport 17.29 s
parallelCreatesCorrectReport 14.43 s

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 17.64 s
checkWarningsFileEncoding 18.98 s

JUnitPlatformIT

testVintageEngine[5.2.0] 21.41 s
testJQwikEngine[5.2.0] 19.08 s
testMultipleEngines[5.2.0] 25.25 s
testVintageEngine[5.3.2] 26.90 s
testJQwikEngine[5.3.2] 23.08 s
testMultipleEngines[5.3.2] 122.2 s
testVintageEngine[5.4.2] 9.500 s
testJQwikEngine[5.4.2] 12.20 s
testMultipleEngines[5.4.2] 13.19 s
testVintageEngine[5.5.2] 10.18 s
testJQwikEngine[5.5.2] 12.24 s
testMultipleEngines[5.5.2] 12.74 s
testVintageEngine[5.6.2] 13.96 s
testJQwikEngine[5.6.2] 10.25 s
testMultipleEngines[5.6.2] 16.71 s
testVintageEngine[5.7.2] 8.944 s
testJQwikEngine[5.7.2] 7.123 s
testMultipleEngines[5.7.2] 7.049 s
testVintageEngine[5.8.2] 4.764 s
testJQwikEngine[5.8.2] 5.257 s
testMultipleEngines[5.8.2] 4.190 s
testVintageEngine[5.9.1] 3.051 s
testJQwikEngine[5.9.1] 3.035 s
testMultipleEngines[5.9.1] 3.350 s
testVintageEngine[5.10.2] 2.822 s
testJQwikEngine[5.10.2] 3.013 s
testMultipleEngines[5.10.2] 3.339 s
testVintageEngine[5.11.0-M2] 2.697 s
testJQwikEngine[5.11.0-M2] 2.850 s
testMultipleEngines[5.11.0-M2] 3.670 s

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 22.90 s

Surefire141PluggableProvidersIT

pluggableProviderPresent 8.377 s
invokeRuntimeException 10.36 s
invokeReporterException 62.56 s
constructorRuntimeException 11.18 s

CheckTestNgBeforeMethodIT

testNgBeforeMethod 22.07 s

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 19.54 s

ClasspathScopeFilteringIT

additionalClasspath 25.17 s

Surefire1787JUnit5IT

apiAndEngine 9.032 s
testNgWithJupiterApi 67.28 s
testNg 11.74 s
junit5Suite 12.95 s
bothEngines 13.13 s
junit4Runner 8.944 s
selectJUnit4 6.700 s
selectJUnit5 5.597 s
testNgWithJupiterEngine 4.720 s
bothApis 4.911 s

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 21.71 s
testJUnit48Provider4 24.43 s

LongWindowsPathIT

shouldRunInSystemTmp 0 s
- skipped -

Surefire817SystemExitIT

systemExit1 12.40 s

XmlReporterRunTimeIT

testForkAlways 132.8 s

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 20.89 s

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 12.88 s

MultiModuleProjectWithJPMSIT

test 0 s
- skipped -

AggregateReportIT

aggregateReport 34.67 s

ForkCountMultiModuleIT

testForkCountOneNoReuse 26.51 s
testForkCountTwoNoReuse 26.80 s
testForkCountTwoReuse 24.93 s
testForkCountOneReuse 23.44 s

PojoSimpleIT

twoTestsWithFixtures 21.23 s

Surefire673MockitoIT

testBuildFailingWhenErrors 14.64 s

CrashDetectionIT

hardCrashInReusableFork 23.75 s
crashInReusableFork 22.59 s
crashInFork 19.86 s

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 20.45 s

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 37.31 s

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 19.70 s
shouldRunTwo 19.88 s
checkOutFileClassesRunParallel 19.80 s

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 10.17 s
testSkippedFailsafeReportGeneration 10.90 s
testReportGeneration 13.07 s

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 11.29 s
testSkippedSurefireReportGeneration 10.47 s
testSkipOptionalSurefireReportGeneration 11.34 s
testReportGeneration 11.65 s

Surefire1570ModularFailsafeIT

shouldRunWithJupiterApi 0 s
- skipped -

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse[0] 22.55 s
testRerunFailingErrorTestsWithOneRetry[0] 29.16 s
testRerunFailingErrorTestsTwoRetry[0] 27.01 s
testRerunFailingErrorTestsFalse[1] 21.28 s
testRerunFailingErrorTestsWithOneRetry[1] 24.64 s
testRerunFailingErrorTestsTwoRetry[1] 23.24 s

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 12.32 s

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 18.54 s

Surefire1602IT

nonCanonicalPath 48.08 s

Surefire1914XmlReportingParameterizedTestIT

testXmlReport[5.2.0] 12.82 s
testXmlReport[5.8.2] 13.26 s
testXmlReport[5.9.1] 13.97 s

JUnitPlatformStreamCorruptionIT

warningIsNotEmitted 24.50 s
warningIsNotEmittedWithJulToLog4j 0 s
- https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005 -
warningIsNotEmittedWithJulToSlf4j 19.51 s

Surefire985ParameterizedRunnerAndCategoriesIT

test 10.69 s

JUnit4RunListenerIT

testJUnit4RunListener 19.48 s
testRunlistenerJunitCoreProvider 21.01 s

ClasspathFilteringIT

additionalClasspath 22.05 s

CheckTestNgSuiteXmlSingleIT

testNgSuite 129.2 s

Surefire2190JUnitIT

test 0 s
- skipped -

CheckSingleTestIT

singleTestDotJava 123.4 s
singleTestNonExistentOverride 16.38 s
singleTestNonExistent 21.61 s
singleTest 93.87 s

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 79.13 s
test[1] 18.82 s
test[2] 13.98 s
test[3] 14.89 s
test[4] 20.09 s
test[5] 12.60 s
test[6] 9.772 s
test[7] 11.27 s
test[8] 7.067 s

CheckTestNgExecuteErrorIT

executionError 25.32 s

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 17.11 s
shouldRunWithCliOption[testng-option-ff] 23.33 s
shouldRunWithCliOption[junit-option-X] 18.94 s
shouldRunWithCliOption[testng-option-X] 9.329 s
shouldRunWithCliOption[junit-option-e] 9.336 s
shouldRunWithCliOption[testng-option-e] 10.97 s

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 9.972 s

EnvironmentVariablesIT

testWhenUseSystemClassLoader 22.97 s
testExcludedEnv 22.31 s
testWhenDontUseSystemClassLoader 18.23 s

DefaultConfigurationIT

defaultConfiguration 23.38 s

Surefire1264IT

positiveTests 21.50 s
negativeTests 19.65 s

Surefire2143ParameterizedSkippedIT

junit4ParameterizedSkipped 12.64 s
junit5ParameterizedSkipped 13.96 s

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 14.55 s

Surefire2065IT

shouldNotDetectFlakyTestsWhenRunningOnlyJunit4 11.20 s
shouldNotDetectFlakyTestsWhenRunningOnlyJunit5 13.78 s
shouldNotDetectFlakyTestsWhenCombiningJunit4And5Tests 12.14 s

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 15.87 s

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 118.4 s

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 19.20 s
testBadCategoryForkAlways 25.48 s
testCategoriesABForkAlways 22.84 s
testCategoriesBadCategory 21.10 s
testCategoriesACClassNameSuffix 25.13 s
testCategoriesACFullyQualifiedClassNameForkAlways 23.71 s
testCategoriesAB 18.47 s
testCategoriesACClassNameSuffixForkAlways 20.17 s

CheckTestFailIfNoTestsForkCountIT

dontFailIfNoTestsForkAlways 20.00 s
failIfNoTestsForkNever 16.24 s
failIfNoTestsForkAlways 19.66 s
failIfNoTestsForkOnce 22.04 s
dontFailIfNoTestsForkNever 17.30 s
dontFailIfNoTestsForkOnce 20.03 s

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 20.99 s

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 17.42 s
testClassesParallelWithSuite 19.40 s

TestMethodPatternIT

testJUnit48WithCategoryFilter[0] 134.4 s
testJUnit48Provider47[0] 21.05 s
testMethodPatternAfter[0] 25.26 s
testTestNGMethodPattern[0] 8.910 s
testJUnit48Provider4[0] 9.309 s
testJUnit44[0] 13.65 s
testTestNgMethodBefore[0] 12.12 s
testJUnit48WithCategoryFilter[1] 10.40 s
testJUnit48Provider47[1] 12.63 s
testMethodPatternAfter[1] 13.18 s
testTestNGMethodPattern[1] 10.69 s
testJUnit48Provider4[1] 40.50 s
testJUnit44[1] 6.464 s
testTestNgMethodBefore[1] 6.037 s

Surefire1278GroupNameEndingIT

testOnlyGroups 21.55 s

JUnit47RedirectOutputIT

testClassesParallel 22.26 s
testPrintSummaryTrueWithRedirect 22.45 s

Surefire975DefaultVMEncodingIT

runWithRussian1251 10.74 s

JUnit4IgnoreIT

testJunit4Ignore 23.34 s
testJunit47ParallelIgnore 21.66 s

JUnitPlatformEnginesIT

testJupiterEngineWithAssertionsFailEmptyStringParameters[1.2.0] 23.81 s
testToRegex[1.2.0] 0.224 s
testJupiterEngineWithAssertionsFailNoParameters[1.2.0] 129.4 s
testJupiterEngineWithExceptionMessage[1.2.0] 20.22 s
testTags[1.2.0] 16.07 s
failingBeforeAllMethod[1.2.0] 20.77 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.2.0] 30.97 s
testJupiterEngineWithAssertionsFailMessage[1.2.0] 11.88 s
errorInBeforeAllMethod[1.2.0] 12.24 s
testJupiterEngineWithFailureInParameterizedSource[1.2.0] 11.45 s
testJupiterEngineWithFailureInTestTemplateProvider[1.2.0] 13.11 s
testJupiterEngineWithErrorInParameterizedSource[1.2.0] 11.18 s
testJupiterEngine[1.2.0] 13.39 s
testJupiterEngineWithDisplayNames[1.2.0] 15.29 s
testJupiterEngineWithErrorInTestTemplateProvider[1.2.0] 13.81 s
testJupiterEngineWithFailureInTestFactory[1.2.0] 10.90 s
testJupiterEngineWithErrorInTestFactory[1.2.0] 8.455 s
platform[1.2.0] 6.686 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.2.0] 9.133 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.3.2] 5.405 s
testToRegex[1.3.2] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.3.2] 3.884 s
testJupiterEngineWithExceptionMessage[1.3.2] 3.175 s
testTags[1.3.2] 2.999 s
failingBeforeAllMethod[1.3.2] 2.814 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.3.2] 5.972 s
testJupiterEngineWithAssertionsFailMessage[1.3.2] 3.158 s
errorInBeforeAllMethod[1.3.2] 2.810 s
testJupiterEngineWithFailureInParameterizedSource[1.3.2] 2.752 s
testJupiterEngineWithFailureInTestTemplateProvider[1.3.2] 3.072 s
testJupiterEngineWithErrorInParameterizedSource[1.3.2] 3.081 s
testJupiterEngine[1.3.2] 2.939 s
testJupiterEngineWithDisplayNames[1.3.2] 2.980 s
testJupiterEngineWithErrorInTestTemplateProvider[1.3.2] 2.055 s
testJupiterEngineWithFailureInTestFactory[1.3.2] 2.269 s
testJupiterEngineWithErrorInTestFactory[1.3.2] 2.429 s
platform[1.3.2] 2.204 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.3.2] 2.241 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.4.2] 2.267 s
testToRegex[1.4.2] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.4.2] 2.633 s
testJupiterEngineWithExceptionMessage[1.4.2] 3.144 s
testTags[1.4.2] 2.487 s
failingBeforeAllMethod[1.4.2] 2.514 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.4.2] 4.947 s
testJupiterEngineWithAssertionsFailMessage[1.4.2] 2.371 s
errorInBeforeAllMethod[1.4.2] 2.695 s
testJupiterEngineWithFailureInParameterizedSource[1.4.2] 2.673 s
testJupiterEngineWithFailureInTestTemplateProvider[1.4.2] 2.634 s
testJupiterEngineWithErrorInParameterizedSource[1.4.2] 3.053 s
testJupiterEngine[1.4.2] 3.196 s
testJupiterEngineWithDisplayNames[1.4.2] 2.415 s
testJupiterEngineWithErrorInTestTemplateProvider[1.4.2] 2.626 s
testJupiterEngineWithFailureInTestFactory[1.4.2] 1.916 s
testJupiterEngineWithErrorInTestFactory[1.4.2] 2.094 s
platform[1.4.2] 1.747 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.4.2] 2.044 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.5.2] 2.022 s
testToRegex[1.5.2] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.5.2] 1.839 s
testJupiterEngineWithExceptionMessage[1.5.2] 2.364 s
testTags[1.5.2] 2.547 s
failingBeforeAllMethod[1.5.2] 2.584 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.5.2] 4.200 s
testJupiterEngineWithAssertionsFailMessage[1.5.2] 2.068 s
errorInBeforeAllMethod[1.5.2] 2.050 s
testJupiterEngineWithFailureInParameterizedSource[1.5.2] 2.065 s
testJupiterEngineWithFailureInTestTemplateProvider[1.5.2] 2.106 s
testJupiterEngineWithErrorInParameterizedSource[1.5.2] 2.048 s
testJupiterEngine[1.5.2] 2.351 s
testJupiterEngineWithDisplayNames[1.5.2] 2.134 s
testJupiterEngineWithErrorInTestTemplateProvider[1.5.2] 2.435 s
testJupiterEngineWithFailureInTestFactory[1.5.2] 2.028 s
testJupiterEngineWithErrorInTestFactory[1.5.2] 2.059 s
platform[1.5.2] 1.898 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.5.2] 1.902 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.6.3] 2.170 s
testToRegex[1.6.3] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.6.3] 1.964 s
testJupiterEngineWithExceptionMessage[1.6.3] 2.173 s
testTags[1.6.3] 2.333 s
failingBeforeAllMethod[1.6.3] 2.214 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.6.3] 4.005 s
testJupiterEngineWithAssertionsFailMessage[1.6.3] 1.406 s
errorInBeforeAllMethod[1.6.3] 1.528 s
testJupiterEngineWithFailureInParameterizedSource[1.6.3] 1.537 s
testJupiterEngineWithFailureInTestTemplateProvider[1.6.3] 1.719 s
testJupiterEngineWithErrorInParameterizedSource[1.6.3] 1.479 s
testJupiterEngine[1.6.3] 1.539 s
testJupiterEngineWithDisplayNames[1.6.3] 1.591 s
testJupiterEngineWithErrorInTestTemplateProvider[1.6.3] 1.432 s
testJupiterEngineWithFailureInTestFactory[1.6.3] 1.435 s
testJupiterEngineWithErrorInTestFactory[1.6.3] 1.422 s
platform[1.6.3] 1.367 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.6.3] 1.427 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.7.2] 1.395 s
testToRegex[1.7.2] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.7.2] 1.410 s
testJupiterEngineWithExceptionMessage[1.7.2] 1.417 s
testTags[1.7.2] 1.368 s
failingBeforeAllMethod[1.7.2] 1.413 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.7.2] 2.983 s
testJupiterEngineWithAssertionsFailMessage[1.7.2] 1.410 s
errorInBeforeAllMethod[1.7.2] 1.392 s
testJupiterEngineWithFailureInParameterizedSource[1.7.2] 1.454 s
testJupiterEngineWithFailureInTestTemplateProvider[1.7.2] 1.413 s
testJupiterEngineWithErrorInParameterizedSource[1.7.2] 1.466 s
testJupiterEngine[1.7.2] 1.519 s
testJupiterEngineWithDisplayNames[1.7.2] 1.566 s
testJupiterEngineWithErrorInTestTemplateProvider[1.7.2] 1.438 s
testJupiterEngineWithFailureInTestFactory[1.7.2] 1.479 s
testJupiterEngineWithErrorInTestFactory[1.7.2] 1.374 s
platform[1.7.2] 1.371 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.7.2] 1.422 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.8.2] 1.454 s
testToRegex[1.8.2] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.8.2] 1.416 s
testJupiterEngineWithExceptionMessage[1.8.2] 1.421 s
testTags[1.8.2] 1.384 s
failingBeforeAllMethod[1.8.2] 1.429 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.8.2] 2.927 s
testJupiterEngineWithAssertionsFailMessage[1.8.2] 1.801 s
errorInBeforeAllMethod[1.8.2] 1.432 s
testJupiterEngineWithFailureInParameterizedSource[1.8.2] 1.415 s
testJupiterEngineWithFailureInTestTemplateProvider[1.8.2] 1.410 s
testJupiterEngineWithErrorInParameterizedSource[1.8.2] 1.433 s
testJupiterEngine[1.8.2] 1.523 s
testJupiterEngineWithDisplayNames[1.8.2] 1.594 s
testJupiterEngineWithErrorInTestTemplateProvider[1.8.2] 1.500 s
testJupiterEngineWithFailureInTestFactory[1.8.2] 1.411 s
testJupiterEngineWithErrorInTestFactory[1.8.2] 1.503 s
platform[1.8.2] 1.532 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.8.2] 1.453 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.9.1] 1.420 s
testToRegex[1.9.1] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.9.1] 1.432 s
testJupiterEngineWithExceptionMessage[1.9.1] 1.440 s
testTags[1.9.1] 1.353 s
failingBeforeAllMethod[1.9.1] 1.398 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.9.1] 2.872 s
testJupiterEngineWithAssertionsFailMessage[1.9.1] 1.378 s
errorInBeforeAllMethod[1.9.1] 1.509 s
testJupiterEngineWithFailureInParameterizedSource[1.9.1] 1.387 s
testJupiterEngineWithFailureInTestTemplateProvider[1.9.1] 1.466 s
testJupiterEngineWithErrorInParameterizedSource[1.9.1] 1.600 s
testJupiterEngine[1.9.1] 1.983 s
testJupiterEngineWithDisplayNames[1.9.1] 1.560 s
testJupiterEngineWithErrorInTestTemplateProvider[1.9.1] 1.404 s
testJupiterEngineWithFailureInTestFactory[1.9.1] 1.438 s
testJupiterEngineWithErrorInTestFactory[1.9.1] 1.451 s
platform[1.9.1] 1.374 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.9.1] 1.522 s
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.10.2] 1.429 s
testToRegex[1.10.2] 0 s
testJupiterEngineWithAssertionsFailNoParameters[1.10.2] 1.427 s
testJupiterEngineWithExceptionMessage[1.10.2] 1.415 s
testTags[1.10.2] 1.371 s
failingBeforeAllMethod[1.10.2] 1.436 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake[1.10.2] 2.976 s
testJupiterEngineWithAssertionsFailMessage[1.10.2] 1.407 s
errorInBeforeAllMethod[1.10.2] 1.430 s
testJupiterEngineWithFailureInParameterizedSource[1.10.2] 1.486 s
testJupiterEngineWithFailureInTestTemplateProvider[1.10.2] 1.461 s
testJupiterEngineWithErrorInParameterizedSource[1.10.2] 1.459 s
testJupiterEngine[1.10.2] 1.570 s
testJupiterEngineWithDisplayNames[1.10.2] 1.611 s
testJupiterEngineWithErrorInTestTemplateProvider[1.10.2] 1.487 s
testJupiterEngineWithFailureInTestFactory[1.10.2] 1.452 s
testJupiterEngineWithErrorInTestFactory[1.10.2] 1.718 s
platform[1.10.2] 1.360 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake[1.10.2] 1.429 s

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 12.39 s
testJUnitRunEmptyGroups 12.42 s
testTestNGRunEmptyExcludeGroups 12.64 s
testTestNGRunEmptyGroups 8.380 s

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 11.89 s

Surefire1881IT

test 15.57 s

TestSingleMethodIT

fullyQualifiedTestNg 29.79 s
testJunit48Provider4 22.75 s
testJunit44 19.42 s
testJunit48parallel 20.26 s
testJunit48Provider47 18.08 s
fullyQualifiedJunit48Provider47 21.09 s
fullyQualifiedJunit48Provider4 24.07 s
testTestNg5149 12.70 s
testTestNg 8.690 s

Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT

mavenShouldFail 13.31 s

Surefire1095NpeInRunListenerIT

testRunStartedWithJUnit40 16.59 s
testRunStartedWithJUnit45 16.23 s
testRunStartedWithJUnit47 19.78 s

CheckTestNgSuiteXmlIT

suiteXmlForkAlways 25.93 s
suiteXml 20.27 s
suiteXmlForkCountTwoReuse 21.31 s

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 27.42 s
testSecondExecutionRunsAfterFirstExecutionFails 18.10 s

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 9.935 s
testForcedFailsafeReportGeneration 10.32 s
testSkipForcedFailsafeReportGeneration 10.56 s
testReportGeneration 11.50 s

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 29.40 s
testReportWithoutAggregate 31.62 s

Surefire1146RerunFailedAndParameterizedIT

testsAreRerun 87.86 s

ResultCountingIT

testCountingWithJunit481ForkAlways 26.06 s
testCountingWithJunit481ForkOnce 20.86 s
testCountingWithJunit481ForkNever 22.98 s

Surefire809GroupExpressionsIT

testNGRunCategoryAB 10.80 s
testExcludedGroups 12.07 s
testJUnitRunCategoryNotC 11.44 s
incorrectJUnitVersions 8.415 s
categoryAB 9.188 s
testNGRunCategoryNotC 7.552 s

AdditionalClasspathIT

additionalClasspathElements 24.90 s
additionalClasspathDependencies 21.77 s

IncludesExcludesFromFileIT

testSimpleMixed 20.40 s
testMissingExcludes 20.08 s
testRegex 22.21 s
testPath 18.82 s
testMissingIncludes 19.03 s
testSimple 20.66 s

CheckTestNgBeforeMethodFailureIT

testNgBeforeMethodFailure 25.33 s

Surefire2117XmlReportingNestedIT

testXmlReport[5.2.0] 13.46 s
testXmlReport[5.8.2] 13.46 s
testXmlReport[5.9.1] 17.38 s

ClassPathOrderIT

classPathOrder 24.20 s

Surefire42NotExtendingTestCaseIT

testInnerClass 11.61 s

ArgLinePropertiesIT

argLine 128.6 s

Surefire995CategoryInheritanceIT

junit411ShouldIgnoreInheritedCategories 11.07 s
junit411ShouldRunExplicitCategory 7.923 s
junit412ShouldExecuteInheritedCategories 6.470 s
junit411ShouldExcludeExplicitCategory 6.216 s
junit412ShouldExcludeInheritedCategory 4.647 s
junit412ShouldRunInheritedCategory 4.864 s
negativeTestShouldRunAllCategories 3.624 s

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 12.10 s

JUnitPlatformRerunFailingTestsIT

testRerunFailingErrorTestsFalse 92.54 s
testRerunFailingErrorTestsWithOneRetry 86.71 s
testParameterizedTest 22.12 s
testRerunFailingErrorTestsTwoRetry 59.24 s
testFailOnTooManyFlakes 11.25 s
testRerunOneTestMethod 57.85 s
testRerunOneTestClass 39.19 s

Surefire2036IT

selectJUnit5UsingConfiguredProviderWithPlatformRunner 10.53 s

Surefire705ParallelForkTimeoutIT

testTimeoutForked 15.18 s

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 23.69 s

Surefire733AllOverrridesCapturedIT

testLogOutput 11.92 s

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 12.57 s

Surefire2032NestedSkippedIT

testXmlReport 13.26 s

ForkConsoleOutputIT

printSummaryTrueWithRedirect 20.74 s
printSummaryFalseWithoutRedirect 18.45 s
printSummaryTrueWithoutRedirect 22.65 s
printSummaryFalseWithRedirect 21.73 s

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 11.87 s

ModulePathIT

testModulePathWithSpaces 0 s
- skipped -
testModulePath 0 s
- skipped -

WorkingDirectoryIT

testWorkingDirectory 105.4 s
testWorkingDirectoryChildOnlyNoFork 17.91 s
testWorkingDirectoryNoFork 14.45 s
testWorkingDirectoryChildOnly 7.164 s

Surefire162CharsetProviderIT

testCharsetProvider 7.014 s

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 33.34 s

FailFastTestNgIT

test[testng-oneFork-ff1] 25.55 s
test[testng-oneFork-ff2] 41.10 s
test[testng-twoForks-ff1] 30.09 s
test[testng-twoForks-ff2] 41.79 s
test[testng-twoForks-ff2-tcp] 36.90 s
test[testng-oneFork-ff3] 62.22 s
test[testng-twoForks-ff3] 46.28 s
test[testng-twoForks-ff3-tcp] 35.55 s

JUnit47ParallelIT

unknownThreadCountClasses 118.1 s
threadCountSuites 28.68 s
unlimitedThreadsSuitesAndMethods1 24.69 s
unlimitedThreadsSuitesAndMethods2 24.22 s
unknownThreadCountMethods 15.27 s
threadCountClassesAndMethods 19.67 s
reusableThreadCountClassesAndMethodsOptimized 26.97 s
unknownThreadCountSuites 13.09 s
reusableThreadCountAll 11.87 s
forcedShutdown 16.00 s
unknownThreadCountAll 10.09 s
serial 18.65 s
reusableThreadCountAllOptimized 15.15 s
suites 16.50 s
unlimitedThreadsMethods1 16.58 s
unlimitedThreadsMethods2 14.46 s
unlimitedThreadsSuitesAndClasses1 9.764 s
unlimitedThreadsSuitesAndClasses2 8.118 s
threadCountAllOptimized 6.396 s
threadCountAll 5.753 s
everyThreadCountSuitesAndClasses 5.408 s
unknownThreadCountBoth 2.582 s
threadCountSuitesAndClassesOptimized 3.962 s
classesAndMethods 3.681 s
everyThreadCountSuitesAndMethods 4.349 s
unknownThreadCountSuitesAndClasses 2.485 s
reusableThreadCountSuitesAndClassesOptimized 4.866 s
unknownThreadCountSuitesAndMethods 2.454 s
suitesAndClasses 4.347 s
suitesAndMethods 4.438 s
shutdown 7.735 s
threadCountClassesAndMethodsOneCore 7.621 s
everyThreadCountClassesAndMethods 3.461 s
all 3.638 s
unknownThreadCountClassesAndMethods 2.067 s
threadCountSuitesAndMethodsOptimized 3.925 s
reusableThreadCountSuitesAndMethodsOptimized 4.569 s
unlimitedThreadsClasses1 4.585 s
unlimitedThreadsClasses2 4.403 s
threadCountClasses 4.468 s
everyThreadCountAll 3.169 s
threadCountMethods 4.839 s
unlimitedThreadsSuites1 5.918 s
unlimitedThreadsSuites2 5.955 s
threadCountSuitesAndClasses 3.881 s
unlimitedThreadsClassesAndMethods1 3.168 s
unlimitedThreadsClassesAndMethods2 2.856 s
threadCountSuitesAndMethods 3.415 s
classes 4.311 s
reusableThreadCountSuitesAndClasses 4.062 s
methods 4.717 s
reusableThreadCountSuitesAndMethods 4.406 s
timeoutAndForcedShutdown 4.800 s
threadCountClassesAndMethodsOptimized 3.024 s
unlimitedThreadsAll1 2.738 s
unlimitedThreadsAll2 2.596 s
forcedShutdownVerifyingLogs 3.467 s
threadCountClassesAndMethodsOneCoreOptimized 7.006 s
reusableThreadCountClassesAndMethods 4.086 s

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 14.33 s

Surefire44InnerClassTestIT

testInnerClass 10.43 s

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 11.27 s

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 16.34 s
testJunit3ParallelSuiteBuildResultCount 12.95 s
testJunit3AllParallelBuildResultCount 11.37 s
testJunit3BuildResultCount 14.07 s
testJunit3SuiteBuildResultCount 11.82 s

Surefire1535TestNGParallelSuitesIT

forks0 10.52 s
forks2 13.98 s
forks0Redirected 12.24 s
forks2Redirected 13.20 s

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 23.06 s
testNgReport688 24.76 s

RunOrderIT

testRandomJUnit4PrintSeedWithNoGivenSeed 18.67 s
testRandomJUnit4DifferentSeed 62.72 s
testNonExistingRunOrderJUnit4 92.16 s
testNonExistingRunOrderJUnit5 18.88 s
testRandomJUnit4SameSeed 108.9 s
testHourlyJUnit4 11.40 s
testHourlyJUnit5 12.29 s
testRandomJUnit4PrintSeedWithGivenSeed 7.714 s
testReverseAlphabeticalJUnit4 6.185 s
testReverseAlphabeticalJUnit5 6.141 s
testAlphabeticalJUnit4 4.260 s
testAlphabeticalJUnit5 5.128 s

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 13.01 s
systemProperties 11.76 s

RunOrderParallelForksIT

testRandomJUnit4PrintSeedWithNoGivenSeed 22.86 s
testRandomJUnit4DifferentSeed 80.69 s
testNonExistingRunOrderJUnit4 14.33 s
testNonExistingRunOrderJUnit5 87.87 s
testRandomJUnit4SameSeed 75.75 s
testHourlyJUnit4 13.90 s
testHourlyJUnit5 19.33 s
testRandomJUnit4PrintSeedWithGivenSeed 10.36 s
testReverseAlphabeticalJUnit4 7.446 s
testReverseAlphabeticalJUnit5 8.032 s
testAlphabeticalJUnit4 5.176 s
testAlphabeticalJUnit5 5.950 s

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding[0] 23.20 s
properNewlinesAndEncodingWithDefaultEncodings[0] 22.57 s
largerSoutThanMemory[0] 55.86 s
properNewlinesAndEncodingWithoutFork[0] 18.78 s
properNewlinesAndEncodingWithDifferentEncoding[1] 25.30 s
properNewlinesAndEncodingWithDefaultEncodings[1] 22.27 s
largerSoutThanMemory[1] 51.18 s
properNewlinesAndEncodingWithoutFork[1] 17.79 s

TwoTestCasesIT

testJunit4Suite 23.89 s
testTestNGSuite 19.79 s
testTwoTestCases 107.0 s
testTwoTestCaseSuite 7.566 s

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 10.82 s
vmStartFailShouldFailBuildk 8.925 s

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 12.23 s

Surefire1733JUnitIT

test 0 s
- skipped -

Surefire1744AlwaysIncludeOutputLogsIT

testAlwaysIncludeOutputLogs 9.926 s

Surefire1934OutErrElementsIT

testOutErrElementsDisabled 11.59 s
testOutErrElementsEnabled 10.38 s

Surefire1360PropertiesElementIT

testPropertiesElementEnabled 21.16 s
testPropertiesElementDisabled 15.45 s

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 12.09 s
testTestNgAndJUnitTogether 12.53 s

FailFastJUnitIT

test[junit4-oneFork-ff1] 127.9 s
test[junit47-oneFork-ff1] 29.41 s
test[junit4-oneFork-ff2] 34.70 s
test[junit47-oneFork-ff2] 34.27 s
test[junit4-twoForks-ff1] 30.98 s
test[junit47-twoForks-ff1] 30.34 s
test[junit4-twoForks-ff2] 29.59 s
test[junit4-twoForks-ff2-tcp] 28.70 s
test[junit47-twoForks-ff2] 66.54 s
test[junit4-oneFork-ff3] 46.06 s
test[junit47-oneFork-ff3] 43.85 s
test[junit4-twoForks-ff3] 26.45 s
test[junit47-twoForks-ff3] 26.38 s
test[junit47-twoForks-ff3-tcp] 26.77 s

Surefire1265Java9IT

shouldRunInPluginJava9 0 s
- skipped -

JUnit47ParallelNotThreadSafeIT

test 22.42 s

UnicodeTestNamesIT

checkFileNamesWithUnicode 30.33 s

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 14.08 s

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 11.01 s

WorkingDirectoryMissingIT

testWorkingDirectory 20.61 s

Surefire930TestNgSuiteXmlIT

suiteXmlRun 14.81 s

Surefire1534ReuseForksFalseWithJavaModuleIT

testExecuteWithReuseForksFalseWithJavaModule 0 s
- skipped -
testExecuteWithReuseForksFalseWithJavaModuleWithFilter 0 s
- skipped -
testExecuteWithZeroForkCountWithJavaModule 0 s
- skipped -

ForkCountIT

testForkNever 23.12 s
testForkOncePerThreadSingleThread 25.36 s
testForkCountOneNoReuse 26.91 s
testForkCountTwoNoReuse 39.20 s
testForkCountTwoReuse 31.72 s
testForkOncePerThreadTwoThreads 33.63 s
testForkCountOneReuse 17.07 s
testForkOnce 22.27 s

Surefire946KillMainProcessInReusableForkIT

test[halt-exit] 34.12 s
test[halt-kill] 26.52 s
test[exit-exit] 25.79 s
test[exit-kill] 25.25 s
test[interrupt-exit] 25.22 s
test[interrupt-kill] 24.62 s

CheckTestNgListenersIT

testNgListenerReporter 20.18 s

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 10.73 s
twoSpecifiedTestExecutionsInCorrectExecutionBlocks 0 s
- since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution -
singleTestInOneExecutionOfMultiExecutionProject 0 s
- since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution -

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 32.77 s
reusableForksJUnit47 19.57 s
reusableForksJUnit4 18.07 s
notReusableForksJUnit4 79.35 s

Surefire1733TestngIT

test 0 s
- skipped -

Junit5ModulePathIT

testModulePathWithSpaces 0 s
- skipped -
testModulePath 0 s
- skipped -

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 19.17 s

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 16.07 s

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 12.77 s

Surefire1737IT

selectJUnit5UsingConfiguredProviderWithPlatformRunner 4.949 s

Surefire510TestClassPathForkModesIT

testForkOnce 11.03 s
testForkAlways 14.43 s

CheckTestNgPathWithSpacesIT

testWithSpaces 20.71 s

CheckTestNgJdk14IT

testNgJdk14 19.65 s

ReportersIT

testRedirectOutputTestNg 22.57 s

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 19.68 s
testJunit[1: JUnit 4.1] 124.7 s
testJunit[2: JUnit 4.2] 19.70 s
testJunit[3: JUnit 4.3] 19.41 s
testJunit[4: JUnit 4.3.1] 17.37 s
testJunit[5: JUnit 4.4] 20.87 s
testJunit[6: JUnit 4.5] 20.82 s
testJunit[7: JUnit 4.6] 8.966 s
testJunit[8: JUnit 4.7] 8.300 s
testJunit[9: JUnit 4.8] 12.74 s
testJunit[10: JUnit 4.8.1] 11.26 s
testJunit[11: JUnit 4.8.2] 11.41 s
testJunit[12: JUnit 4.9] 11.01 s
testJunit[13: JUnit 4.10] 12.34 s
testJunit[14: JUnit 4.11] 12.68 s
testJunit[15: JUnit 4.12] 10.36 s
testJunit[16: JUnit 4.13] 13.39 s
testJunit[17: JUnit 4.13.1] 10.28 s
testJunit[18: JUnit 4.13.2] 7.807 s

Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT

shouldScanAndRunTestsInDependencyJars 21.84 s

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 24.45 s
shouldHaveDefaultReportTitleAndDescription 30.57 s

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 9.483 s

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 88.52 s
testRerunFailingErrorTestsWithOneRetry 172.2 s
testRerunFailingErrorTestsTwoRetry 46.10 s
testRerunOneTestMethod 51.20 s
testRerunOneTestClass 31.56 s

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 11.14 s

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 23.25 s
jarShouldUseFile 15.80 s
warShouldUseClasses 11.14 s
osgiBundleShouldUseFile 8.202 s

AssumptionFailureReportIT

testWriteSkippedMessageToReport 22.27 s

Surefire943ReportContentIT

test_noParallel 18.97 s
test_parallelBoth 8.969 s

CheckTestNg740ParallelIT

withTestNG740AndParallelSetWithoutThreadCount 27.24 s
withTestNG740AndParallelSet 25.71 s

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 20.13 s

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 0 s
- skipped -
shouldLoadMultipleJavaModules_ToolchainsXML 0 s
- skipped -
shouldLoadMultipleJavaModules_JvmParameter 0 s
- skipped -

UmlautDirIT

surefire1617WithColonInLocalRepo 52.78 s
surefire1617WithColonInProjectDir 18.70 s
testUmlautIsolatedClassLoader 17.96 s
testUmlaut 17.02 s

CheckTestNgVersionsIT

test751 25.84 s
test69136 23.65 s
test6143 26.38 s
test6821 20.99 s

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 10.56 s

Surefire1211JUnitTestNgIT

withoutJUnit 25.31 s
withJUnit 16.11 s

ArgLineIT

argLine 176.8 s

PlexusConflictIT

testPlexusConflict 21.52 s
testPlexusConflictIsolatedClassLoader 20.54 s

JUnitDepIT

testJUnit44DepWithSneaky381 23.42 s
testJUnit44Dep 18.95 s
testJUnit47Dep 19.98 s
testJUnit48Dep 23.06 s

Surefire1383ScanSessionDependenciesIT

test 53.23 s

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 15.27 s

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 20.20 s
twoSuitesInParallel 23.79 s

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 11.49 s
classWithoutCategory 13.23 s

CheckTestNgReportTestIT

testNgReport 31.16 s
shouldNotBeVerbose 25.43 s
shouldBeVerbose 27.35 s

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 18.78 s
testSpecifiedTestNotInIncludes 19.18 s

Surefire1202RerunAndSkipIT

junit47 31.19 s
junit4 28.00 s

TestNgGroupsIT

testExclusion 23.28 s
testGroupsAndExclusion 25.02 s
groupsWithDash 20.18 s
testOnlyGroups 19.85 s
groupsBySimpleRegex 20.95 s

Surefire257NotRerunningTestsIT

shouldNotRerun 15.53 s

Surefire34SecurityManagerIT

testSecurityManager 9.846 s
shouldFailOnJDK 0 s
- skipped -
testSecurityManagerSuccessful 10.87 s

Failure Details

[Summary] [Package List] [Test Cases]


negativeTest[0]
- skipped: skipped
simpleNameTestAsParallel[0]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
- skipped: skipped
negativeTest[1]
- skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
- skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
- skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
- skipped: skipped
testSuccessTwo[2]
- skipped: skipped
shouldNotRunExcludedMethods[2]
- skipped: skipped
shouldMatchMultiplePatterns[2]
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
- skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
- skipped: skipped
testRegexSuccessTwo[2]
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
- skipped: skipped
shouldMatchMultiplePatternsComplex[2]
- skipped: skipped
simpleNameTestAsParallel[2]
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
- skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
- skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
- skipped: skipped
regexClassAndMethod[2]
- skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
- skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
- skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
- skipped: skipped
testSuccessTwo[3]
- skipped: skipped
shouldNotRunExcludedMethods[3]
- skipped: skipped
shouldMatchMultiplePatterns[3]
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
- skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
- skipped: skipped
testRegexSuccessTwo[3]
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
- skipped: skipped
shouldMatchMultiplePatternsComplex[3]
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
- skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
- skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
- skipped: skipped
regexClassAndMethod[3]
- skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
- skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
- skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
- skipped: skipped
testSuccessTwo[4]
- skipped: skipped
shouldNotRunExcludedMethods[4]
- skipped: skipped
shouldMatchMultiplePatterns[4]
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
- skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
- skipped: skipped
testRegexSuccessTwo[4]
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
- skipped: skipped
shouldMatchMultiplePatternsComplex[4]
- skipped: skipped
simpleNameTestAsParallel[4]
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
- skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
- skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
- skipped: skipped
regexClassAndMethod[4]
- skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
- skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
- skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
- skipped: skipped
testSuccessTwo[5]
- skipped: skipped
shouldNotRunExcludedMethods[5]
- skipped: skipped
shouldMatchMultiplePatterns[5]
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
- skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
- skipped: skipped
testRegexSuccessTwo[5]
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
- skipped: skipped
shouldMatchMultiplePatternsComplex[5]
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
- skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
- skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
- skipped: skipped
regexClassAndMethod[5]
- skipped: skipped
test
- skipped: skipped
negativeTest[0]
- skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
- skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
- skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
- skipped: skipped
testSuccessTwo[1]
- skipped: skipped
shouldNotRunExcludedMethods[1]
- skipped: skipped
shouldMatchMultiplePatterns[1]
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
- skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
- skipped: skipped
testRegexSuccessTwo[1]
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
- skipped: skipped
shouldMatchMultiplePatternsComplex[1]
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
- skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
- skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
- skipped: skipped
regexClassAndMethod[1]
- skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
- skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
- skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
- skipped: skipped
testSuccessTwo[2]
- skipped: skipped
shouldNotRunExcludedMethods[2]
- skipped: skipped
shouldMatchMultiplePatterns[2]
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
- skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
- skipped: skipped
testRegexSuccessTwo[2]
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
- skipped: skipped
shouldMatchMultiplePatternsComplex[2]
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
- skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
- skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
- skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
- skipped: skipped
regexClassAndMethod[2]
- skipped: skipped
verify
- skipped: skipped
shouldRunInSystemTmp
- skipped: skipped
test
- skipped: skipped
shouldRunWithJupiterApi
- skipped: skipped
warningIsNotEmittedWithJulToLog4j
- skipped: https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005
test
- skipped: skipped
testModulePathWithSpaces
- skipped: skipped
testModulePath
- skipped: skipped
test
- skipped: skipped
shouldRunInPluginJava9
- skipped: skipped
testExecuteWithReuseForksFalseWithJavaModule
- skipped: skipped
testExecuteWithReuseForksFalseWithJavaModuleWithFilter
- skipped: skipped
testExecuteWithZeroForkCountWithJavaModule
- skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
- skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
- skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
test
- skipped: skipped
testModulePathWithSpaces
- skipped: skipped
testModulePath
- skipped: skipped
shouldLoadMultipleJavaModules_JavaHome
- skipped: skipped
shouldLoadMultipleJavaModules_ToolchainsXML
- skipped: skipped
shouldLoadMultipleJavaModules_JvmParameter
- skipped: skipped
shouldFailOnJDK
- skipped: skipped