Skip to content

Instantly share code, notes, and snippets.

@mmatrosov

mmatrosov/gist:8248a77d8b82623475e39dc84bdceba0

Created January 2, 2022 20:15
Show Gist options
  • Save mmatrosov/8248a77d8b82623475e39dc84bdceba0 to your computer and use it in GitHub Desktop.
Save mmatrosov/8248a77d8b82623475e39dc84bdceba0 to your computer and use it in GitHub Desktop.
Download ZIP
Catch2 output with gtest reporter on failing tests
Raw
gistfile1.txt
[23:13:01] mmatrosov ~/dev/temp/Catch2/build (gtest-reporter)
$ ninja && projects/SelfTest -r gtest '*fail*'
Filters: *fail*
[==========] Running SelfTest
[----------] A METHOD_AS_TEST_CASE based test run that fails
[ RUN ] A METHOD_AS_TEST_CASE based test run that fails
../projects/SelfTest/UsageTests/Class.tests.cpp:32: FAILED:
REQUIRE( s == "world" )
with expansion:
"hello" == "world"
[ FAILED ] A METHOD_AS_TEST_CASE based test run that fails
[----------] 1 test from A METHOD_AS_TEST_CASE based test run that fails (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEST_CASE_METHOD based test run that fails
[ RUN ] A TEST_CASE_METHOD based test run that fails
../projects/SelfTest/UsageTests/Class.tests.cpp:112: FAILED:
REQUIRE( m_a == 2 )
with expansion:
1 == 2
[ FAILED ] A TEST_CASE_METHOD based test run that fails
[----------] 1 test from A TEST_CASE_METHOD based test run that fails (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_TEST_CASE_METHOD based test run that fails - int
[ RUN ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - int
../projects/SelfTest/UsageTests/Class.tests.cpp:117: FAILED:
REQUIRE( Template_Fixture<TestType>::m_a == 2 )
with expansion:
1 == 2
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - int
[----------] 1 test from A TEMPLATE_TEST_CASE_METHOD based test run that fails - int (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_TEST_CASE_METHOD based test run that fails - float
[ RUN ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - float
../projects/SelfTest/UsageTests/Class.tests.cpp:117: FAILED:
REQUIRE( Template_Fixture<TestType>::m_a == 2 )
with expansion:
1.0f == 2
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - float
[----------] 1 test from A TEMPLATE_TEST_CASE_METHOD based test run that fails - float (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_TEST_CASE_METHOD based test run that fails - double
[ RUN ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - double
../projects/SelfTest/UsageTests/Class.tests.cpp:117: FAILED:
REQUIRE( Template_Fixture<TestType>::m_a == 2 )
with expansion:
1.0 == 2
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - double
[----------] 1 test from A TEMPLATE_TEST_CASE_METHOD based test run that fails - double (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 1
[ RUN ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 1
../projects/SelfTest/UsageTests/Class.tests.cpp:121: FAILED:
REQUIRE( Nttp_Fixture<V>::value == 0 )
with expansion:
1 == 0
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 1
[----------] 1 test from A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 1 (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 3
[ RUN ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 3
../projects/SelfTest/UsageTests/Class.tests.cpp:121: FAILED:
REQUIRE( Nttp_Fixture<V>::value == 0 )
with expansion:
3 == 0
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 3
[----------] 1 test from A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 3 (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 6
[ RUN ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 6
../projects/SelfTest/UsageTests/Class.tests.cpp:121: FAILED:
REQUIRE( Nttp_Fixture<V>::value == 0 )
with expansion:
6 == 0
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 6
[----------] 1 test from A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 6 (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<int>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<int>
../projects/SelfTest/UsageTests/Class.tests.cpp:126: FAILED:
REQUIRE( Template_Fixture_2<TestType>::m_a.size() == 1 )
with expansion:
0 == 1
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<int>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<int> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<float>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<float>
../projects/SelfTest/UsageTests/Class.tests.cpp:126: FAILED:
REQUIRE( Template_Fixture_2<TestType>::m_a.size() == 1 )
with expansion:
0 == 1
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<float>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<float> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int>
../projects/SelfTest/UsageTests/Class.tests.cpp:126: FAILED:
REQUIRE( Template_Fixture_2<TestType>::m_a.size() == 1 )
with expansion:
0 == 1
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<float>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<float>
../projects/SelfTest/UsageTests/Class.tests.cpp:126: FAILED:
REQUIRE( Template_Fixture_2<TestType>::m_a.size() == 1 )
with expansion:
0 == 1
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<float>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<float> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<int, 2>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<int, 2>
../projects/SelfTest/UsageTests/Class.tests.cpp:131: FAILED:
REQUIRE( Template_Fixture_2<TestType>{}.m_a.size() < 2 )
with expansion:
2 < 2
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<int, 2>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<int, 2> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<float, 6>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<float, 6>
../projects/SelfTest/UsageTests/Class.tests.cpp:131: FAILED:
REQUIRE( Template_Fixture_2<TestType>{}.m_a.size() < 2 )
with expansion:
6 < 2
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<float, 6>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<float, 6> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2>
../projects/SelfTest/UsageTests/Class.tests.cpp:131: FAILED:
REQUIRE( Template_Fixture_2<TestType>{}.m_a.size() < 2 )
with expansion:
2 < 2
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2> (0 ms total)
[ FAILED ] 1 test failed
[----------] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<float, 6>
[ RUN ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<float, 6>
../projects/SelfTest/UsageTests/Class.tests.cpp:131: FAILED:
REQUIRE( Template_Fixture_2<TestType>{}.m_a.size() < 2 )
with expansion:
6 < 2
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<float, 6>
[----------] 1 test from A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<float, 6> (0 ms total)
[ FAILED ] 1 test failed
[----------] #925: comparing function pointer to function address failed to compile
[ RUN ] #925: comparing function pointer to function address failed to compile
[ OK ] #925: comparing function pointer to function address failed to compile
[----------] 1 test from #925: comparing function pointer to function address failed to compile (0 ms total)
[----------] Equality checks that should fail
[ RUN ] Equality checks that should fail
../projects/SelfTest/UsageTests/Condition.tests.cpp:75: FAILED:
CHECK( data.int_seven == 6 )
with expansion:
7 == 6
../projects/SelfTest/UsageTests/Condition.tests.cpp:76: FAILED:
CHECK( data.int_seven == 8 )
with expansion:
7 == 8
../projects/SelfTest/UsageTests/Condition.tests.cpp:77: FAILED:
CHECK( data.int_seven == 0 )
with expansion:
7 == 0
../projects/SelfTest/UsageTests/Condition.tests.cpp:78: FAILED:
CHECK( data.float_nine_point_one == Approx( 9.11f ) )
with expansion:
9.1f == Approx( 9.1099996567 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:79: FAILED:
CHECK( data.float_nine_point_one == Approx( 9.0f ) )
with expansion:
9.1f == Approx( 9.0 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:80: FAILED:
CHECK( data.float_nine_point_one == Approx( 1 ) )
with expansion:
9.1f == Approx( 1.0 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:81: FAILED:
CHECK( data.float_nine_point_one == Approx( 0 ) )
with expansion:
9.1f == Approx( 0.0 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:82: FAILED:
CHECK( data.double_pi == Approx( 3.1415 ) )
with expansion:
3.1415926535 == Approx( 3.1415 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:83: FAILED:
CHECK( data.str_hello == "goodbye" )
with expansion:
"hello" == "goodbye"
../projects/SelfTest/UsageTests/Condition.tests.cpp:84: FAILED:
CHECK( data.str_hello == "hell" )
with expansion:
"hello" == "hell"
../projects/SelfTest/UsageTests/Condition.tests.cpp:85: FAILED:
CHECK( data.str_hello == "hello1" )
with expansion:
"hello" == "hello1"
../projects/SelfTest/UsageTests/Condition.tests.cpp:86: FAILED:
CHECK( data.str_hello.size() == 6 )
with expansion:
5 == 6
../projects/SelfTest/UsageTests/Condition.tests.cpp:89: FAILED:
CHECK( x == Approx( 1.301 ) )
with expansion:
1.3 == Approx( 1.301 )
[ OK ] Equality checks that should fail
[----------] 1 test from Equality checks that should fail (0 ms total)
[ EXPECTED ] 1 test failed as expected
[----------] Mayfail test case with nested sections
[ RUN ] Mayfail test case with nested sections
[ RUN ] Mayfail test case with nested sections / A
[ RUN ] Mayfail test case with nested sections / A / 1
../projects/SelfTest/UsageTests/Condition.tests.cpp:95: FAILED:
[ OK ] Mayfail test case with nested sections / A / 1 (0 ms)
[ OK ] Mayfail test case with nested sections / A (0 ms)
[ RUN ] Mayfail test case with nested sections / A
[ RUN ] Mayfail test case with nested sections / A / 2
../projects/SelfTest/UsageTests/Condition.tests.cpp:96: FAILED:
[ OK ] Mayfail test case with nested sections / A / 2 (0 ms)
[ OK ] Mayfail test case with nested sections / A (0 ms)
[ RUN ] Mayfail test case with nested sections / A
[ OK ] Mayfail test case with nested sections / A (0 ms)
[ RUN ] Mayfail test case with nested sections / B
[ RUN ] Mayfail test case with nested sections / B / 1
../projects/SelfTest/UsageTests/Condition.tests.cpp:99: FAILED:
[ OK ] Mayfail test case with nested sections / B / 1 (0 ms)
[ OK ] Mayfail test case with nested sections / B (0 ms)
[ RUN ] Mayfail test case with nested sections / B
[ RUN ] Mayfail test case with nested sections / B / 2
../projects/SelfTest/UsageTests/Condition.tests.cpp:100: FAILED:
[ OK ] Mayfail test case with nested sections / B / 2 (0 ms)
[ OK ] Mayfail test case with nested sections / B (0 ms)
[ RUN ] Mayfail test case with nested sections / B
[ OK ] Mayfail test case with nested sections / B (0 ms)
[ OK ] Mayfail test case with nested sections
[----------] 6 tests from Mayfail test case with nested sections (0 ms total)
[ EXPECTED ] 4 tests failed as expected
[----------] Inequality checks that should fail
[ RUN ] Inequality checks that should fail
../projects/SelfTest/UsageTests/Condition.tests.cpp:126: FAILED:
CHECK( data.int_seven != 7 )
with expansion:
7 != 7
../projects/SelfTest/UsageTests/Condition.tests.cpp:127: FAILED:
CHECK( data.float_nine_point_one != Approx( 9.1f ) )
with expansion:
9.1f != Approx( 9.1000003815 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:128: FAILED:
CHECK( data.double_pi != Approx( 3.1415926535 ) )
with expansion:
3.1415926535 != Approx( 3.1415926535 )
../projects/SelfTest/UsageTests/Condition.tests.cpp:129: FAILED:
CHECK( data.str_hello != "hello" )
with expansion:
"hello" != "hello"
../projects/SelfTest/UsageTests/Condition.tests.cpp:130: FAILED:
CHECK( data.str_hello.size() != 5 )
with expansion:
5 != 5
[ OK ] Inequality checks that should fail
[----------] 1 test from Inequality checks that should fail (0 ms total)
[ EXPECTED ] 1 test failed as expected
[----------] Ordering comparison checks that should fail
[ RUN ] Ordering comparison checks that should fail
../projects/SelfTest/UsageTests/Condition.tests.cpp:165: FAILED:
CHECK( data.int_seven > 7 )
with expansion:
7 > 7
../projects/SelfTest/UsageTests/Condition.tests.cpp:166: FAILED:
CHECK( data.int_seven < 7 )
with expansion:
7 < 7
../projects/SelfTest/UsageTests/Condition.tests.cpp:167: FAILED:
CHECK( data.int_seven > 8 )
with expansion:
7 > 8
../projects/SelfTest/UsageTests/Condition.tests.cpp:168: FAILED:
CHECK( data.int_seven < 6 )
with expansion:
7 < 6
../projects/SelfTest/UsageTests/Condition.tests.cpp:169: FAILED:
CHECK( data.int_seven < 0 )
with expansion:
7 < 0
../projects/SelfTest/UsageTests/Condition.tests.cpp:170: FAILED:
CHECK( data.int_seven < -1 )
with expansion:
7 < -1
../projects/SelfTest/UsageTests/Condition.tests.cpp:172: FAILED:
CHECK( data.int_seven >= 8 )
with expansion:
7 >= 8
../projects/SelfTest/UsageTests/Condition.tests.cpp:173: FAILED:
CHECK( data.int_seven <= 6 )
with expansion:
7 <= 6
../projects/SelfTest/UsageTests/Condition.tests.cpp:175: FAILED:
CHECK( data.float_nine_point_one < 9 )
with expansion:
9.1f < 9
../projects/SelfTest/UsageTests/Condition.tests.cpp:176: FAILED:
CHECK( data.float_nine_point_one > 10 )
with expansion:
9.1f > 10
../projects/SelfTest/UsageTests/Condition.tests.cpp:177: FAILED:
CHECK( data.float_nine_point_one > 9.2 )
with expansion:
9.1f > 9.2
../projects/SelfTest/UsageTests/Condition.tests.cpp:179: FAILED:
CHECK( data.str_hello > "hello" )
with expansion:
"hello" > "hello"
../projects/SelfTest/UsageTests/Condition.tests.cpp:180: FAILED:
CHECK( data.str_hello < "hello" )
with expansion:
"hello" < "hello"
../projects/SelfTest/UsageTests/Condition.tests.cpp:181: FAILED:
CHECK( data.str_hello > "hellp" )
with expansion:
"hello" > "hellp"
../projects/SelfTest/UsageTests/Condition.tests.cpp:182: FAILED:
CHECK( data.str_hello > "z" )
with expansion:
"hello" > "z"
../projects/SelfTest/UsageTests/Condition.tests.cpp:183: FAILED:
CHECK( data.str_hello < "hellm" )
with expansion:
"hello" < "hellm"
../projects/SelfTest/UsageTests/Condition.tests.cpp:184: FAILED:
CHECK( data.str_hello < "a" )
with expansion:
"hello" < "a"
../projects/SelfTest/UsageTests/Condition.tests.cpp:186: FAILED:
CHECK( data.str_hello >= "z" )
with expansion:
"hello" >= "z"
../projects/SelfTest/UsageTests/Condition.tests.cpp:187: FAILED:
CHECK( data.str_hello <= "a" )
with expansion:
"hello" <= "a"
[ FAILED ] Ordering comparison checks that should fail
[----------] 1 test from Ordering comparison checks that should fail (0 ms total)
[ FAILED ] 1 test failed
[----------] 'Not' checks that should fail
[ RUN ] 'Not' checks that should fail
../projects/SelfTest/UsageTests/Condition.tests.cpp:335: FAILED:
CHECK( false != false )
../projects/SelfTest/UsageTests/Condition.tests.cpp:336: FAILED:
CHECK( true != true )
../projects/SelfTest/UsageTests/Condition.tests.cpp:337: FAILED:
CHECK( !true )
with expansion:
false
../projects/SelfTest/UsageTests/Condition.tests.cpp:338: FAILED:
CHECK_FALSE( true )
with expansion:
!true
../projects/SelfTest/UsageTests/Condition.tests.cpp:340: FAILED:
CHECK( !trueValue )
with expansion:
false
../projects/SelfTest/UsageTests/Condition.tests.cpp:341: FAILED:
CHECK_FALSE( trueValue )
with expansion:
!true
../projects/SelfTest/UsageTests/Condition.tests.cpp:343: FAILED:
CHECK( !(1 == 1) )
with expansion:
false
../projects/SelfTest/UsageTests/Condition.tests.cpp:344: FAILED:
CHECK_FALSE( 1 == 1 )
[ FAILED ] 'Not' checks that should fail
[----------] 1 test from 'Not' checks that should fail (0 ms total)
[ FAILED ] 1 test failed
[----------] Expected exceptions that don't throw or unexpected exceptions fail the test
[ RUN ] Expected exceptions that don't throw or unexpected exceptions fail the test
../projects/SelfTest/UsageTests/Exception.tests.cpp:80: FAILED:
CHECK_THROWS_AS( thisThrows(), std::string )
due to unexpected exception with message:
expected exception
../projects/SelfTest/UsageTests/Exception.tests.cpp:81: FAILED:
CHECK_THROWS_AS( thisDoesntThrow(), std::domain_error )
because no exception was thrown where one was expected:
../projects/SelfTest/UsageTests/Exception.tests.cpp:82: FAILED:
CHECK_NOTHROW( thisThrows() )
due to unexpected exception with message:
expected exception
[ FAILED ] Expected exceptions that don't throw or unexpected exceptions fail the test
[----------] 1 test from Expected exceptions that don't throw or unexpected exceptions fail the test (0 ms total)
[ FAILED ] 1 test failed
[----------] When unchecked exceptions are thrown directly they are always failures
[ RUN ] When unchecked exceptions are thrown directly they are always failures
../projects/SelfTest/UsageTests/Exception.tests.cpp:85: FAILED:
due to unexpected exception with message:
unexpected exception
[ FAILED ] When unchecked exceptions are thrown directly they are always failures
[----------] 1 test from When unchecked exceptions are thrown directly they are always failures (0 ms total)
[ FAILED ] 1 test failed
[----------] When unchecked exceptions are thrown from sections they are always failures
[ RUN ] When unchecked exceptions are thrown from sections they are always failures
[ RUN ] When unchecked exceptions are thrown from sections they are always failures / section name
../projects/SelfTest/UsageTests/Exception.tests.cpp:95: FAILED:
due to unexpected exception with message:
unexpected exception
[ FAILED ] When unchecked exceptions are thrown from sections they are always failures / section name (0 ms)
[ FAILED ] When unchecked exceptions are thrown from sections they are always failures
[----------] 2 tests from When unchecked exceptions are thrown from sections they are always failures (0 ms total)
[ FAILED ] 1 test failed
[----------] When unchecked exceptions are thrown from functions they are always failures
[ RUN ] When unchecked exceptions are thrown from functions they are always failures
../projects/SelfTest/UsageTests/Exception.tests.cpp:101: FAILED:
CHECK( thisThrows() == 0 )
due to unexpected exception with message:
expected exception
[ FAILED ] When unchecked exceptions are thrown from functions they are always failures
[----------] 1 test from When unchecked exceptions are thrown from functions they are always failures (0 ms total)
[ FAILED ] 1 test failed
[----------] When unchecked exceptions are thrown during a REQUIRE the test should abort fail
[ RUN ] When unchecked exceptions are thrown during a REQUIRE the test should abort fail
../projects/SelfTest/UsageTests/Exception.tests.cpp:105: FAILED:
REQUIRE( thisThrows() == 0 )
due to unexpected exception with message:
expected exception
[ FAILED ] When unchecked exceptions are thrown during a REQUIRE the test should abort fail
[----------] 1 test from When unchecked exceptions are thrown during a REQUIRE the test should abort fail (0 ms total)
[ FAILED ] 1 test failed
[----------] Mismatching exception messages failing the test
[ RUN ] Mismatching exception messages failing the test
../projects/SelfTest/UsageTests/Exception.tests.cpp:187: FAILED:
REQUIRE_THROWS_WITH( thisThrows(), "should fail" )
with expansion:
"expected exception" equals: "should fail"
[ FAILED ] Mismatching exception messages failing the test
[----------] 1 test from Mismatching exception messages failing the test (0 ms total)
[ FAILED ] 1 test failed
[----------] INFO gets logged on failure
[ RUN ] INFO gets logged on failure
../projects/SelfTest/UsageTests/Message.tests.cpp:32: FAILED:
REQUIRE( a == 1 )
with expansion:
2 == 1
with messages:
this message should be logged
so should this
[ FAILED ] INFO gets logged on failure
[----------] 1 test from INFO gets logged on failure (0 ms total)
[ FAILED ] 1 test failed
[----------] INFO gets logged on failure, even if captured before successful assertions
[ RUN ] INFO gets logged on failure, even if captured before successful assertions
../projects/SelfTest/UsageTests/Message.tests.cpp:42: FAILED:
CHECK( a == 1 )
with expansion:
2 == 1
with messages:
this message may be logged later
this message should be logged
../projects/SelfTest/UsageTests/Message.tests.cpp:46: FAILED:
CHECK( a == 0 )
with expansion:
2 == 0
with messages:
this message may be logged later
this message should be logged
and this, but later
[ FAILED ] INFO gets logged on failure, even if captured before successful assertions
[----------] 1 test from INFO gets logged on failure, even if captured before successful assertions (0 ms total)
[ FAILED ] 1 test failed
[----------] FAIL aborts the test
[ RUN ] FAIL aborts the test
../projects/SelfTest/UsageTests/Message.tests.cpp:54: FAILED:
explicitly with message:
This is a failure
[ FAILED ] FAIL aborts the test
[----------] 1 test from FAIL aborts the test (0 ms total)
[ FAILED ] 1 test failed
[----------] FAIL_CHECK does not abort the test
[ RUN ] FAIL_CHECK does not abort the test
../projects/SelfTest/UsageTests/Message.tests.cpp:59: FAILED:
explicitly with message:
This is a failure
../projects/SelfTest/UsageTests/Message.tests.cpp:60: warning:
This message appears in the output
[ FAILED ] FAIL_CHECK does not abort the test
[----------] 1 test from FAIL_CHECK does not abort the test (0 ms total)
[ FAILED ] 1 test failed
[----------] FAIL does not require an argument
[ RUN ] FAIL does not require an argument
../projects/SelfTest/UsageTests/Message.tests.cpp:64: FAILED:
[ FAILED ] FAIL does not require an argument
[----------] 1 test from FAIL does not require an argument (0 ms total)
[ FAILED ] 1 test failed
[----------] The NO_FAIL macro reports a failure but does not fail the test
[ RUN ] The NO_FAIL macro reports a failure but does not fail the test
[ OK ] The NO_FAIL macro reports a failure but does not fail the test
[----------] 1 test from The NO_FAIL macro reports a failure but does not fail the test (0 ms total)
[----------] just failure
[ RUN ] just failure
../projects/SelfTest/UsageTests/Message.tests.cpp:125: FAILED:
explicitly with message:
Previous info should not be seen
[ FAILED ] just failure
[----------] 1 test from just failure (0 ms total)
[ FAILED ] 1 test failed
[----------] just failure after unscoped info
[ RUN ] just failure after unscoped info
../projects/SelfTest/UsageTests/Message.tests.cpp:153: FAILED:
explicitly with message:
previous unscoped info SHOULD not be seen
[ FAILED ] just failure after unscoped info
[----------] 1 test from just failure after unscoped info (0 ms total)
[ FAILED ] 1 test failed
[----------] prints unscoped info on failure
[ RUN ] prints unscoped info on failure
../projects/SelfTest/UsageTests/Message.tests.cpp:164: FAILED:
REQUIRE( false )
with messages:
this SHOULD be seen
this SHOULD also be seen
[ FAILED ] prints unscoped info on failure
[----------] 1 test from prints unscoped info on failure (0 ms total)
[ FAILED ] 1 test failed
[----------] not prints unscoped info from previous failures
[ RUN ] not prints unscoped info from previous failures
../projects/SelfTest/UsageTests/Message.tests.cpp:174: FAILED:
REQUIRE( false )
with message:
this SHOULD be seen
[ FAILED ] not prints unscoped info from previous failures
[----------] 1 test from not prints unscoped info from previous failures (0 ms total)
[ FAILED ] 1 test failed
[----------] checkedIf, failing
[ RUN ] checkedIf, failing
../projects/SelfTest/UsageTests/Misc.tests.cpp:32: FAILED:
CHECKED_IF( flag )
with expansion:
false
../projects/SelfTest/UsageTests/Misc.tests.cpp:175: FAILED:
REQUIRE( testCheckedIf( false ) )
with expansion:
false
[ FAILED ] checkedIf, failing
[----------] 1 test from checkedIf, failing (0 ms total)
[ FAILED ] 1 test failed
[----------] checkedElse, failing
[ RUN ] checkedElse, failing
../projects/SelfTest/UsageTests/Misc.tests.cpp:38: FAILED:
CHECKED_ELSE( flag )
with expansion:
false
../projects/SelfTest/UsageTests/Misc.tests.cpp:183: FAILED:
REQUIRE( testCheckedElse( false ) )
with expansion:
false
[ FAILED ] checkedElse, failing
[----------] 1 test from checkedElse, failing (0 ms total)
[ FAILED ] 1 test failed
[----------] A couple of nested sections followed by a failure
[ RUN ] A couple of nested sections followed by a failure
[ RUN ] A couple of nested sections followed by a failure / Outer
[ RUN ] A couple of nested sections followed by a failure / Outer / Inner
[ OK ] A couple of nested sections followed by a failure / Outer / Inner (0 ms)
[ OK ] A couple of nested sections followed by a failure / Outer (0 ms)
../projects/SelfTest/UsageTests/Misc.tests.cpp:407: FAILED:
explicitly with message:
to infinity and beyond
[ FAILED ] A couple of nested sections followed by a failure
[----------] 1 test from A couple of nested sections followed by a failure (0 ms total)
[ FAILED ] 1 test failed
[----------] This test 'should' fail but doesn't
[ RUN ] This test 'should' fail but doesn't
[ FAILED ] This test 'should' fail but doesn't
[----------] 1 test from This test 'should' fail but doesn't (0 ms total)
[----------] A failing expression with a non streamable type is still captured
[ RUN ] A failing expression with a non streamable type is still captured
../projects/SelfTest/UsageTests/Tricky.tests.cpp:73: FAILED:
CHECK( &o1 == &o2 )
with expansion:
0x00007ffe57b67008 == 0x00007ffe57b67000
../projects/SelfTest/UsageTests/Tricky.tests.cpp:74: FAILED:
CHECK( o1 == o2 )
with expansion:
{?} == {?}
[ FAILED ] A failing expression with a non streamable type is still captured
[----------] 1 test from A failing expression with a non streamable type is still captured (0 ms total)
[ FAILED ] 1 test failed
[----------] Matchers can be composed with both && and || - failing
[ RUN ] Matchers can be composed with both && and || - failing
../projects/SelfTest/UsageTests/Matchers.tests.cpp:205: FAILED:
CHECK_THAT( testStringForMatching(), (Contains("string") || Contains("different")) && Contains("random") )
with expansion:
"this string contains 'abc' as a substring" ( ( contains: "string" or
contains: "different" ) and contains: "random" )
[ FAILED ] Matchers can be composed with both && and || - failing
[----------] 1 test from Matchers can be composed with both && and || - failing (0 ms total)
[ FAILED ] 1 test failed
[----------] Matchers can be negated (Not) with the ! operator - failing
[ RUN ] Matchers can be negated (Not) with the ! operator - failing
../projects/SelfTest/UsageTests/Matchers.tests.cpp:214: FAILED:
CHECK_THAT( testStringForMatching(), !Contains("substring") )
with expansion:
"this string contains 'abc' as a substring" not contains: "substring"
[ FAILED ] Matchers can be negated (Not) with the ! operator - failing
[----------] 1 test from Matchers can be negated (Not) with the ! operator - failing (0 ms total)
[ FAILED ] 1 test failed
[----------] Vector matchers that fail
[ RUN ] Vector matchers that fail
[ RUN ] Vector matchers that fail / Contains (element)
../projects/SelfTest/UsageTests/Matchers.tests.cpp:368: FAILED:
CHECK_THAT( v, VectorContains(-1) )
with expansion:
{ 1, 2, 3 } Contains: -1
../projects/SelfTest/UsageTests/Matchers.tests.cpp:369: FAILED:
CHECK_THAT( empty, VectorContains(1) )
with expansion:
{ } Contains: 1
[ FAILED ] Vector matchers that fail / Contains (element) (0 ms)
[ RUN ] Vector matchers that fail / Contains (vector)
../projects/SelfTest/UsageTests/Matchers.tests.cpp:372: FAILED:
CHECK_THAT( empty, Contains(v) )
with expansion:
{ } Contains: { 1, 2, 3 }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:374: FAILED:
CHECK_THAT( v, Contains(v2) )
with expansion:
{ 1, 2, 3 } Contains: { 1, 2, 4 }
[ FAILED ] Vector matchers that fail / Contains (vector) (0 ms)
[ RUN ] Vector matchers that fail / Equals
../projects/SelfTest/UsageTests/Matchers.tests.cpp:379: FAILED:
CHECK_THAT( v, Equals(v2) )
with expansion:
{ 1, 2, 3 } Equals: { 1, 2 }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:380: FAILED:
CHECK_THAT( v2, Equals(v) )
with expansion:
{ 1, 2 } Equals: { 1, 2, 3 }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:381: FAILED:
CHECK_THAT( empty, Equals(v) )
with expansion:
{ } Equals: { 1, 2, 3 }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:382: FAILED:
CHECK_THAT( v, Equals(empty) )
with expansion:
{ 1, 2, 3 } Equals: { }
[ FAILED ] Vector matchers that fail / Equals (0 ms)
[ RUN ] Vector matchers that fail / UnorderedEquals
../projects/SelfTest/UsageTests/Matchers.tests.cpp:385: FAILED:
CHECK_THAT( v, UnorderedEquals(empty) )
with expansion:
{ 1, 2, 3 } UnorderedEquals: { }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:386: FAILED:
CHECK_THAT( empty, UnorderedEquals(v) )
with expansion:
{ } UnorderedEquals: { 1, 2, 3 }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:391: FAILED:
CHECK_THAT( permuted, UnorderedEquals(v) )
with expansion:
{ 1, 3 } UnorderedEquals: { 1, 2, 3 }
../projects/SelfTest/UsageTests/Matchers.tests.cpp:394: FAILED:
CHECK_THAT( permuted, UnorderedEquals(v) )
with expansion:
{ 3, 1 } UnorderedEquals: { 1, 2, 3 }
[ FAILED ] Vector matchers that fail / UnorderedEquals (0 ms)
[ FAILED ] Vector matchers that fail
[----------] 4 tests from Vector matchers that fail (0 ms total)
[ FAILED ] 4 tests failed
[----------] Exception matchers that fail
[ RUN ] Exception matchers that fail
[ RUN ] Exception matchers that fail / No exception
../projects/SelfTest/UsageTests/Matchers.tests.cpp:405: FAILED:
CHECK_THROWS_MATCHES( doesNotThrow(), SpecialException, ExceptionMatcher{1} )
because no exception was thrown where one was expected:
../projects/SelfTest/UsageTests/Matchers.tests.cpp:406: FAILED:
REQUIRE_THROWS_MATCHES( doesNotThrow(), SpecialException, ExceptionMatcher{1} )
because no exception was thrown where one was expected:
[ FAILED ] Exception matchers that fail / No exception (0 ms)
[ RUN ] Exception matchers that fail / Type mismatch
../projects/SelfTest/UsageTests/Matchers.tests.cpp:409: FAILED:
CHECK_THROWS_MATCHES( throwsAsInt(1), SpecialException, ExceptionMatcher{1} )
due to unexpected exception with message:
Unknown exception
../projects/SelfTest/UsageTests/Matchers.tests.cpp:410: FAILED:
REQUIRE_THROWS_MATCHES( throwsAsInt(1), SpecialException, ExceptionMatcher{1} )
due to unexpected exception with message:
Unknown exception
[ FAILED ] Exception matchers that fail / Type mismatch (0 ms)
[ RUN ] Exception matchers that fail / Contents are wrong
../projects/SelfTest/UsageTests/Matchers.tests.cpp:413: FAILED:
CHECK_THROWS_MATCHES( throwsSpecialException(3), SpecialException, ExceptionMatcher{1} )
with expansion:
SpecialException::what special exception has value of 1
../projects/SelfTest/UsageTests/Matchers.tests.cpp:414: FAILED:
REQUIRE_THROWS_MATCHES( throwsSpecialException(4), SpecialException, ExceptionMatcher{1} )
with expansion:
SpecialException::what special exception has value of 1
[ FAILED ] Exception matchers that fail / Contents are wrong (0 ms)
[ FAILED ] Exception matchers that fail
[----------] 4 tests from Exception matchers that fail (0 ms total)
[ FAILED ] 3 tests failed
[----------] Vector Approx matcher -- failing
[ RUN ] Vector Approx matcher -- failing
[ RUN ] Vector Approx matcher -- failing / Empty and non empty vectors are not approx equal
../projects/SelfTest/UsageTests/Matchers.tests.cpp:608: FAILED:
CHECK_THAT( empty, Approx(t1) )
with expansion:
{ } is approx: { 1.0, 2.0 }
[ FAILED ] Vector Approx matcher -- failing / Empty and non empty vectors are not approx equal (0 ms)
[ RUN ] Vector Approx matcher -- failing / Just different vectors
../projects/SelfTest/UsageTests/Matchers.tests.cpp:612: FAILED:
CHECK_THAT( v1, Approx(v2) )
with expansion:
{ 2.0, 4.0, 6.0 } is approx: { 1.0, 3.0, 5.0 }
[ FAILED ] Vector Approx matcher -- failing / Just different vectors (0 ms)
[ FAILED ] Vector Approx matcher -- failing
[----------] 2 tests from Vector Approx matcher -- failing (0 ms total)
[ FAILED ] 2 tests failed
[==========] 61 tests from 48 test cases run (4 ms total)
[ PASSED ] 7 tests passed
[ EXPECTED ] 6 tests failed as expected
[ FAILED ] 48 tests from 43 test cases failed in 48 sections:
[ FAILED ] A METHOD_AS_TEST_CASE based test run that fails
[ FAILED ] A TEST_CASE_METHOD based test run that fails
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - int
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - float
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD based test run that fails - double
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 1
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 3
[ FAILED ] A TEMPLATE_TEST_CASE_METHOD_SIG based test run that fails - 6
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<int>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - std::vector<float>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<float>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<int, 2>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - std::array<float, 6>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2>
[ FAILED ] A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<float, 6>
[ FAILED ] Ordering comparison checks that should fail
[ FAILED ] 'Not' checks that should fail
[ FAILED ] Expected exceptions that don't throw or unexpected exceptions fail the test
[ FAILED ] When unchecked exceptions are thrown directly they are always failures
[ FAILED ] When unchecked exceptions are thrown from sections they are always failures / section name
[ FAILED ] When unchecked exceptions are thrown from functions they are always failures
[ FAILED ] When unchecked exceptions are thrown during a REQUIRE the test should abort fail
[ FAILED ] Mismatching exception messages failing the test
[ FAILED ] INFO gets logged on failure
[ FAILED ] INFO gets logged on failure, even if captured before successful assertions
[ FAILED ] FAIL aborts the test
[ FAILED ] FAIL_CHECK does not abort the test
[ FAILED ] FAIL does not require an argument
[ FAILED ] just failure
[ FAILED ] just failure after unscoped info
[ FAILED ] prints unscoped info on failure
[ FAILED ] not prints unscoped info from previous failures
[ FAILED ] checkedIf, failing
[ FAILED ] checkedElse, failing
[ FAILED ] A couple of nested sections followed by a failure
[ FAILED ] A failing expression with a non streamable type is still captured
[ FAILED ] Matchers can be composed with both && and || - failing
[ FAILED ] Matchers can be negated (Not) with the ! operator - failing
[ FAILED ] Vector matchers that fail / Contains (element)
[ FAILED ] Vector matchers that fail / Contains (vector)
[ FAILED ] Vector matchers that fail / Equals
[ FAILED ] Vector matchers that fail / UnorderedEquals
[ FAILED ] Exception matchers that fail / No exception
[ FAILED ] Exception matchers that fail / Type mismatch
[ FAILED ] Exception matchers that fail / Contents are wrong
[ FAILED ] Vector Approx matcher -- failing / Empty and non empty vectors are not approx equal
[ FAILED ] Vector Approx matcher -- failing / Just different vectors
48 FAILED TESTS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment