Details
P4: Low Description
Now the Linux targets try to run the binary compatibility tests for the Linux configurations.
See for example: http://ci-files01-hki.intra.qt.io:8080/coin/integration/tqtc-boot2qt/qtsaferenderer/tasks/1610438645 and corresponding QEMU logs.
Here is an example:
Executing instruction 66 of 66 - RunQtUnitTest Running tests in directory {{.AgentWorkingDir}}/qt/qtqa-latest/tests/postbuild/bic Generating test results with TESTARGS=-o /home/qt/qt/qtqa-latest/tests/postbuild/bic147122855,xml -o /home/qt/qt/qtqa-latest/tests/postbuild/bic147122855-junit,xunitxml -o -,txt [make check -j1] 3600 3600 [make check -j1] 3600 3600 false false /opt/yocto-armv7/sysroots/x86_64-pokysdk-linux/usr/bin/arm-poky-linux-gnueabi/arm-poky-linux-gnueabi-g++ -pipe -march=armv7-a -mfpu=neon -DLINUX=1 -mfloat-abi=hard --sysroot=/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi -O2 -Wall -Wextra -dM -E -o .moc/moc_predefs.h /home/qt/work/install/mkspecs/features/data/dummy.cpp /home/qt/work/install/bin/moc -DQT_NO_LINKED_LIST -DSRCDIR=\"/home/qt/work/qt/qtqa-latest/tests/postbuild/bic/\" -D_LARGEFILE64_SOURCE -D_LARGEFILE_SOURCE -DQT_NO_DEBUG -DQT_TESTLIB_LIB -DQT_CORE_LIB -DQT_TESTCASE_BUILDDIR='"/home/qt/work/qt/qtqa-latest/tests/postbuild/bic"' --include /home/qt/work/qt/qtqa-latest/tests/postbuild/bic/.moc/moc_predefs.h -I/home/qt/work/install/mkspecs/devices/linux-imx7-g++ -I/home/qt/work/qt/qtqa-latest/tests/postbuild/bic -I/home/qt/work/qt/qtqa-latest/tests/postbuild -I/home/qt/work/install/include -I/home/qt/work/install/include/QtTest -I/home/qt/work/install/include/QtCore -I/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi/usr/include/c++/8.2.0 -I/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi/usr/include/c++/8.2.0/arm-poky-linux-gnueabi -I/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi/usr/include/c++/8.2.0/backward -I/opt/yocto-armv7/sysroots/x86_64-pokysdk-linux/usr/lib/arm-poky-linux-gnueabi/gcc/arm-poky-linux-gnueabi/8.2.0/include -I/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi/usr/lib/gcc/arm-poky-linux-gnueabi/8.2.0/include -I/opt/yocto-armv7/sysroots/x86_64-pokysdk-linux/usr/lib/arm-poky-linux-gnueabi/gcc/arm-poky-linux-gnueabi/8.2.0/include-fixed -I/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi/usr/include tst_bic.cpp -o .moc/tst_bic.moc /opt/yocto-armv7/sysroots/x86_64-pokysdk-linux/usr/bin/arm-poky-linux-gnueabi/arm-poky-linux-gnueabi-g++ -c -pipe -march=armv7-a -mfpu=neon -DLINUX=1 -mfloat-abi=hard --sysroot=/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi -O2 -Wall -Wextra -D_REENTRANT -fPIC -DQT_NO_LINKED_LIST -DSRCDIR=\"/home/qt/work/qt/qtqa-latest/tests/postbuild/bic/\" -D_LARGEFILE64_SOURCE -D_LARGEFILE_SOURCE -DQT_NO_DEBUG -DQT_TESTLIB_LIB -DQT_CORE_LIB -DQT_TESTCASE_BUILDDIR='"/home/qt/work/qt/qtqa-latest/tests/postbuild/bic"' -I. -I.. -I/home/qt/work/install/include -I/home/qt/work/install/include/QtTest -I/home/qt/work/install/include/QtCore -I.moc -I/home/qt/work/install/mkspecs/devices/linux-imx7-g++ -o .obj/tst_bic.o tst_bic.cpp /opt/yocto-armv7/sysroots/x86_64-pokysdk-linux/usr/bin/arm-poky-linux-gnueabi/arm-poky-linux-gnueabi-g++ -c -pipe -march=armv7-a -mfpu=neon -DLINUX=1 -mfloat-abi=hard --sysroot=/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi -O2 -Wall -Wextra -D_REENTRANT -fPIC -DQT_NO_LINKED_LIST -DSRCDIR=\"/home/qt/work/qt/qtqa-latest/tests/postbuild/bic/\" -D_LARGEFILE64_SOURCE -D_LARGEFILE_SOURCE -DQT_NO_DEBUG -DQT_TESTLIB_LIB -DQT_CORE_LIB -DQT_TESTCASE_BUILDDIR='"/home/qt/work/qt/qtqa-latest/tests/postbuild/bic"' -I. -I.. -I/home/qt/work/install/include -I/home/qt/work/install/include/QtTest -I/home/qt/work/install/include/QtCore -I.moc -I/home/qt/work/install/mkspecs/devices/linux-imx7-g++ -o .obj/qbic.o qbic.cpp /opt/yocto-armv7/sysroots/x86_64-pokysdk-linux/usr/bin/arm-poky-linux-gnueabi/arm-poky-linux-gnueabi-g++ -mfloat-abi=hard --sysroot=/opt/yocto-armv7/sysroots/armv7at2hf-neon-poky-linux-gnueabi -Wl,-O1 -Wl,--enable-new-dtags -Wl,-rpath,/home/qt/work/install/lib -Wl,-z,origin -Wl,-rpath,\$ORIGIN/../../lib -o tst_bic .obj/tst_bic.o .obj/qbic.o /home/qt/work/install/lib/libQt5Test.so /home/qt/work/install/lib/libQt5Core.so -lpthread /home/qt/work/qt/qtqa-latest/tests/postbuild/bic/target_wrapper.sh ./tst_bic -o /home/qt/qt/qtqa-latest/tests/postbuild/bic147122855,xml -o /home/qt/qt/qtqa-latest/tests/postbuild/bic147122855-junit,xunitxml -o -,txt ********* Start testing of tst_Bic ********* Config: Using QtTest library 5.15.3, Qt 5.15.3 (arm-little_endian-ilp32-eabi-hardfloat shared (dynamic) release build; by GCC 8.2.0), b2qt 2.6.1 WARNING: tst_Bic::initTestCase() This test needs the correct qmake in PATH, we need it to generate INCPATH for qt modules. Loc: [tst_bic.cpp(349)] SKIP : tst_Bic::initTestCase() /home/qt/work/tqtc-boot2qt/qtsaferenderer/tests/global/global.cfg does not exist. Create it if you want to run this test. Loc: [tst_bic.cpp(372)] PASS : tst_Bic::cleanupTestCase() Totals: 1 passed, 0 failed, 1 skipped, 0 blacklisted, 62ms ********* Finished testing of tst_Bic *********
Now it skips this since there is no config. Is there any need to either suppress it completely or do we want to have some kind of binary compatibility tests?
Definition of Done:
- Test cases are in TestRail suites and plans
- Related .pro is updated
- Test code is reviewed
- Test code is in version control
- Unrelated tests are not executed in Coin
