Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-82946

Q12020 Flaky failing autotest functionEditorialModel::test_reset in declarative_core

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • P1: Critical
    • None
    • 5.12, 5.14, 5.15, 6.0.0
    • Location
    • None

    Description

      Here is the log from the incident

      Coin task #1: http://coin/coin/integration/qt/qtlocation/tasks/1584105687

      Host OS version: Windows_10, target OS version Windows_10, MSVC2017 and MSVC2019 compilers

      Log #1: http://coin/coin/logview/qt/qtlocation/465af9878f455baa16857b75473c1a940f089f5d/WindowsWindows_10x86_64WindowsWindows_10x86_64MSVC2017qtci-windows-10-x86_64-16-2a685f/18204f157e62016af21f4caa82c20e1d47fde48b/test_1584105768

      ********* Start testing of declarative_core *********
      Config: Using QtTest library 5.14.2, Qt 5.14.2 (x86_64-little_endian-llp64 shared (dynamic) release build; by MSVC 2017)
      PASS : declarative_core::Address::initTestCase()
      ...
      FAIL! : declarative_core::EditorialModel::test_reset() 'verify()' returned FALSE. ()
      C:\Users\qt\work\qt\qtlocation\tests\auto\declarative_core\utils.js(150) : failure location
      ...
      Totals: 232 passed, 1 failed, 0 skipped, 0 blacklisted, 34234ms
      ********* Finished testing of declarative_core *********
      ...
      ********* Start testing of declarative_core *********
      Config: Using QtTest library 5.14.2, Qt 5.14.2 (x86_64-little_endian-llp64 shared (dynamic) release build; by MSVC 2017)
      PASS : declarative_core::EditorialModel::initTestCase()
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.658 D] qt.qml.diskcache unknown - Error loading "file:///C:/Users/qt/work/qt/qtlocation/tests/auto/declarative_core/editorialModel" from disk cache: "The system cannot find the file specified."
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.659 D] qt.qml.diskcache unknown - Error saving cached version of "file:///C:/Users/qt/work/qt/qtlocation/tests/auto/declarative_core/editorialModel" to disk: "Missing time stamp for source file"
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.661 D] qt.qml.diskcache unknown - Error loading "file:///C:/Users/qt/work/qt/qtlocation/tests/auto/declarative_core/dataModel" from disk cache: "The system cannot find the file specified."
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.662 D] qt.qml.diskcache unknown - Error saving cached version of "file:///C:/Users/qt/work/qt/qtlocation/tests/auto/declarative_core/dataModel" to disk: "Missing time stamp for source file"
      FAIL! : declarative_core::EditorialModel::test_reset() 'verify()' returned FALSE. ()
      C:\Users\qt\work\qt\qtlocation\tests\auto\declarative_core\utils.js(150) : failure location
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.666 D] default unknown - Generated BaselineJIT code for
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.666 D] default unknown - function qtest_runInternal
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.667 D] default unknown - : Code at [0x000002C2DBE10014, 0x000002C2DBE1078B):
      QDEBUG : declarative_core::EditorialModel::test_reset() [ 0.667 D] qt.v4.asm unknown - disassembly not available for range 000002C2DBE10014...000002C2DBE1078B
      PASS : declarative_core::EditorialModel::cleanupTestCase(
      Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 1203ms
      ********* Finished testing of declarative_core *********
      

      Externally accessible log: http://testresults.qt.io/coin/integration/qt/qtlocation/tasks/1584105687

      The wanted action

      • Please delegate this task to a suitable developer
      • Fix the autotest flakiness in all affected versions, not just one. 
      • Cherry-pick the fix to all relevant branches
      • Mark the fix versions to Jira
      • Try to fix the actual issue instead of just blacklisting the test function

      Guidelines for debugging

      Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues

      How to locate the failed flaky test:

      Please open the link to the Grafana dashboard showing the failure history of the test:

      https://testresults.qt.io/grafana/d/5GKDJSPZz/02-qt-framework-please-fix-these-flaky-tests-random-fails?orgId=1&from=now%2Fy&to=now&var-project=qt%2Fqtlocation&var-testcase=tests%2Fauto%2Fdeclarative_core&var-testfunction=EditorialModel::test_reset&var-branch=5.12&var-branch=5.13&var-branch=5.14&var-branch=5.15&var-branch=dev&var-inter=24h

      Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances. 

      Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs. 

      Need to know more about the test binary execution history?

      Please see this Grafana dashboard: 

      https://testresults.qt.io/grafana/d/C-1oxSEWz/04-qt-framework-please-see-the-flakiness-history-of-tests?orgId=1&from=now%2Fy&to=now&var-project=qt%2Fqtlocation&var-testcase=tests%2Fauto%2Fdeclarative_core&var-testfunction=All&var-branch=5.12&var-branch=5.13&var-branch=5.14&var-branch=5.15&var-branch=dev&var-inter=24h

       

      Attachments

        Issue Links

          Activity

            People

              vhilshei Volker Hilsheimer
              assaarel Asmo Saarela
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: