Uploaded image for project: 'Coin'
  1. Coin
  2. COIN-174

Create test binaries as a part of building phase

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • P1: Critical
    • None
    • None
    • Build / Test Instructions
    • None
    • 1547bdc20e1fe93003023f22dec8e2e2e7005a40 (qtqa/tqtc-coin-ci/master)

    Description

      Instead of building test artifacts as a part of the test phase, let's do them in the building phase. That way these artifacts can be used in multiple places. This enables splitting the job of running the tests into smaller parts and distribute it into several VMs running different tests. It also enables us to create tests with a new macOS and test it on older macOS distrors without needing to rebuild the tests on those.

      Attachments

        Issue Links

          depends on

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-73227 Testlib: Test results might contain invalid XML attribute values for Duration

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed

          Task - A task that needs to be done. QTQAINFRA-2154 Detailed Test Plan Support to COIN

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed
          is duplicated by

          Task - A task that needs to be done. QTQAINFRA-2135 Split test binaries from build binaries

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed
          is required for

          Bug - A problem which impairs or prevents the functions of the product. COIN-77 Need COIN to support DoNotRunTests other than DisableTests

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed

          Task - A task that needs to be done. COIN-205 Fix way of building macOS

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Task - A task that needs to be done. QTQAINFRA-3059 Add macOS 10.15(Catalina) into the CI

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed

          Suggestion - Public suggestions COIN-201 Split tests execution

          • P3: Somewhat important - Should be fixed, but doesn't affect the release in any way.
          • Reported
          relates to

          Task - A task that needs to be done. COIN-169 Add device testing to Coin

          • P4: Low - Would be nice to fix, but it's not very important.
          • Closed

          Activity

            People

              mapaaso Matti Paaso
              tosaraja Tony Sarajärvi
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: