Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-46

Improve annotation feature in BM tool

    XMLWordPrintable

Details

    • Task
    • Resolution: Out of scope
    • P2: Important
    • 2012q4
    • None
    • Performance tracking
    • None

    Description

      The annotation feature in the BM tool is currently very basic in that it only allows for editing of a comment string associated with a benchmark time series (i.e. results for all SHA-1s for a given host/platform/branch/benchmark/metric combination).

      This could easily be improved in different ways:

      • Interactively classify a time series as "suspended" or "active".
      • Interactively classify a change within a time series as "omitted" or "keep". Typically we would classify a change as "omitted" if we know that the change has some irrelevant cause (like the benchmark code itself being modified unintentionally).

      This effectively provides a filtering mechanism: A suspended time series will be omitted from certain analyses. An omitted change will not contribute to the change analysis for the benchmark in question.

      Attachments

        Activity

          People

            bdo Jo Asplin (Inactive)
            bdo Jo Asplin (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: