1. 14 Mar, 2024 1 commit
    • Loïc Sharma's avatar
      Reduce Windows_arm64 plugin_test_windows test timeout (#145110) · 349cbb4a
      Loïc Sharma authored
      Windows Defender sometimes kills the `Windows_arm64 plugin_test_windows` test process, causing the test to hang until it times out after 30 minutes. This reduces the test timeout to 900 seconds (15 minutes) to recover from this scenario faster.
      
      Test timeout duration was chosen by looking at successful duration percentiles in the last 100 days:
      
      duration_seconds_p90 | duration_seconds_p99 | duration_seconds_max
      -- | -- | --
      532 | 545 | 576
      
      BigQuery SQL:
      
      ```sql
      WITH
        successful_steps AS (
          SELECT
            b.id,
            TIMESTAMP_DIFF(s.end_time, s.start_time, SECOND) AS duration_seconds,
          FROM cr-buildbucket.flutter.builds AS b, UNNEST(steps) AS s
          WHERE
            create_time > TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 100 DAY)
            AND regexp_substr(input.gitiles_commit.project, '[^\\/]+$') = 'flutter'
            AND builder.project || '/' || builder.bucket || '/' || builder.builder
              = 'flutter/prod/Windows_arm64 plugin_test_windows'
            AND name = 'run plugin_test_windows'
            AND s.status = 'SUCCESS'
        )
      SELECT
        percentiles[offset(90)] AS duration_seconds_p90,
        percentiles[offset(99)] AS duration_seconds_p99,
        duration_seconds_max
      FROM (
        SELECT
          APPROX_QUANTILES(duration_seconds, 100) AS percentiles,
          MAX(duration_minutes) AS duration_seconds_max
        FROM successful_steps
      );
      ```
      
      `test_timeout_secs` is documented here: https://github.com/flutter/cocoon/blob/main/CI_YAML.md
      
      Part of https://github.com/flutter/flutter/issues/145072
      349cbb4a
  2. 13 Mar, 2024 22 commits
  3. 12 Mar, 2024 17 commits