Unverified Commit c0da4164 authored by Casey Hillers's avatar Casey Hillers Committed by GitHub

[devicelab] Add hot reload tests to presubmit (#93684)

parent eb00598b
...@@ -1705,12 +1705,13 @@ targets: ...@@ -1705,12 +1705,13 @@ targets:
- name: Linux_android hot_mode_dev_cycle_linux__benchmark - name: Linux_android hot_mode_dev_cycle_linux__benchmark
recipe: devicelab/devicelab_drone recipe: devicelab/devicelab_drone
presubmit: false
timeout: 60 timeout: 60
properties: properties:
tags: > tags: >
["devicelab","android","linux"] ["devicelab","android","linux"]
task_name: hot_mode_dev_cycle_linux__benchmark task_name: hot_mode_dev_cycle_linux__benchmark
runIf:
- dev/**
scheduler: luci scheduler: luci
- name: Linux_android image_list_jit_reported_duration - name: Linux_android image_list_jit_reported_duration
...@@ -3168,12 +3169,13 @@ targets: ...@@ -3168,12 +3169,13 @@ targets:
- name: Mac_ios hot_mode_dev_cycle_macos_target__benchmark - name: Mac_ios hot_mode_dev_cycle_macos_target__benchmark
recipe: devicelab/devicelab_drone recipe: devicelab/devicelab_drone
presubmit: false
timeout: 60 timeout: 60
properties: properties:
tags: > tags: >
["devicelab","ios","mac"] ["devicelab","ios","mac"]
task_name: hot_mode_dev_cycle_macos_target__benchmark task_name: hot_mode_dev_cycle_macos_target__benchmark
runIf:
- dev/**
scheduler: luci scheduler: luci
- name: Mac_ios integration_test_test_ios - name: Mac_ios integration_test_test_ios
......
...@@ -206,27 +206,14 @@ There are several PRs needed to add a DeviceLab task to CI. ...@@ -206,27 +206,14 @@ There are several PRs needed to add a DeviceLab task to CI.
_TASK_- the name of your test that also matches the name of the _TASK_- the name of your test that also matches the name of the
file in `bin/tasks` without the `.dart` extension. file in `bin/tasks` without the `.dart` extension.
1. Add prod builder to [flutter/infra devicelab_config.star](https://github.com/flutter/infra/blob/master/config/devicelab_config.star) 1. Add target to
- Example PR: https://github.com/flutter/infra/pull/401/files [.ci.yaml](https://github.com/flutter/flutter/blob/master/.ci.yaml)
- This will need to soak for 15 minutes after merged to propagate (should show up in [LUCI console](https://ci.chromium.org/p/flutter/g/devicelab/console)) - Mirror an existing one that has the recipe `devicelab_drone`
- There are various lists for the different testbeds a test can run on
2. Add task to [flutter/flutter prod_builders.json](https://github.com/flutter/flutter/blob/master/dev/prod_builders.json)
- Example PR: https://github.com/flutter/flutter/pull/79913/files
- Set `flaky: true` for validation before blocking tree
3. After 10 green runs, update [flutter/flutter prod_builders.json](https://github.com/flutter/flutter/blob/master/dev/prod_builders.json) to `flaky:false`
If your test needs to run on multiple operating systems, create a separate test
for each operating system.
## Adding tests to presubmit If your test needs to run on multiple operating systems, create a separate
target for each operating system.
Flutter's DeviceLab does not currently have capacity to run tests against physical devices in presubmit.
Note that DeviceLab tests should generally require a tethered device. If you are adding host-only tests, considering adding your test to `packages/flutter_tools/test/integration.shard`. Example: https://github.com/flutter/flutter/pull/73577/files" ## Adding tests to presubmit
1. Add try builder to [flutter/infra devicelab_config.star](https://github.com/flutter/infra/blob/master/config/devicelab_config.star) Flutter's DeviceLab has a limited capacity in presubmit. File an infra ticket
- Example PR: https://github.com/flutter/infra/pull/401/files to investigate feasibility of adding a test to presubmit.
- This will need to soak for 15 minutes after merged to propagate
- There are various lists for the different testbeds a test can run on
2. Add task to [flutter/flutter try_builders.json](https://github.com/flutter/flutter/blob/master/dev/try_builders.json)
- Example PR: https://github.com/flutter/flutter/pull/79913/files
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment