Here is a tree of all the tests that take > 1s.
Many of these are much slower than they need to be - for example we're just testing that pub get fires when we save the pubspec. We don't need to actually run that command, we could just use a mock to verify we would've run the process.
There are probably many groups here where one change like that would speed up many tests of that kind.
flutter_debug (426868ms)
flutter run debugger (launch on flutter-tester) (258131ms)
evaluateName evaluates to the expected value (12917ms)
stops at a breakpoint after each reload (1) (12726ms)
does not stop at a breakpoint with a condition returning false (11779ms)
does not stop on exception in noDebug mode (10809ms)
runs, collects expected output, and remains active until told to quit (10040ms)
provides local variables when stopped at a breakpoint (9939ms)
expected debugger services/extensions are available in debug mode and after a hot restart (9872ms)
excludes type args from local variables when stopped at a breakpoint in a generic method (9832ms)
does not step into the SDK if debugSdkLibraries is false (9733ms)
steps into the SDK if debugSdkLibraries is true (9629ms)
stops on exception (9629ms)
correctly marks non-debuggable SDK frames when debugSdkLibraries is false (9272ms)
includes fields and getters in variables when stopped at a breakpoint (9163ms)
writes exception to output and adds metadata for known files in call stacks (9115ms)
renders correct output for structured errors (9090ms)
includes fields but not getters in variables when evaluateGettersInDebugViews=false+showGettersInDebugViews=false (9071ms)
reports errors evaluating breakpoint conditions (9067ms)
stops at a breakpoint with a condition returning true (8994ms)
correctly marks non-debuggable external library frames when debugExternalPackageLibraries is false (8989ms)
does not step into an external library if debugExternalPackageLibraries is false (8969ms)
correctly marks debuggable local library frames even when debugExternalPackageLibraries is false (8907ms)
steps into a local library even if debugExternalPackageLibraries is false (8902ms)
correctly marks debuggable SDK frames when debugSdkLibraries is true (8847ms)
steps into an external library if debugExternalPackageLibraries is true (8823ms)
expected debugger services/extensions are available in noDebug mode (8814ms)
correctly marks debuggable external library frames when debugExternalPackageLibraries is true (8761ms)
can quit during a build (3678ms)
does not stop at a breakpoint in noDebug mode (2764ms)
flutter run debugger (only test device) (154152ms)
can evaluate at breakpoint (39014ms)
simple expressions (9789ms)
complex expressions (9779ms)
complex expressions when in a top level function (9761ms)
an expression that returns a variable (9685ms)
inspector can navigate (18070ms)
in debug mode (9054ms)
in noDebug mode (9016ms)
can hot reload with customRequest, using command, on-save, on-save with custom glob, external modification (11320ms)
can fetch slices of stack frames (10236ms)
re-sends theme on hot restart only if set by us, not if set by someone else (10221ms)
can hot restart using customRequest, command (10207ms)
logs expected text (and does not stop) at a logpoint (9539ms)
can override platform, toggle brightness/theme (9519ms)
shows deep link prompt for overflow errors (9203ms)
can launch DevTools externally (8970ms)
can run using a custom tool (8942ms)
can replace all args using custom tool (8911ms)
flutter run debugger (attach) (13394ms)
attaches to a Flutter application, collects stdout, remains active, detaches without stopping it (13394ms)
flutter debugger type (1191ms)
bin/temp_tool.dart (1191ms)
absolute: D:\Dev\Dart-Code\Dart-Code\src\test\test_projects\flutter_hello_world\bin\temp_tool.dart (cwd: undefined) (1191ms)
flutter_test_debug (323658ms)
flutter test debugger (323658ms)
when running tests by name (156180ms)
can run test_driver tests (15185ms)
runs all tests through Test: Run All Tests (14643ms)
can run integration_test tests (10612ms)
stops at a breakpoint in app code in integration_test tests (10143ms)
can run a selection of tests across multiple files (9961ms)
stops at a breakpoint in test code in integration_test tests (9789ms)
runs a Flutter test script to completion (9623ms)
runs all tests if given a folder (8377ms)
runs the open script if no file is provided (5377ms)
runs the provided script regardless of what's open (5370ms)
provides exception details when stopped on exception (5368ms)
receives the expected events from a Flutter test script (5326ms)
stops on exception (5324ms)
can run using a custom tool (5322ms)
successfully runs a Flutter test script with a relative path (5274ms)
can replace all args using custom tool (5252ms)
stops at a breakpoint (5200ms)
can run tests from codelens (5108ms)
can run skipped tests from codelens (5059ms)
send failure results for failing tests (4959ms)
can run test with multiline name from codelens (4908ms)
when running tests by line (151393ms)
can run test_driver tests (15246ms)
runs all tests through Test: Run All Tests (14483ms)
can run integration_test tests (10526ms)
stops at a breakpoint in app code in integration_test tests (10123ms)
can run a selection of tests across multiple files (9945ms)
stops at a breakpoint in test code in integration_test tests (9650ms)
runs all tests if given a folder (8281ms)
runs the open script if no file is provided (5408ms)
can run using a custom tool (5376ms)
provides exception details when stopped on exception (5372ms)
runs a Flutter test script to completion (5363ms)
stops on exception (5337ms)
runs the provided script regardless of what's open (5331ms)
successfully runs a Flutter test script with a relative path (5283ms)
receives the expected events from a Flutter test script (5279ms)
can replace all args using custom tool (5264ms)
stops at a breakpoint (5172ms)
can run skipped tests from codelens (5041ms)
can run tests from codelens (5034ms)
send failure results for failing tests (4961ms)
can run test with multiline name from codelens (4918ms)
collects coverage (16085ms)
for a basic test (5441ms)
and includes dependencies (5324ms)
and excludes configured paths (5320ms)
dart_debug (157494ms)
dart test debugger (129751ms)
when running tests by line (63375ms)
can run tests through test controller using a project node (19868ms)
merges same name items together (10070ms)
does not overwrite unrelated test nodes due to overlapping IDs (8089ms)
can run nested projects through Test: Run All Tests (3774ms)
dynamic tests (3671ms)
DartCode issue 4250 (752ms)
DartCode issue 4168 (745ms)
DartCode issue 4099 (731ms)
DartCode issue 4021 (726ms)
DartCode issue 4150 (717ms)
runs all tests if given a folder (2177ms)
can run a selection of tests across multiple files (1412ms)
allows more-specific default launch template using noDebug flag (1183ms)
provides exception details when stopped on exception (1144ms)
stops on exception (1121ms)
can hide skipped tests and groups from tree (1105ms)
receives the expected events from a Dart test script (975ms)
stops at a breakpoint (966ms)
runs a Dart test script to completion (965ms)
can run tests from codelens with backticks (740ms)
builds the expected tree if tests are run in multiple overlapping sessions (722ms)
can run tests from codelens (719ms)
can run tests from codelens with greater than after quote (719ms)
can run tests from codelens with greater than (715ms)
builds the expected tree from a test run (696ms)
can run tests through test controller using default launch template (678ms)
sends failure results for failing tests (643ms)
can run using a custom tool (612ms)
can replace all args using custom tool (611ms)
when running tests by name (59931ms)
can run tests through test controller using a project node (19904ms)
merges same name items together (9954ms)
does not overwrite unrelated test nodes due to overlapping IDs (8084ms)
can run nested projects through Test: Run All Tests (4234ms)
runs all tests if given a folder (2041ms)
can run a selection of tests across multiple files (1409ms)
allows more-specific default launch template using noDebug flag (1193ms)
provides exception details when stopped on exception (1159ms)
stops on exception (1143ms)
can hide skipped tests and groups from tree (1036ms)
runs a Dart test script to completion (1011ms)
receives the expected events from a Dart test script (961ms)
stops at a breakpoint (951ms)
can run tests from codelens with greater than after quote (744ms)
can run tests from codelens with greater than (722ms)
can run tests from codelens (721ms)
can run tests from codelens with backticks (715ms)
builds the expected tree if tests are run in multiple overlapping sessions (715ms)
builds the expected tree from a test run (688ms)
can run tests through test controller using default launch template (667ms)
sends failure results for failing tests (648ms)
can run using a custom tool (617ms)
can replace all args using custom tool (614ms)
can run tests outside of main() (3602ms)
collects coverage (2843ms)
and excludes configured paths (975ms)
for a basic test (949ms)
and includes dependencies (919ms)
dart cli debugger (27743ms)
attaches (11793ms)
and removes breakpoints and unpauses on detach (1785ms)
to the observatory uri provided by the user when not specified in launch.json (1770ms)
to a paused Dart script and can unpause to run it to completion (1763ms)
to a paused Dart script and can collects stdout (1755ms)
when provided only a port in launch.config (1750ms)
to a Dart script launched externally using --write-service-info and can unpause to run it to completion (1704ms)
to a paused Dart script and can set breakpoints (1266ms)
prompts the user if trying to run with errors (1868ms)
and launches if they click Debug Anyway (945ms)
unless the errors are in test scripts (923ms)
can run in a terminal (1232ms)
runs for autolaunch file (1040ms)
logs expected text (and does not stop) at a logpoint (920ms)
reports errors evaluating breakpoint conditions (919ms)
runs to completion (911ms)
does not stop at a breakpoint with a condition returning false (906ms)
can run using a custom tool (873ms)
can hot reload (868ms)
does not stop at a breakpoint in noDebug mode (844ms)
receives the expected output (819ms)
can replace all args using custom tool (787ms)
correctly marks non-debuggable external library frames when debugExternalPackageLibraries is false (695ms)
steps into an external library if debugExternalPackageLibraries is true (690ms)
stops at a breakpoint in an external package (687ms)
does not step into an external library if debugExternalPackageLibraries is false (679ms)
correctly marks debuggable external library frames when debugExternalPackageLibraries is true (678ms)
can launch DevTools externally (534ms)
dart (99843ms)
pub add (24288ms)
~~can add a dependency to multiple projects (4067ms)~~
~~can add a dependency by URL by pasting (3577ms)~~
~~can add a dependency by URL by selecting the GIT option (3450ms)~~
~~can add from a quick fix if not listed in pubspec.yaml (2005ms)~~
~~can add multiple dependencies separated by ", " using command (1945ms)~~
~~can add multiple dependencies separated by "," using command (1931ms)~~
~~can add a dependency using command (1866ms)~~
~~can add a dev-dependency using command (1852ms)~~
~~can add a dependency with trailing whitespace using command (1826ms)~~
~~can add multiple dependencies separated by " " using command (1769ms)~~
debug autolaunch (16201ms)
VM Service probing (9684ms)
should wait for VM Service to become available after a delay (5116ms)
should fail to start debugging if VM Service never becomes available (2114ms)
should handle already existing VM Service (1118ms)
should start debugging immediately if waitForVmServiceMs is provided but vmServiceUri is not (679ms)
should start debugging immediately if vmServiceUri is provided but waitForVmServiceMs is not (657ms)
file modifications (2897ms)
should debounce rapid file changes (1631ms)
should handle file modifications (1266ms)
with file created later (2360ms)
with config path set to "D:\Temp\dart-code-tests\26106" (1251ms)
with config path set to ".test_dart_code" (1109ms)
with existing file (1260ms)
with config path set to ".test_dart_code" (643ms)
with config path set to "D:\Temp\dart-code-tests\75652" (617ms)
helpers (9578ms)
closeFile forces VS Code to run onDidCloseTextDocument (9578ms)
multi-document position tracker (7422ms)
retains tracking when document is closed and re-opened (2627ms)
invalidates all trackers if any become invalid references (2440ms)
invalidates all trackers if file is modified externally causing position mismatch (2355ms)
dart_implementation_provider (7172ms)
returns direct class implementations (7172ms)
multi-document range tracker (6873ms)
invalidates all trackers if any become invalid references (2321ms)
invalidates all range trackers if file is modified externally causing position mismatch (2299ms)
retains tracking when document is closed and re-opened (2253ms)
pub get (6422ms)
runs delayed when pubspec is auto-saved (4443ms)
runs automatically when pubspec is saved (1315ms)
does not run automatically if disabled (664ms)
dart tasks (6063ms)
dart.task.dartdoc causes documentation to be generated (6063ms)
extract method refactor (3759ms)
displays an error if an invalid new name is provided (3231ms)
can extract simple code into a method (528ms)
dart tests (3182ms)
handles renaming of discovered tests (3182ms)
pub outdated (1986ms)
runs and prints output (1986ms)
workspace_symbol_provider (1857ms)
includes items from 'everything.dart' (1857ms)
extension api (1648ms)
provides the DTD Uri and notifies of changes (557ms)
workspace.getOutline (550ms)
provides the Dart SDK and notifies of changes (541ms)
file tracker (1234ms)
subscriptions (1234ms)
tracks outlines for open files (1234ms)
dart tooling daemon (952ms)
should send ActiveLocationChanged events when the selection changes (952ms)
diagnostics_provider (651ms)
does not return errors for a file in settings (651ms)
hot reloads on save (555ms)
for Dart (555ms)
flutter (32933ms)
flutter doctor (7160ms)
runs and prints output (7160ms)
pub add (6807ms)
can add a Flutter SDK dependency using command (2359ms)
can add a dev-dependency using command (2232ms)
can add a dependency using command (2216ms)
device_manager (5013ms)
handles unresponsive tryGetSupportedPlatformTypes (5013ms)
packages tree (3468ms)
includes known packages inside the project in the correct categories (1761ms)
does not include own package inside the project (1707ms)
extract widget refactor (3156ms)
displays an error if an invalid new name is provided (3156ms)
flutter clean (2755ms)
all (2755ms)
cleans all packages (2755ms)
flutter packages outdated (1917ms)
runs and prints output (1917ms)
completion_item_provider (1625ms)
includes expected completions (1625ms)
test_flutter_dartpad_samples (518ms)
includes interactive sample links for Flutter classes (518ms)
generate localizations on save (514ms)
does not run gen_l10n when the setting is never (514ms)
multi_root (8654ms)
dart.getPackages (8654ms)
successfully fetches packages for all projects (3984ms)
successfully fetches packages for Dart project (2455ms)
successfully fetches packages for Flutter project (2215ms)
multi_project_folder (6582ms)
dart.getPackages (5488ms)
successfully fetches packages for Dart project (3283ms)
successfully fetches packages for Flutter project (2205ms)
extension (1094ms)
resolves the correct debug config for a nested project (1094ms)
dart_nested (5199ms)
pub get (5199ms)
runs pub get for parent project if set to 'above' (1331ms)
runs pub get for all projects if set to 'both' (1301ms)
runs pub get for child project if set to 'below' (1300ms)
runs pub get only for main project by default (1267ms)
not_activated/flutter_create (4485ms)
command (4485ms)
Flutter: Create Sample Project can be invoked and creates trigger file (2516ms)
Flutter: Create New Project can be invoked and creates app trigger file (1969ms)
not_activated/dart_create (1883ms)
command (1883ms)
Dart: Create New Project can be invoked and creates trigger file (1883ms)
Here is a tree of all the tests that take > 1s.
Many of these are much slower than they need to be - for example we're just testing that
pub getfires when we save the pubspec. We don't need to actually run that command, we could just use a mock to verify we would've run the process.There are probably many groups here where one change like that would speed up many tests of that kind.