VSadov/Satori
1
0
Fork 0
mirror of https://github.com/VSadov/Satori.git synced 2025-06-10 10:00:57 +09:00
Code Activity
120209 commits 55 branches 3 tags 788 MiB
Commit graph

118 commits

Author SHA1 Message Date
Nathan Ricci
4b1840b700
Updated test doc. (#75736) 2022-09-16 12:46:16 -05:00
Jan Kotas
32ac664fca
Replace net7 with net8 in dogfooding and workflow docs (#75453) 2022-09-12 20:40:44 -07:00
Ankit Jain
ba3ee97687
[wasm] Move src/tests/BuildWasmApps/* to src/mono/wasm (#74698) 
- This will help simplifying the path subsets in
`eng/pipelines/common/evaluate-default-paths.yml`, which would then help
to avoid a lot of unrelated non-wasm builds on PRs
 2022-08-29 17:34:35 -04:00
Aleksey Kliger (λgeek)
4f835ae440
[docs] Debugging Libraries tests on Mono using VS Code (#73393) 
* [docs] Debugging Libraries tests on Mono using VS Code

* markdown lint fixes

* A note about windows
 2022-08-04 15:43:21 -04:00
Steve Pfister
d7d0e421d7
[wasm] Modify workload to pick threading runtime packs (#72412) 
* [wasm] Modify workload to pick threading runtime packs

This change adds the 2 wasm threading runtime packs to the wasm workload. In order for a threading runtime pack to be chosen, WorkloadManifest.targets is also modified to override the runtime pack name when the following props are set:

WasmEnableThreads - full threading support and will load Microsoft.NETCore.App.Runtime.multithread.Mono.browser-wasm

WasmEnablePerfTrace - runtime only threading support and will load Microsoft.NETCore.App.Runtime.perftrace.Mono.browser-wasm

* Add error condition when both WasmEnableThreading and WasmEnablePerfTrace are true

* [wasm] Set default value for MonoWasmBuildVariant, for runtime pack nuget

* [wasm] Wasm.Build.Tests: build runtime pack nugets with different names

- The earlier approach of simply making copies of the existing runtime
pack nuget with different names doesn't work, and `dotnet workload
install` rejects it.

```
  Installing pack Microsoft.NETCore.App.Runtime.Mono.multithread.browser-wasm version 7.0.0-ci...
  Workload installation failed. Rolling back installed packs...
```

Instead, now we build the missing nugets from the project with different
values for `$(MonoWasmBuildVariant)`.

- this handles local builds, and incremental builds also
- To skip building the missing nugets, for example, when you have all of
them available, then set `WasmSkipMissingRuntimePackBuild=true`.

* fix comment

Co-authored-by: Steve Pfister <steve.pfister@microsoft.com>
Co-authored-by: Ankit Jain <radical@gmail.com>
 2022-07-27 12:08:59 -04:00
Adeel Mujahid
9d6396deb0
Fix typos (#72709) 2022-07-23 20:24:28 -07:00
Jan Kotas
0f75a0269c
Rename nightly to daily in the dogfood instructions (#71383) 
Consistency with runtime and SDK download urls and other docs.
 2022-06-28 09:27:58 -04:00
Filip Navara
2f38fb55e9
Fix unit test example (#70457) 2022-06-08 14:59:38 -07:00
Thays Grazia
fd0a8e4b3b
Update testing-android.md (#70362) 2022-06-07 13:15:13 -03:00
Fan Yang
2fbc50fe92
[mono][doc] Update Android NDK version to r23c (#69913) 2022-05-31 09:39:51 -04:00
Elinor Fung
e5f284401c
Add doc about using local build of apphost (#69097) 2022-05-10 14:24:38 -07:00
Bruce Forstall
0f3f7ea4d9
Add document describing how to disable tests (#68727) 
* Add document describing how to disable tests

Update libraries "filtering tests" doc with information and examples for
using `SkipOnCoreClrAttribute`

* Update for feedback

Added SkipOnMonoAttribute, CollectionAttribute, an example
of using multiple SkipOnCoreClrAttribute, and how the xunit
attributes for test disabling apply to the "converted"
src/tests tree.
 2022-05-03 10:56:34 -07:00
Andrew Au
3c7c9fb773
Make it easier to enable FEATURE_AUTO_TRACE (#63478) 2022-04-13 15:59:13 -07:00
Dan Moseley
ac20efd2a2
fix pal test (#66636) 2022-03-16 14:56:01 -06:00
Elinor Fung
78083e7dd0
Add test for comhost with managed host (#66360) 2022-03-09 20:52:18 -08:00
Elinor Fung
627851323f
Add tests for ijwhost (#66308) 2022-03-08 09:14:43 -08:00
Aaron Robinson
6fe1a80959
Use CMakeProjectReference instead of ProjectReference (#66202) 
* Use CMakeProjectReference instead of ProjectReference

Changing this permits usage of "\runtime\dotnet.cmd build" as opposed
  to forcing users to use "\runtime\dotnet.cmd msbuild".
 2022-03-04 19:40:27 -08:00
Marek Fišera
1ac45f5161
[wasm] Fix WebSocket tests on NodeJS (#64330) 
- Move all SetScriptCommands to a target, so they are placed after scenario in the generated script.
- Add WasmXHarnessArgsCli as an alternative variable that can be used from cli.
- Fix NodeJS symbolic links on Helix.
- Copy TestEchoMiddleware and RemoteLoopMiddleware even for Scenario=NodeJS.
- Enable System.Net.WebSockets.Client.Tests on NodeJS.
 2022-02-09 10:27:24 +01:00
Maxim Lipnin
0b17270554
Update the apple testing doc (#63119) 2021-12-24 15:33:24 +03:00
Tomáš Rylek
c3683b06b0
Rename 'excludemonofailures' to 'mono' (#62749) 2021-12-14 07:38:55 +01:00
Nathan Ricci
1d4b5f684c
Updated testing document; patching and various mono-specific msbuild targets are no longer needed. (#62588) 2021-12-09 13:40:03 -05:00
Simon Rozsival
6cf785d9fb
Support Process.Start() on MacCatalyst (#61507) 
* Modify existing tests

* Enable process start and kill on MacCatalyst

* Typo

* Temporarily enable ProcessTests for MacCatalyst

* Temporarily enable ProcessTests for MacCatalyst - attempt 2

* Allow running Mac Catalyst builds in App Sandbox

* Allow enabling app sandbox for the other Mac Catalyst sample

* Add missing parameter to XCode project generator

* Remove unnecessary MacCatalyst detection

* Enable App Sandbox for Mac Catalyst tests

* Create a separate test branch for App Sandbox

* Remove the restriction to enable app sandbox just for Mac Catalyst apps

* Do not throw PNSE for Mac Catalyst

* Clean-up platform-specific conditions

* Build correct Process implementation for MacCatalyst

* Try to get more information from CI for further investigation of the failing build

* Revert "Try to get more information from CI for further investigation of the failing build"

This reverts commit fc63a370d688aa0d1dc890e6928a8d031d148e56.

* Add MacCatalyst target framework for System.Diagnostics.Process

* Add supported platform annotations for Mac Catalyst

* Fix annotations

* Remove incorrectly placed attributes

* Update attributes including the reference file

* Change platform attributes

* Generate app.entitlements in the BuildAppleAppBundles test build target

* Revert "Generate app.entitlements in the BuildAppleAppBundles test build target"

This reverts commit abbe2241586e3469c3d3e9d4ecd2cea2e09d3641.

* Enable AppSandbox when generating CMakeLists.txt for libraries tests

* Try implementing a workaround for app sandbox mode

* Fix app sandbox detection bug

* Add explanation comment

* Enable more tests for MacCatalyst

* Add apple app builder input validation

* Add Mac Catalyst w/ App Sandbox enabled to runtime-manual test pipeline

* Enable networking in App Sandbox mode

* Skip test which won't work on Mac Catalyst

* Skip some tests in app sandbox mode

* Update src/tasks/AppleAppBuilder/AppleAppBuilder.cs

Co-authored-by: Alexander Köplinger <alex.koeplinger@outlook.com>

* Add a clarification comment for a networking entitlement

* Simplify supported platform condition

* Remove temporarily enabled test

* Remove unnecessary attributes

* Replace checking env variable with checking errno in libproc

* Update docs

* Remove unnecessary changes

* Temporarily enable running System.Diagnostics.Process.Tests for this PR

This reverts commit 02d370c2cf730bf67a3cf6fca8fcb8c5e4ff1ccd.

* Revert "Temporarily enable running System.Diagnostics.Process.Tests for this PR"

This reverts commit dc72f0f1d068314317d088d33ec87f9aa6447854.

* Fix job suffix in runtime-manual

* Remove attributes

* Revert "Remove attributes"

This reverts commit 704e9fa73cd40854d1becc2889569bab3c47d62d.

* Try changing the order of attributes to please CI

* Update ApiCompat baseline

* ApiCompat step 1: remove all attributes for MaxWorkingSet setter

* Revert "Update ApiCompat baseline"

This reverts commit a2ad03207c5f9f40b9dd2c335a1b0f31c37a0ac5.

* Revert "ApiCompat step 1: remove all attributes for MaxWorkingSet setter"

This reverts commit be72a3d2564afb89a83198ef010b3d4622799601.

* Update ApiCompat baseline

* Update ApiCompat baseline after pulling upstream main

* Remove trailing whitespace

Co-authored-by: Alexander Köplinger <alex.koeplinger@outlook.com>
 2021-12-07 20:33:38 +01:00
Jeremy Koritzinsky
7099f4b12a
Use reflection or a compile-time only shim assembly to reference unexposed corelib types. (#61802) 
Co-authored-by: Aaron Robinson <arobins@microsoft.com>
 2021-11-19 19:28:42 -08:00
Maxim Lipnin
b9a2c48aa8
Clean up the documentation for the library testing (#59401) 2021-11-08 12:11:54 +03:00
Aleksey Kliger (λgeek)
72bcf2f77a
[tests] In test wrapper scripts if -debug is gdb or lldb, add separator before corerun and args (#60416) 
* [tests] If -debug is LLDB, add separator before corerun and args

   For runtime test shell scripts, if a debugger is specified with `-debug=/usr/bin/lddb` or the like, add a separator so that `lldb` doesn't try to interpret `-p` as a PID argument.

   Also update mono workflow doc

* Also support gdb as the debugger
 2021-10-20 10:17:54 -04:00
Aleksey Kliger (λgeek)
10d8964fb0
[docs] Add LLDB debugging instructions for Mono running a runtime test (#60410) 
* [docs] Add LLDB debugging instructions for Mono running a runtime test

* Also add a note about building a single test
 2021-10-14 12:54:31 -04:00
Aleksey Kliger (λgeek)
89cea2e659
[docs] Add instructions for debugging native runtime code on Android (#59183) 2021-09-17 09:01:13 -04:00
Viktor Hofer
67354a2fb4
Upgrade to net7.0 and remove target frameworks (#58011) 
* Remove EOL tfms and upgrade to net7.0

* Make linker tests net7 aware

Make installer tests run on net7.0

Don't attempt to use live apphost

Fix payloads

Regenerate test files

Fix package testing
 2021-09-08 22:04:23 +02:00
Jeremy Koritzinsky
f3c705ef29
Implement support for passing a .env file to corerun to easily set environment variables for stress testing. (#58222) 
* Implement support for passing a .env file to corerun to easily set environment variables for stress testing.

* Load the parsed dotenv into the process.

* Implement support for # comments

* Clean up code

* Avoid copy

* PR feedback

* Update docs and bash/batch scripts to support the dotenv files.

* Use what clang recommends to not copy

* Apply suggestions from code review

Co-authored-by: Aaron Robinson <arobins@microsoft.com>

Co-authored-by: Aaron Robinson <arobins@microsoft.com>
 2021-09-03 02:18:59 +00:00
Aleksey Kliger (λgeek)
d033e1a902
Don't build ReferenceSystemPrivateCoreLib tests with Mono (#58232) 
New tests that extend the System.Private.CoreLib API should add to the ref assemblies in src/libraries and the tests themselves should be library tests.

Updated the workflow doc: the Clr.Native subset is all that is need if we're interested in testing Mono.

Contributes to https://github.com/dotnet/runtime/issues/58266

* [tests] Use RuntimeFlavor to build ReferenceSystemPrivateCoreLib tests

   When building tests that reference System.Private.CoreLib, use the one from the specified RuntimeFlavor (or fall back to coreclr if it's unset - although src/tests/build.sh sets it always)

* Update docs: We only need to build the Clr.Native subset if we're interested in testing Mono.

* flavor the pipelines to build the runtime-specific System.Private.CoreLib for the runtime tests.

* Don't build ReferenceSystemPrivateCoreLib tests with Mono

   We should avoid adding new ReferenceSystemPrivateCoreLib tests
 2021-08-30 12:11:42 -04:00
Vitek Karas
0042240dd8
Add zip tool to the install list for Android tests (#57569) 
On default WSL Ubuntu `zip` is not installed, and trying to build Android tests fails with rather cryptic errors.
 2021-08-17 08:00:48 -07:00
Tomáš Rylek
3b40c7cfc4
Add support for building just a subset of runtime tests (#57142) 
This change adds four new options to the runtime test build command:

1) test <test project path relative to src\tests> - build just that
one test.

2) dir <directory relative to src\tests> - build all tests in the
directory.

3) tree <directory relative to src\tests> - build all tests in the
given subtree.

4) all - use clean rebuild (i.e. don't apply incrementalism)
when building the tests.

Thanks

Tomas
 2021-08-12 15:54:17 +02:00
Fan Yang
e0ba450d7f
[Mono] Update instructions for running runtime tests on Android (#57166) 
* Update instructions for running runtime tests on Android

* Update docs/workflow/testing/mono/testing.md

Co-authored-by: Juan Hoyos <juan.hoyos@microsoft.com>

Co-authored-by: Juan Hoyos <juan.hoyos@microsoft.com>
 2021-08-11 12:13:29 -04:00
Jeremy Koritzinsky
3dc99e900b
Build C++/CLI tests as .NET Core C++/CLI (#56502) 
* Build IJW assemblies against LKG SDK ref pack.

* Allow building against the live ref assemblies by passing `-cmakeargs -DCPP_CLI_LIVE_REF_ASSEMBLIES=1` to the test build script.

* Add test instructions

* Error handling

* Add support for the stdcall-mangled _CorDllMain entrypoint on x86 since MSVC uses it if it exists.

* Write out ref-pack path.
 2021-08-02 16:53:48 +00:00
Ankit Jain
d953229d54
[wasm] Run Wasm.Build.Tests against workloads (#54451) 
Co-authored-by: Larry Ewing <lewing@microsoft.com>
 2021-07-14 10:47:03 -04:00
Jeff Handley
69d67390e5
Fix the daily build links in docs (#55443) 
* Fix the daily build links in docs

* Update the NuGet feed referenced
 2021-07-09 22:32:23 -04:00
Noah Falk
d783a8c812
Update library testing docs page to reduce confusion (#54324) 
* Add warning on unmaintained testing doc page

* Update testing.md

Some example text that seems more clear to me, but only offered as a suggestion. 
Feel free to adjust it or if you want to use it as-is please double check what I wrote is accurate : )

I think the useful elements are:
1. Being explicit about what workflow steps need to happen in total
2. Being explicit about which commands are covering the entire workflow and which ones are only covering a part of it
3. Show the simple "do-it-all" options first before showing more complex partial options. Glancing at the first example and blindly copying it should land in the pit of success.

Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
 2021-06-23 09:00:47 +02:00
Pavel Savara
fb61be479e
[wasm][testing] hosting echo server in xharness process (#52923) 
- move tests to inner loop
- include echo middleware in xharness server
- improve doc
- more granular ActiveIssue https://github.com/dotnet/runtime/issues/53592 for lack of TRACE
- more granular ActiveIssue https://github.com/dotnet/runtime/issues/53591 for content on GET/HEAD
- more granular ActiveIssue https://github.com/dotnet/runtime/issues/53874 for HttpRequestMessage.Headers.Host
- more granular ActiveIssue https://github.com/dotnet/runtime/issues/53872 for NPE on System.Net.Http.BrowserHttpHandler
- more granular ActiveIssue https://github.com/dotnet/runtime/issues/53876
- include middleware in Helix correlation payload
 2021-06-09 17:32:58 +02:00
Adam Sitnik
b443b8ccce
Update testing docs with x86 instructions (#48715) 
* Update testing docs with x86 instructions

* Apply suggestions from code review

Co-authored-by: Santiago Fernandez Madero <safern@microsoft.com>

* add more examples

* Apply suggestions from code review

Co-authored-by: Dan Moseley <danmose@microsoft.com>

* Update docs/workflow/testing/libraries/testing.md

Co-authored-by: Santiago Fernandez Madero <safern@microsoft.com>

Co-authored-by: Santiago Fernandez Madero <safern@microsoft.com>
Co-authored-by: Dan Moseley <danmose@microsoft.com>
Co-authored-by: Eric StJohn <ericstj@microsoft.com>
 2021-05-24 11:45:21 -07:00
Aaron Robinson
66abf41f1e
corerun supports user defined properties from command line. (#51774) 
* corerun supports user defined properties from command line.

* Update workflow help doc for corerun.

Co-authored-by: Elinor Fung <elfung@microsoft.com>
 2021-04-26 20:46:55 -07:00
Steve Pfister
6ca3d9105d
Shift Most of Wasm AOT test build to helix (#48226) 
Since AOT'ing each test suite takes between 3-9 min, we need to shift the burden over to helix.

## This is done by:
1. building the test assemblies on the build machine
   - the wasm part of the build is not executed on the build machine,
      because it has the AOT build part
2. Zip up the test assembly+friends, *and* any bits required to run the wasm
    app build for that on helix (eg. emsdk, wasm app targets, cross compiler etc)
3. Send all this to helix, and use a custom `aot-build.proj`
     - which recreates all the build inputs for the `WasmBuildApp` target
        using the paths for the assets on helix
     - then we can run `WasmBuildApp` for the build, resulting in a wasm app
       bundle.
4. Run the tests!

- We already have the bits required for building wasm apps on helix, supported
for `Wasm.Build.Tests`, which we can use here too.

## Trimming:

- Since, AOT can be so expensive, we use `EnableAggressiveTrimming=true`(EAT), but
   that means that we could have issues due to trimming.
- And it can sometimes be unclear whether the build/test failures are due to trimming
     or AOT.

- Because these builds+test runs are different from other builds, owing to the
   "build partially on helix" step, a normal EAT build would not be the same as 
- to help with testing this, we add two lanes to `runtime-staging`:
   - `*_Mono_AOT`: builds AOT+EAT on helix
   - `*_Mono_EAT`: builds EAT, on helix
      - this is required because we want to run almost the same kinda
         build: 1. build test assembly; *2. send to helix; 3. build wasm app;* 4. run tests

- This should effectively mean that we can see which errors might be due to EAT, and
   which are clearly because of EAT+AOT.

Co-authored-by: Steve Pfister <steve.pfister@microsoft.com>
Co-authored-by: Marek Safar <marek.safar@gmail.com>
Co-authored-by: Mitchell Hwang <mitchell.hwang@microsoft.com>
Co-authored-by: Ankit Jain <radical@gmail.com>
 2021-04-21 20:58:25 -04:00
Elinor Fung
189829cbf6
Use simpler command in example for building individual coreclr test (#51364) 
* Use simpler command in example for building individual coreclr test

* Remove comment about using 'dotnet msbuild'
 2021-04-16 10:56:28 -07:00
Ankit Jain
8d102e3fc2
[wasm][tests] Enable line numbers in stack traces (#50893) 2021-04-12 13:01:25 -04:00
Alexander Köplinger
bc9f00c226
Cleanup PlatformSpecific/SkipOnMono attributes that skip a platform (#50907) 
We have a bunch of test assemblies that don't make sense on some platforms, e.g. Browser.
Right now we're skipping them via `[SkipOnMono("reason", TestPlatforms.Browser)]` but there's nothing that inherently ties this to Mono other than the current implementation.

The more generic `SkipOnPlatform` attribute can be used instead.
We can also use it in places where we do `[PlatformSpecific(~TestPlatforms....)]` to avoid the double inversion.
 2021-04-09 13:20:18 +02:00
erhanatesoglu
aa64d2e712
Fixed broken link (#50964) 
The link to xunit on github has changed.
 2021-04-08 17:56:01 -04:00
Elinor Fung
5ca4992150
Clarify instructions for building individual test with native dependency (#50869) 2021-04-07 13:59:03 -07:00
Ankit Jain
8a1101d2b5
[wasm][tests] Add properties to allow passing args to xharness (#50678) 
* [wasm][tests] Add properties to allow passing args to xharness

New properties:
- `$(WasmXHarnessArgs)`
- `$(WasmXHarnessMonoArgs)`
- `$(WasmTestAppArgs)`

Xharness command line is built with these:

`dotnet xharness wasm test .. $(WasmXHarnessArgs) .. -- $(WasmXHarnessMonoArgs) .. --run .. $(WasmTestAppArgs)`

* [wasm][tests] extract wasm bits into tests.wasm.targets

* [wasm] set EMSDK_PATH for makefile run-tests- targets

* [wasm] Update target dependencies for wasm

* Don't overwrite RunScriptCommand, thus fixing wasm build tests

* Track property name changes
 2021-04-07 13:06:55 -04:00
Ryan Lucia
240fcec9d8
Update iOS workflow docs to clarify simulator/device os split (#50366) 2021-04-05 07:55:20 -04:00
SingleAccretion
af5eae3c87
Delete missed mono/netcore from the documentation (#50557) 2021-04-01 09:27:57 -04:00
Fan Yang
1ce7460578
Update testing-android.md (#50484) 2021-03-31 10:03:27 -07:00