Interaction between Microsoft test components and the adapter

[OsirisTerje]

@Youssef1313 @Evangelink @nohwnd

Hi Guys!

The adapter can run in many different ways, but I wonder if some of these are outdated, and how the interfaces are actually being used from your side.

1. The discovery/execution interfaces implemented by the adapter opens the possibility for running multiple assemblies. This was used way back in time, but are there any calls from any Microsoft platform, MTP or non-MTP, that actually do this now ?
2. There are two interfaces Microsoft can call, one with a list of test cases and the other with a list of assemblies. Are both in use, and if so, when are each being called? (From my own checks, I see that both are (or where until recently) in use, but what causes which?)
3. Are there any limit to the number of tests that can be sent (as TestCases), or a limit of the total size of that?
4. Are there any situation where ProcessModel would be anything but "InProcess" and DomainUsage would be anything but "Single" ?
5. Have you made any documentation for the interface and its intended usage? (as we always have reverse engineered this, and haven't really looked for the last decade or so....)

[Evangelink]

The discovery/execution interfaces implemented by the adapter opens the possibility for running multiple assemblies. This was used way back in time, but are there any calls from any Microsoft platform, MTP or non-MTP, that actually do this now ?

My understanding is no, you will never receive more than 1 assembly.

There are two interfaces Microsoft can call, one with a list of test cases and the other with a list of assemblies. Are both in use, and if so, when are each being called? (From my own checks, I see that both are (or where until recently) in use, but what causes which?)

Yes both are still used by VSTest. The one with TestCase is called when you are running specific tests from the IDE while the one with assemblies is run when running tests with CLI.

Are there any limit to the number of tests that can be sent (as TestCases), or a limit of the total size of that?

That's not a part of VSTest and TE I know enough to reply to that.

Are there any situation where ProcessModel would be anything but "InProcess" and DomainUsage would be anything but "Single" ?

I also cannot comment on that.

Have you made any documentation for the interface and its intended usage? (as we always have reverse engineered this, and haven't really looked for the last decade or so....)

AFAIK this is the only doc https://github.com/microsoft/vstest/blob/main/docs/RFCs/0004-Adapter-Extensibility.md (I don't know if that's up-to-date).