Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create testing plan #190

Open
mmccool opened this issue Sep 9, 2019 · 4 comments
Open

Create testing plan #190

mmccool opened this issue Sep 9, 2019 · 4 comments
Labels
for next iteration Planned or postponed topics for the future priority: low Issues that might be deferred for later Testing Issues and PRs related to testing.

Comments

@mmccool
Copy link
Contributor

mmccool commented Sep 9, 2019

Issue #117 is a bit too specific. What is needed is a plan outlining how a scripting API implementation is tested for conformance with the specification. This can be a simple .md file, and may or may not use the assertion extraction mechanism used for the TD spec. Also the definition of "feature" should be discussed; features are points of the implementation to be tested but may or may not map directly onto assertions in the text. They may also relate to (for example) each entry point in the API defined in the IDL.

@zolkis zolkis added the for next iteration Planned or postponed topics for the future label Sep 10, 2019
@zolkis
Copy link
Contributor

zolkis commented Feb 3, 2020

Do we plan something generic like https://github.com/web-platform-tests/wpt/ ?

@danielpeintner
Copy link
Contributor

@egekorkan are there any plans to extend https://github.com/tum-esi/testbench with the support of testing scripting implementations?

i.e., based on a TD scripts could be generated.

@egekorkan
Copy link
Contributor

There are currently no plans to generate a script that can be run but the requests to be sent are generated on the Servient. The responses are also reported in a test report.
If a script is needed to be generated, what should it test?
Currently, wot-testbench test only the Exposed Thing through its TD and the Thing could be programmed in different ways, not necessarily via Scripting API.

@relu91 relu91 added the priority: low Issues that might be deferred for later label Dec 4, 2023
@relu91
Copy link
Member

relu91 commented Dec 4, 2023

Call 04/12:

  • @zolkis: testing is important in W3C, issue raised by a Chair, we just didn't have the bandwidth to work on this.
  • @relu91 proposing to put low priority for now and reevaluate later
  • @mmccool please let us know if you feel otherwise and we need to prioritize this work. Or feel free to expand your original idea.
  • @ashimura remind that it is not necessary to note document. It relates to how we want to do testing in general in the working group.

@JKRhb JKRhb added the Testing Issues and PRs related to testing. label Dec 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
for next iteration Planned or postponed topics for the future priority: low Issues that might be deferred for later Testing Issues and PRs related to testing.
Projects
None yet
Development

No branches or pull requests

6 participants