You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We need an integrated test (Query agent integrated with AtomDB) running on a large KB to serve as functional and performance test.
Ideally the test should use 3 containers, one for AtomDB, one for Query server and one for client (the test code itself). This is desired but is not a hard requirement. Having everything running in the same container may work just as well.
Tests are expected to run (by hand, command line) in one of our large RAM bare metal servers. No automation is expected at this stage.
Performance test should cover different cases with different features. At least:
Queries with large responses for LinkTemplates
Queries with deep/complex AND, OR operations
KB of different sizes. At least small (few thousands sentences), medium and large (after loaded, near 80% of RAM is used)
Functional test can be implemented as a regression test on top of the results of (some of) the performance tests. We can run the selected tests once and record the query outputs, then check the result manually once and use the correct output to create baseline files. Afterwards, the actual functional tests should run the code and compare query outputs against the baseline.
The text was updated successfully, but these errors were encountered:
We need an integrated test (Query agent integrated with AtomDB) running on a large KB to serve as functional and performance test.
The text was updated successfully, but these errors were encountered: