Devel20250429 #7

fepitre · 2025-04-29T14:05:01Z

Several fixes and we add test suites for module itself and from using with ansible cli.

marmarek · 2025-04-29T14:07:03Z

for the "default" thing there was an issue: QubesOS/qubes-issues#9922, add fixes to the commit message

qubesos-bot · 2025-04-30T21:56:00Z

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025052004-4.3&flavor=pull-requests

Test run included the following:

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025021804-4.3&flavor=update

system_tests_whonix
- whonix_torbrowser: unnamed test (unknown)
- whonix_torbrowser: Failed (test died)
  # Test died: no candidate needle with tag(s) 'anon-whonix-tor-brows...
system_tests_dispvm
- TC_20_DispVM_debian-12-xfce: test_013_dvm_run_preload_gui (failure)
  ^... AssertionError: None is not true
- TC_20_DispVM_debian-12-xfce: test_014_dvm_run_preload_nogui (failure)
  ^... AssertionError: None is not true
- TC_20_DispVM_debian-12-xfce: test_015_dvm_run_preload_race_more (error + cleanup)
  raise TimeoutError from exc_val... TimeoutError
- TC_20_DispVM_fedora-41-xfce: test_013_dvm_run_preload_gui (failure)
  ^... AssertionError: None is not true
- TC_20_DispVM_fedora-41-xfce: test_014_dvm_run_preload_nogui (error + cleanup)
  qubes.exc.QubesValueError: Qube GUI is 'False' and does not support...
- TC_20_DispVM_fedora-41-xfce: test_015_dvm_run_preload_race_more (error)
  raise TimeoutError from exc_val... TimeoutError
system_tests_kde_gui_interactive
- gui_filecopy: unnamed test (unknown)
- gui_filecopy: Failed (test died)
  # Test died: no candidate needle with tag(s) 'files-test-file' matc...
system_tests_qwt_win10_seamless@hw13
- windows_install: wait_serial (wait serial expected)
  # wait_serial expected: qr/0ZKG~-\d+-/...
- windows_install: Failed (test died + timed out)
  # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected)
  # wait_serial expected: qr/dcWzE-\d+-/...
- windows_install: Failed (test died + timed out)
  # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_gui_interactive@hw1
- gui_filecopy: unnamed test (unknown)
- gui_filecopy: Failed (test died)
  # Test died: no candidate needle with tag(s) 'files-test-file' matc...
system_tests_gui_tools@hw7
- qui_widgets_devices: unnamed test (unknown)
- qui_widgets_devices: Failed (test died)
  # Test died: no candidate needle with tag(s) 'qui-devices-opened' m...

Failed tests

18 failures

system_tests_whonix
- whonix_torbrowser: unnamed test (unknown)
- whonix_torbrowser: Failed (test died)
  # Test died: no candidate needle with tag(s) 'anon-whonix-tor-brows...
system_tests_dispvm
- TC_20_DispVM_debian-12-xfce: test_013_dvm_run_preload_gui (failure)
  ^... AssertionError: None is not true
- TC_20_DispVM_debian-12-xfce: test_014_dvm_run_preload_nogui (failure)
  ^... AssertionError: None is not true
- TC_20_DispVM_debian-12-xfce: test_015_dvm_run_preload_race_more (error + cleanup)
  raise TimeoutError from exc_val... TimeoutError
- TC_20_DispVM_fedora-41-xfce: test_013_dvm_run_preload_gui (failure)
  ^... AssertionError: None is not true
- TC_20_DispVM_fedora-41-xfce: test_014_dvm_run_preload_nogui (error + cleanup)
  qubes.exc.QubesValueError: Qube GUI is 'False' and does not support...
- TC_20_DispVM_fedora-41-xfce: test_015_dvm_run_preload_race_more (error)
  raise TimeoutError from exc_val... TimeoutError
system_tests_kde_gui_interactive
- gui_filecopy: unnamed test (unknown)
- gui_filecopy: Failed (test died)
  # Test died: no candidate needle with tag(s) 'files-test-file' matc...
system_tests_qwt_win10_seamless@hw13
- windows_install: wait_serial (wait serial expected)
  # wait_serial expected: qr/0ZKG~-\d+-/...
- windows_install: Failed (test died + timed out)
  # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected)
  # wait_serial expected: qr/dcWzE-\d+-/...
- windows_install: Failed (test died + timed out)
  # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_gui_interactive@hw1
- gui_filecopy: unnamed test (unknown)
- gui_filecopy: Failed (test died)
  # Test died: no candidate needle with tag(s) 'files-test-file' matc...
system_tests_gui_tools@hw7
- qui_widgets_devices: unnamed test (unknown)
- qui_widgets_devices: Failed (test died)
  # Test died: no candidate needle with tag(s) 'qui-devices-opened' m...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/129058#dependencies

15 fixed

system_tests_whonix
- whonixcheck: fail (unknown)
  Whonixcheck for sys-whonix failed...
- whonixcheck: unnamed test (unknown)
system_tests_suspend
- suspend: unnamed test (unknown)
- suspend: Failed (test died)
  # Test died: no candidate needle with tag(s) 'SUSPEND-FAILED' match...
system_tests_qrexec
- TC_00_Qrexec_whonix-workstation-17: test_070_qrexec_vm_simultaneous_write (failure)
  exited with non-zero code 125; stderr: b"dd: error writing 'standa...
system_tests_kde_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died)
  # Test died: no candidate needle with tag(s) 'clipboard-paste-notif...
system_tests_audio
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_223_audio_play_hvm (failure)
  AssertionError: too short audio, expected 10s, got 7.33528344671201...
- TC_20_AudioVM_PipeWire_whonix-workstation-17: test_226_audio_playback_pipewire (failure)
  AssertionError: too short audio, expected 10s, got 9.19027210884353...
- TC_20_AudioVM_PipeWire_whonix-workstation-17: test_251_audio_playback_audiovm_pipewire_late_start (failure)
  AssertionError: too short audio, expected 10s, got 9.22900226757369...
system_tests_whonix@hw7
- whonixcheck: fail (unknown)
  Whonixcheck for sys-whonix failed...
- whonixcheck: unnamed test (unknown)
system_tests_basic_vm_qrexec_gui_btrfs
- TC_03_QvmRevertTemplateChanges: test_000_revert_linux (error)
  subprocess.CalledProcessError: Command '['sha1sum', '/var/lib/qubes...
system_tests_suspend@hw1
- suspend: unnamed test (unknown)
- suspend: Failed (test died)
  # Test died: no candidate needle with tag(s) 'SUSPEND-FAILED' match...

Unstable tests

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

56 tests

debian-12-xfce_exec: 8.05
debian-12-xfce_exec-root: 29.22
debian-12-xfce_socket: 8.42
debian-12-xfce_socket-root: 8.54
debian-12-xfce_exec-data-simplex: 62.61
debian-12-xfce_exec-data-duplex: 72.56
debian-12-xfce_exec-data-duplex-root: 70.97
debian-12-xfce_socket-data-duplex: 159.99
fedora-41-xfce_exec: 9.36
fedora-41-xfce_exec-root: 60.53
fedora-41-xfce_socket: 8.88
fedora-41-xfce_socket-root: 8.18
fedora-41-xfce_exec-data-simplex: 67.65
fedora-41-xfce_exec-data-duplex: 68.44
fedora-41-xfce_exec-data-duplex-root: 107.11
fedora-41-xfce_socket-data-duplex: 149.47
dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 133792.00
dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 97261.00
dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 151301.00
dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 11895.00
dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 14268.00
dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 381.00
dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 3304.00
dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 3366.00
dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 417260.00
dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 128429.00
dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 438551.00
dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 144504.00
dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 104934.00
dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 8473.00
dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 7881.00
dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 5086.00
fedora-41-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 381161.00
fedora-41-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 56087.00
fedora-41-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 317654.00
fedora-41-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 30795.00
fedora-41-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 84152.00
fedora-41-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 3206.00
fedora-41-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 8143.00
fedora-41-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 667.00
fedora-41-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 360087.00
fedora-41-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 96619.00
fedora-41-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 280442.00
fedora-41-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 65596.00
fedora-41-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 94426.00
fedora-41-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 1698.00
fedora-41-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 8295.00
fedora-41-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 1232.00
fedora-41-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 336621.00
fedora-41-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 171613.00
fedora-41-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 308677.00
fedora-41-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 86900.00
fedora-41-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 85009.00
fedora-41-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 5232.00
fedora-41-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 8047.00
fedora-41-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 2424.00

marmarek · 2025-05-02T02:38:41Z

For tests to run in the actual Qubes OS system (in openQA or elsewhere), they need to be included in a package. If you don't want in the main package, it can be a subpackage.

fepitre · 2025-05-02T08:55:26Z

For tests to run in the actual Qubes OS system (in openQA or elsewhere), they need to be included in a package. If you don't want in the main package, it can be a subpackage.

It's now called qubes-ansible-tests.

marmarek · 2025-05-02T10:15:40Z

PipelineRefresh

marmarek · 2025-05-02T10:16:39Z

PipelineRetry

marmarek · 2025-05-02T10:18:20Z

PipelineRefresh

marmarek · 2025-05-02T10:35:04Z

PipelineRefresh

codecov-commenter · 2025-05-19T09:28:40Z

Welcome to Codecov 🎉

Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.

Thanks for integrating Codecov - We've got you covered ☂️

fepitre · 2025-05-19T13:20:45Z

PipelineRetry

marmarek · 2025-05-19T19:15:06Z

plugins/modules/qubesos.py

            # Because it is not running
-
+            pass
+        print("toto")


Leftover debug

We add several tests to be executed into a mgmtvm or dom0.

Closes QubesOS/qubes-issues#9922

fepitre force-pushed the devel20250429 branch from d3fab87 to 290c296 Compare April 29, 2025 14:08

marmarek added the openqa-pending label Apr 30, 2025

fepitre force-pushed the devel20250429 branch from 314c8db to e34515c Compare May 2, 2025 08:53

fepitre force-pushed the devel20250429 branch 6 times, most recently from 31688d5 to a461686 Compare May 7, 2025 10:27

fepitre force-pushed the devel20250429 branch from ad5d50e to 69f925e Compare May 19, 2025 07:56

fepitre force-pushed the devel20250429 branch 4 times, most recently from be3b184 to 698d9d4 Compare May 19, 2025 13:17

qubesos-bot mentioned this pull request May 19, 2025

Allow VM boot modes to change a VM's default user QubesOS/qubes-core-admin#681

Merged

fepitre force-pushed the devel20250429 branch from 698d9d4 to 185842e Compare May 19, 2025 15:05

marmarek requested changes May 19, 2025

View reviewed changes

fepitre added 10 commits May 20, 2025 08:51

Introduce "absent" instead of "undefine" and add several fixes

2d9940a

We add several tests to be executed into a mgmtvm or dom0.

module: don't speficy 'default' in template

bb37e02

Closes QubesOS/qubes-issues#9922

Improve tests and add tests of generated playbooks

0b14a9c

conftests: don't print kwargs in exit_json

5dc2cb6

Add tests subpackage

f979039

spec: update R

d1016a6

Add CI test

e708a10

qubesos: change checks syntax

a682208

spec: update tests path

f80e10d

Add test coverage

85c45dd

fepitre force-pushed the devel20250429 branch from 185842e to 85c45dd Compare May 20, 2025 06:51

marmarek approved these changes May 20, 2025

View reviewed changes

marmarek merged commit 85c45dd into QubesOS:main May 20, 2025
2 checks passed

This was referenced May 20, 2025

Resolve merge conflict for #198 QubesOS/qubes-core-qrexec#207

Closed

Preload disposables QubesOS/qubes-core-admin#660

Merged

fepitre deleted the devel20250429 branch July 17, 2025 13:27

Uh oh!

Devel20250429 #7

Devel20250429 #7

Uh oh!

Conversation

fepitre commented Apr 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

marmarek commented Apr 29, 2025

Uh oh!

qubesos-bot commented Apr 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

OpenQA test summary

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

Uh oh!

marmarek commented May 2, 2025

Uh oh!

fepitre commented May 2, 2025

Uh oh!

marmarek commented May 2, 2025

Uh oh!

marmarek commented May 2, 2025

Uh oh!

marmarek commented May 2, 2025

Uh oh!

marmarek commented May 2, 2025

Uh oh!

codecov-commenter commented May 19, 2025

Welcome to Codecov 🎉

Uh oh!

fepitre commented May 19, 2025

Uh oh!

marmarek May 19, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

fepitre commented Apr 29, 2025 •

edited

Loading

qubesos-bot commented Apr 30, 2025 •

edited

Loading