tests: adjust audio tests for changed recording stream behavior

[marmarek]

Now "muted" mic is not connected anymore, so don't expect it.

QubesOS/qubes-issues#9999

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.51%. Comparing base (26ae94d) to head (4571c3f).
Report is 10 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #688   +/-   ##
=======================================
  Coverage   70.51%   70.51%           
=======================================
  Files          61       61           
  Lines       13312    13312           
=======================================
  Hits         9387     9387           
  Misses       3925     3925           

Flag	Coverage Δ
unittests	70.51% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[qubesos-bot]

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025062603-4.3&flavor=pull-requests

Test run included the following:

• Add Arch packaging qubes-core-admin-client#332 (QubesOS/qubes-core-admin-client@40487bc)
• Preload dispvm dom0 feat qubes-core-admin-client#360 (QubesOS/qubes-core-admin-client@dff00f4)
• vmupdate: answer "yes" to the import key question qubes-core-admin-linux#194 (QubesOS/qubes-core-admin-linux@5ee0faa)
• Handle global disposable preload feature #686 (f105a73)
• tests: adjust audio tests for changed recording stream behavior #688 (4571c3f)
• Add preload disposable setting to global config qubes-desktop-linux-manager#262 (QubesOS/qubes-desktop-linux-manager@7fb2915)
• Add handler for internal feature qubes-desktop-linux-menu#55 (QubesOS/qubes-desktop-linux-menu@933d7d3)
• Don't try to send grants for not realized windows qubes-gui-agent-linux#236 (QubesOS/qubes-gui-agent-linux@6a6d733)
• pulse: connect recording stream only when recording is allowed qubes-gui-daemon#164 (QubesOS/qubes-gui-daemon@9cb7792)
• Automatically accept test-signed driver installation qubes-installer-qubes-os-windows-tools#6 (QubesOS/qubes-installer-qubes-os-windows-tools@0b6a52a)
• Ignore RemoteVM for now qubes-manager#398 (QubesOS/qubes-manager@679eff4)
• Add disposable preload setting to advanced settings qubes-manager#425 (QubesOS/qubes-manager@16f7bd0)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025061004-4.3&flavor=update

• system_tests_extra

  • TC_00_QVCTest_whonix-gateway-17: test_010_screenshare (failure)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 0 == 0

• system_tests_qwt_win10@hw13

  • windows_install: Failed (test died)
    # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...

• system_tests_qwt_win10_seamless@hw13

  • windows_clipboard_and_filecopy: unnamed test (unknown)
  • windows_clipboard_and_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'windows-Edge-address-...

• system_tests_qwt_win11@hw13

  • windows_install: Failed (test died)
    # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...

• system_tests_guivm_vnc_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'qubes-website' matche...

Failed tests

13 failures

• system_tests_extra

  • TC_00_QVCTest_whonix-gateway-17: test_010_screenshare (failure)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 0 == 0

  • TC_00_QVCTest_whonix-workstation-17: test_010_screenshare (failure)
    AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...

• system_tests_kde_gui_interactive

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: qr/JmOTS-\d+-/...

  • gui_keyboard_layout: Failed (test died + timed out)
    # Test died: command 'echo -e '[Layout]...

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: "# "...

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: qr/2E8vz-\d+-/...

• system_tests_qwt_win10@hw13

  • windows_install: Failed (test died)
    # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...

• system_tests_qwt_win10_seamless@hw13

  • windows_clipboard_and_filecopy: unnamed test (unknown)
  • windows_clipboard_and_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'windows-Edge-address-...

• system_tests_qwt_win11@hw13

  • windows_install: Failed (test died)
    # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...

• system_tests_guivm_vnc_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'qubes-website' matche...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/142375#dependencies

10 fixed

• system_tests_splitgpg

  • TC_10_Thunderbird_whonix-workstation-17: test_000_send_receive_default (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

  • TC_10_Thunderbird_whonix-workstation-17: test_010_send_receive_inline_signed_only (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

  • TC_10_Thunderbird_whonix-workstation-17: test_020_send_receive_inline_with_attachment (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

• system_tests_extra

  • TC_10_Thunderbird_whonix-workstation-17: test_000_send_receive_default (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

  • TC_10_Thunderbird_whonix-workstation-17: test_010_send_receive_inline_signed_only (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

  • TC_10_Thunderbird_whonix-workstation-17: test_020_send_receive_inline_with_attachment (failure)
    dogtail.tree.SearchError: descendent of [application | Thunderbird]...

• system_tests_audio

  • TC_20_AudioVM_Pulse_debian-12-xfce: test_252_audio_playback_audiovm_switch_hvm (failure)
    AssertionError: only silence detected, no useful audio data

  • TC_20_AudioVM_Pulse_whonix-workstation-17: test_225_audio_rec_unmuted_hvm (failure)
    AssertionError: too short audio, expected 10s, got 7.95233560090703...

• system_tests_guivm_vnc_gui_interactive

  • simple_gui_apps: unnamed test (unknown)
  • simple_gui_apps: Failed (test died)
    # Test died: no candidate needle with tag(s) 'vm-settings-applicati...

Unstable tests

Performance Tests

Performance degradation:

6 performance degradations

• debian-12-xfce_exec-data-simplex: 72.82 🔺 ( previous job: 65.51, degradation: 111.16%)
• whonix-gateway-17_exec-data-duplex-root: 100.54 🔺 ( previous job: 90.74, degradation: 110.80%)
• dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 7521.00 :small_red_triangle: ( previous job: 11086.00, degradation: 67.84%)
• dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 35661.00 :small_red_triangle: ( previous job: 122848.00, degradation: 29.03%)
• dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 143368.00 :small_red_triangle: ( previous job: 167872.00, degradation: 85.40%)
• dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 6935.00 :small_red_triangle: ( previous job: 8874.00, degradation: 78.15%)

Remaining performance tests:

66 tests

• debian-12-xfce_exec: 6.62 🟢 ( previous job: 8.63, improvement: 76.72%)
• debian-12-xfce_exec-root: 30.33 🔺 ( previous job: 29.44, degradation: 103.05%)
• debian-12-xfce_socket: 9.23 🔺 ( previous job: 8.50, degradation: 108.62%)
• debian-12-xfce_socket-root: 7.87 🟢 ( previous job: 8.31, improvement: 94.62%)
• debian-12-xfce_exec-data-duplex: 76.27 🔺 ( previous job: 73.55, degradation: 103.71%)
• debian-12-xfce_exec-data-duplex-root: 69.42 🟢 ( previous job: 70.01, improvement: 99.15%)
• debian-12-xfce_socket-data-duplex: 165.24 🔺 ( previous job: 161.35, degradation: 102.41%)
• fedora-42-xfce_exec: 9.05
• fedora-42-xfce_exec-root: 57.98
• fedora-42-xfce_socket: 7.78
• fedora-42-xfce_socket-root: 8.14
• fedora-42-xfce_exec-data-simplex: 76.24
• fedora-42-xfce_exec-data-duplex: 75.10
• fedora-42-xfce_exec-data-duplex-root: 111.90
• fedora-42-xfce_socket-data-duplex: 154.09
• whonix-gateway-17_exec: 6.30 🟢 ( previous job: 7.34, improvement: 85.82%)
• whonix-gateway-17_exec-root: 38.51 🟢 ( previous job: 39.57, improvement: 97.30%)
• whonix-gateway-17_socket: 6.87 🟢 ( previous job: 7.85, improvement: 87.49%)
• whonix-gateway-17_socket-root: 6.76 🟢 ( previous job: 7.89, improvement: 85.59%)
• whonix-gateway-17_exec-data-simplex: 78.59 🔺 ( previous job: 77.76, degradation: 101.06%)
• whonix-gateway-17_exec-data-duplex: 68.70 🟢 ( previous job: 78.39, improvement: 87.64%)
• whonix-gateway-17_socket-data-duplex: 174.40 🔺 ( previous job: 161.95, degradation: 107.69%)
• whonix-workstation-17_exec: 7.81 🟢 ( previous job: 8.27, improvement: 94.40%)
• whonix-workstation-17_exec-root: 56.17 🟢 ( previous job: 57.61, improvement: 97.50%)
• whonix-workstation-17_socket: 8.73 🟢 ( previous job: 8.97, improvement: 97.33%)
• whonix-workstation-17_socket-root: 8.30 🟢 ( previous job: 9.46, improvement: 87.69%)
• whonix-workstation-17_exec-data-simplex: 77.61 🔺 ( previous job: 74.54, degradation: 104.12%)
• whonix-workstation-17_exec-data-duplex: 72.72 🟢 ( previous job: 74.84, improvement: 97.16%)
• whonix-workstation-17_exec-data-duplex-root: 90.52 🔺 ( previous job: 86.00, degradation: 105.25%)
• whonix-workstation-17_socket-data-duplex: 163.11 🔺 ( previous job: 160.20, degradation: 101.81%)
• dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 387643.00 :green_circle: ( previous job: 289982.00, improvement: 133.68%)
• dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 102460.00 :green_circle: ( previous job: 101988.00, improvement: 100.46%)
• dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 257698.00 :green_circle: ( previous job: 14284.00, improvement: 1804.10%)
• dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 49791.00 :green_circle: ( previous job: 32696.00, improvement: 152.28%)
• dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 102264.00 :green_circle: ( previous job: 17102.00, improvement: 597.97%)
• dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 6151.00 :green_circle: ( previous job: 1091.00, improvement: 563.79%)
• dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 3535.00 :green_circle: ( previous job: 1840.00, improvement: 192.12%)
• dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 476408.00 :green_circle: ( previous job: 289182.00, improvement: 164.74%)
• dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 443372.00 :green_circle: ( previous job: 433654.00, improvement: 102.24%)
• dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 99909.00 :small_red_triangle: ( previous job: 108760.00, degradation: 91.86%)
• dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 8054.00 :green_circle: ( previous job: 6356.00, improvement: 126.71%)
• dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 4501.00 :green_circle: ( previous job: 4420.00, improvement: 101.83%)
• fedora-42-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 358487.00
• fedora-42-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 262012.00
• fedora-42-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 298824.00
• fedora-42-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 95600.00
• fedora-42-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 79362.00
• fedora-42-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 1365.00
• fedora-42-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 7702.00
• fedora-42-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 1513.00
• fedora-42-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 379506.00
• fedora-42-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 197306.00
• fedora-42-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 310046.00
• fedora-42-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 66676.00
• fedora-42-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 84554.00
• fedora-42-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 3733.00
• fedora-42-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 8403.00
• fedora-42-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 1440.00
• fedora-42-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 350225.00
• fedora-42-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 129171.00
• fedora-42-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 289581.00
• fedora-42-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 19417.00
• fedora-42-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 80552.00
• fedora-42-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 2688.00
• fedora-42-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 7964.00
• fedora-42-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 497.00