Project Number Date
test_Tails_ISO_devel 3488 21 Aug 2024, 12:26

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
Browsing the web using the Tor Browser 131 0 0 0 0 131 12 5 17 17:28.864 Failed
Tags: @product
Feature Browsing the web using the Tor Browser
As a Tails user when I browse the web using the Tor Browser all Internet traffic should flow only through Tor
Tags: @product
45.900
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD and logged in and the network is connected 11.650
And a web server is running on the LAN 1.039
And I capture all network traffic 0.007
When I start the Tor Browser 21.423
And the Tor Browser loads the startup page 0.785
And I open a page on the LAN web server in the Tor Browser 9.910
Then the Tor Browser shows the "Unable to connect" error 0.721
And no traffic was sent to the web server on the LAN 0.361
After features/support/hooks.rb:326 0.982
After features/support/hooks.rb:100 0.035
Tags: @product @check_tor_leaks
53.282
Scenario The Tor Browser directory is usable
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:507 0.005
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.688
Then the amnesiac Tor Browser directory exists 0.053
And there is a GNOME bookmark for the amnesiac Tor Browser directory 1.668
And the persistent Tor Browser directory does not exist 0.051
When I start the Tor Browser 23.505
And the Tor Browser loads the startup page 0.933
Then I can save the current page as "index.html" to the default downloads directory 5.823
And I can print the current page as "output.pdf" to the default downloads directory 9.557
Hooks
After features/support/hooks.rb:515 0.525
Error message 
Unexpected connections were made
  #<OpenStruct mac_saddr="50:54:00:ef:5a:e6", mac_daddr="52:54:00:16:6f:22", protocol="tcp", sport=44606, dport=80, dns_question=[], saddr="10.2.1.157", daddr="38.145.60.20"> (FirewallAssertionFailedError)
./features/support/helpers/firewall_helper.rb:133:in `assert_all_connections'
./features/support/helpers/firewall_helper.rb:143:in `assert_no_leaks'
./features/support/hooks.rb:524:in `After'
After features/support/hooks.rb:326 4.927 
SCENARIO FAILED: 'The Tor Browser directory is usable' (at time 04:20:47)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:20:47_The_Tor_Browser_directory_is_usable.file_content_var_log_boot.log
Network capture: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:20:47_The_Tor_Browser_directory_is_usable.pcap
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:20:47_The_Tor_Browser_directory_is_usable.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:20:47_The_Tor_Browser_directory_is_usable.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:20:47_The_Tor_Browser_directory_is_usable.journal
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
48.800
Scenario Downloading files with the Tor Browser
Before features/support/hooks.rb:269 0.007
Before features/support/hooks.rb:507 0.008
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.763
When I start the Tor Browser 22.860
Then the Tor Browser loads the startup page 0.860
When I download some file in the Tor Browser 12.983
Then the file is saved to the default Tor Browser download directory 0.332
Hooks
After features/support/hooks.rb:515 0.988
Error message 
Unexpected connections were made
  #<OpenStruct mac_saddr="50:54:00:ef:5a:e6", mac_daddr="52:54:00:16:6f:22", protocol="tcp", sport=44606, dport=80, dns_question=[], saddr="10.2.1.157", daddr="38.145.60.20"> (FirewallAssertionFailedError)
./features/support/helpers/firewall_helper.rb:133:in `assert_all_connections'
./features/support/helpers/firewall_helper.rb:143:in `assert_no_leaks'
./features/support/hooks.rb:524:in `After'
After features/support/hooks.rb:326 4.805 
SCENARIO FAILED: 'Downloading files with the Tor Browser' (at time 04:21:42)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:21:42_Downloading_files_with_the_Tor_Browser.file_content_var_log_boot.log
Network capture: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:21:42_Downloading_files_with_the_Tor_Browser.pcap
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:21:42_Downloading_files_with_the_Tor_Browser.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:21:42_Downloading_files_with_the_Tor_Browser.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:21:42_Downloading_files_with_the_Tor_Browser.journal
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
1:18.958
Scenario Playing an Ogg audio track
Before features/support/hooks.rb:269 0.007
Before features/support/hooks.rb:507 0.007
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.763
When I start the Tor Browser 21.836
And the Tor Browser loads the startup page 0.888
Then I can listen to an Ogg audio track in Tor Browser 44.470
Hooks
After features/support/hooks.rb:515 1.036
Error message 
Unexpected connections were made
  #<OpenStruct mac_saddr="50:54:00:ef:5a:e6", mac_daddr="52:54:00:16:6f:22", protocol="tcp", sport=44606, dport=80, dns_question=[], saddr="10.2.1.157", daddr="38.145.60.20"> (FirewallAssertionFailedError)
./features/support/helpers/firewall_helper.rb:133:in `assert_all_connections'
./features/support/helpers/firewall_helper.rb:143:in `assert_no_leaks'
./features/support/hooks.rb:524:in `After'
After features/support/hooks.rb:326 5.197 
SCENARIO FAILED: 'Playing an Ogg audio track' (at time 04:23:07)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:07_Playing_an_Ogg_audio_track.file_content_var_log_boot.log
Network capture: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:07_Playing_an_Ogg_audio_track.pcap
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:07_Playing_an_Ogg_audio_track.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:07_Playing_an_Ogg_audio_track.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:07_Playing_an_Ogg_audio_track.journal
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
43.988
Scenario Watching a WebM video
Before features/support/hooks.rb:269 0.007
Before features/support/hooks.rb:507 0.007
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.850
When I start the Tor Browser 21.589
And the Tor Browser loads the startup page 0.860
Then I can watch a WebM video in Tor Browser 9.689
Hooks
After features/support/hooks.rb:515 0.515
Error message 
Unexpected connections were made
  #<OpenStruct mac_saddr="50:54:00:ef:5a:e6", mac_daddr="52:54:00:16:6f:22", protocol="tcp", sport=44606, dport=80, dns_question=[], saddr="10.2.1.157", daddr="38.145.60.20"> (FirewallAssertionFailedError)
./features/support/helpers/firewall_helper.rb:133:in `assert_all_connections'
./features/support/helpers/firewall_helper.rb:143:in `assert_no_leaks'
./features/support/hooks.rb:524:in `After'
After features/support/hooks.rb:326 6.228 
SCENARIO FAILED: 'Watching a WebM video' (at time 04:23:56)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:56_Watching_a_WebM_video.file_content_var_log_boot.log
Network capture: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:56_Watching_a_WebM_video.pcap
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:56_Watching_a_WebM_video.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:56_Watching_a_WebM_video.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:23:56_Watching_a_WebM_video.journal
After features/support/hooks.rb:100 0.000
Tags: @product
1:15.384
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD and logged in and the network is connected 11.670
And I copy "/usr/share/synaptic/html/index.html" to "/home/amnesia/Tor Browser/synaptic.html" as user "amnesia" 0.146
And I copy "/usr/share/synaptic/html/index.html" to "/home/amnesia/.gnupg/synaptic.html" as user "amnesia" 0.055
And I copy "/usr/share/synaptic/html/index.html" to "/tmp/synaptic.html" as user "amnesia" 0.078
Then the file "/home/amnesia/.gnupg/synaptic.html" exists 0.056
And the file "/lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" exists 0.051
And the file "/live/overlay/rw/home/amnesia/.gnupg/synaptic.html" exists 0.052
And the file "/tmp/synaptic.html" exists 0.054
Given I start monitoring the AppArmor log of "torbrowser_firefox" 0.132
When I start the Tor Browser 22.136
And the Tor Browser loads the startup page 0.941
And I open the address "file:///home/amnesia/Tor Browser/synaptic.html" in the Tor Browser 9.882
Then I see "TorBrowserSynapticManual.png" after at most 5 seconds 0.556
And AppArmor has not denied "torbrowser_firefox" from opening "/home/amnesia/Tor Browser/synaptic.html" 0.302
Given I restart monitoring the AppArmor log of "torbrowser_firefox" 0.158
When I open the address "file:///home/amnesia/.gnupg/synaptic.html" in the Tor Browser 9.001
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.519
And AppArmor has denied "torbrowser_firefox" from opening "/home/amnesia/.gnupg/synaptic.html" 0.070
Given I restart monitoring the AppArmor log of "torbrowser_firefox" 0.096
When I open the address "file:///lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" in the Tor Browser 5.897
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.506
And AppArmor has denied "torbrowser_firefox" from opening "/usr/lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" 0.069
Given I restart monitoring the AppArmor log of "torbrowser_firefox" 0.099
When I open the address "file:///live/overlay/rw/home/amnesia/.gnupg/synaptic.html" in the Tor Browser 5.813
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.557
# Due to our AppArmor aliases, /live/overlay will be treated
# as /lib/live/mount/overlay.
And AppArmor has denied "torbrowser_firefox" from opening "/usr/lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" 0.063
# We do not get any AppArmor log for when access to files in /tmp is denied
# since we explictly override (commit 51c0060) the rules (from the user-tmp
# abstraction) that would otherwise allow it, and we do so with "deny", which
# also specifies "noaudit". We could explicitly specify "audit deny" and
# then have logs, but it could be a problem when we set up desktop
# notifications for AppArmor denials (#9337).
When I open the address "file:///tmp/synaptic.html" in the Tor Browser 5.913
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.498
After features/support/hooks.rb:326 0.753
After features/support/hooks.rb:100 0.000
Tags: @product
35.347
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD and logged in and the network is connected 11.874
When I start the Tor Browser 22.273
Then the Tor Browser uses all expected TBB shared libraries 1.198
After features/support/hooks.rb:326 0.753
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
53.672
Scenario The Tor Browser's "New identity" feature works as expected
Before features/support/hooks.rb:269 0.009
Before features/support/hooks.rb:507 0.009
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.647
When I start the Tor Browser 21.646
And the Tor Browser loads the startup page 0.810
And I open the Tails homepage in the Tor Browser 9.565
Then the Tor Browser loads the Tails homepage 1.064
When I request a new identity in Tor Browser 3.196
Then the Tor Browser restarts into a fresh session 5.740
Hooks
After features/support/hooks.rb:515 0.968
Error message 
Unexpected connections were made
  #<OpenStruct mac_saddr="50:54:00:ef:5a:e6", mac_daddr="52:54:00:16:6f:22", protocol="tcp", sport=44606, dport=80, dns_question=[], saddr="10.2.1.157", daddr="38.145.60.20"> (FirewallAssertionFailedError)
./features/support/helpers/firewall_helper.rb:133:in `assert_all_connections'
./features/support/helpers/firewall_helper.rb:143:in `assert_no_leaks'
./features/support/hooks.rb:524:in `After'
After features/support/hooks.rb:326 5.401 
SCENARIO FAILED: 'The Tor Browser's "New identity" feature works as expected' (at time 04:26:50)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:26:50_The_Tor_Browser_s__New_identity__feature_works_as_expected.file_content_var_log_boot.log
Network capture: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:26:50_The_Tor_Browser_s__New_identity__feature_works_as_expected.pcap
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:26:50_The_Tor_Browser_s__New_identity__feature_works_as_expected.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:26:50_The_Tor_Browser_s__New_identity__feature_works_as_expected.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3488/artifact/build-artifacts/04:26:50_The_Tor_Browser_s__New_identity__feature_works_as_expected.journal
After features/support/hooks.rb:100 0.000
Tags: @product
36.018
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD and logged in and the network is connected 11.695
When I start the Tor Browser 21.860
And the Tor Browser loads the startup page 0.976
Then Tor Browser's circuit view is working 1.485
After features/support/hooks.rb:326 0.676
After features/support/hooks.rb:100 0.000
Tags: @product
54.241
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD and logged in and the network is connected 11.557
When I start the Tor Browser 21.709
And the Tor Browser loads the startup page 0.999
When I open the address "https://net.ipcalf.com/" in the Tor Browser 9.729
Then Tor Browser displays a 'ifconfig | grep inet | grep -v inet6 | cut -d" " -f2 | tail -n1' heading on the "Network IP Address via ipcalf.com" page 0.835
When I open the address "https://mozilla.github.io/webrtc-landing/pc_test.html" in the Tor Browser 8.629
Then Tor Browser displays a "RTCPeerConnection is missing!" heading on the "Simple RTCPeerConnection Video Test" page 0.781
After features/support/hooks.rb:326 0.646
After features/support/hooks.rb:100 0.000
Tags: @product
1:35.094
Before features/support/hooks.rb:269 0.007
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 10.114
And the network is plugged 0.093
And I successfully configure Tor 17.237
And available upgrades have been checked 1.115
And all notifications have disappeared 3.933
Then the persistent Tor Browser directory exists 0.055
And there is a GNOME bookmark for the persistent Tor Browser directory 1.624
When I start the Tor Browser 19.669
And I open the address "https://tails.net/about" in the Tor Browser 10.369
And "Tails - How Tails works" has loaded in the Tor Browser 1.086
Then I can save the current page as "index.html" to the persistent Tor Browser directory 8.570
And I open the address "file:///home/amnesia/Persistent/Tor Browser/index.html" in the Tor Browser 9.373
Then "Tails - How Tails works" has loaded in the Tor Browser 1.375
And I can print the current page as "output.pdf" to the persistent Tor Browser directory 10.472
After features/support/hooks.rb:326 0.754
After features/support/hooks.rb:100 0.000
Tags: @product
44.961
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 8.161
Then the amnesiac Documents directory exists 0.046
And there is a GNOME bookmark for the amnesiac Documents directory 1.659
Then I start the Tor Browser in offline mode 26.365
And I can save the current page as "index.html" to the Documents GNOME bookmark 8.727
After features/support/hooks.rb:326 0.753
After features/support/hooks.rb:100 0.000
Tags: @product
46.904
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 10.463
Then the amnesiac Downloads directory exists 0.057
And there is a GNOME bookmark for the amnesiac Downloads directory 1.845
Then I start the Tor Browser in offline mode 25.072
And I can save the current page as "index.html" to the Downloads GNOME bookmark 9.465
After features/support/hooks.rb:326 0.722
After features/support/hooks.rb:100 0.000
Tags: @product
42.859
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 8.036
Then the amnesiac Music directory exists 0.054
And there is a GNOME bookmark for the amnesiac Music directory 1.638
Then I start the Tor Browser in offline mode 23.795
And I can save the current page as "index.html" to the Music GNOME bookmark 9.333
After features/support/hooks.rb:326 0.788
After features/support/hooks.rb:100 0.000
Tags: @product
44.550
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 8.077
Then the amnesiac Pictures directory exists 0.051
And there is a GNOME bookmark for the amnesiac Pictures directory 1.632
Then I start the Tor Browser in offline mode 26.468
And I can save the current page as "index.html" to the Pictures GNOME bookmark 8.321
After features/support/hooks.rb:326 0.806
After features/support/hooks.rb:100 0.000
Tags: @product
46.069
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 8.104
Then the amnesiac Videos directory exists 0.058
And there is a GNOME bookmark for the amnesiac Videos directory 1.631
Then I start the Tor Browser in offline mode 25.425
And I can save the current page as "index.html" to the Videos GNOME bookmark 10.849
After features/support/hooks.rb:326 0.810
After features/support/hooks.rb:100 0.000
Tags: @product
3:22.829
Before features/support/hooks.rb:269 0.014
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 9.590
And all tps features are active 2.245
And all persistent filesystems have safe access rights 0.235
And all persistence configuration files have safe access rights 0.373
And all persistent directories have safe access rights 2.198
When I start the Tor Browser in offline mode 23.363
And I add a bookmark to eff.org in the Tor Browser 10.857
And I cold reboot the computer 11.528
And the computer reboots Tails 57.302
And I enable persistence 14.604
And I log in to a new session 36.913
And all notifications have disappeared 9.322
And I start the Tor Browser in offline mode 23.042
Then the Tor Browser has a bookmark to eff.org 1.251
After features/support/hooks.rb:326 1.250
After features/support/hooks.rb:100 0.010