Project Number Date
test_Tails_ISO_5501-plaintext-locale-greeter 56 09 Jul 2025, 06:29

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 36 2 5 0 0 43 7 2 9 8:24.657 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
28.425
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.080
Given I have started Tails from DVD and logged in and the network is connected 22.239
Then the firewall's policy is to drop all IPv4 traffic 3.116
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 2.733
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.143
And the firewall is configured to block all external IPv6 traffic 0.193
After features/support/hooks.rb:330 0.691
After features/support/hooks.rb:100 0.000
Tags: @product
2:36.540
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Steps
Given I have started Tails from DVD and logged in and the network is connected 39.759
And I capture all network traffic 0.021
When I successfully start the Unsafe Browser 34.767
And I open the Tails homepage in the Unsafe Browser 16.581
And the Tails homepage loads in the Unsafe Browser 1:5.409
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 6.126 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 07:10:52)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:10:52_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:10:52_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:10:52_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:10:52_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.033
Tags: @product
1:18.972
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.018
Given I have started Tails from DVD and logged in and the network is connected 1:18.064
And I capture all network traffic 0.012
And I disable Tails' firewall 0.211
When I do a TCP DNS lookup of "torproject.org" 0.574
Then the firewall leak detector has detected leaks 0.109
After features/support/hooks.rb:330 0.682
After features/support/hooks.rb:100 0.048
Tags: @product
36.944
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.019
Given I have started Tails from DVD and logged in and the network is connected 33.886
And I capture all network traffic 0.073
And I disable Tails' firewall 1.380
When I do a UDP DNS lookup of "torproject.org" 1.340
Then the firewall leak detector has detected leaks 0.263
After features/support/hooks.rb:330 1.418
After features/support/hooks.rb:100 0.053
Tags: @product
43.716
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.020
Given I have started Tails from DVD and logged in and the network is connected 39.071
And I capture all network traffic 0.007
And I disable Tails' firewall 0.214
When I send some ICMP pings 4.123
Then the firewall leak detector has detected leaks 0.299
After features/support/hooks.rb:330 1.004
After features/support/hooks.rb:100 0.055
Tags: @product @check_tor_leaks
28.446
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.009
Before features/support/hooks.rb:507 0.008
Given I have started Tails from DVD and logged in and the network is connected 25.288
When I open an untorified TCP connection to 1.2.3.4 on port 42 2.754
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.402
After features/support/hooks.rb:515 2.595
After features/support/hooks.rb:330 2.030
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
25.476
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.033
Before features/support/hooks.rb:507 0.028
Given I have started Tails from DVD and logged in and the network is connected 23.820
When I open an untorified UDP connection to 1.2.3.4 on port 42 1.492
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.163
After features/support/hooks.rb:515 0.503
After features/support/hooks.rb:330 1.112
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
35.680
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.022
Before features/support/hooks.rb:507 0.020
Given I have started Tails from DVD and logged in and the network is connected 26.103
When I open an untorified ICMP connection to 1.2.3.4 9.496
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.081
After features/support/hooks.rb:515 0.316
After features/support/hooks.rb:330 0.875
After features/support/hooks.rb:100 0.000
Tags: @product
1:10.455
Scenario The system DNS is always set up to use Tor's DNSPort
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.051
Steps
Given I have started Tails from DVD without network and logged in 1:10.455
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:89:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ without\ network\ and\ logged\ in$/'
features/tor_enforcement.feature:66:in `Given I have started Tails from DVD without network and logged in'
And the system DNS is using the local DNS resolver 0.000
And the network is plugged 0.000
And I successfully configure Tor 0.000
Then the system DNS is still using the local DNS resolver 0.000
After features/support/hooks.rb:330 7.039 
SCENARIO FAILED: 'The system DNS is always set up to use Tor's DNSPort' (at time 07:16:30)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:16:30_The_system_DNS_is_always_set_up_to_use_Tor_s_DNSPort.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:16:30_The_system_DNS_is_always_set_up_to_use_Tor_s_DNSPort.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:16:30_The_system_DNS_is_always_set_up_to_use_Tor_s_DNSPort.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/56/artifact/build-artifacts/07:16:30_The_system_DNS_is_always_set_up_to_use_Tor_s_DNSPort.journal
After features/support/hooks.rb:100 0.000