Project Number Date
test_Tails_ISO_devel 3899 07 Jul 2025, 14:42

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 4:48.633 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
18.971
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Given I have started Tails from DVD and logged in and the network is connected 18.380
Then the firewall's policy is to drop all IPv4 traffic 0.108
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 0.276
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.124
And the firewall is configured to block all external IPv6 traffic 0.081
After features/support/hooks.rb:330 1.236
After features/support/hooks.rb:100 0.000
Tags: @product
2:0.873
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Steps
Given I have started Tails from DVD and logged in and the network is connected 18.728
And I capture all network traffic 0.008
When I successfully start the Unsafe Browser 25.769
And I open the Tails homepage in the Unsafe Browser 16.113
And the Tails homepage loads in the Unsafe Browser 1:0.253
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 8.734 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 06:12:45)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3899/artifact/build-artifacts/06:12:45_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3899/artifact/build-artifacts/06:12:45_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3899/artifact/build-artifacts/06:12:45_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3899/artifact/build-artifacts/06:12:45_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.039
Tags: @product
19.334
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.023
Given I have started Tails from DVD and logged in and the network is connected 16.091
And I capture all network traffic 0.009
And I disable Tails' firewall 0.253
When I do a TCP DNS lookup of "torproject.org" 1.185
Then the firewall leak detector has detected leaks 1.793
After features/support/hooks.rb:330 1.422
After features/support/hooks.rb:100 0.036
Tags: @product
19.293
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.026
Given I have started Tails from DVD and logged in and the network is connected 16.044
And I capture all network traffic 0.022
And I disable Tails' firewall 0.808
When I do a UDP DNS lookup of "torproject.org" 1.558
Then the firewall leak detector has detected leaks 0.859
After features/support/hooks.rb:330 1.417
After features/support/hooks.rb:100 0.052
Tags: @product
20.655
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.023
Given I have started Tails from DVD and logged in and the network is connected 15.557
And I capture all network traffic 0.038
And I disable Tails' firewall 0.746
When I send some ICMP pings 4.166
Then the firewall leak detector has detected leaks 0.146
After features/support/hooks.rb:330 0.808
After features/support/hooks.rb:100 0.054
Tags: @product @check_tor_leaks
18.950
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.022
Before features/support/hooks.rb:507 0.012
Given I have started Tails from DVD and logged in and the network is connected 15.740
When I open an untorified TCP connection to 1.2.3.4 on port 42 2.937
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.272
After features/support/hooks.rb:515 0.402
After features/support/hooks.rb:330 1.006
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
17.654
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.059
Before features/support/hooks.rb:507 0.049
Given I have started Tails from DVD and logged in and the network is connected 15.192
When I open an untorified UDP connection to 1.2.3.4 on port 42 2.293
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.168
After features/support/hooks.rb:515 0.959
After features/support/hooks.rb:330 2.587
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
20.515
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.013
Before features/support/hooks.rb:507 0.020
Given I have started Tails from DVD and logged in and the network is connected 14.107
When I open an untorified ICMP connection to 1.2.3.4 6.310
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.097
After features/support/hooks.rb:515 0.333
After features/support/hooks.rb:330 1.018
After features/support/hooks.rb:100 0.000
Tags: @product
32.383
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.022
Given I have started Tails from DVD without network and logged in 9.391
And the system DNS is using the local DNS resolver 0.016
And the network is plugged 0.079
And I successfully configure Tor 22.847
Then the system DNS is still using the local DNS resolver 0.048
After features/support/hooks.rb:330 1.783
After features/support/hooks.rb:100 0.000