Project Number Date
test_Tails_ISO_5501-plaintext-locale-greeter 44 02 Jul 2025, 10:56

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 8:37.561 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
37.956
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Given I have started Tails from DVD and logged in and the network is connected 36.891
Then the firewall's policy is to drop all IPv4 traffic 0.294
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 0.494
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.155
And the firewall is configured to block all external IPv6 traffic 0.120
After features/support/hooks.rb:330 0.747
After features/support/hooks.rb:100 0.000
Tags: @product
2:23.205
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.009
Steps
Given I have started Tails from DVD and logged in and the network is connected 21.839
And I capture all network traffic 0.009
When I successfully start the Unsafe Browser 39.669
And I open the Tails homepage in the Unsafe Browser 21.658
And the Tails homepage loads in the Unsafe Browser 1:0.028
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 12.218 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 05:22:30)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/44/artifact/build-artifacts/05:22:30_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/44/artifact/build-artifacts/05:22:30_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/44/artifact/build-artifacts/05:22:30_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_5501-plaintext-locale-greeter/44/artifact/build-artifacts/05:22:30_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.056
Tags: @product
24.798
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.021
Given I have started Tails from DVD and logged in and the network is connected 22.317
And I capture all network traffic 0.127
And I disable Tails' firewall 1.043
When I do a TCP DNS lookup of "torproject.org" 1.162
Then the firewall leak detector has detected leaks 0.148
After features/support/hooks.rb:330 1.039
After features/support/hooks.rb:100 0.056
Tags: @product
57.631
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.034
Given I have started Tails from DVD and logged in and the network is connected 54.566
And I capture all network traffic 0.103
And I disable Tails' firewall 1.086
When I do a UDP DNS lookup of "torproject.org" 1.586
Then the firewall leak detector has detected leaks 0.287
After features/support/hooks.rb:330 0.849
After features/support/hooks.rb:100 0.046
Tags: @product
43.406
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.009
Given I have started Tails from DVD and logged in and the network is connected 38.197
And I capture all network traffic 0.208
And I disable Tails' firewall 0.573
When I send some ICMP pings 4.235
Then the firewall leak detector has detected leaks 0.191
After features/support/hooks.rb:330 1.248
After features/support/hooks.rb:100 0.052
Tags: @product @check_tor_leaks
57.616
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Before features/support/hooks.rb:507 0.007
Given I have started Tails from DVD and logged in and the network is connected 56.198
When I open an untorified TCP connection to 1.2.3.4 on port 42 1.348
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.069
After features/support/hooks.rb:515 0.565
After features/support/hooks.rb:330 0.972
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
55.981
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.018
Before features/support/hooks.rb:507 0.016
Given I have started Tails from DVD and logged in and the network is connected 51.876
When I open an untorified UDP connection to 1.2.3.4 on port 42 3.964
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.139
After features/support/hooks.rb:515 0.471
After features/support/hooks.rb:330 1.215
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
43.403
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.006
Before features/support/hooks.rb:507 0.008
Given I have started Tails from DVD and logged in and the network is connected 37.595
When I open an untorified ICMP connection to 1.2.3.4 5.733
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.074
After features/support/hooks.rb:515 0.499
After features/support/hooks.rb:330 0.785
After features/support/hooks.rb:100 0.000
Tags: @product
53.560
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Given I have started Tails from DVD without network and logged in 19.050
And the system DNS is using the local DNS resolver 0.035
And the network is plugged 0.118
And I successfully configure Tor 34.332
Then the system DNS is still using the local DNS resolver 0.024
After features/support/hooks.rb:330 0.641
After features/support/hooks.rb:100 0.000