Project Number Date
test_Tails_ISO_feature-arti 111 08 Jul 2025, 21:21

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 7:23.732 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
30.460
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.010
Given I have started Tails from DVD and logged in and the network is connected 24.367
Then the firewall's policy is to drop all IPv4 traffic 1.358
And the firewall is configured to only allow the arti, clearnet and debian-tor users to connect directly to the Internet over IPv4 4.108
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.339
And the firewall is configured to block all external IPv6 traffic 0.285
After features/support/hooks.rb:330 1.633
After features/support/hooks.rb:100 0.000
Tags: @product
2:19.769
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Steps
Given I have started Tails from DVD and logged in and the network is connected 18.980
And I capture all network traffic 0.026
When I successfully start the Unsafe Browser 41.007
And I open the Tails homepage in the Unsafe Browser 18.387
And the Tails homepage loads in the Unsafe Browser 1:1.367
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 7.203 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 07:52:02)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/111/artifact/build-artifacts/07:52:02_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/111/artifact/build-artifacts/07:52:02_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/111/artifact/build-artifacts/07:52:02_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/111/artifact/build-artifacts/07:52:02_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.042
Tags: @product
31.633
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.023
Given I have started Tails from DVD and logged in and the network is connected 27.217
And I capture all network traffic 0.624
And I disable Tails' firewall 1.600
When I do a TCP DNS lookup of "torproject.org" 1.673
Then the firewall leak detector has detected leaks 0.518
After features/support/hooks.rb:330 2.207
After features/support/hooks.rb:100 0.050
Tags: @product
39.072
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.010
Given I have started Tails from DVD and logged in and the network is connected 35.979
And I capture all network traffic 0.088
And I disable Tails' firewall 0.577
When I do a UDP DNS lookup of "torproject.org" 1.200
Then the firewall leak detector has detected leaks 1.226
After features/support/hooks.rb:330 1.601
After features/support/hooks.rb:100 0.047
Tags: @product
40.932
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Given I have started Tails from DVD and logged in and the network is connected 36.145
And I capture all network traffic 0.020
And I disable Tails' firewall 0.443
When I send some ICMP pings 4.216
Then the firewall leak detector has detected leaks 0.108
After features/support/hooks.rb:330 1.386
After features/support/hooks.rb:100 0.037
Tags: @product @check_tor_leaks
47.231
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.023
Before features/support/hooks.rb:509 0.060
Given I have started Tails from DVD and logged in and the network is connected 33.286
When I open an untorified TCP connection to 1.2.3.4 on port 42 12.164
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 1.779
After features/support/hooks.rb:517 4.277
After features/support/hooks.rb:330 1.657
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
34.834
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.093
Before features/support/hooks.rb:509 0.061
Given I have started Tails from DVD and logged in and the network is connected 21.874
When I open an untorified UDP connection to 1.2.3.4 on port 42 11.742
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 1.217
After features/support/hooks.rb:517 2.317
After features/support/hooks.rb:330 2.594
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
29.853
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.022
Before features/support/hooks.rb:509 0.020
Given I have started Tails from DVD and logged in and the network is connected 24.300
When I open an untorified ICMP connection to 1.2.3.4 5.460
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.093
After features/support/hooks.rb:517 0.515
After features/support/hooks.rb:330 3.984
After features/support/hooks.rb:100 0.001
Tags: @product
49.943
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.129
Given I have started Tails from DVD without network and logged in 14.994
And the system DNS is using the local DNS resolver 0.018
And the network is plugged 0.086
And I successfully configure Tor 34.830
Then the system DNS is still using the local DNS resolver 0.012
After features/support/hooks.rb:330 2.561
After features/support/hooks.rb:100 0.000