Project Number Date
test_Tails_ISO_stable 6179 01 Mar 2026, 11:09

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 2:27.079 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
11.015
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.010
Given I have started Tails from DVD and logged in and the network is connected 10.707
Then the firewall's policy is to drop all IPv4 traffic 0.058
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 0.162
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.049
And the firewall is configured to block all external IPv6 traffic 0.038
After features/support/hooks.rb:331 0.738
After features/support/hooks.rb:100 0.000
Tags: @product @doc
25.437
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails from DVD and logged in and the network is connected 10.007
And I capture all network traffic 0.014
When I successfully start the Unsafe Browser 6.898
And I open the Tails homepage in the Unsafe Browser 7.604
And the Tails homepage loads in the Unsafe Browser 0.399
Then the firewall leak detector has detected leaks 0.512
After features/support/hooks.rb:331 0.856
After features/support/hooks.rb:100 0.041
Tags: @product
21.394
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Given I have started Tails from DVD and logged in and the network is connected 10.421
And I capture all network traffic 0.006
And I disable Tails' firewall 0.131
When I do a TCP DNS lookup of "torproject.org" 10.376
Then the firewall leak detector has detected leaks 0.459
After features/support/hooks.rb:331 1.196
After features/support/hooks.rb:100 0.044
Tags: @product
20.276
Scenario Anti test: Detecting UDP leaks of DNS lookups with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Steps
Given I have started Tails from DVD and logged in and the network is connected 9.975
And I capture all network traffic 0.003
And I disable Tails' firewall 0.115
When I do a UDP DNS lookup of "torproject.org" 10.181
Failed 
Failed to resolve torproject.org:
;; communications error to 9.9.9.9#53: timed out
;; communications error to 9.9.9.9#53: timed out
;; no servers could be reached
.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/firewall_leaks.rb:27:in `/^I do a UDP DNS lookup of "(.*?)"$/'
features/tor_enforcement.feature:35:in `When I do a UDP DNS lookup of "torproject.org"'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:331 5.427 
SCENARIO FAILED: 'Anti test: Detecting UDP leaks of DNS lookups with the firewall leak detector' (at time 02:38:03)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/6179/artifact/build-artifacts/02:38:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/6179/artifact/build-artifacts/02:38:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/6179/artifact/build-artifacts/02:38:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/6179/artifact/build-artifacts/02:38:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.035
Tags: @product
14.261
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails from DVD and logged in and the network is connected 9.903
And I capture all network traffic 0.006
And I disable Tails' firewall 0.136
When I send some ICMP pings 4.098
Then the firewall leak detector has detected leaks 0.117
After features/support/hooks.rb:331 0.984
After features/support/hooks.rb:100 0.062
Tags: @product @check_tor_leaks
11.220
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Before features/support/hooks.rb:519 0.002
Given I have started Tails from DVD and logged in and the network is connected 9.913
When I open an untorified TCP connection to 1.2.3.4 on port 42 1.226
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.080
After features/support/hooks.rb:527 0.195
After features/support/hooks.rb:331 0.794
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
11.327
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Before features/support/hooks.rb:519 0.002
Given I have started Tails from DVD and logged in and the network is connected 9.940
When I open an untorified UDP connection to 1.2.3.4 on port 42 1.288
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.098
After features/support/hooks.rb:527 0.235
After features/support/hooks.rb:331 0.605
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
15.398
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Before features/support/hooks.rb:519 0.002
Given I have started Tails from DVD and logged in and the network is connected 9.947
When I open an untorified ICMP connection to 1.2.3.4 5.359
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.090
After features/support/hooks.rb:527 0.193
After features/support/hooks.rb:331 0.738
After features/support/hooks.rb:100 0.000
Tags: @product
16.746
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails from DVD without network and logged in 6.781
And the system DNS is using the local DNS resolver 0.011
And the network is plugged 0.015
And I successfully configure Tor 9.933
Then the system DNS is still using the local DNS resolver 0.004
After features/support/hooks.rb:331 1.188
After features/support/hooks.rb:100 0.000