Project Number Date
test_Tails_ISO_devel 3363 26 Apr 2024, 13:20

Failures Overview

The following summary displays scenarios that failed.

Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
30.720
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:259 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.312
And I prepare Tails for memory erasure tests 0.537
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.200
Then I find very few patterns in the guest's memory 4.771 
Pattern coverage: 0.000% (0 MiB out of 853 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.004
Then patterns cover at least 86% of the test FS size in the guest's memory 4.893
84.883% 
84.883% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 84.883% (108 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:305 4.779 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:30:53)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/00:30:53_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/00:30:53_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/00:30:53_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/00:30:53_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:89 0.000
Feature: Tails-related cryptographic keys are up-to-date
Tags: @product
23.308
Scenario The included APT repository keys are up-to-date
Before features/support/hooks.rb:259 0.006
Steps
Given I have started Tails from DVD without network and logged in 8.336
Then the keys trusted by APT are valid for the next 3 months 14.972
The 
The following APT key(s) will not be valid in 3 months: A3C4F0F979CAA22CDBA8F512EE8CBC9E886DDD89, 2265EB4CB2BF88D900AE8D1B74A941BA219EC810.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/checks.rb:29:in `assert_all_keys_are_valid_for_n_months'
./features/step_definitions/checks.rb:8:in `/^the keys trusted by APT are valid for the next (\d+) months$/'
features/keys.feature:11:in `Then the keys trusted by APT are valid for the next 3 months'
After features/support/hooks.rb:305 4.471 
SCENARIO FAILED: 'The included APT repository keys are up-to-date' (at time 02:27:02)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:27:02_The_included_APT_repository_keys_are_up-to-date.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:27:02_The_included_APT_repository_keys_are_up-to-date.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:27:02_The_included_APT_repository_keys_are_up-to-date.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:27:02_The_included_APT_repository_keys_are_up-to-date.journal
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.914
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.008
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.032
When I log in to a new session in Chinese (zh_CN) 33.183
Then the keyboard layout is set to "cn" 0.389
When the network is plugged 0.035
And Tor is ready 18.207
Then I successfully start the Unsafe Browser in "zh_CN" 16.941
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 25.940
And DuckDuckGo is the default search engine 44.211
Operation 
Operation failed (despite retrying 10 times) with
Timeout::Error: try_for() timeout expired (MaxRetriesFailure)
./features/support/helpers/misc_helpers.rb:227:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:394:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:45:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.787 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#2)' (at time 02:36:02)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:36:02_Tails_is_localized_for_every_tier-1_language,_Examples___2_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:36:02_Tails_is_localized_for_every_tier-1_language,_Examples___2_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:36:02_Tails_is_localized_for_every_tier-1_language,_Examples___2_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:36:02_Tails_is_localized_for_every_tier-1_language,_Examples___2_.journal
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.981
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.007
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.513
When I log in to a new session in Turkish (tr) 33.728
Then the keyboard layout is set to "tr" 0.240
When the network is plugged 0.052
And Tor is ready 16.540
Then I successfully start the Unsafe Browser in "tr" 16.469
And I kill the Unsafe Browser 5.728
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 29.551
And DuckDuckGo is the default search engine 44.026
Operation 
Operation failed (despite retrying 10 times) with
Timeout::Error: try_for() timeout expired (MaxRetriesFailure)
./features/support/helpers/misc_helpers.rb:227:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:394:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:57:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.596 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#11)' (at time 02:59:44)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:59:44_Tails_is_localized_for_every_tier-1_language,_Examples___11_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:59:44_Tails_is_localized_for_every_tier-1_language,_Examples___11_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:59:44_Tails_is_localized_for_every_tier-1_language,_Examples___11_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/02:59:44_Tails_is_localized_for_every_tier-1_language,_Examples___11_.journal
After features/support/hooks.rb:89 0.000
Feature: Browsing the web using the Tor Browser
Tags: @product @check_tor_leaks
42:8.937
Scenario Playing an Ogg audio track
Before features/support/hooks.rb:259 0.008
Before features/support/hooks.rb:456 0.008
Steps
Given I have started Tails from DVD and logged in and the network is connected 13.004
When I start the Tor Browser 24.881
And the Tor Browser loads the startup page 1.259
Then I can listen to an Ogg audio track in Tor Browser 41:29.791
can 
can still find TorBrowserStopButton.png on the screen (FindFailed)
./features/support/helpers/screen.rb:199:in `rescue in wait_vanish'
./features/support/helpers/screen.rb:184:in `wait_vanish'
./features/step_definitions/browser.rb:178:in `block (2 levels) in <top (required)>'
./features/support/helpers/misc_helpers.rb:194:in `block in retry_tor'
./features/support/helpers/misc_helpers.rb:223:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/support/helpers/misc_helpers.rb:197:in `retry_tor'
./features/step_definitions/browser.rb:185:in `call'
./features/step_definitions/browser.rb:185:in `/^I open the address "([^"]*)" in the (.* Browser)( without waiting)?$/'
./features/step_definitions/browser.rb:353:in `block (2 levels) in <top (required)>'
./features/step_definitions/browser.rb:358:in `block (2 levels) in <top (required)>'
./features/support/helpers/misc_helpers.rb:194:in `block in retry_tor'
./features/support/helpers/misc_helpers.rb:223:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/support/helpers/misc_helpers.rb:197:in `retry_tor'
./features/step_definitions/browser.rb:362:in `/^I can listen to an Ogg audio track in Tor Browser$/'
features/torified_browsing.feature:41:in `Then I can listen to an Ogg audio track in Tor Browser'
After features/support/hooks.rb:464 0.055
After features/support/hooks.rb:305 4.464 
SCENARIO FAILED: 'Playing an Ogg audio track' (at time 05:17:36)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/05:17:36_Playing_an_Ogg_audio_track.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/05:17:36_Playing_an_Ogg_audio_track.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/05:17:36_Playing_an_Ogg_audio_track.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3363/artifact/build-artifacts/05:17:36_Playing_an_Ogg_audio_track.journal
After features/support/hooks.rb:89 0.000