Project Number Date
test_Tails_ISO_test-suite-early-boot-hooks 7 12 Dec 2024, 20:16

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 40 1 10 0 0 51 5 1 6 12:27.454 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
25.108
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails from DVD without network and logged in 8.881
And I prepare Tails for memory erasure tests 0.592
When I start a process allocating 128 MiB of memory with a known pattern 2.473
Then patterns cover at least 128 MiB in the guest's memory 4.822 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.350
Then I find very few patterns in the guest's memory after 3 seconds 7.987 
Pattern coverage: 0.000% (0 MiB out of 860 MiB reference memory)
After features/support/hooks.rb:330 0.927
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
29.274
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Given I have started Tails from DVD without network and logged in 8.576
And I prepare Tails for memory erasure tests 0.473
And I find very few patterns in the guest's memory 5.667 
Pattern coverage: 0.000% (0 MiB out of 859 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.340
Then patterns cover at least 99% of the test FS size in the guest's memory 4.508 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.889
Then I find very few patterns in the guest's memory after 3 seconds 6.818 
Pattern coverage: 0.000% (0 MiB out of 859 MiB reference memory)
After features/support/hooks.rb:330 0.834
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
59.566
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails from DVD without network and logged in 9.098
And I prepare Tails for memory erasure tests 0.469
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.591
Then I find very few patterns in the guest's memory 3.971 
Pattern coverage: 0.000% (0 MiB out of 865 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 4.120
Then patterns cover at least 75% of the test FS size in the guest's memory 4.546 
Pattern coverage: 86.891% (110 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.801
Then I find very few patterns in the guest's memory after 3 seconds 7.458 
Pattern coverage: 0.000% (0 MiB out of 865 MiB reference memory)
# read cache
When I mount the USB drive again 1.632
And I read the content of the test FS 3.429
Then patterns cover at least 99% of the test FS size in the guest's memory 4.258 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.602
Then I find very few patterns in the guest's memory after 3 seconds 7.587 
Pattern coverage: 0.000% (0 MiB out of 865 MiB reference memory)
After features/support/hooks.rb:330 1.208
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
59.513
Scenario Erasure of read and write disk caches on unmount: LUKS-encrypted ext4
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.897
And I prepare Tails for memory erasure tests 0.549
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 50.066
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:791:in `deal_with_polkit_prompt'
./features/step_definitions/common_steps.rb:1493:in `/^I plug and mount a (\d+) MiB USB drive with an? (.*)$/'
features/erase_memory.feature:50:in `When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf"'
Then I find very few patterns in the guest's memory 0.000
# write cache
When I fill the USB drive with a known pattern 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
After features/support/hooks.rb:330 6.168 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: LUKS-encrypted ext4' (at time 00:32:01)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-suite-early-boot-hooks/7/artifact/build-artifacts/00:32:01_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-suite-early-boot-hooks/7/artifact/build-artifacts/00:32:01_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-suite-early-boot-hooks/7/artifact/build-artifacts/00:32:01_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-suite-early-boot-hooks/7/artifact/build-artifacts/00:32:01_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.journal
After features/support/hooks.rb:100 0.004
Tags: @product @slow @not_release_blocker
52.686
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails from DVD without network and logged in 9.006
And I prepare Tails for memory erasure tests 0.468
When I fill a 128 MiB file with a known pattern on the root filesystem 16.672
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.001
Then patterns cover at least 128 MiB in the guest's memory 3.306 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.022
Then I find very few patterns in the guest's memory after 20 seconds 21.209 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
After features/support/hooks.rb:330 3.556
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
8:41.303
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:57.206
And I prepare Tails for memory erasure tests 0.508
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.280
When I trigger shutdown 0.016
Then I find very few patterns in the guest's memory after 20 seconds 21.291 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
After features/support/hooks.rb:330 3.518
After features/support/hooks.rb:100 0.011