Project Number Date
test_Tails_ISO_stable 5192 17 Oct 2024, 15:08

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 5 5 41 0 0 51 1 5 6 12:45.439 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
54.019
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 54.019
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:89:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:139:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ without\ network\ and\ logged\ in$/'
features/erase_memory.feature:14:in `Given I have started Tails from DVD without network and logged in'
And I prepare Tails for memory erasure tests 0.000
When I start a process allocating 128 MiB of memory with a known pattern 0.000
Then patterns cover at least 128 MiB in the guest's memory 0.000
When I kill the allocating process 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
After features/support/hooks.rb:326 5.140 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:31:44)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:31:44_Erasure_of_memory_freed_by_killed_userspace_processes.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:31:44_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:31:44_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:31:44_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
54.268
Scenario Erasure of tmpfs data on unmount
Before features/support/hooks.rb:269 0.004
Steps
Given I have started Tails from DVD without network and logged in 54.268
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:89:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:139:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ without\ network\ and\ logged\ in$/'
features/erase_memory.feature:22:in `Given I have started Tails from DVD without network and logged in'
And I prepare Tails for memory erasure tests 0.000
And I find very few patterns in the guest's memory 0.000
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount "/mnt" 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
After features/support/hooks.rb:326 5.445 
SCENARIO FAILED: 'Erasure of tmpfs data on unmount' (at time 00:32:44)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:32:44_Erasure_of_tmpfs_data_on_unmount.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:32:44_Erasure_of_tmpfs_data_on_unmount.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:32:44_Erasure_of_tmpfs_data_on_unmount.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:32:44_Erasure_of_tmpfs_data_on_unmount.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
53.294
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 53.294
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:89:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:139:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ without\ network\ and\ logged\ in$/'
features/erase_memory.feature:31:in `Given I have started Tails from DVD without network and logged in'
And I prepare Tails for memory erasure tests 0.000
When I plug and mount a 128 MiB USB drive with a vfat filesystem 0.000
Then I find very few patterns in the guest's memory 0.000
# write cache
When I fill the USB drive with a known pattern 0.000
Then patterns cover at least 75% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
After features/support/hooks.rb:326 4.956 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:33:43)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:33:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:33:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:33:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:33:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
57.045
Scenario Erasure of read and write disk caches on unmount: LUKS-encrypted ext4
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails from DVD without network and logged in 57.045
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:89:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:139:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ without\ network\ and\ logged\ in$/'
features/erase_memory.feature:48:in `Given I have started Tails from DVD without network and logged in'
And I prepare Tails for memory erasure tests 0.000
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 0.000
Then I find very few patterns in the guest's memory 0.000
# write cache
When I fill the USB drive with a known pattern 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory after 3 seconds 0.000
After features/support/hooks.rb:326 4.996 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: LUKS-encrypted ext4' (at time 00:34:45)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:34:45_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:34:45_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:34:45_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:34:45_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
57.726
Scenario Erasure of the overlayfs read-write branch on shutdown
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 57.726
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:89:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:95:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:72:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:139:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ without\ network\ and\ logged\ in$/'
features/erase_memory.feature:65:in `Given I have started Tails from DVD without network and logged in'
And I prepare Tails for memory erasure tests 0.000
When I fill a 128 MiB file with a known pattern on the root filesystem 0.000
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 0.000
Then patterns cover at least 128 MiB in the guest's memory 0.000
When I trigger shutdown 0.000
Then I find very few patterns in the guest's memory after 20 seconds 0.000
After features/support/hooks.rb:326 5.008 
SCENARIO FAILED: 'Erasure of the overlayfs read-write branch on shutdown' (at time 00:35:47)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:35:47_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:35:47_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:35:47_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5192/artifact/build-artifacts/00:35:47_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
8:9.086
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:22.995
And I prepare Tails for memory erasure tests 0.601
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.919
When I trigger shutdown 0.020
Then I find very few patterns in the guest's memory after 20 seconds 21.548 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:326 3.608
After features/support/hooks.rb:100 0.015