Project Number Date
test_Tails_ISO_devel 3457 11 Jul 2024, 15:39

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 52 1 0 0 0 53 5 1 6 11:37.215 Failed
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
20.294
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.275
And I prepare Tails for memory erasure tests 0.416
When I start a process allocating 128 MiB of memory with a known pattern 1.281
Then patterns cover at least 128 MiB in the guest's memory 4.103

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 1.071
Then I find very few patterns in the guest's memory 5.145

Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)

After features/support/hooks.rb:326 1.717
After features/support/hooks.rb:100 0.000
29.126
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 11.557
And I prepare Tails for memory erasure tests 0.504
And I find very few patterns in the guest's memory 5.181

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.688
Then patterns cover at least 99% of the test FS size in the guest's memory 4.233

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 1.518
Then I find very few patterns in the guest's memory 4.441

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

After features/support/hooks.rb:326 3.482
After features/support/hooks.rb:100 0.000
56.245
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.137
And I prepare Tails for memory erasure tests 0.489
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.152
Then I find very few patterns in the guest's memory 4.838

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 7.504
Then patterns cover at least 86% of the test FS size in the guest's memory 5.892

Pattern coverage: 86.790% (110 MiB out of 127 MiB reference memory)

When I umount the USB drive 5.337
Then I find very few patterns in the guest's memory 4.442

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

# read cache
When I mount the USB drive again 0.279
And I read the content of the test FS 0.511
Then patterns cover at least 99% of the test FS size in the guest's memory 3.801

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.632
Then I find very few patterns in the guest's memory 4.226

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

After features/support/hooks.rb:326 0.801
After features/support/hooks.rb:100 0.000
1:13.249
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.131
And I prepare Tails for memory erasure tests 0.411
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 36.262
Then I find very few patterns in the guest's memory 3.823

Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.256
Then patterns cover at least 99% of the test FS size in the guest's memory 3.393

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.431
Then I find very few patterns in the guest's memory 3.503

Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)

# read cache
When I mount the USB drive again 4.610
And I read the content of the test FS 0.821
Then patterns cover at least 99% of the test FS size in the guest's memory 3.188

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.686
Then I find very few patterns in the guest's memory 3.731

Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)

After features/support/hooks.rb:326 3.435
After features/support/hooks.rb:100 0.000
56.085
Scenario Erasure of the overlayfs read-write branch on shutdown
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.427
And I prepare Tails for memory erasure tests 0.453
When I fill a 128 MiB file with a known pattern on the root filesystem 18.110
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.954
Then patterns cover at least 128 MiB in the guest's memory 3.468

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.019
And I wait 20 seconds 20.019

Slept for 20 seconds

Then I find very few patterns in the guest's memory 3.631
14.431% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:73:in `Then I find very few patterns in the guest's memory'
Output 1

Pattern coverage: 14.431% (128 MiB out of 887 MiB reference memory)

After features/support/hooks.rb:326 10.617

SCENARIO FAILED: 'Erasure of the overlayfs read-write branch on shutdown' (at time 00:36:30)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3457/artifact/build-artifacts/00:36:30_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3457/artifact/build-artifacts/00:36:30_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3457/artifact/build-artifacts/00:36:30_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.journal

After features/support/hooks.rb:100 0.000
7:42.214
Before features/support/hooks.rb:269 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:58.535
And I prepare Tails for memory erasure tests 0.473
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.020
When I trigger shutdown 0.011
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.153

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

After features/support/hooks.rb:326 3.512
After features/support/hooks.rb:100 0.012