|
Size: 2274
Comment:
|
Size: 5893
Comment: reorderd test cases. formatting.
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| ## page was renamed from GpgOL/Development/Testcase | |
| Line 6: | Line 5: |
| == What is (going to be) tested | <<TableOfContents(3)>> == What should be tested? |
| Line 10: | Line 11: |
| The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and (or) signed emails, and the receiving of encrypted and (or) signed emails. |
The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and/or signed emails, and the receiving of encrypted and/or signed emails. |
| Line 13: | Line 14: |
| The tests are not only performed with encrypted and signed messages from and to Microsoft Outlook, but also with other Windows and Linux Mail-Clients which are supported by Gpg. |
The tests are not only performed with messages from and to Microsoft Outlook, but also with other Windows and Linux mail clients which are supported by GnuPG, especially: |
| Line 16: | Line 16: |
| Especially: | * Microsoft Outlook 2010 32bit (on Windows 7 64bit) * Microsoft Outlook 2013 64bit (on Windows 8 64bit) * Microsoft Outlook 2016 32bit (on Windows 7 32bit) * Microsoft Outlook 2016 64bit (on Windows 8 64bit) * Microsoft Outlook 2016 64bit (on Windows 10 64bit) * Thunderbird with Enigmail-Add-On (on Windows or GNU/Linux) * KMail of Kontact enterprise 35 (on GNU/Linux) |
| Line 18: | Line 24: |
| * Microsoft Outlook 2010 (On Windows 7 64bit) * Microsoft Outlook 2013 (On Windows 8 64bit) * Microsoft Outlook 2016 (On Windows 7 32bit) * Microsoft Outlook 2016 (On Windows 8 64bit) * Microsoft Outlook 2016 (On Windows 10 64bit) * thunderbird (Windows and Linux) * KMail (Kontact e35 Linux) |
The tests will refer to the usage of PGP/~MIME and PGP/Inline. |
| Line 26: | Line 26: |
| The tests will refer to the usage of PGP/MIME and PGP/Inline. == About the testing-environment To test out the different Versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test-Environment was created using Oracle [[https://www.virtualbox.org/|VirtualBox]]. |
To test out the different versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test environment was recommenended, e.g. [[https://www.virtualbox.org/|VirtualBox]]. |
| Line 33: | Line 29: |
| Check if GpgOL can perform the following test suites without errors. | |
| Line 34: | Line 31: |
| .... | === 1. Outlook <--> Outlook Send crypto emails between Outlook (GpgOL) and Outlook (GpgOL). ==== 1.1 Using PGP/MIME a) sign -> verify\\ b) encrypt -> decrypt\\ c) sign/encrypt with attachment -> decrypt/verify and check attachment ==== 1.2 Using S/MIME a) sign -> verify\\ b) encrypt -> decrypt\\ c) sign/encrypt with attachment -> decrypt/verify and check attachment |
| Line 37: | Line 45: |
| == Test plan matrix | === 2. KMail <--> Outlook Send crypto emails between KMail and Outlook (GpgOL). |
| Line 39: | Line 48: |
| |send|=OL2010 W7_64 |=OL2013 W8_64 |=OL2016 W7_32 | =OL2016 W8_64 | =OL2016 W10_64 |=Signing| ? | ? | ? | ? | ? | |=Encrypting| ? | ? | ? | ? | ? | |=Sig+Enc| ? | ? | ? | ? | ? | |
==== 2.1 Using PGP/MIME a) sign (KMail) -> verify (GpgOL)\\ b) encrypt (KMail) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (KMail)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail) ==== 2.2 Using S/MIME a) sign (KMail) -> verify (GpgOL)\\ b) encrypt (KMail) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (KMail)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail) ==== 2.3 Using PGP/Inline a) sign (KMail) -> verify (GpgOL)\\ b) encrypt (KMail) -> decrypt (GpgOL)\\ c) sign/encrypt without attachment (KMail) -> decrypt/verify (GpgOL)\\ |
| Line 45: | Line 70: |
| === consigner is the same client | === 3. Thunderbird <--> Outlook Send crypto emails between Thunderbird (Enigmail) and Outlook (GpgOL). |
| Line 47: | Line 73: |
| |receive|=OL2010 W7_64 |=OL2013 W8_64 |=OL2016 W7_32 | =OL2016 W8_64 | =OL2016 W10_64 |=Verify signature| ? | ? | ? | ? | ? | |=Decrypt| ? | ? | ? | ? | ? | |=Verify + Decrypt| ? | ? | ? | ? | ? | |
==== 3.1 Using PGP/MIME a) sign (TB) -> verify (GpgOL)\\ b) encrypt (TB) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (TB)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (TB)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB) |
| Line 52: | Line 81: |
| === consigner is KMail | ==== 3.2 Using S/MIME (with Thunderbird's S/MIME implementation) a) sign (TB) -> verify (GpgOL)\\ b) encrypt (TB) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (TB)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (TB)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB) |
| Line 54: | Line 89: |
| |receive|=OL2010 W7_64 |=OL2013 W8_64 |=OL2016 W7_32 | =OL2016 W8_64 | =OL2016 W10_64 |=Verify signature| ? | ? | ? | ? | ? | |=Decrypt| ? | ? | ? | ? | ? | |=Verify + Decrypt| ? | ? | ? | ? | ? | |
==== 3.3 Using PGP/Inline a) sign (TB) -> verify (GpgOL)\\ b) encrypt (TB) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL) |
| Line 59: | Line 94: |
| === consigner is thunderbird | |
| Line 61: | Line 95: |
| |receive|=OL2010 W7_64 |=OL2013 W8_64 |=OL2016 W7_32 | =OL2016 W8_64 | =OL2016 W10_64 |=Verify signature| ? | ? | ? | ? | ? | |=Decrypt| ? | ? | ? | ? | ? | |=Verify + Decrypt| ? | ? | ? | ? | ? | |
== Test matrix === 1. Sender and receiver is Outlook on Windows using OpenPGP/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Signing| ? | ? | ? | ? | ? | |=b) Encrypting| ? | ? | ? | ? | ? | |=c) Sig+Enc| ? | ? | ? | ? | ? | |=d) Verify signature| ? | ? | ? | ? | ? | |=e) Decrypt| ? | ? | ? | ? | ? | |=f) Verify + Decrypt| ? | ? | ? | ? | ? | === 2. Sender and receiver is Outlook on Windows using S/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Signing| ? | ? | ? | ? | ? | |=b) Encrypting| ? | ? | ? | ? | ? | |=c) Sig+Enc| ? | ? | ? | ? | ? | |=d) Verify signature| ? | ? | ? | ? | ? | |=e) Decrypt| ? | ? | ? | ? | ? | |=f) Verify + Decrypt| ? | ? | ? | ? | ? | === 3. Sender is KMail receiver is Outlook ==== 3.1 using OpenPGP/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | ==== 3.2 using S/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | === 4. Sender is Thunderbird, receiver is Outlook ==== 4.1 using OpenPGP/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | ==== 4.2 using using S/MIME |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | |
GpgOL test plan (DRAFT)
Here you can find information about the manual testing progress of GpgOL.
What should be tested?
We want to ensure GpgOL works well on all supported Microsoft Windows operating systems with all supported versions of Microsoft Outlook.
The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and/or signed emails, and the receiving of encrypted and/or signed emails.
The tests are not only performed with messages from and to Microsoft Outlook, but also with other Windows and Linux mail clients which are supported by GnuPG, especially:
- Microsoft Outlook 2010 32bit (on Windows 7 64bit)
- Microsoft Outlook 2013 64bit (on Windows 8 64bit)
- Microsoft Outlook 2016 32bit (on Windows 7 32bit)
- Microsoft Outlook 2016 64bit (on Windows 8 64bit)
- Microsoft Outlook 2016 64bit (on Windows 10 64bit)
- Thunderbird with Enigmail-Add-On (on Windows or GNU/Linux)
- KMail of Kontact enterprise 35 (on GNU/Linux)
The tests will refer to the usage of PGP/MIME and PGP/Inline.
To test out the different versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test environment was recommenended, e.g. VirtualBox.
Test plan
Check if GpgOL can perform the following test suites without errors.
1. Outlook <--> Outlook
Send crypto emails between Outlook (GpgOL) and Outlook (GpgOL).
1.1 Using PGP/MIME
a) sign -> verify
b) encrypt -> decrypt
c) sign/encrypt with attachment -> decrypt/verify and check attachment
1.2 Using S/MIME
a) sign -> verify
b) encrypt -> decrypt
c) sign/encrypt with attachment -> decrypt/verify and check attachment
2. KMail <--> Outlook
Send crypto emails between KMail and Outlook (GpgOL).
2.1 Using PGP/MIME
a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (KMail)
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)
2.2 Using S/MIME
a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (KMail)
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)
2.3 Using PGP/Inline
a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt without attachment (KMail) -> decrypt/verify (GpgOL)
3. Thunderbird <--> Outlook
Send crypto emails between Thunderbird (Enigmail) and Outlook (GpgOL).
3.1 Using PGP/MIME
a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (TB)
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)
3.2 Using S/MIME (with Thunderbird's S/MIME implementation)
a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (TB)
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)
3.3 Using PGP/Inline
a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
Test matrix
1. Sender and receiver is Outlook on Windows using OpenPGP/Mime
| o | 1) OL2010 W7_64 | 2) OL2013 W8_64 | 3) OL2016 W7_32 | 4) OL2016 W8_64 | 5) OL2016 W10_64 |
|---|---|---|---|---|---|
| a) Signing | ? | ? | ? | ? | ? |
| b) Encrypting | ? | ? | ? | ? | ? |
| c) Sig+Enc | ? | ? | ? | ? | ? |
| d) Verify signature | ? | ? | ? | ? | ? |
| e) Decrypt | ? | ? | ? | ? | ? |
| f) Verify + Decrypt | ? | ? | ? | ? | ? |
2. Sender and receiver is Outlook on Windows using S/Mime
| o | 1) OL2010 W7_64 | 2) OL2013 W8_64 | 3) OL2016 W7_32 | 4) OL2016 W8_64 | 5) OL2016 W10_64 |
|---|---|---|---|---|---|
| a) Signing | ? | ? | ? | ? | ? |
| b) Encrypting | ? | ? | ? | ? | ? |
| c) Sig+Enc | ? | ? | ? | ? | ? |
| d) Verify signature | ? | ? | ? | ? | ? |
| e) Decrypt | ? | ? | ? | ? | ? |
| f) Verify + Decrypt | ? | ? | ? | ? | ? |
3. Sender is KMail receiver is Outlook
3.1 using OpenPGP/Mime
| o | 1) OL2010 W7_64 | 2) OL2013 W8_64 | 3) OL2016 W7_32 | 4) OL2016 W8_64 | 5) OL2016 W10_64 |
|---|---|---|---|---|---|
| a) Verify signature | ? | ? | ? | ? | ? |
| b) Decrypt | ? | ? | ? | ? | ? |
| c) Verify + Decrypt | ? | ? | ? | ? | ? |
3.2 using S/Mime
| o | 1) OL2010 W7_64 | 2) OL2013 W8_64 | 3) OL2016 W7_32 | 4) OL2016 W8_64 | 5) OL2016 W10_64 |
|---|---|---|---|---|---|
| a) Verify signature | ? | ? | ? | ? | ? |
| b) Decrypt | ? | ? | ? | ? | ? |
| c) Verify + Decrypt | ? | ? | ? | ? | ? |
4. Sender is Thunderbird, receiver is Outlook
4.1 using OpenPGP/Mime
| o | 1) OL2010 W7_64 | 2) OL2013 W8_64 | 3) OL2016 W7_32 | 4) OL2016 W8_64 | 5) OL2016 W10_64 |
|---|---|---|---|---|---|
| a) Verify signature | ? | ? | ? | ? | ? |
| b) Decrypt | ? | ? | ? | ? | ? |
| c) Verify + Decrypt | ? | ? | ? | ? | ? |
4.2 using using S/MIME
| o | 1) OL2010 W7_64 | 2) OL2013 W8_64 | 3) OL2016 W7_32 | 4) OL2016 W8_64 | 5) OL2016 W10_64 |
|---|---|---|---|---|---|
| a) Verify signature | ? | ? | ? | ? | ? |
| b) Decrypt | ? | ? | ? | ? | ? |
| c) Verify + Decrypt | ? | ? | ? | ? | ? |