|
Size: 9962
Comment: made clear-text test-cases
|
Size: 6796
Comment: Move gpgol test report to new page
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = GpgOL test plan (DRAFT) | = GpgOL Test Plan |
| Line 3: | Line 3: |
| Here you can find information about the manual testing progress of GpgOL. | **Status: in progress** |
| Line 5: | Line 5: |
| <<TableOfContents(2)>> | <<TableOfContents(3)>> |
| Line 7: | Line 7: |
| == What is (going to be) tested | == Introduction |
| Line 9: | Line 9: |
| We want to ensure GpgOL works well on all supported Microsoft Windows operating systems with all supported versions of Microsoft Outlook. | The purpose of this test plan is to ensure GpgOL works well on all supported Microsoft Windows operating systems with all supported versions of Microsoft Outlook. |
| Line 11: | Line 11: |
| The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and (or) signed emails, and the receiving of encrypted and (or) signed emails. |
== Test environment |
| Line 14: | Line 13: |
| The tests are not only performed with encrypted and signed messages from and to Microsoft Outlook, but also with other Windows and Linux Mail-Clients which are supported by Gpg. |
Choose one combination of the following target platforms supported by GpgOL. |
| Line 17: | Line 15: |
| Especially: | Microsoft Outlook: * 2003 (32bit) * 2007 (32bit) * 2010 (32 or 64bit) * 2013 (32 or 64bit) * 2016 (32 or 64bit) |
| Line 19: | Line 22: |
| * Microsoft Outlook 2010 (On Windows 7 64bit) * Microsoft Outlook 2013 (On Windows 8 64bit) * Microsoft Outlook 2016 (On Windows 7 32bit) * Microsoft Outlook 2016 (On Windows 8 64bit) * Microsoft Outlook 2016 (On Windows 10 64bit) * thunderbird (Windows and Linux) * KMail (Kontact e35 Linux) |
Operation system: * Windows Vista (32 or 64bit) * Windows 7 (32 or 64bit) * Windows 8 (32 or 64bit) * Windows 10 (32 or 64bit) |
| Line 27: | Line 28: |
| The tests will refer to the usage of PGP/MIME and PGP/Inline. | For interoperability tests additional mail clients will be tested together with Outlook/GpgOL: * Thunderbird with Enigmail-Add-On (on Windows, MacOS or GNU/Linux) * Apple Mail with GPGTools (on MacOS) * Kontact Mail (KMail) enterprise 35 (on GNU/Linux) * Kontact Mail (KMail) of KDE 4.14 (on GNU/Linux) |
| Line 29: | Line 34: |
| == About the testing-environment | It is recommended to use a clean virtual test environment, e.g. with [[https://www.virtualbox.org/|VirtualBox]]. |
| Line 31: | Line 36: |
| To test out the different Versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test-Environment was created using Oracle [[https://www.virtualbox.org/|VirtualBox]]. | == Preconditions |
| Line 33: | Line 38: |
| == Test plan | * email account A on IMAP/SMTP server * email account B on Exchange Server 2013 or later * ~OpenPGP public key (*.asc or *.gpg) and private key (*.asc or *.gpg) * S/~M~I~M~E certificate chain (*.pem) and private key (*.p12) |
| Line 35: | Line 43: |
| The test cases described in plain text | == Tests === Testsuite 1: GpgOL basic crypto tests Send crypto mails from/to same Outlook account. ==== 1.1 PGP/MIME Send mails with P~G~P/~M~I~M~E:\\ a) sign and verify\\ b) encrypt and decrypt\\ c) sign/encrypt (with attachment*) and decrypt/verify (and check attachment) ==== 1.2 S/MIME Send mails with S/~M~I~M~E:\\ a) sign and verify\\ b) encrypt and decrypt\\ c) sign/encrypt (with attachment*) and decrypt/verify (and check attachment) (*) Attachment should contain umlauts in filename (e.g. fooäüö.txt) |
| Line 38: | Line 63: |
| 1. Send a Mail from a Outlook Client to an Outlook Client. **Use OpenPGP/Mime** for the signing process # for Microsoft Outlook 2010 (On Windows 7 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2013 (On Windows 8 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2016 (On Windows 7 32bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2016 (On Windows 8 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2016 (On Windows 10 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step |
=== Testsuite 2: GpgOL extended tests ==== 2.1 Exchange Server Run all tests from testsuite 1 via Exchange Server. ==== 2.2 Move Mails Move some encrypted mails from inbox into an other folder. Check with an other IMAP client that all mails are always encrypted. ==== 2.3 Drafts Create new message. Mark message with "sign" and "encrypt". Close and save mail as draft. Open draft again. Check if the message is still marked with "sign" and "encrypt". ==== 2.4 Cancel crypto operation Create a mew message. Mark as sign/encrypt. Click send. Cancel certificate selection dialog. Check if the message is not sent. ==== 2.5 Sent messages Send a signed/encrypted message. Check the sent folder ("Sent messages") if the mail is still signed/encrypted. ==== 2.6 Reply Reply to an encrypted mail. Check if the quoted text contains the decrypted message. ==== 2.7 Disable GpgOL Disable the GpgOL plugin in Outlook (via COM add-ons). Select a signed/encrypted mail. Check that the mail cannot decrypted/verify. |
| Line 77: | Line 88: |
| 2. Send a Mail from a Outlook Client to an Outlook Client. **Use S/Mime** for the signing process # for Microsoft Outlook 2010 (On Windows 7 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2013 (On Windows 8 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2016 (On Windows 7 32bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2016 (On Windows 8 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step # for Microsoft Outlook 2016 (On Windows 10 64bit) ** a) Sign the E-Mail ** b) Encrypt the E-Mail ** c) Sign and Encrypt the E-Mail in one step ** d) Verify signature of the E-Mail you just sent ** e) Decrypt the E-Mail you just sent ** f) Verify and decypt the email you just sent in one step |
==== 2.8 Deactivate GpgOL's S/MIME (GpgSM) TODO === Testsuite 3. Interoperability tests (Kontact Mail) Send crypto mails from Kontact Mail (KMail) to Outlook (GpgOL). ==== 3.1 Using PGP/MIME a) sign (KMail) -> verify (GpgOL)\\ b) encrypt (KMail) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (KMail)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail) ==== 3.2 Using S/MIME a) sign (KMail) -> verify (GpgOL)\\ b) encrypt (KMail) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (KMail)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail) ==== 3.3 Using no-mime-PGP a) sign (KMail) -> verify (GpgOL)\\ b) encrypt (KMail) -> decrypt (GpgOL)\\ c) sign/encrypt without attachment (KMail) -> decrypt/verify (GpgOL)\\ |
| Line 116: | Line 118: |
| 3. Send an E-Mail with KMail to an Outlook Client. Check if the Outlook Client can perform the following tasks without errors # Perform the Steps using OpenPGP/Mime ## Microsoft Outlook 2010 (On Windows 7 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2013 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 7 32bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 10 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step # Perform the Steps using S/Mime ## Microsoft Outlook 2010 (On Windows 7 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2013 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 7 32bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 10 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step |
=== Testsuite 4. Interoperability tests (Thunderbird) Send crypto mails from Thunderbird (Enigmail) to Outlook (GpgOL). ==== 4.1 Using PGP/MIME a) sign (TB) -> verify (GpgOL)\\ b) encrypt (TB) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (TB)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (TB)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB) ==== 4.2 Using S/MIME (with Thunderbird's S/MIME implementation) a) sign (TB) -> verify (GpgOL)\\ b) encrypt (TB) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)\\ d) answer to (a): sign (GpgOL) -> verify (TB)\\ e) answer to (b): encrypt (GpgOL) -> decrypt (TB)\\ f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB) ==== 4.3 Using no-mime-PGP a) sign (TB) -> verify (GpgOL)\\ b) encrypt (TB) -> decrypt (GpgOL)\\ c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL) |
| Line 161: | Line 144: |
| 4. Send an E-Mail with Thunderbird to an Outlook Client. Check if the Outlook Client can perform the following tasks without errors # Perform the Steps using OpenPGP/Mime ## Microsoft Outlook 2010 (On Windows 7 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2013 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 7 32bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 10 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step # Perform the Steps using S/Mime ## Microsoft Outlook 2010 (On Windows 7 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2013 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 7 32bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 8 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step ## Microsoft Outlook 2016 (On Windows 10 64bit) *** a) Verify the signature *** b) Decrypt the mail *** c) Verify and Decrypt the E-Mail in one step |
|
| Line 205: | Line 145: |
| == Test plan matrix | == Test matrix |
| Line 207: | Line 147: |
| === 1. Sender and receiver is Outlook on Windows using OpenPGP/Mime | Legend:\\ ? = untested\\ x = passed\\ F = failed |
| Line 209: | Line 152: |
| |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Signing| ? | ? | ? | ? | ? | |=b) Encrypting| ? | ? | ? | ? | ? | |=c) Sig+Enc| ? | ? | ? | ? | ? | |=d) Verify signature| ? | ? | ? | ? | ? | |=e) Decrypt| ? | ? | ? | ? | ? | |=f) Verify + Decrypt| ? | ? | ? | ? | ? | |
** +++ Tested ~GpgOL version: X.X.X +++** |
| Line 217: | Line 154: |
=== 2. Sender and receiver is Outlook on Windows using S/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Signing| ? | ? | ? | ? | ? | |=b) Encrypting| ? | ? | ? | ? | ? | |=c) Sig+Enc| ? | ? | ? | ? | ? | |=d) Verify signature| ? | ? | ? | ? | ? | |=e) Decrypt| ? | ? | ? | ? | ? | |=f) Verify + Decrypt| ? | ? | ? | ? | ? | === 3. Sender is KMail receiver is Outlook ==== 3.1 using OpenPGP/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | ==== 3.2 using S/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | === 4. Sender is Thunderbird, receiver is Outlook ==== 4.1 using OpenPGP/Mime |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | ==== 4.2 using using S/MIME |o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64 |=a) Verify signature| ? | ? | ? | ? | ? | |=b) Decrypt| ? | ? | ? | ? | ? | |=c) Verify + Decrypt| ? | ? | ? | ? | ? | |
|Outlook |=2010 (32) |= 2013 (64) |=2016 (32) |= 2016 (64) |= 2016 (64) |= .. |Windows |=7 (64) |= 8 (64) |=7 (32) |= 8 (64) |= 10 (64) |= .. |Testsuite 1: OL/OL | |1.1.a | ? | ? | ? | ? | ? | .. | |1.1.b | ? | ? | ? | ? | ? | .. | |1.1.c | ? | ? | ? | ? | ? | .. | |1.2.a | ? | ? | ? | ? | ? | .. | |1.2.b | ? | ? | ? | ? | ? | .. | |1.2.c | ? | ? | ? | ? | ? | .. | |Testsuite 2: KMail/OL | |2.1.a | ? | ? | ? | ? | ? | .. | |2.1.b | ? | ? | ? | ? | ? | .. | |2.1.c | ? | ? | ? | ? | ? | .. | |2.1.d | ? | ? | ? | ? | ? | .. | |2.1.e | ? | ? | ? | ? | ? | .. | |2.1.f | ? | ? | ? | ? | ? | .. | |2.2.a | ? | ? | ? | ? | ? | .. | |2.2.b | ? | ? | ? | ? | ? | .. | |2.2.c | ? | ? | ? | ? | ? | .. | |2.2.d | ? | ? | ? | ? | ? | .. | |2.2.e | ? | ? | ? | ? | ? | .. | |2.2.f | ? | ? | ? | ? | ? | .. | |2.3.a | ? | ? | ? | ? | ? | .. | |2.3.b | ? | ? | ? | ? | ? | .. | |2.3.c | ? | ? | ? | ? | ? | .. | |Testsuite 3: Thunderbird/OL | |3.1.a | ? | ? | ? | ? | ? | .. | |3.1.b | ? | ? | ? | ? | ? | .. | |3.1.c | ? | ? | ? | ? | ? | .. | |3.1.d | ? | ? | ? | ? | ? | .. | |3.1.e | ? | ? | ? | ? | ? | .. | |3.1.f | ? | ? | ? | ? | ? | .. | |3.2.a | ? | ? | ? | ? | ? | .. | |3.2.b | ? | ? | ? | ? | ? | .. | |3.2.c | ? | ? | ? | ? | ? | .. | |3.2.d | ? | ? | ? | ? | ? | .. | |3.2.e | ? | ? | ? | ? | ? | .. | |3.2.f | ? | ? | ? | ? | ? | .. | |3.3.a | ? | ? | ? | ? | ? | .. | |3.3.b | ? | ? | ? | ? | ? | .. | |3.3.c | ? | ? | ? | ? | ? | .. | |
GpgOL Test Plan
Status: in progress
Contents
Introduction
The purpose of this test plan is to ensure GpgOL works well on all supported Microsoft Windows operating systems with all supported versions of Microsoft Outlook.
Test environment
Choose one combination of the following target platforms supported by GpgOL.
Microsoft Outlook:
- 2003 (32bit)
- 2007 (32bit)
- 2010 (32 or 64bit)
- 2013 (32 or 64bit)
- 2016 (32 or 64bit)
Operation system:
- Windows Vista (32 or 64bit)
- Windows 7 (32 or 64bit)
- Windows 8 (32 or 64bit)
- Windows 10 (32 or 64bit)
For interoperability tests additional mail clients will be tested together with Outlook/GpgOL:
- Thunderbird with Enigmail-Add-On (on Windows, MacOS or GNU/Linux)
- Apple Mail with GPGTools (on MacOS)
- Kontact Mail (KMail) enterprise 35 (on GNU/Linux)
- Kontact Mail (KMail) of KDE 4.14 (on GNU/Linux)
It is recommended to use a clean virtual test environment, e.g. with VirtualBox.
Preconditions
- email account A on IMAP/SMTP server
- email account B on Exchange Server 2013 or later
- OpenPGP public key (*.asc or *.gpg) and private key (*.asc or *.gpg)
- S/MIME certificate chain (*.pem) and private key (*.p12)
Tests
Testsuite 1: GpgOL basic crypto tests
Send crypto mails from/to same Outlook account.
1.1 PGP/MIME
Send mails with PGP/MIME:
a) sign and verify
b) encrypt and decrypt
c) sign/encrypt (with attachment*) and decrypt/verify (and check attachment)
1.2 S/MIME
Send mails with S/MIME:
a) sign and verify
b) encrypt and decrypt
c) sign/encrypt (with attachment*) and decrypt/verify (and check attachment)
(*) Attachment should contain umlauts in filename (e.g. fooäüö.txt)
Testsuite 2: GpgOL extended tests
2.1 Exchange Server
Run all tests from testsuite 1 via Exchange Server.
2.2 Move Mails
Move some encrypted mails from inbox into an other folder. Check with an other IMAP client that all mails are always encrypted.
2.3 Drafts
Create new message. Mark message with "sign" and "encrypt". Close and save mail as draft. Open draft again. Check if the message is still marked with "sign" and "encrypt".
2.4 Cancel crypto operation
Create a mew message. Mark as sign/encrypt. Click send. Cancel certificate selection dialog. Check if the message is not sent.
2.5 Sent messages
Send a signed/encrypted message. Check the sent folder ("Sent messages") if the mail is still signed/encrypted.
2.6 Reply
Reply to an encrypted mail. Check if the quoted text contains the decrypted message.
2.7 Disable GpgOL
Disable the GpgOL plugin in Outlook (via COM add-ons). Select a signed/encrypted mail. Check that the mail cannot decrypted/verify.
2.8 Deactivate GpgOL's S/MIME (GpgSM)
Testsuite 3. Interoperability tests (Kontact Mail)
Send crypto mails from Kontact Mail (KMail) to Outlook (GpgOL).
3.1 Using PGP/MIME
a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (KMail)
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)
3.2 Using S/MIME
a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (KMail)
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)
3.3 Using no-mime-PGP
a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt without attachment (KMail) -> decrypt/verify (GpgOL)
Testsuite 4. Interoperability tests (Thunderbird)
Send crypto mails from Thunderbird (Enigmail) to Outlook (GpgOL).
4.1 Using PGP/MIME
a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (TB)
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)
4.2 Using S/MIME (with Thunderbird's S/MIME implementation)
a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (TB)
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)
4.3 Using no-mime-PGP
a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
Test matrix
Legend:
? = untested
x = passed
F = failed
+++ Tested GpgOL version: X.X.X +++
| Outlook | 2010 (32) | 2013 (64) | 2016 (32) | 2016 (64) | 2016 (64) | .. |
|---|---|---|---|---|---|---|
| Windows | 7 (64) | 8 (64) | 7 (32) | 8 (64) | 10 (64) | .. |
| Testsuite 1: OL/OL | ||||||
| 1.1.a | ? | ? | ? | ? | ? | .. |
| 1.1.b | ? | ? | ? | ? | ? | .. |
| 1.1.c | ? | ? | ? | ? | ? | .. |
| 1.2.a | ? | ? | ? | ? | ? | .. |
| 1.2.b | ? | ? | ? | ? | ? | .. |
| 1.2.c | ? | ? | ? | ? | ? | .. |
| Testsuite 2: KMail/OL | ||||||
| 2.1.a | ? | ? | ? | ? | ? | .. |
| 2.1.b | ? | ? | ? | ? | ? | .. |
| 2.1.c | ? | ? | ? | ? | ? | .. |
| 2.1.d | ? | ? | ? | ? | ? | .. |
| 2.1.e | ? | ? | ? | ? | ? | .. |
| 2.1.f | ? | ? | ? | ? | ? | .. |
| 2.2.a | ? | ? | ? | ? | ? | .. |
| 2.2.b | ? | ? | ? | ? | ? | .. |
| 2.2.c | ? | ? | ? | ? | ? | .. |
| 2.2.d | ? | ? | ? | ? | ? | .. |
| 2.2.e | ? | ? | ? | ? | ? | .. |
| 2.2.f | ? | ? | ? | ? | ? | .. |
| 2.3.a | ? | ? | ? | ? | ? | .. |
| 2.3.b | ? | ? | ? | ? | ? | .. |
| 2.3.c | ? | ? | ? | ? | ? | .. |
| Testsuite 3: Thunderbird/OL | ||||||
| 3.1.a | ? | ? | ? | ? | ? | .. |
| 3.1.b | ? | ? | ? | ? | ? | .. |
| 3.1.c | ? | ? | ? | ? | ? | .. |
| 3.1.d | ? | ? | ? | ? | ? | .. |
| 3.1.e | ? | ? | ? | ? | ? | .. |
| 3.1.f | ? | ? | ? | ? | ? | .. |
| 3.2.a | ? | ? | ? | ? | ? | .. |
| 3.2.b | ? | ? | ? | ? | ? | .. |
| 3.2.c | ? | ? | ? | ? | ? | .. |
| 3.2.d | ? | ? | ? | ? | ? | .. |
| 3.2.e | ? | ? | ? | ? | ? | .. |
| 3.2.f | ? | ? | ? | ? | ? | .. |
| 3.3.a | ? | ? | ? | ? | ? | .. |
| 3.3.b | ? | ? | ? | ? | ? | .. |
| 3.3.c | ? | ? | ? | ? | ? | .. |