Differences between revisions 3 and 8 (spanning 5 versions)

GpgOL test plan

Here you can find information about the manual testing progress of GpgOL.

Contents

GpgOL test plan

What should be tested?

We want to ensure GpgOL works well on all supported Microsoft Windows operating systems with all supported versions of Microsoft Outlook.

The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and/or signed emails, and the receiving of encrypted and/or signed emails.

The tests are not only performed with messages from and to Microsoft Outlook, but also with other Windows and Linux mail clients which are supported by GnuPG, especially:

Microsoft Outlook 2010 32bit (on Windows 7 64bit)
Microsoft Outlook 2013 64bit (on Windows 8 64bit)
Microsoft Outlook 2016 32bit (on Windows 7 32bit)
Microsoft Outlook 2016 64bit (on Windows 8 64bit)
Microsoft Outlook 2016 64bit (on Windows 10 64bit)
Thunderbird with Enigmail-Add-On (on Windows or GNU/Linux)
KMail of Kontact enterprise 35 (on GNU/Linux)

The tests will refer to the usage of PGP/MIME and PGP/Inline.

To test out the different versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test environment was recommenended, e.g. VirtualBox.

Test plan

Check if GpgOL can perform the following test suites without errors.

1. Outlook <--> Outlook

Send crypto emails between Outlook (GpgOL) and Outlook (GpgOL).

1.1 Using PGP/MIME

a) sign -> verify
b) encrypt -> decrypt
c) sign/encrypt with attachment -> decrypt/verify and check attachment

1.2 Using S/MIME

a) sign -> verify
b) encrypt -> decrypt
c) sign/encrypt with attachment -> decrypt/verify and check attachment

2. KMail <--> Outlook

Send crypto emails between KMail and Outlook (GpgOL).

2.1 Using PGP/MIME

a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (KMail)
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)

2.2 Using S/MIME

2.3 Using PGP/Inline

a) sign (KMail) -> verify (GpgOL)
b) encrypt (KMail) -> decrypt (GpgOL)
c) sign/encrypt without attachment (KMail) -> decrypt/verify (GpgOL)

3. Thunderbird <--> Outlook

Send crypto emails between Thunderbird (Enigmail) and Outlook (GpgOL).

3.1 Using PGP/MIME

a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)
d) answer to (a): sign (GpgOL) -> verify (TB)
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)

3.2 Using S/MIME (with Thunderbird's S/MIME implementation)

3.3 Using PGP/Inline

a) sign (TB) -> verify (GpgOL)
b) encrypt (TB) -> decrypt (GpgOL)
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)

Test Results

The detailed description of how the test was performed, what kind of results were expected and what the actual result was like.

1.1.a Using PGP/MIME

Windows 7 32 Outlook 2016

Using Gpg4Win version 2.2.6 and gpgol.dll beta 1.3.0-beta85 (2015-11-04). Imported two necessary certificates in Kleopatra and authenticated them manually.

Signing an E-Mail with OpenPGP and sending it worked without a noticeable problem.

Receiving an signed E-Mail and read it worked without a problem.

To verify the received E-Mail, it was necessary to open it (The E-Mail) in an external window (double click) and navigate to the GpgOL-tab afterwards, which is inconvenient. It was not possible to verify the E-Mail inside the Outlook-Main-Window (missing option).

Expected:

The E-Mail may be verified automatically
The E-Mail may be verified from inside the main window (GpgOL-tab)

Result:

Successful verification from an external window

1.2.a Using S/MIME

Windows 7 32 Outlook 2016

Using Gpg4Win version 2.2.6 and gpgol.dll beta 1.3.0-beta85 (2015-11-04). Imported two necessary certificates in Kleopatra and authenticated them manually.

(like in 1.1.a) Signing an E-mail with S/MIME and sending it worked without a noticeable problem.

Receiving a signed E-Mail and reading it worked without a noticeable problem.

The process of verifying failed. The error message was "Decryption failed: no data" (sic: (German) "Entschlüsseln fehlgeschlagen: Keine Daten.") The detailed error decryption was "input error: unknown error" (sic: (German) "Eingabefehler: Unbekannter fehler").

Expected:

The E-Mail may be verified successful.
The E-Mail may be verified from inside the main window (GpgOL-tab)

Result:

The verification failed. Error message: "Decryption failed: no data" | "input error: unknown error"

Test matrix

Legend:
? = untested
x = passed
F = failed

+++ Tested GpgOL version: X.X.X +++

Outlook	2010 (32)	2013 (64)	2016 (32)	2016 (64)	2016 (64)	..
Windows	7 (64)	8 (64)	7 (32)	8 (64)	10 (64)	..
Testsuite 1: OL/OL
1.1.a	?	?	x¹	?	?	..
1.1.b	?	?	?	?	?	..
1.1.c	?	?	?	?	?	..
1.1.d	?	?	?	?	?	..
1.1.e	?	?	?	?	?	..
1.1.f	?	?	?	?	?	..
1.2.a	?	?	F	?	?	..
1.2.b	?	?	?	?	?	..
1.2.c	?	?	?	?	?	..
1.2.d	?	?	?	?	?	..
1.2.e	?	?	?	?	?	..
1.2.f	?	?	?	?	?	..
Testsuite 2: KMail/OL
2.1.a	?	?	?	?	?	..
2.1.b	?	?	?	?	?	..
2.1.c	?	?	?	?	?	..
2.1.d	?	?	?	?	?	..
2.1.e	?	?	?	?	?	..
2.1.f	?	?	?	?	?	..
2.2.a	?	?	?	?	?	..
2.2.b	?	?	?	?	?	..
2.2.c	?	?	?	?	?	..
2.2.d	?	?	?	?	?	..
2.2.e	?	?	?	?	?	..
2.2.f	?	?	?	?	?	..
2.3.a	?	?	?	?	?	..
2.3.b	?	?	?	?	?	..
2.3.c	?	?	?	?	?	..
Testsuite 3: Thunderbird/OL
3.1.a	?	?	?	?	?	..
3.1.b	?	?	?	?	?	..
3.1.c	?	?	?	?	?	..
3.1.d	?	?	?	?	?	..
3.1.e	?	?	?	?	?	..
3.1.f	?	?	?	?	?	..
3.2.a	?	?	?	?	?	..
3.2.b	?	?	?	?	?	..
3.2.c	?	?	?	?	?	..
3.2.d	?	?	?	?	?	..
3.2.e	?	?	?	?	?	..
3.2.f	?	?	?	?	?	..
3.3.a	?	?	?	?	?	..
3.3.b	?	?	?	?	?	..
3.3.c	?	?	?	?	?	..

¹) To verify and decrypt an email, it is necessary to open it in an external window, which is inconvenient.

-  ⇤ ← Revision 3 as of 2015-11-03 16:06:16 → 
  Size: 9962
  Editor: SeanEngelhardt
  Comment: made clear-text test-cases
+   ← Revision 8 as of 2015-11-10 11:59:54 → ⇥
  Size: 7875
  Editor: SeanEngelhardt
  Comment: Added "Test Result" section. Added first two tests, Added them in the Matrix, created a scheme for future test results
-Deletions are marked like this.
+Additions are marked like this.
 Line 1:
-= GpgOL test plan (DRAFT)
+## page was renamed from GpgOL/Development/Testplan
= GpgOL test plan
-Line 5:
+Line 6:
-<<TableOfContents(2)>>

== What is (going to be) tested
+<<TableOfContents(3)>>

== What should be tested?
-Line 11:
+Line 12:
-The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and (or) signed emails, and
the receiving of encrypted and (or) signed emails.

The tests are not only performed with encrypted and signed messages from and to Microsoft Outlook, but also with other 
Windows and Linux Mail-Clients which are supported by Gpg.

Especially:

* Microsoft Outlook 2010 (On Windows 7 64bit)
* Microsoft Outlook 2013 (On Windows 8 64bit)
* Microsoft Outlook 2016 (On Windows 7 32bit)
* Microsoft Outlook 2016 (On Windows 8 64bit)
* Microsoft Outlook 2016 (On Windows 10 64bit)
* thunderbird (Windows and Linux)
* KMail (Kontact e35 Linux)

The tests will refer to the usage of PGP/MIME and PGP/Inline.

== About the testing-environment

To test out the different Versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test-Environment was created using Oracle [[https://www.virtualbox.org/|VirtualBox]].
+The tests refer to the signing and encrypting process in Microsoft Outlook using GpgOL, the transmission of encrypted and/or signed emails, and
the receiving of encrypted and/or signed emails.

The tests are not only performed with messages from and to Microsoft Outlook, but also with other Windows and Linux mail clients which are supported by GnuPG, especially:

* Microsoft Outlook 2010 32bit (on Windows 7 64bit)
* Microsoft Outlook 2013 64bit (on Windows 8 64bit)
* Microsoft Outlook 2016 32bit (on Windows 7 32bit)
* Microsoft Outlook 2016 64bit (on Windows 8 64bit)
* Microsoft Outlook 2016 64bit (on Windows 10 64bit)
* Thunderbird with Enigmail-Add-On (on Windows or GNU/Linux)
* KMail of Kontact enterprise 35 (on GNU/Linux)

The tests will refer to the usage of PGP/~MIME and PGP/Inline.

To test out the different versions of Microsoft Outlook on different platforms and CPU-Architectures a virtual test environment was recommenended, e.g. [[https://www.virtualbox.org/|VirtualBox]].
-Line 34:
+Line 30:
-The test cases described in plain text


1. Send a Mail from a Outlook Client to an Outlook Client.
**Use OpenPGP/Mime** for the signing process
# for Microsoft Outlook 2010 (On Windows 7 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2013 (On Windows 8 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2016 (On Windows 7 32bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2016 (On Windows 8 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2016 (On Windows 10 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step


2. Send a Mail from a Outlook Client to an Outlook Client.
**Use S/Mime** for the signing process
# for Microsoft Outlook 2010 (On Windows 7 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2013 (On Windows 8 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2016 (On Windows 7 32bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2016 (On Windows 8 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step
# for Microsoft Outlook 2016 (On Windows 10 64bit)
** a) Sign the E-Mail
** b) Encrypt the E-Mail
** c) Sign and Encrypt the E-Mail in one step
** d) Verify signature of the E-Mail you just sent
** e) Decrypt the E-Mail you just sent
** f) Verify and decypt the email you just sent in one step


3. Send an E-Mail with KMail to an Outlook Client. Check if the Outlook Client can perform the following tasks without errors
# Perform the Steps using OpenPGP/Mime
## Microsoft Outlook 2010 (On Windows 7 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2013 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 7 32bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 10 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
# Perform the Steps using S/Mime
## Microsoft Outlook 2010 (On Windows 7 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2013 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 7 32bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 10 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step


4. Send an E-Mail with Thunderbird to an Outlook Client. Check if the Outlook Client can perform the following tasks without errors
# Perform the Steps using OpenPGP/Mime
## Microsoft Outlook 2010 (On Windows 7 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2013 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 7 32bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 10 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
# Perform the Steps using S/Mime
## Microsoft Outlook 2010 (On Windows 7 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2013 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 7 32bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 8 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step
## Microsoft Outlook 2016 (On Windows 10 64bit)
*** a) Verify the signature
*** b) Decrypt the mail
*** c) Verify and Decrypt the E-Mail in one step

== Test plan matrix

=== 1. Sender and receiver is Outlook on Windows using OpenPGP/Mime

|o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64
|=a) Signing| ? | ? | ? | ? | ? |
|=b) Encrypting| ? | ? | ? | ? | ? |
|=c) Sig+Enc| ? | ? | ? | ? | ? |
|=d) Verify signature| ? | ? | ? | ? | ? |
|=e) Decrypt| ? | ? | ? | ? | ? |
|=f) Verify + Decrypt| ? | ? | ? | ? | ? |


=== 2. Sender and receiver is Outlook on Windows using S/Mime

|o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64
|=a) Signing| ? | ? | ? | ? | ? |
|=b) Encrypting| ? | ? | ? | ? | ? |
|=c) Sig+Enc| ? | ? | ? | ? | ? |
|=d) Verify signature| ? | ? | ? | ? | ? |
|=e) Decrypt| ? | ? | ? | ? | ? |
|=f) Verify + Decrypt| ? | ? | ? | ? | ? |


=== 3. Sender is KMail receiver is Outlook

==== 3.1 using OpenPGP/Mime

|o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64
|=a) Verify signature| ? | ? | ? | ? | ? |
|=b) Decrypt| ? | ? | ? | ? | ? |
|=c) Verify + Decrypt| ? | ? | ? | ? | ? |

==== 3.2 using S/Mime

|o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64
|=a) Verify signature| ? | ? | ? | ? | ? |
|=b) Decrypt| ? | ? | ? | ? | ? |
|=c) Verify + Decrypt| ? | ? | ? | ? | ? |


=== 4. Sender is Thunderbird, receiver is Outlook

==== 4.1 using OpenPGP/Mime
|o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64
|=a) Verify signature| ? | ? | ? | ? | ? |
|=b) Decrypt| ? | ? | ? | ? | ? |
|=c) Verify + Decrypt| ? | ? | ? | ? | ? |

==== 4.2 using using S/MIME
|o|=1) OL2010 W7_64 |=2) OL2013 W8_64 |=3) OL2016 W7_32 | =4) OL2016 W8_64 | =5) OL2016 W10_64
|=a) Verify signature| ? | ? | ? | ? | ? |
|=b) Decrypt| ? | ? | ? | ? | ? |
|=c) Verify + Decrypt| ? | ? | ? | ? | ? |
+Check if GpgOL can perform the following test suites without errors.

=== 1. Outlook <--> Outlook
Send crypto emails between Outlook (GpgOL) and Outlook (GpgOL).

==== 1.1 Using PGP/MIME
a) sign -> verify\\
b) encrypt -> decrypt\\
c) sign/encrypt with attachment -> decrypt/verify and check attachment

==== 1.2 Using S/MIME
a) sign -> verify\\
b) encrypt -> decrypt\\
c) sign/encrypt with attachment -> decrypt/verify and check attachment


=== 2. KMail <--> Outlook
Send crypto emails between KMail and Outlook (GpgOL). 

==== 2.1 Using PGP/MIME
a) sign (KMail) -> verify (GpgOL)\\
b) encrypt (KMail) -> decrypt (GpgOL)\\
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)\\
d) answer to (a): sign (GpgOL) -> verify (KMail)\\
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)\\
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)

==== 2.2 Using S/MIME
a) sign (KMail) -> verify (GpgOL)\\
b) encrypt (KMail) -> decrypt (GpgOL)\\
c) sign/encrypt with attachment (KMail) -> decrypt/verify and check attachment (GpgOL)\\
d) answer to (a): sign (GpgOL) -> verify (KMail)\\
e) answer to (b): encrypt (GpgOL) -> decrypt (KMail)\\
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (KMail)

==== 2.3 Using PGP/Inline
a) sign (KMail) -> verify (GpgOL)\\
b) encrypt (KMail) -> decrypt (GpgOL)\\
c) sign/encrypt without attachment (KMail) -> decrypt/verify (GpgOL)\\


=== 3. Thunderbird <--> Outlook
Send crypto emails between Thunderbird (Enigmail) and Outlook (GpgOL). 

==== 3.1 Using PGP/MIME
a) sign (TB) -> verify (GpgOL)\\
b) encrypt (TB) -> decrypt (GpgOL)\\
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)\\
d) answer to (a): sign (GpgOL) -> verify (TB)\\
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)\\
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)

==== 3.2 Using S/MIME (with Thunderbird's S/MIME implementation)
a) sign (TB) -> verify (GpgOL)\\
b) encrypt (TB) -> decrypt (GpgOL)\\
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)\\
d) answer to (a): sign (GpgOL) -> verify (TB)\\
e) answer to (b): encrypt (GpgOL) -> decrypt (TB)\\
f) answer to (c): sign/encrypt with attachment (GpgOL) -> decrypt/verify and check attachment (TB)

==== 3.3 Using PGP/Inline
a) sign (TB) -> verify (GpgOL)\\
b) encrypt (TB) -> decrypt (GpgOL)\\
c) sign/encrypt with attachment (TB) -> decrypt/verify and check attachment (GpgOL)

== Test Results

The detailed description of how the test was performed, what kind of results were expected and what the actual result was like.


==== 1.1.a Using PGP/MIME

===== Windows 7 32 Outlook 2016

Using Gpg4Win version 2.2.6 and gpgol.dll beta 1.3.0-beta85 (2015-11-04).
Imported two necessary certificates in Kleopatra and authenticated them manually.

Signing an E-Mail with OpenPGP and sending it worked without a noticeable problem.
 
Receiving an signed E-Mail and read it worked without a problem.

To verify the received E-Mail, it was necessary to open it (The E-Mail) in an external window (double click) and navigate to the GpgOL-tab afterwards, which is inconvenient.
It was not possible to verify the E-Mail inside the Outlook-Main-Window (missing option).

Expected:
 * The E-Mail may be verified automatically 
 * The E-Mail may be verified from inside the main window (GpgOL-tab)

Result:
 * Successful verification from an external window


==== 1.2.a Using S/MIME

===== Windows 7 32 Outlook 2016

Using Gpg4Win version 2.2.6 and gpgol.dll beta 1.3.0-beta85 (2015-11-04).
Imported two necessary certificates in Kleopatra and authenticated them manually. 

(like in 1.1.a)
Signing an E-mail with S/MIME and sending it worked without a noticeable problem.

Receiving a signed E-Mail and reading it worked without a noticeable problem.

The process of verifying failed. The error message was "Decryption failed: no data" (sic: (German) "Entschlüsseln fehlgeschlagen: Keine Daten.")
The detailed error decryption was "input error: unknown error" (sic: (German) "Eingabefehler: Unbekannter fehler").

Expected:
 * The E-Mail may be verified successful.
 * The E-Mail may be verified from inside the main window (GpgOL-tab)

Result:
 * The verification failed. Error message: "Decryption failed: no data" | "input error: unknown error"

== Test matrix

Legend:\\
? = untested\\
x = passed\\
F = failed

** +++ Tested ~GpgOL version: X.X.X +++**

|Outlook  |=2010 (32) |= 2013 (64) |=2016 (32) |= 2016 (64) |= 2016 (64) |= ..
|Windows  |=7 (64)    |= 8 (64)    |=7 (32)    |= 8 (64)    |= 10 (64)   |= ..
|Testsuite 1: OL/OL |  
|1.1.a | ? | ? | x¹ | ? | ? | .. |
|1.1.b | ? | ? | ? | ? | ? | .. |
|1.1.c | ? | ? | ? | ? | ? | .. |
|1.1.d | ? | ? | ? | ? | ? | .. |
|1.1.e | ? | ? | ? | ? | ? | .. |
|1.1.f | ? | ? | ? | ? | ? | .. |
|1.2.a | ? | ? | F | ? | ? | .. |
|1.2.b | ? | ? | ? | ? | ? | .. |
|1.2.c | ? | ? | ? | ? | ? | .. |
|1.2.d | ? | ? | ? | ? | ? | .. |
|1.2.e | ? | ? | ? | ? | ? | .. |
|1.2.f | ? | ? | ? | ? | ? | .. |
|Testsuite 2: KMail/OL |
|2.1.a | ? | ? | ? | ? | ? | .. |
|2.1.b | ? | ? | ? | ? | ? | .. |
|2.1.c | ? | ? | ? | ? | ? | .. |
|2.1.d | ? | ? | ? | ? | ? | .. |
|2.1.e | ? | ? | ? | ? | ? | .. |
|2.1.f | ? | ? | ? | ? | ? | .. |
|2.2.a | ? | ? | ? | ? | ? | .. |
|2.2.b | ? | ? | ? | ? | ? | .. |
|2.2.c | ? | ? | ? | ? | ? | .. |
|2.2.d | ? | ? | ? | ? | ? | .. |
|2.2.e | ? | ? | ? | ? | ? | .. |
|2.2.f | ? | ? | ? | ? | ? | .. |
|2.3.a | ? | ? | ? | ? | ? | .. |
|2.3.b | ? | ? | ? | ? | ? | .. |
|2.3.c | ? | ? | ? | ? | ? | .. |
|Testsuite 3: Thunderbird/OL | 
|3.1.a | ? | ? | ? | ? | ? | .. |
|3.1.b | ? | ? | ? | ? | ? | .. |
|3.1.c | ? | ? | ? | ? | ? | .. |
|3.1.d | ? | ? | ? | ? | ? | .. |
|3.1.e | ? | ? | ? | ? | ? | .. |
|3.1.f | ? | ? | ? | ? | ? | .. |
|3.2.a | ? | ? | ? | ? | ? | .. |
|3.2.b | ? | ? | ? | ? | ? | .. |
|3.2.c | ? | ? | ? | ? | ? | .. |
|3.2.d | ? | ? | ? | ? | ? | .. |
|3.2.e | ? | ? | ? | ? | ? | .. |
|3.2.f | ? | ? | ? | ? | ? | .. |
|3.3.a | ? | ? | ? | ? | ? | .. |
|3.3.b | ? | ? | ? | ? | ? | .. |
|3.3.c | ? | ? | ? | ? | ? | .. |

¹) To verify and decrypt an email, it is necessary to open it in an external window, which is inconvenient.