[hemmerling] Testing

[hemmerling] Testing

ASQF e.V. - Arbeitskreis Software-Qualität & -Fortbildung e.V..
British Computer Society ( BCS ), UK.
- Information Systems Examination Board ( ISEB ) - “The Information Systems Examinations Board (ISEB) is part of BCS”.
- Blog oddIT Blog.
Global Association for Software Quality ( gasq ).
German Testing Board e.V..
Gesellschaft für Informatik e.V. (GI).
- Gesellschaft für Informatik e.V., Fachgruppe TAV (Test, Analyse und Verifikation von Software) ( GI FG TAV ).
- DLGI - Dienstleistungsgesellschaft für Informatik mbH.
International Software Quality Institute ( iSQI ).
The Network Test Automation Forum ( NTAF ) - It “was created to promote the interoperability of commercial testing tools and test infrastructure for the data communications and telecommunications industry”.
Vivit - “The independent, non-profit service organization that represents the broad HP Software community.. Membership is free”.
- Vivit TQA.
  - Vivit TQA: Testing, Quality, Application Lifecycle Management ( - 2011 ).
  - Vivit "Special Interest Group: Testing Quality and ALM" ( Vivit TQA ).
- Vivit Chapter Germany, Vivit-Germany.
- Blog Vivit Blog.
- Events:
  - Vivit "Community Calendar - Special Interest Group: Testing Quality".
    - Vivit "User Group Treffen 'Testmanagement und agile Entwicklung mit HPE ALM.net / Quality Center und HPE ALM Octane'", 2016-09-01 in Hannover - I participated .
    - Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'", 2015-04-14.
    - Vivit TQA, Germany "User Group Treffen 'Testautomatisierung: Einführung, Ausweitung und Tool-Unterstützung'", 2014-12-09.
    - Vivit TQA, Germany "Vivit TQA beim Vivit Deutschland Treffen 2014", 2014-09-30 - 2014-10-01.
    - Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'", 2014-09-04.
    - Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'", 2014-04-03.
    - Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'", 2013-09-25.
    - Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'", 2013-04-18.
      - Vivit TQA, Germany "API-‐Programmierung und –Nutzung bei HP Quality Center / ALM" ( PDF ).

Fairs, Conferences, Events

German Testing Day.
The virtual conference German Testing WebCon – Die virtuelle Konferenz zu Software-Qualität, 2020-05-15.
- GotoMeeting.
  - Raum-ID “259-138-043” ( Raum 1 ).
  - Raum-ID “629-244-715”.
  - Raum-ID “927-682-555”.
  - Raum-ID “996-665-707”.
German Testing Night, 2014-03-27, 2014-07-01.
- German Testing Night 2014-03-27 "Giesecke&Devrient, Andrej Pietschker: Tests als Requirements - Brücke zwischen Entwicklung und Systemtest bauen".
Automotive Testing Expo Europe, Stuttgart.
Hewlett Packard Enterprise "Veranstaltungskalender".
- Hewlett Packard Enterprise "HPE ALM Octane Launch Roadshow", 2016-06-08 in Berlin.
UCAAT - User Conference on Advanced Automated Testing in München, 2014-09-16 - 2014-09-18.
XP Days Germany - Mitmach-Konferenz für Exteme ProgrammiererInnen, Hamburg ( 2012-11-29 - 2012-12-01 ).
Softwerkskammer "Workshop: Javascript-Frameworks für Testautomatisierung" in Frankfurt, 2014-08-21.
- Alexei Vinogradov, Alexei Vinogradov, XING "Alexei Vinogradov", LinkedIn "Alexei Vinogradov".
  - GitHub "vinogradoff".
    - GitHub "vinogradoff/nightwatch-workshop".
- Kahlil Lechelt, Kahlil Lechelt, XING "Kahlil Lechelt", LinkedIn "Kahlil Lechelt".
  - GitHub "Kahlil Lechelt, distilledhype".
    - GitHub "distilledhype/softwerkskammer-dalekjs".
- Tools I used on the event:
  1. Nightwatch.js, GitHub "beatfactor/nightwatch".
  2. DalekJS, GitHub "DalekJS".
Online seminar applitools "Future of Testing: Mobile. Virtual Event for Mobile Engineers", 2021-04-08, 9 am PT, 18:00 UTC+1.
- GuildConferences "Future of Testing: Mobile. Virtual Event for Mobile Engineers" - Login.

Certification

Knowledge Department GmbH & Co. KG..
- Knowledge Department GmbH & Co. KG. "Certified Tester Probeprüfung" - free test of knowledge, usful before taking a paid test.
Certified Agile Tester.

Testing Experts

Graham Maxfield, Germany.
- XING "Graham Maxfield" - “Checking is not testing. Testing is more than checking” .

Crowdtesting Jobs

See Crowdtesting.

Basics

Explorative testing = Manual testing, with testplan.

Questions about the Testing of Embedded Software

How to test embedded software ? Under the conditions
1. Most of the code is machine-dependent, i.e. a function to be tested accesses hardware ( reads and writes registers, while the results depend on external conditions and events ).
2. Resources ( RAM,.. ) are limited, in comparison to the well-known standard of deskop PCs.
3. Use of standard ( free, OpenSource, commercial )Test frameworks and especially Unit Test frameworks.

Mockup - Simulation of Objects

See [unittest.html|Unit Test / Module Test]].

Unit Test vs Functional Test

EDUCBA "Unit Test vs Functional Test" - “Difference Between Unit Test vs Functional Test”.

Keyword-based Testing

EN.Wikipedia "Keyword-driven testing", DE.Wikipedia "Keyword-Driven Testing".

Test-First Approach - UX-Driven Testing

Test-First Approach

The domain experts define the input mask of screens, of an IT application, plus the behaviour ( how to move from one screen to the next ), by simple tools, e.g. spreadsheets. The software developers are not involved.
If this is derived from the specification, it can be used also as guide for implementation by the software developers.
This is used also later for integration test.
Alternatively, the domain expert might build a rapid prototype, with little or no help by a software developer.

UX-Driven Testing

The software is developed from point of view of the user, and his / her “user experience” ( UX ).

Property-based Testing

Scala ( and Java )

ScalaTest - “Property-based testing for Scala”.
- ScalaTest "Property-based testing".

Haskell

Haskell "QuickCheck" - “Automatic testing of Haskell programs”.
EN.Wikipedia "QuickCheck".

F#

Javascript

GitHub.io "JSVerify - Write powerful and concise tests".

Instrumentation Frameworks for Dynamic Application Testing

The OpenSource Google Code "address-sanitizer" - "AddressSanitizer: a fast memory error detector" ( ASan ) - “It finds use-after-free and {heap,stack,global}-buffer overflow bugs in C/C++ programs”.
- clang: a C language family frontend for LLVM.
  - Clang 3.6 documentation AddressSanitizer.
- EN.Wikipedia "AddressSanitizer" - “AddressSanitizer is currently implemented in Clang (starting from version 3.1) and GCC (starting from version 4.8)”.
The OpenSource Valgrind - instrumentation framework for dynamic testing of applications written in C/C++ language, e.g. detection of memory leaks.

Test Mangement, Functional Test Tools, Automation Frameworks, GUI Testing Tools / Capture & Replay Tools

Important Dynamic Code Analysis Tools / Tools for Dynamic Analysis Security Testing ( DAST ), according to VDC Research in 2015, 2016-08, 2018-08

RapiTime/RapiCover (Rapita Systems).
LDRA Testbed (LDRA).
SilkTest (Borland / Micro Focus).
HP.
- HP Quality Center / ALM.
- HP Security Fortify (HP).
Rational Test RealTime/Tau Tester (IBM Rational).
TestQuest (BSQUARE).
Cantata++ /AdaTEST (QA Systems).
Test Center (Keynote/DeviceAnywhere).
Parasoft C++test/Insure++/Standard Compliance (Parasoft).
MobileCloud (Perfecto Mobile).
Coverity.
- Coverity Quality Adviser (Coverity) 2015-2016.
- Coverity Dynamic Analysis (Coverity) 2018.
VectorCAST (Vector Software).
Veracode (Veracode), 2016-08
SW-Assure (Monroe Software), 2016-08.

Some other General Test Management Tools

The commercial CASEMAKER - “If you are an “ISTQB Certified Tester” register now to receive a license for one month, free of charge, so you can see for yourself the advantage this tool will provide you in your daily application of the taught methods”.
The free klaros testmanagement Community Edition for Linux and Windows.
- Integration with Jenkins and with Hudson by Jenkins plugin and Hudson plugin .
The free graphical editor for classification trees Berner & Mattner "CTE XL" for Windows.
- System Testing - “Functional Testing ( with CTE ), Evolutionary Testing, Static Analysis”.
The Opensource TestLink, SourceForge "TestLink", SourceForge "TestLink" - “Test case management tool”.
- EN.Wikipedia "TestLink".

Testdata Creation and Testdata Management

Methods

EN.Wikipedia "Fuzzing", DE.Wikipedia "Fuzzing" - “Fuzzing or fuzz testing is an automated software testing technique that involves providing invalid, unexpected, or random data as inputs to a computer program. The program is then monitored for exceptions such as crashes, failing built-in code assertions, or potential memory leaks”.

Software

The commercial testdata management system Averna Proligent.
The OpenSource Damhave Systems "sequence" - “A UNIX/Linux command line tool for generation binary or ASCII test sequences. Sequence is specially useful in bash scripts for test data generation when testing and debugging your own linux device drivers or playing with flash or MTD devices”.
The OpenSource GenerateData.com - Open-source data generator script.

Integration & Automation Frameworks, Tools for functional Tests and Regression Tests

.NET

The OpenSource Github "machine / machine.specifications" - “A Context/Specification framework geared towards removing language noise and simplifying tests”.
- CodeBetter.com, Aaron Jensen "Introducing Machine.Specifications (or MSpec for short)", 2008-05-08.
The OpenSource NSpec, Github "mattflo / NSpec" - “A BDD framework for .NET of the xSpec (context/specification) flavor”.
The OpenSource WatiN - “Web Application Testing for the .Net languages”.

Java, Python, Web,..

The OpenSource Apache JMeter for Java - “Java desktop application designed to load test functional behavior and measure performance”.
Concordion -“An open source tool for writing automated acceptance tests in Java. There are also versions for .NET, Python, Scala, and Ruby”. “It's similar to the Fit Framework but a lot more intuitive”.
- Concordion - Non-Java Versions.
  - Google Code "pyconcordion - “Concordion Python Port (write concordion like html files, python fixtures and run it !)”.
The OpenSource SourceForge "Jameleon", SourceForge "Jameleon" - “Automated testing framework”.
The OpenSource JSystem - Layered Test Automation Framework for Java - “Functional tests automation framework based on JUnit”.
The OpenSource Radview WebLOAD - "WebLOAD Open Source Load Generation Engine" - “Test with confidence”. “Load Testing, Stress Testing and Performance testing tools”.
The OpenSource Robot Framework in Python.
- GitHub "robotframework".
  - GitHub "robotframework / RIDE" - “Test data editor for Robot Framework”.
  - Google Code "robotframework-seleniumlibrary", GitHub "robotframework/SeleniumLibrary".
- EN.Wikipedia "Robot Framework", DE.Wikipedia "Robot Framework".
The commercial Tricentis Tosca.
- Tricentis Tosca - “Testautomatisierung @ DevOps Speed”.
- The free MOOC course Udemy "Get in touch with Tricentis Tosca Testsuit".
- DE.Wikipedia "Tosca (Software)" - “Die Tosca Testsuite ist ein Software-Tool für die automatisierte Durchführung von Funktional- und Regressions-Tests an Software”.
The free XQual "XStudio" for Windows, Linux, MacOS.

Free GUI Testing Tools / Capture & Replay Tools

Windows, MacOSX, Linux, iPhone, Android

The OpenSource Sikuli.

.NET

The OpenSource QAliber for .NET.
- “QAliber Test Developer” - Visual Studio plug-in.
- “QAliber Test Builder”.
- EN.Wikipedia "QAliber".
The OpenSource WatiN, SourceForge "WatiN", SourceForge "WatiN" - “WatiN (pronounced 'what-in') aims to bring you an easy way to automate Web Application Testing in .Net. Inspired by Watir”.

Java

Codehouse “FEST” → See section “JUnit” on Unit Test / Module Test.
“jfcUnit” → See section “JUnit” on Unit Test / Module Test.
The OpenSource SourceForge "Abbot", SourceForge "Abbot" for Java with AWT / Swing - “Abbot framework for automated testing of Java GUI components and programs”.
- SourceForge "Abbot (framework)".
The free Google Java Developer Tools “WindowTester Pro” - “Streamlines testing of those GUIs with automated recording, test generation, code coverage and playback”.
“GUIdancer / Eclipse Jubula Project”.
- The project will be merged, starting with Eclipse Kepler ( 2013-06 - ).
- BREDEX GmbH "BREDEX Testing Resources Portal".
- The once-commercial, now free BREDEX GmbH "Bredex GUIdancer" for Java - “Eclipse-based tool for the automated functional testing of Graphical User Interfaces (GUI's)”, “Tests Java (Swing, SWT/RCP, GEF) and HTML GUI's”.
- The Opensource Eclipse Jubula Project for Java - “Automated Functional Testing”.
- Blog BREDEX GmbH "BREDEX on Software".
- In 2017-12, experts told me that there are now 2 options to create tests, by:
  - A GUI interface, i.e. by manual mouse clicking.
  - An API, so that you can write your tests in Java.
The OpenSource SourceForge "maveryx - Open Source Test Automation Framework", SourceForge "Maveryx" for Java - “Automated Java GUI Testing”.
- Wikipedia "Maveryx".
- An Eclipse plugin is available.
The OpenSource Java.net "Jemmy framework. Ultimate UI testing solution".
The commercial froglogic GmbH "Squish" for testing of Windows, Java, QT, HTML5 applications.
- froglogic GmbH "Squish Coco CE" - “Squish Coco is available as a Commercial Edition for usage with commercial and proprietary applications and as a Non Commercial Community Edition (CE) for non-commercial, private use, such as in Open Source projects or educational University projects”.
- EN.Wikipedia "Squish (Froglogic)".
Eclipse "SWTBot", SourceForge "SWTBot", SourceForge "SWTBot - SWT/Eclipse functional testing" - “UI Testing for SWT and Eclipse”.
- EN.Wikipedia "SWTBot".

Linux, X Window

The Opensource Linux Desktop Testing Project for Linux desktops.
- EN.Wikipedia "Linux Desktop Testing Project".
The OpenSource GNU Xnee - “A suite of programs that can record, replay and distribute user actions under the X11 environment”.
- EN.Wikipedia "Xnee".

PowerShell

“Test Run” - See Scripting Languages for Windows 2/2 - Windows Powershell.

Python

The OpenSource Fedora Hosted "dogtail" for Python - “GUI testing tool and automation framework”.
- Wikipedia "Dogtail".

Tcl/Tk

DejaGnu / Expect - See Tcl / Tk ( tickle) 2/2 - Debugging & Testing.

Web / HTML Testing in Python, Java, Javascript, PHP

Appium

Javascript Tools

Cypress, GitHub "cypress-io/cypress" - “Fast, easy and reliable testing for anything that runs in a browser”.
Galen Framework, GitHub "galenframework" - “Automated testing of look and feel for your responsive websites”. A Selenium-based Javascript framework.
GitHub.io "Karma - Spectacular Test Runner for Javascript", GitHub "Karma - The Spectacular Test Runner for JavaScript" - “Karma is essentially a tool which spawns a web server that executes source code against test code for each of the browsers connected”.
- Bradley Braithwaite "Getting started with Karma for AngularJS Testing".
Nightwatch.js, GitHub "beatfactor/nightwatch".
- “Nightwatch.js is an easy to use Node.js based End-to-End (E2E) testing solution for browser based apps and websites. It uses the powerful Selenium WebDriver API to perform commands and assertions on DOM elements”.
- “Nightwatch.js works with cloud testing providers, such as SauceLabs and BrowserStack.
- Twitter "Nightwatch.js".
- Daniel und Kian "Continuous Deployment mit git, codeship.io und nightwatch.js bei youhear.it", 2014-06-14.
- Installation:
  1. “sudo npm install nightwatch”.
  2. Install and run the Selenium Server - “java -jar selenium-server-standalone.2.42.0.jar”.
  3. “nightwatch” or “node nightwatch.js”
- Configuration on Windows:
  - On Windows, as shipped, “nightwatch” aborts by the error message “ERROR There was an error while starting the test runner: Error: Failed to load external global file: External global file could not be located - using ./examples/globals.json”.
  - To fix this for Windows, please modifly these lines of the file ”./node_modules/nightwatch/examples/tests” of your local node module directory:
```
"output_folder" : "./node_modules/nightwatch/examples/reports",
"custom_commands_path" : "./node_modules/nightwatch/examples/custom-commands",
"custom_assertions_path" : "",
"globals_path" : "./node_modules/nightwatch/examples/globals.json",
```
- Configuration on Linux:
  - In case of a local installation of “nightwatch”, this “nightwatch.js” file worked for me:
```
#!/usr/bin/env node
require('./node_modules/nightwatch/bin/runner.js');
```
- General configuration tips:
  - You should build your own “nightwatch.json” in your local project directory, see official tutorial .
DalekJS, GitHub "DalekJS".
- DalekJS "Get Started. This ain’t Selenium".
- “Dalek's only dependency is node.js, there is no need to install Java or download the Selenium.jar file”.
- Installation for a certain project directory. Though I was able to install DalekJS on Windows as total local installation, with Linux I must - as instructed by the documentation - dalek-cli as global, but dalekjs as local, else it does not appear with “dalek -v”. I decided to follow the instructions and installed the rest of the modules as local, too.
  1. ```
  sudo npm install -g dalek-cli
```
  .
2. ```
npm install dalekjs --save-dev
```
    This creates the folder “node_modules” in your project directory, and installs some code there.
  3. ```
  dalek -v
```
  for checking the proper installation. Both “dalek-cli” and “dalek” must be listed, so 2 modules, not just one.
4. ```
dalek test/my_first_test.js
```
  5. ```
  sudo npm install dalek-browser-chrome --save-dev
```
  or
```
  npm install dalek-browser-firefox --save-dev
```
  - dalek-browser-chrome - Must be installed with “sudo”.
  - dalek-browser-firefox - May be installed by a local user.
6. ```
dalek test/my_first_test.js -b chrome
```
    or
```
dalek test/my_first_test.js -b firefox
```
    - There is the error on Windows ”» ERROR: dalek-driver-firefox: Binary not found: C:\Program Files\Mozilla Firefox\firefox.exe”, if Firefox is not installed at the default location.
    - There is the error on Windows ”» ERROR: dalek-browser-firefox: Error starting WebDriverServer, port 9006 in use”.
      - GitHub Issues for "dalekjs/dalek-browser-firefox" - “Firefox won't start on any port #11”.
      - If I set a larger timeout at “my_project\node_modules\dalek-browser-firefox\node_modules\portscanner\lib\portscanner.js”, I get the error “net.js:1236: throw new Error('Not running');”:
        
        Original:
        
        “var timeout = options.timeout || 400”
        
        Changed to:
        
        “var timeout = options.timeout || 4000”
  7. ```
  npm install -g dalek-reporter-html --save-dev
```
8. ```
mkdir report
```
  9. ```
  mkdir cd report
```
10. ```
mkdir dalek
```
  11. ```
  mkdir cd ..
```
12. ```
dalek test/my_first_test.js -r console,html
```
    This command expects that the folder “report/dalek” exists. If so, it creates the file “index.html” in that directory with all the information from your test run.
- My personal experience of 2014-08: The current version of Dalek “hangs” if an assertion is not passed succesfully
GitHub "puppeteer/puppeteer" - “Headless Chrome Node.js API”, “A Node library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium”.
Resources:
- chercher.tech "Puppeteer vs Cypress".
- testim Blog "Puppeteer, Selenium, Playwright, Cypress – how to choose?".

Katalon Studio

Katalon Studio - “Simplify API, Web, Mobile Automation Tests”.
Google Chrome Store "Katalon Recorder (Selenium IDE for Chrome)".
EN.Wikipedia "Katalon Studio" - “A free automation testing solution developed by Katalon LLC. The software is built on top of open-source automation frameworks Selenium, Appium with a specialized IDE interface for API, Web and Mobile testing”.

Playwright

Playwright for Node.js, Python, Java, .NET - “Enables reliable end-to-end testing for modern web apps”.
Playwright for Python
- GitHub " microsoft / playwright-python".
- PyPI "playwright".
- Playwright for Python "Documentation" ( without “www.” ).
Resources:
- Experts told me, it'S also ok for webscrapting .
- Works with iPhython, doesn´t work with Jupyter notebooks.
- Best to use with websites which provide auto complete .

Selenium

The “slow” OpenSource Web application testing system “Selenium”.
- Selenium automates browsers. That's it! What you do with that power is entirely up to you, SeleniumHQ "Selenium".
- GitHub "Selenium".
- ~~Google Code "selenium. Browser automation framework"~~, GoogleAPIs - Download of outdated "Selenium" versions #.
- Experts feedback: Selenium is “slow”, and no replacement for the “fast” Canoo WebTest .
- Selenium "Documentation" - “The Selenium Browser Automation Project”.
  - Selenium "Ecosystem".
    - “Selenium can be extended in different ways. Here are a number of drivers, bindings, plugins, and frameworks created and maintained by third parties”.
    - GitHub "teodesian/Selenium-Remote-Driver", 2022-04 - “WARNING. Selenium has essentially been leapfrogged technologically by Playwright. (using the devtools protocol for all browsers) Use Chrome::DevToolsProtocol (or the Playwright interface on CPAN) instead of this unless you want to be frustrated by a tool which doesn't do half of what you want. Even then you are probably shooting yourself in the foot not using Javascript directly to automate the testing of webpages” .
    - “Language Bindings” - Go, Haskell, JavaScript, Perl, PHP, R, Dart.
  - Selenium "WebDriver".
  - Selenium "Remote WebDriver".
- Annual conferences.
  - Events.
    - ~~Selenium Conference~~.
      - Archive.org "Selenium Conference" ( - 2021-02-27 ) - “Bengaluru, India. September 10 - 12, 2020” & “Chicago, USA. Postponed to 2021”.
      - Archive.org "Selenium Conference" ( - 2019-12-02 ).
        
        “Bengaluru, India. June 18-20, 2020”.
        
        “Berlin 2017”.
    - SeleniumConf Berlin 2017 in Berlin, 2017-10-09 - 2017-10-10.
    - SeleniumConf Chicago in Chicago, USA, 2018-10-18 - 2018-10-19.
    - SeleniumConf Tokyo in Tokyo, Japan, 2019-04-18 - 2019-04-19.
    - SeleniumConf London in London, UK, 2019-10-07 - 2019-10-08.
    - Selenium Conference India.
  - Videos YouTube "Selenium Conference" - 2019 ( London ), 2018 ( Chicago ), 2017 ( Berlin & Austin ), 2015 ( Portland ).
- Language driver APIs:
  - Python.
  - Java.
    - Github.io "JavaDoc API".
  - C#
  - Ruby.
  - Javascript (Node).
- Resources for the legacy Selenium 1 RC:
- Resources for Selenium 2 WebDriver:
  - Google Code Wiki "selenium" - "FrequentlyAskedQuestions".
  - Selenium HQ Browser Automation "Documentation".
    - Selenium HQ Browser Automation "Documentation / Selenium WebDriver".
    - Selenium HQ Browser Automation "Documentation / WebDriver: Advanced Usage".
  - Corey Goldberg "Python - Getting Started With Selenium WebDriver on Ubuntu/Debian".
  - Baiju Muthukadan "Selenium with Python".
    - Baiju Muthukadan "Selenium with Python / 4. Locating Elements".
  - Selenium Tutorial.
    - Selenium Tutorial "Selenium-2 / Webdriver / Python".
  - Sauce Labs "Automated Testing Tutorials".
  - Simeon Visser "Running Tests in Python with Selenium 2 and WebDriver".
  - Stack Overflow "How to use Selenium with Python?".
  - YouTube "Selenium For Pythonistas".
  - How to catch a link on a website ?
    - Read The Docs " Selenium Python Bindings 2 Documentation - 4. Locating Elements" - “find_element_by_xpath”
    - Selenium IDE - Users "how to identify xpath for a link?"
      - xpath=//a[text()="Pizza Hut"] or xpath=//a[@href="http://yoururl"]
    - Stack Overflow "Xpath for href element".
      - selenium.click("css=a[href*='listDetails.do'][id='oldcontent']")
      - selenium.click("xpath=//a[contains(@href,'listDetails.do') and @id='oldcontent']")
- Resources for XPATH:
  - See Databases, Webserver, Webservices, SQL, XML.
- Browser plugins:
  - The Firefox browser plugin SeleniumHQ "Selenium IDE".
  - The Firefox browser plugin SelBlocks (for Selenium IDE).
    - Refactoror Wiki "Selblocks Reference".
    - Selblocks may use blocks of data in Json or XML format, stored in files. However, the script export of “Selenium IDE” doesn´t work with recordings using “Selblocks” features .
  - The MSIE browser plugin Google Code "InternetExplorerDriver standalone server for 32-bit IE".
  - With the browser plugin for Chrome, you may export recorded sessions in different target languages, e.g. “Python 2”.
- Cloud Services.
  - Sauce Labs.
    - “Run your web and mobile app tests across hundreds of real browsers and platforms instantly”.
    - “Run your Selenium tests in the cloud”.
    - Sauce Labs - Pricing - There is a free account with “30 manual minutes, 100 Win/Linux/Android minutes, 40 Mac/iOS minutes” per month.
- The Opensource Bromine, SourceForge "Bromine", SourceForge "Bromine" for Java and PHP.
  - “Its lofty aim is to be the open source alternative to commercial tools (such as HP Quality Center)”.
  - “An open source QA tool that uses selenium RC as its testing engine. It provides project management, OS/browser specification, test-case creation as well as user management”.
- The OpenSource Google Code "aost - Tellurium Automated Testing Framework".
  - EN.Wikipedia "Tellurium (software)".
- The OpenSouce OpenQA "CubicTest" - “Functional web testing”, “A graphical Eclipse plug-in for writing Selenium and Watir tests”.
  - EN.Wikipedia "CubicTest".

Selenium with Geb

Geb - ”(pronounced “jeb”). Very groovy browser automation… web testing, screen scraping and more”.
GitHub "Geb".
- GitHub "geb/geb-example-gradle" - “An example project for using Geb in a Gradle build (Spock and JUnit 4)”.
Entwicklertag Karlsruhe "Spock und Geb: Übersichtlich und nachvollziehbar Testen für alle!".
Experts told me, that the option ”@stepwise” of “Geb” is important for Selenium debugging to process the tasks one after another in a forced and determined sequence.

Selenium with Codeception

The OpenSource Selenium-based PHP framework Codeception, GitHub "Codeception Testing Framework".

SOAPSonar

Crosscheck Networks "SOAPSonar" - “Global Leader in Service and API Testing. HTML, XML, SOAP, REST, and JSON. Test over HTTP/s FTP/s, SFTP, IBM MQ, Tibco EMS, Weblogic JMS. Functional, Automation, Performance, Compliance, and Security Testing. Comprehensive out-of-the box standards support for OASIS and W3C standards”]].
- The free Crosscheck Networks "SOAPSonar Personal Edition (Free)".

SoupUI

The OpenSource web service testing application for service-oriented architectures (SOA) and representational state transfers (REST) SoupUI, SourceForge "SoupUI", SourceForge "SoupUI" by Smart Bear Software, Inc..
SoapUI "API Testing Dojo".
EN.Wikipedia "SoapUI", DE.Wikipedia "SoapUI".

Some other Tools

The free Add-ons for browsers (IE, Firefox, Chrome) iOpus GmbH "iMacros" - “The unique tool for instant Web Automation, Web Testing & Data Extraction”.
- iOpus GmbH - iMacros Feature Comparison Chart.
- EN.Wikipedia "iMacros"
The OpenSource Watir - “A family of Ruby libraries for automating web browsers”, “They support Internet Explorer on Windows, Firefox and Chrome on Windows, Mac and Linux and Safari on Mac”.
- EN.Wikipedia "Watir".
The “fast” OpenSource Canoo WebTest in Java.

Online Services

BrowserStack - “Live, Web-Based Browser Testing. Instant access to all real mobile and desktop browsers. Say goodbye to your lab of devices and virtual machines”.
- EN.Wikipedia "BrowserStack".
Sauce Labs.
- EN.Wikipedia "Sauce Labs" - “Cloud-hosted, web and mobile application automated testing platform company”.

Web Automation by direct HTTP Automation

twill: a simple scripting language for Web browsing - “twill supports automated Web testing and has a simple Python interface”.
WebRat - “Webrat - Ruby Acceptance Testing for Web applications”.
Selenium Browser automation framework, HtmlUnitDriver.

Windows Macro Recorders

Basics

Many Windows macro recorders work on Vista / Win7 just with deacitivated UAC ( EN.Wikipedia "User Account Control", DE.Wikipedia "Benutzerkontensteuerung" ).

Tools

AutoHotkey.
- The OpenSource AutoHotkey, SourceForge "AutoHotkey - Automation and Hotkeys", SourceForge "AutoHotkey - Automation and Hotkeys" for Windows - “Mouse and Keyboard Macro Program with Hotkeys and AutoText” #.
  - AutoHotkey Documentation "#IfWinActive / #IfWinExist" - “Variable references such as %Var% are not currently supported. Therefore, percent signs must be escaped via `% to allow future support for them.” .
  - AutoHotkey "Frequently Asked Questions (FAQ)".
  - AutoHotkey "Unofficial AutoHotkey FAQ".
  - AutoHotkey "Tutorial".
  - AutoHotkey Forums "AutoHotkey as an automation testing aid tool".
- The OpenSource “AutoHotkey_L”.
  - autohotkey.net.
    - The OpenSource AutoHotkey_L,
  - GitHub "Lexikos".
    - GitHub "Lexikos / AutoHotkey_L" - “Continuation of Chris Mallett's AutoHotkey, by Lexikos. http://ahkscript.org/”.
  - AHKScript.org - “A new community founded by a number of enthusiasts to promote the use of AutoHotkey”.
- EN.Wikipedia "AutoHotkey", DE.Wikipedia "AutoHotkey".
- Video YouTube "Using AutoHotKey For Windows Macro Recording".
The free Jonathan Bennett & AutoIt Consulting Ltd "AutoIt" - “Automation and Scripting Language” #.
- Jonathan Bennett & AutoIt Consulting Ltd - AutoIT Wiki.
- EN.Wikipedia "AutoIt", DE.Wikipedia "AutoIt".
The free AutomaticSolution Software "GhostMouse".
The free bitdreamers - quality driven solutions "TimeComX Basic".
- freeware.de "Windows Automatisierung Freeware".
The free Free Labs Software. "Windows Macro Recorder".
The free Gentee, Inc "Perfect Automation".
- The OpenSource programming language Gentee, SourceForge "Gentee Programming Language", SourceForge "Gentee Programming Language".
- FR.Wikipedia "Gentee".
The free Donationware Thierry Haurie "Smart Automatic Test ( SAT )".
Mag. Marina Hintenaus ( = “Walter Hintenaus” ).
- The free Mag. Marina Hintenaus "Makro".
Hitek Software LLC.
- The free Fileguru "AceMacro 2.0".
S. Senthil Kumar.
- The free S. Senthil Kumar "WinMacro. A Macro Recorder/Player for Windows" - “WinMacro v1.2.1”.
- CodePlex "WinMacro" → certificate installation required .
The free Donationware Anthony Mathews "MacroMaker".
The free MyBits Home, Alexander Bolli "GhostHand ".
The free Neowise Software "RoboTask Lite - Freeware automation utility".
The free Phantom Automated Solutions "Phantom Automation" for Windows.
- ~~EN.Wikipedia "Phantom automation language"~~.
- EN.Wikipedia "User:Aeroslacker/Phantom automation".
Archive.org "Detlef Schaefer - freewarehits.de".
- The free Archive.org "Detlef Schaefer 'RemoteKeys'".
- CHIP Online "RemoteKeys 8.7".
The free Donationware Spacetornado Software "Do It Again".
Vista Software - Free Software Tools.
- The free tools “TinyTask”, “TyperTask”.
The free ZenCODE "ZenKEY".

Windows Automation & Batch Systems

KiXtart.
- The free KiXtart - “A free-format scripting language and has rich built-in functionality for easy scripting. It supports COM (providing access to ADSI, ADO, WMI, etc) and thus is easily extensible”.
- The free KiXforms - “The most powerful graphical plug-in for the popular KiXtart scripting language”.
- EN.Wikipedia "KiXtart", DE.Wikipedia "KiXtart".
The free ThinBasic - passion powered script interpreter for Windows.
- EN.Wikipedia "ThinBasic".

Macro Recorders in Desktop Applications

The Macro Recorder in OpenOffice

OpenOffice Wiki "Using the macro recorder".

Just-Commercial GUI Testing Tools / Capture & Replay Tools

Web, Windows, WPF, HTML5, Flash, Flex, Silverlight, .NET, VCL and Java

SmartBear Software "Automated Testing - TestComplete".
- EN.Wikipedia "TestComplete" - “It automates front-end UI/functional testing and back-end testing like database testing”.
- Twitter "TestComplete".

Java & Web

QF-Test - “Das GUI Testtool für Java und Web”.

.NET

Telerik.
- Telerik "Test Studio" ( formerly: “Telerik WebUI Test Studio” ) - “Functional Testing ( HTML, Silverlight, AJAX, WPF ), Load Testing, Performance Testing, Testing in Visual Studio, Explorative Testing, Manual Testing, Mobile Testing”.
Automated UI tests for WPF projects with Visual Studio.
- Microsoft MSDN Library "Testing the User Interface with Automated UI Tests" - “You can use Visual Studio 2010 Ultimate or Visual Studio 2010 Premium to create automated tests of the user interface (UI) known as coded UI tests”.

Windows & Windows GUI

AutoIt Consulting Ltd "AutoIt" - “AutoIt v3 is a freeware BASIC-like scripting language designed for automating the Windows GUI and general scripting”.
Automation Anywhere, Inc, Automation Anywhere, Inc. ( previously known as Tethys Solutions, LLC. ).
- Automation Anywhere, Inc. "Testing Anywhere".
  - Supportet test types:
    - Automated Software Testing.
    - Automated Load Testing.
    - Cross-browser Testing.
    - Regression Testing.
    - Black Box Testing.
    - Keyword-driven Testing.
    - Smoke Testing.
    - Compatibility Testing.
    - System Testing.
    - Automated Flex Testing.
    - Mainframe Application Testing.
    - WPF Testing.
    - Automated Mobile Testing.
    - Automated Web Testing.
    - Distributed Load Testing.
    - Functional Testing.
    - Acceptance Testing.
    - Data-driven Testing.
    - Integration Testing.
    - Performance Testing.
    - GUI Testing.
    - Silverlight Application Testing.
    - Java Application Testing.
    - Automated Unit Testing.
- Twitter "Testing Anywhere".
- SlideShare "Automation Anywhere".
- EN.Wikipedia "Automation Anywhere", EN.Wikipedia "Testing Anywhere".
Hewlett-Packard ALM → See Application Lifecycle Management ( ALM ).
IBM.
- IBM Rational Functional Tester.
- IBM Rational Robot ( formerly: Rational Teamtest, SQA Teamtest ).
  - IBM developerWorks "Rational Robot".
- ~~IBM Rational Visual Test~~ (formerly: ~~Microsoft Visual Test~~, ~~MS Test~~).
  - EN.Wikipedia "Visual Test".
Micro Focus International.
- Borland - A Micro Focus Company "SilkTest" ( once a Borland product, then supplied by Micro Focus International, now by Borland again ).
  - EN.Wikipedia "SilkTest".
- MicroFocus TestPartner ( formerly: Compuware TestPartner ).
  - EN.Wikipedia "TestPartner".
  - SilkCentral Test Manager ( SCTM ).
- ~~Micro Focus QARun~~ ( formerly: ~~Compuware QARun~~ ).
Oracle.
- Oracle Enterprise Manager ( formerly ~~Empirix e-TEST~~, ~~RSW e-TEST~~, Oracle Enterprise Manager ).
  - Oracle and Empirix - “Oracle has aquired the e-TEST suite products from Empirix”.
Ranorex GmbH "Ranorex - Next Generation Automated Testing" for Windows.
- GUI Testing of .NET Application on Windows and of GUI testing of Labview applications.
- EN.Wikipedia "Ranorex".

Windows Macro Recorders

Basics

Many Windows macro recorders work on Vista / Win7 just with deacitivated UAC ( EN.Wikipedia "User Account Control", DE.Wikipedia "Benutzerkontensteuerung" ).

Tools

AutoIt Consulting Ltd "AutoIt" - “AutoIt v3 is a freeware BASIC-like scripting language designed for automating the Windows GUI and general scripting”.
Automation Anywhere, Inc, Automation Anywhere, Inc. ( previously known as Tethys Solutions, LLC. ).
- Automation Anywhere, Inc. "Workspace Macro recorder" - Free trial software version available.
- Automation Anywhere, Inc. "Automation Anywhere" - “The Intelligent Automation Software. Automate & Schedule business processes & IT tasks easily”. Free trial software version available.
- Automation Anywhere, Inc. "Compare Our Macro Software & Automation Software".
- SlideShare "Automation Anywhere".
- EN.Wikipedia "Automation Anywhere", EN.Wikipedia "Workspace Macro".
Chosen Software "Journal Macro" - Free trial software version available.
Gintaras Didzgalvis "Quick Macros".
GoldSolution Software, Inc. "Easy Macro Recorder".
Graphical Dynamics, Inc. "AutoIntern" - “Small-Business Process Automation”. Free trial software version available.
GrassSoftware.
- GrassSoftware "Macro Expert" - Free trial software version available.
- GrassSoftware "Advanced Key and Mouse Recorder" - Free trial software version available.
Hitek Software LLC "Automize" - Free trial software version available.
Insight Software Solutions, Inc. "MacroExpess - The Windows Automation Tool" - Free trial software version available.
- EN.Wikipedia "Macro Express".
Jitbit Software.
- Jitbit Software "Macro Recorder", "Macro Recorder LITE" - Free trial software version available.
- Jitbit Software "Free Macro Recorder".
Michael Milawski Software "MacroX - Automatisierungssoftware für Windows" - Free trial software version available.
MJT Net Ltd - Free trial software version available.
- MJT Net Ltd "mjtnet Macro Scheduler - Windows Automation Made Easy".
- MJT Net Ltd "Mouse Recorder".
Neowise Software "RoboTask" - Free trial software version available.
Readmesoft Company, Inc. "Auto Macro Recorder" - Free trial software version available.
Vista Software "vTask Studio" - Free trial software version available.
Softomotive Ltd "WinAutomation" - “The most advanced Windows Automation app, featuring a Macro Recorder and a Web Recorder”. Free trial software version available.

Windows Automation & Batch Systems

WinBatch, the Batch Language for Windows.

Macro Recorders in Desktop Applications

The Macro Recorders in Microsoft Excel

About.com "Excel 2003 Macro Tutorial".
#1 Source for Excel macros on the net "Excel Macro Recorder".
Dummies.com - Make everything easier "How to Record a Macro to Automate Tasks in Excel 2010".
Cookbook instructions for development of Excel automation solutions:
1. Use the built-in macro recorder of Excel to do what you want to do automatically.
2. Modify the recorded VBA code to make it run indepedantly. Especially replace all “Select” instructions.
Literature selection tip: Get a book which deals with both Excel & VBA automation, instead of a book about Excel ( wnich might handle macros in one of the last chapters, and enventually Excel automation with VBA not at all ) and another book about VBA ( which might not deal with the specialties of Excel automation ).

The Macro Recorder in Microsoft Visual Studio

MSDN Library "Visual Studio Macros" for Visual Studio 2005.

The Macro Recorder in Microsoft Word

Addons

The free QA-Tools GmbH "SmarTest Framework" for use with commercial capture & replay tools.

OpenSource Software for End-to-End Testing of Databases

ORAYLIS BI.Quality

CodePlex "ORAYLIS BI.Quality".
I was told that “ORAYLIS BI.Quality” was popular, until ist was superceded by “NBi”.

NBi

The Tool

NBi, GitHub "Seddryck/NBi", CodePlex "NBi".
- NBi "Getting started with genbiL" - “GenbiL is a language to automate the generation of test suites through Genbi”.
- “Genbi” generates the necessary XML from templates.
Twitter "Cédric L. Charlier, @Seddryck".
Ambiguity vs Information. A journey in a world made of data, information, knowledge and wisdom.
- Ambiguity vs Information. A journey in a world made of data, information, knowledge and wisdom: "Testing a Power BI Desktop solution with NBi".

Resources

NBi makes use of NUnit as job runner.
Experts suggested to use “Visual Studio Professional” with commercial “Integration Services” package. By that, you may call NBi by a “Control Flow” to provide workflow automation.
Jonathon Eve-O'Connor's Blog "Setup Unit Testing with NUnit & NBi".
Slides SlideShare "Automating the testing of your bi solution with NBi".

Model-based Testing of Embedded Control Systems

The commercial PikeTec GmbH "TPT".
- Tests.
  1. Test of MATLAB/Simulink models and TargetLink models test and verification of MATLAB Simulink models and TargetLink models.
  2. Test of ASCET models test and verification of ASCET models.
  3. Test of AUTOSAR software test and verification of AUTOSAR Software.
  4. Test of C-Code test and verification of C-Code, C-Programs.
  5. Test via CAN-Bus test and verification via CAN-Bus.
  6. Test via INCA und CANape test and verification via INCA and CANape.
  7. Test at HiL.
- EN.Wikipedia "TPT (software)", DE.Wikipedia "TPT (Software)".

Resources

EN.Wikipedia "Test management tools".

Test Anything Protocol ( TAP )

Test Anything Protocol ( TAP ).
- “A simple text-based interface between testing modules in a test harness. It decouples the reporting of errors from the presentation of the reports. One of its major uses is for noise reduction; when you have a suite of many tests, making them TAP producers and using a TAP consumer to view them helps ensures that you will see everything you need to notice and diagnose breakage without being distracted by a flood of irrelevant success messages. It can assist other forms of analysis and statistics-gathering as well”.
- “TAP started life as part of the test harness for Perl but now has implementations in C, C++, Python, PHP, Perl, Java, JavaScript, Go, Rust, and others. Consumers and producers do not have to be written in the same language to interoperate”.
Python.
Lua:
- See Lua & eLua.
EN.Wikipedia "Test Anything Protocol".

TTCN-3

Commercial TTCN Testing Tools

Elvior LLC "TTCN-3 Products".
- The free online TTCN-3 verification service Elvior LLC "TTCN-3 verification service".
IBM Rational.
- IBM Rational TTCN Suite.
- IBM Rational Systems Tester ( formerly: Telelogic Tester ).
- IBM developerworks "Downloads, trials, and cloud. Evaluation software for developers".
- Experts told me, that from their point of view there was no major development of “Telelogic Tester” since it was acquired by IBM .
TestingTech.
- TestingTech - "TTworkbench - The Reliable Test Automation Platform", free trial version is available for download.

Resources

ISO / IEC 9646-4: 1994.
EN.Wikipedia "TTCN", DE.Wikipedia "TTCN".
ETSI's official TTCN-3 home page.
Andrej Pietschker, XING "Andrej Pietschker", LinkedIn "Andrej Pietschker":
- Hannover Fair - Forum Industrial IT "Andrej Pietschker: Model-basierte Sicherheitstests - Ergebnisse eines EU Forschungsprojektes" - About TTCN-3.
ITU-T Z.140 "The Tree and Tabular Combined Notation version 3 ( PDF ).

YAML - YAML Ain't Markup Language, RAML, TAML,...

YAML Resources

EN.Wikipedia "YAML", DE.Wikipedia "YAML".
YAML.Org - “The Official YAML Web Site”.
- YAML.Org "YAML™ Specification Index".
kwiki "YAML"
- kwiki "YAML" - "Yaml In Five Minutes".
Tore Haug-Warberg.
- Tore Haug-Warberg "Yaml Cookbook".
PyYAML.org - “The home of various YAML implementations for Python”.
- BitBucket "xi / pyyaml" - “PyYAML - The next generation YAML parser and emitter for Python.”.
- BitBucket "xi / libyaml" - “LibYAML - A C library for parsing and emitting YAML”.
IBM "developerWorks / XML / Technical library" - "XML Matters: YAML improves on XML".

RAML ( RESTful API Modeling Language )

See Representational State Transfer ( REST ).

YAML Software

Kwalify - “schema validator and data binding for YAML/JSON”.
- Sourceforge "Kwalify", Sourceforge "Kwalify" - implementation in Java.
java.net "JvYAML" - “A Java YAML 1.1 parser and emitter”.
Google Code "snakeyaml" - “YAML parser and emitter for Java”.

Free YAML Online Services

Swagger → See Representational State Transfer ( REST ).

TAML

Tools

TOML [Tom's Obvious Minimal Language] - “A config file format for humans”.

Resources

Dynamic Code Analysis

EN.Wikipedia "Dynamic program analysis".

Test Concept for Embedded Systems

Test Concept #1 - One-way Communication

Test Concept #1 - The classical "printf()"

Use “printf()” by an URART to a remote console on the host. In case of multithreading, multitasking this is sometimes the best quick + dirty solution.

Test Concept #1.2 - "Spy" Function of an RTOS

A “spy” function of an RTOS sends a binary, but ordered or tagged, data stream to the PC (via serial, USB, Ethernet, wireless, etc.) and the PC decodes it for capture and/or display. An advanced diagnostic tool might send this binary data over Ethernet to be captured by Wireshark and IIRC ( a custom filter within Wireshark ).

Test Concept #2 - Unit Test with Hardware Emulation

Write a test for any module that will exercise the function at edge and corner cases.
If the module code accesses hardware in the production version,
1. Either supply adequiate hardware signals to the device under test ( Hardware in the Loop ( HIL ) ).
2. And / or emulate the hardware and its input and output ( just use an if-query not to access hardware if the code is tested, bzt
  1. to use predefined static values.
  2. to use calculated values.
  3. to use values provided by a state machine.
  4. or values transfered from a host, which generates the values by a script, a calculation or with the help of a state machine.
You might use test concept #1 for one-way communication.
Somehow you have to start your tests, by uploading code which executes the tests instead of executing the application.

Test Concept #3 - Script Languages

Test Concept #3.1 - Script Language on the Target

Test Concept #3.1.1 - Dialog by a classical Monitor

Implement and use an on-target monitor ( e.g. “debug.com” or a monitor running in the firmware ) to transfer informations by UART to a remote console on a host.

Test Concept #3.1.2 - Application-specific Script Language on the Target

Design a “command language” and a parser to run on the device and its application under test, so that the interface to the module functions can be triggered with various values.
The input to that device under test could be scripted.

Test Concept #3.2 - Script Language on the Host

Install a script language ( Python, Perl,..) which can work by serial communications.
The target “opens” a new console on the host and executes script command by its own output.

Test Concept #3.3 - Script Language both on the Host and the target

Combine concept #3.1.2 and #3.2 to let interact 2 applications by a common interface and interface language.

Some other Test Concepts

Blinded Experiment

EN.Wikipedia "Blinded experiment", DE.Wikipedia "Blindstudie" ( “Blindtest” ).
In German language for technical “Blinded Experiments”:
- “Ein Blindversuch ist ein Vorversuch unter den gleichen Bedingungen wie das endgültige Experiment durchgeführt wird, ohne das das eigentliche Untersuchungs-Objekt hinzugenommen wird. Und wenn das erste Objekt den Vorversuch besteht, kann das eigentliche Experiment zu den gleichen Voraussetzungen gestartet und zum Abschluss gebracht werden. Wichtig: Es darf nicht das selbe Objekt sein, es müssen 2 ( gleiche ) Objekte sein: Das Test-Objekt und das Untersuchungs-Objekt. Der erste wird getestet und dann wird der gleiche Versuch mit dem zweiten Objekt durchgeführt”.

Magazines

Diaz & Hilterscheid Unternehmensberatung GmbH.
- Agile Record - The Magazine for Agile Developers and Agile Testers - free PDF and paper magazine.
- testing experience - The Magazine for Professional Testers - free PDF and paper magazine.
  - “testing experience”, PDF issue “December 2010” - Open Source Tools”.
CrossTalk - Journal of Defense Software Engineering by Software Technology Support Center & Department of Defence ( DOD - free PDF magazine.

Books

General

Andreas Spillner.
- Book Andreas Spillner, Tilo Linz: "Basiswissen Softwaretest: Aus- und Weiterbildung zum Certified Tester - Foundation Level nach ISTQB-Standard".
- Book Andreas Spillner, Thomas Roßner, Mario Winter, Tilo Linz: "Praxiswissen Softwaretest - Testmanagement, Aus- und Weiterbildung zum Certified Tester - Advanced Level nach ISTQB-Standard".
Martin Pol, polteq.
- polteq "Test (Process) Improvement" ( TPI ).
- polteq "Management und Optimierung des Testprozesses" - “Mit TMap (Test Management Approach) wird eine seit Jahren erfolgreich beim Testen eingesetzte Vorgehensweise an Hand vieler Beispiele erläutert. TPI (Test Process Improvement) bietet de Möglichkeit, einen bereits praktizierten Testprozess zu analysieren und zu optimieren. Beide Ansätze bauen aufeinander auf und ergänzen sich”.
- Book Martin Pol, Tim Koomen, Andreas Spillner: "Management und Optimierung des Testprozesses".
Parasoft.
- The free PDF book Parasoft "End-to-End Testing. Simplify Complex Testing Across APIs, Cloud, SOA, and Composite Apps" → Parasoft "End-to-End Testing. Simplify Complex Testing Across APIs, Cloud, SOA, and Composite Apps" ( PDF ).
- The free PDF book Parasoft "Techniques for Unit Testing Embedded Systems Software" → Parasoft "Techniques for Unit Testing Embedded Systems Software" ( PDF ).

Books about Software Testing

Book Steve Freeman, Nat Pryce: "Growing Object-Oriented Software, Guided by Tests" - I was told that this book explains the use of testing & TDD by non-trivial but simple software project throughout the complete book #.