====== [hemmerling] Testing ====== Related pages: *[[alm.html|Application Lifecycle Management ( ALM )]]. *[[ci.html|Continuous Integration ( CI ) & Continuous Delivery ( CD )]]. *[[codingdojo.html|Coding Dojo / Coding Kata / Randori / Code Retreat / Object Calisthenics / Hackathons / Hackfests / / Programming Marathons / Elephant Carpaccio Exercise - Group-Awareness, Self-Awareness, Self-Training in Software Development as well as Developer Contests & Developer Challenges]]. *[[crowdtesting.html|Crowdtesting]]. *[[fizzbuzz01.html|Coding Dojo / Coding Cutter: How to play Kata FizzBuzz with JUnit]]. *[[fizzbuzz02.html|Coding Dojo / Coding Cutter: How to play Kata FizzBuzz with NUnit]]. *[[goodcoding.html|Good Coding ! - Software Coding, Coding Rules, Static Code Analysis, Code Reviews]]. *[[requirements.html|Requirements]]. *[[sdocumentation.html|Software Documentation]]. *[[specbyex.html|Specification by Example, Modelling by Example]]. *[[systemdesign.html|System Design]]. *[[de:testhub.html|Testhub]]. *[[unittest.html|Unit Test / Module Test]]. *[[wscripting03.html|Scripting Programming Languages for Windows 3/3 - Testing with Windows PowerShell]]. ===== Organizations ===== *[[http://www.asqf.de/|ASQF e.V. - Arbeitskreis Software-Qualität & -Fortbildung e.V.]]. *[[http://www.bcs.org/|British Computer Society ( BCS )]], UK. *[[http://www.iseb.org.uk/|Information Systems Examination Board ( ISEB )]] - "The Information Systems Examinations Board (ISEB) is part of BCS". *Blog [[http://www.bcs.org/server.php?show=ConBlog.2|oddIT Blog]]. *[[http://www.gasq.org/|Global Association for Software Quality]] ( gasq ). *[[http://german-testing-board.info/|German Testing Board e.V.]]. *[[https://www.gi-ev.de/|Gesellschaft für Informatik e.V. (GI)]]. *[[http://www.gm.fh-koeln.de/~winter/tav/|Gesellschaft für Informatik e.V., Fachgruppe TAV (Test, Analyse und Verifikation von Software)]] ( GI FG TAV ). *[[http://www.dlgi.de/|DLGI - Dienstleistungsgesellschaft für Informatik mbH]]. *[[http://www.isqi.org/|International Software Quality Institute ( iSQI )]]. *[[http://www.isqi.org/en/certification/|iSQI Certification]]. *[[http://www.qamp.org/|QAMP - Quality Assurance Management Professional]]. *[[http://www.agile-tester.org/|iSQI - International Software Quality Institute GmbH "Agile Certified Tester"]]. *[[http://www.ntaforum.org/|The Network Test Automation Forum ( NTAF )]] - It "was created to promote the interoperability of commercial testing tools and test infrastructure for the data communications and telecommunications industry". *[[http://www.vivit-worldwide.org/|Vivit]] - "The independent, non-profit service organization that represents the broad HP Software community.. Membership is free". *Vivit TQA. *[[http://www.vivit-tqa.org/|Vivit TQA: Testing, Quality, Application Lifecycle Management]] ( - 2011 ). *[[http://www.vivit-worldwide.org/group/TQAL|Vivit "Special Interest Group: Testing Quality and ALM"]] ( Vivit TQA ). *[[http://vivitworldwide.site-ym.com/members/group.aspx?id=80113|Vivit Chapter Germany]], [[http://www.vivit-germany.org/|Vivit-Germany]]. *Blog [[http://www.vivit-worldwide.org/blogpost/701724/Vivit-Blog|Vivit Blog]]. *Events: *[[http://www.vivit-worldwide.org/events/event_list.asp?show=past&group=79943|Vivit "Community Calendar - Special Interest Group: Testing Quality"]]. *[[http://www.vivit-worldwide.org/events/EventDetails.aspx?id=838104|Vivit "User Group Treffen 'Testmanagement und agile Entwicklung mit HPE ALM.net / Quality Center und HPE ALM Octane'"]], 2016-09-01 in Hannover - I participated :-). *[[http://www.vivit-worldwide.org/events/event_details.asp?id=622360&group=79943|Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'"]], 2015-04-14. *[[http://www.vivit-worldwide.org/events/event_details.asp?id=527205&group=79943|Vivit TQA, Germany "User Group Treffen 'Testautomatisierung: Einführung, Ausweitung und Tool-Unterstützung'"]], 2014-12-09. *[[http://www.vivit-worldwide.org/events/event_details.asp?id=480896&group=79943|Vivit TQA, Germany "Vivit TQA beim Vivit Deutschland Treffen 2014"]], 2014-09-30 - 2014-10-01. *[[http://www.vivit-worldwide.org/events/event_details.asp?id=480335&group=79943|Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'"]], 2014-09-04. *[[http://www.vivit-worldwide.org/events/event_details.asp?id=414305&group=79943|Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'"]], 2014-04-03. *[[http://www.vivit-worldwide.org/events/event_details.asp?id=338441&group=79943|Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'"]], 2013-09-25. *[[http://www.vivit-worldwide.org/events/event_details.asp?id=296617&group=79943|Vivit TQA, Germany "User Group Treffen 'Testen & Test-Management mit HP'"]], 2013-04-18. *[[http://www.vivit-worldwide.org/resource/collection/FAC4D5E5-531C-4F23-9E7A-EB7FCD8A9537/20120418_Oestereich_API-Programmierung.pdf|Vivit TQA, Germany "API-­‐Programmierung und –Nutzung bei HP Quality Center / ALM"]] ( PDF ). ===== Fairs, Conferences, Events ===== *[[http://www.germantestingday.info/|German Testing Day]]. *The virtual conference [[http://webcon.germantestingday.info/|German Testing WebCon – Die virtuelle Konferenz zu Software-Qualität]], 2020-05-15. *[[http://www.gotomeeting.com/de-de/webinar/webinar-beitreten|GotoMeeting]]. *Raum-ID "259-138-043" ( Raum 1 ). *Raum-ID "629-244-715". *Raum-ID "927-682-555". *Raum-ID "996-665-707". *[[http://www.germantestingnight.de/|German Testing Night]], 2014-03-27, 2014-07-01. *[[http://www.germantestingnight.de/docs/2014/GTN-2014-03_APietschker_Test-als-Requirements.pdf|German Testing Night 2014-03-27 "Giesecke&Devrient, Andrej Pietschker: Tests als Requirements - Brücke zwischen Entwicklung und Systemtest bauen"]]. *[[http://www.testing-expo.com/europe/german/|Automotive Testing Expo Europe]], Stuttgart. *[[http://h22166.www2.hpe.com/calendar_hpe.aspx?COMPID=HPE&cc=de&lang=de|Hewlett Packard Enterprise "Veranstaltungskalender"]]. *[[http://h22166.www2.hpe.com/Event/EventPage.aspx?cc=de&lang=de&eventid=OQAxADAAMQA1AA==|Hewlett Packard Enterprise "HPE ALM Octane Launch Roadshow"]], 2016-06-08 in Berlin. *[[http://ucaat.etsi.org/|UCAAT - User Conference on Advanced Automated Testing]] in München, 2014-09-16 - 2014-09-18. *[[http://www.xpdays.de/|XP Days Germany - Mitmach-Konferenz für Exteme ProgrammiererInnen]], Hamburg ( 2012-11-29 - 2012-12-01 ). *[[http://www.softwerkskammer.org/activities/workshop_js_testautomatisierung|Softwerkskammer "Workshop: Javascript-Frameworks für Testautomatisierung"]] in Frankfurt, 2014-08-21. *Alexei Vinogradov, [[htp://www.alexei-vinogradov.de/|Alexei Vinogradov]], [[http://www.xing.com/profile/alexei_vinogradov2|XING "Alexei Vinogradov"]], [[http://de.linkedin.com/in/vinogradov|LinkedIn "Alexei Vinogradov"]]. *[[http://www.github.com/vinogradoff|GitHub "vinogradoff"]]. *[[http://www.github.com/vinogradoff/nightwatch-workshop|GitHub "vinogradoff/nightwatch-workshop"]]. *Kahlil Lechelt, [[http://www.kahlil.co/|Kahlil Lechelt]], [[http://www.xing.com/profile/Kahlil_Lechelt|XING "Kahlil Lechelt"]], [[http://de.linkedin.com/in/kahlillechelt|LinkedIn "Kahlil Lechelt"]]. *[[http://www.github.com/distilledhype|GitHub "Kahlil Lechelt, distilledhype"]]. *[[http://www.github.com/distilledhype/softwerkskammer-dalekjs|GitHub "distilledhype/softwerkskammer-dalekjs"]]. *Tools I used on the event: -[[http://www.nightwatchjs.org/|Nightwatch.js]], [[http://www.github.com/beatfactor/nightwatch|GitHub "beatfactor/nightwatch"]]. -[[http://www.dalekjs.com/|DalekJS]], [[http://www.github.com/dalekjs|GitHub "DalekJS"]]. *Online seminar [[http://www.applitools.com/future-of-testing-mobile-north-america/|applitools "Future of Testing: Mobile. Virtual Event for Mobile Engineers"]], 2021-04-08, 9 am PT, 18:00 UTC+1. *[[http://www.guildconferences.com/events/future-of-testing-mobile-north-america/|GuildConferences "Future of Testing: Mobile. Virtual Event for Mobile Engineers"]] - Login. ===== Certification ===== *[[http://www.knowledge-department.de/|Knowledge Department GmbH & Co. KG.]]. *[[http://www.certified-tester-pruefung.de/|Knowledge Department GmbH & Co. KG. "Certified Tester Probeprüfung"]] - free test of knowledge, usful before taking a paid test. *[[http://www.agile-tester.org/|Certified Agile Tester]]. ===== Testing Experts ===== *[[http://www.grahammaxfield.com/|Graham Maxfield]], Germany. *[[http://www.xing.com/profile/Graham_Maxfield|XING "Graham Maxfield"]] - "Checking is not testing. Testing is more than checking" :-). ===== Crowdtesting Jobs ==== *See [[crowdtesting.html|Crowdtesting]]. ===== Basics ===== *Explorative testing = Manual testing, with testplan. ==== Questions about the Testing of Embedded Software ==== -How to test embedded software ? Under the conditions -Most of the code is machine-dependent, i.e. a function to be tested accesses hardware ( reads and writes registers, while the results depend on external conditions and events ). -Resources ( RAM,.. ) are limited, in comparison to the well-known standard of deskop PCs. -Use of standard ( free, OpenSource, commercial )Test frameworks and especially Unit Test frameworks. ==== Mockup - Simulation of Objects ==== *See [unittest.html|Unit Test / Module Test]]. ==== Unit Test vs Functional Test ==== *[[http://www.educba.com/unit-test-vs-functional-test/|EDUCBA "Unit Test vs Functional Test"]] - "Difference Between Unit Test vs Functional Test". ===== Keyword-based Testing ===== *[[http://en.wikipedia.org/wiki/Keyword-driven_testing|EN.Wikipedia "Keyword-driven testing"]], [[http://de.wikipedia.org/wiki/Keyword-Driven_Testing|DE.Wikipedia "Keyword-Driven Testing"]]. ===== Test-First Approach - UX-Driven Testing ===== ==== Test-First Approach ==== *The domain experts define the input mask of screens, of an IT application, plus the behaviour ( how to move from one screen to the next ), by simple tools, e.g. spreadsheets. The software developers are not involved. *If this is derived from the specification, it can be used also as guide for implementation by the software developers. *This is used also later for integration test. *Alternatively, the domain expert might build a rapid prototype, with little or no help by a software developer. ==== UX-Driven Testing ==== *The software is developed from point of view of the user, and his / her "user experience" ( UX ). ===== Property-based Testing ===== ==== Scala ( and Java ) ==== *[[http://www.scalatest.org/|ScalaTest]] - "Property-based testing for Scala". *[[http://www.scalatest.org/user_guide/property_based_testing|ScalaTest "Property-based testing"]]. ==== Haskell ==== *[[http://hackage.haskell.org/package/QuickCheck|Haskell "QuickCheck"]] - "Automatic testing of Haskell programs". *[[http://en.wikipedia.org/wiki/QuickCheck|EN.Wikipedia "QuickCheck"]]. ==== F# ==== *[[https://github.com/fsharp/FsCheck|GitHub "fsharp/FsCheck"]], [[http://fsharp.github.io/FsCheck/|GitHub.io "FsCheck"]]. *[[http://www.fsharpforfunandprofit.com/posts/property-based-testing/|F# for fun and profit "An introduction to property-based testing. Or, why you should be using FsCheck and QuickCheck"]]. ==== Javascript ==== *[[http://jsverify.github.io/|GitHub.io "JSVerify - Write powerful and concise tests"]]. ===== Instrumentation Frameworks for Dynamic Application Testing ===== *The OpenSource [[http://code.google.com/p/address-sanitizer/|Google Code "address-sanitizer" - "AddressSanitizer: a fast memory error detector"]] ( ASan ) - "It finds use-after-free and {heap,stack,global}-buffer overflow bugs in C/C++ programs". *[[http://clang.llvm.org/|clang: a C language family frontend for LLVM]]. *[[http://clang.llvm.org/docs/AddressSanitizer.html|Clang 3.6 documentation AddressSanitizer]]. *[[http://en.wikipedia.org/wiki/AddressSanitizer|EN.Wikipedia "AddressSanitizer"]] - "AddressSanitizer is currently implemented in Clang (starting from version 3.1) and GCC (starting from version 4.8)". *The OpenSource [[http://www.valgrind.org/|Valgrind]] - instrumentation framework for dynamic testing of applications written in C/C++ language, e.g. detection of memory leaks. ===== Test Mangement, Functional Test Tools, Automation Frameworks, GUI Testing Tools / Capture & Replay Tools ===== ==== Important Dynamic Code Analysis Tools / Tools for Dynamic Analysis Security Testing ( DAST ), according to VDC Research in 2015, 2016-08, 2018-08 ==== *RapiTime/RapiCover (Rapita Systems). *LDRA Testbed (LDRA). *SilkTest (Borland / Micro Focus). *HP. *HP Quality Center / ALM. *HP Security Fortify (HP). *Rational Test RealTime/Tau Tester (IBM Rational). *TestQuest (BSQUARE). *Cantata++ /AdaTEST (QA Systems). *Test Center (Keynote/DeviceAnywhere). *Parasoft C++test/Insure++/Standard Compliance (Parasoft). *MobileCloud (Perfecto Mobile). *Coverity. *Coverity Quality Adviser (Coverity) 2015-2016. *Coverity Dynamic Analysis (Coverity) 2018. *VectorCAST (Vector Software). *Veracode (Veracode), 2016-08 *SW-Assure (Monroe Software), 2016-08. ==== Some other General Test Management Tools ==== *The commercial [[http://www.casemaker.eu/|CASEMAKER]] - "If you are an “ISTQB Certified Tester” [[http://www.casemaker.eu/register.php|register now]] to receive a license for one month, free of charge, so you can see for yourself the advantage this tool will provide you in your daily application of the taught methods". *The free [[http://www.klaros-testmanagement.com/|klaros testmanagement Community Edition]] for Linux and Windows. *Integration with [[http://www.jenkins-ci.org/|Jenkins]] and with Hudson by [[http://wiki.jenkins-ci.org/display/JENKINS/Klaros-Testmanagement+Plugin|Jenkins plugin]] and Hudson plugin :-). *The free graphical editor for classification trees [[http://www.berner-mattner.com/en/berner-mattner-home/products/cte-xl/|Berner & Mattner "CTE XL"]] for Windows. *[[http://www.systematic-testing.com/|System Testing]] - "Functional Testing ( with CTE ), Evolutionary Testing, Static Analysis". *The Opensource [[http://www.teamst.org/|TestLink]], [[http://testlink.sourceforge.net/|SourceForge "TestLink"]], [[http://www.sourceforge.net/projects/testlink/|SourceForge "TestLink"]] - "Test case management tool". *[[http://en.wikipedia.org/wiki/TestLink|EN.Wikipedia "TestLink"]]. ==== Testdata Creation and Testdata Management ==== === Methods === *[[http://en.wikipedia.org/wiki/Fuzzing|EN.Wikipedia "Fuzzing"]], [[http://de.wikipedia.org/wiki/Fuzzing|DE.Wikipedia "Fuzzing"]] - "Fuzzing or fuzz testing is an automated software testing technique that involves providing invalid, unexpected, or random data as inputs to a computer program. The program is then monitored for exceptions such as crashes, failing built-in code assertions, or potential memory leaks". === Software === *The commercial testdata management system [[http://www.averna.com/solutions/mfg_test/proligent/|Averna Proligent]]. *The OpenSource [[http://www.damhave.com/FreeSourceCode/FreeSourceCode.html|Damhave Systems "sequence"]] - "A UNIX/Linux command line tool for generation binary or ASCII test sequences. Sequence is specially useful in bash scripts for test data generation when testing and debugging your own linux device drivers or playing with flash or MTD devices". *The OpenSource [[http://www.generatedata.com/|GenerateData.com]] - Open-source data generator script. ==== Integration & Automation Frameworks, Tools for functional Tests and Regression Tests ==== === .NET === *The OpenSource [[http://github.com/machine/machine.specifications|Github "machine / machine.specifications"]] - "A Context/Specification framework geared towards removing language noise and simplifying tests". *[[http://codebetter.com/aaronjensen/2008/05/08/introducing-machine-specifications-or-mspec-for-short/|CodeBetter.com, Aaron Jensen "Introducing Machine.Specifications (or MSpec for short)"]], 2008-05-08. *The OpenSource [[http://www.nspec.org/|NSpec]], [[http://www.github.com/mattflo/nspec|Github "mattflo / NSpec"]] - "A BDD framework for .NET of the xSpec (context/specification) flavor". *The OpenSource [[http://www.watin.org/|WatiN]] - "Web Application Testing for the .Net languages". === Java, Python, Web,.. === *The OpenSource [[http://jakarta.apache.org/jmeter/|Apache JMeter]] for Java - "Java desktop application designed to load test functional behavior and measure performance". *[[http://www.concordion.org/|Concordion]] -"An open source tool for writing automated acceptance tests in Java. There are also versions for .NET, Python, Scala, and Ruby". "It's similar to the [[http://fit.c2.com/|Fit Framework]] but a lot more intuitive”. *[[http://www.concordion.org/Ports.html|Concordion - Non-Java Versions]]. *[[http://code.google.com/p/pyconcordion/|Google Code "pyconcordion]] - "Concordion Python Port (write concordion like html files, python fixtures and run it !)". *The OpenSource [[http://jameleon.sourceforge.net/|SourceForge "Jameleon"]], [[http://www.sourceforge.net/projects/jameleon|SourceForge "Jameleon"]] - "Automated testing framework". *The OpenSource [[http://www.jsystemtest.org/|JSystem - Layered Test Automation Framework]] for Java - "Functional tests automation framework based on JUnit". *The OpenSource [[http://www.webload.org/|Radview WebLOAD - "WebLOAD Open Source Load Generation Engine"]] - "Test with confidence". "Load Testing, Stress Testing and Performance testing tools". *The OpenSource [[http://www.robotframework.org/|Robot Framework]] in Python. *[[http://www.github.com/robotframework/|GitHub "robotframework"]]. *[[http://www.github.com/robotframework/RIDE|GitHub "robotframework / RIDE"]] - "Test data editor for Robot Framework". *[[http://code.google.com/archive/p/robotframework-seleniumlibrary/|Google Code "robotframework-seleniumlibrary"]], [[http://www.github.com/robotframework/SeleniumLibrary/|GitHub "robotframework/SeleniumLibrary"]]. *[[http://de.wikipedia.org/wiki/Robot_Framework|EN.Wikipedia "Robot Framework"]], [[http://de.wikipedia.org/wiki/Robot_Framework|DE.Wikipedia "Robot Framework"]]. *The commercial [[http://www.tricentis.com/|Tricentis Tosca]]. *[[http://www.tricentis.com/software-testing-tools/|Tricentis Tosca]] - "Testautomatisierung @ DevOps Speed". *The free MOOC course [[http://www.udemy.com/get-in-touch-with-tricentis-tosca-testsuite/#%2F|Udemy "Get in touch with Tricentis Tosca Testsuit"]]. *[[http://de.wikipedia.org/wiki/Tosca_(Software)|DE.Wikipedia "Tosca (Software)"]] - "Die Tosca Testsuite ist ein Software-Tool für die automatisierte Durchführung von Funktional- und Regressions-Tests an Software". *The free [[http://www.xqual.com/|XQual "XStudio"]] for Windows, Linux, MacOS. ==== Free GUI Testing Tools / Capture & Replay Tools ==== === Windows, MacOSX, Linux, iPhone, Android === *The OpenSource [[http://www.sikuli.org/|Sikuli]]. *[[http://doc.sikuli.org/|Sikuli Documentation]]. *[[http://www.launchpad.net/sikuli/|Launchpad "Sikuli"]]. *[[http://www.github.com/RaiMan/SikuliX-IDE|GitHub "RaiMan / SikuliX-IDE"]]. *[[http://github.com/RaiMan/SikuliX-API|GitHub "RaiMan / SikuliX-API"]]. *[[http://www.slideshare.net/vgod/practical-sikuli-using-screenshots-for-gui-automation-and-testing|SlideShare "Tsung-Hsiang ( Sean ) Chang: Practical Sikuli. Using screenshots for GUI automation and testing"]]. *[[http://www.github.com/smysnk/sikuli-framework|GitHub "smysnk / sikuli-framework"]]. *[[http://en.wikipedia.org/wiki/Sikuli|EN.Wikipedia "Sikuli"]]. === .NET === *The OpenSource [[http://www.qaliber.net/|QAliber]] for .NET. *"QAliber Test Developer" - Visual Studio plug-in. *"QAliber Test Builder". *[[http://en.wikipedia.org/wiki/QAliber|EN.Wikipedia "QAliber"]]. *The OpenSource [[http://www.watin.org/|WatiN]], [[http://www.sourceforge.net/projects/watin/|SourceForge "WatiN"]], [[http://www.sourceforge.net/projects/watin/|SourceForge "WatiN"]] - "WatiN (pronounced 'what-in') aims to bring you an easy way to automate Web Application Testing in .Net. Inspired by Watir". === Java === *Codehouse "FEST" -> See section "JUnit" on [[unittest.html|Unit Test / Module Test]]. *"jfcUnit" -> See section "JUnit" on [[unittest.html|Unit Test / Module Test]]. *The OpenSource [[http://abbot.sourceforge.net/|SourceForge "Abbot"]], [[http://www.sourceforge.net/projects/abbot|SourceForge "Abbot"]] for Java with AWT / Swing - "Abbot framework for automated testing of Java GUI components and programs". *[[http://en.wikipedia.org/wiki/Abbot_%28framework%29|SourceForge "Abbot (framework)"]]. *The free [[http://code.google.com/intl/de/javadevtools/|Google Java Developer Tools]] "WindowTester Pro" - "Streamlines testing of those GUIs with automated recording, test generation, code coverage and playback". *"GUIdancer / Eclipse Jubula Project". *The project will be merged, starting with Eclipse Kepler ( 2013-06 - ). *[[http://testing.bredex.de/|BREDEX GmbH "BREDEX Testing Resources Portal"]]. *The once-commercial, now free [[http://www.bredex.de/en/guidancer/|BREDEX GmbH "Bredex GUIdancer"]] for Java - "Eclipse-based tool for the automated functional testing of Graphical User Interfaces (GUI's)", "Tests Java (Swing, SWT/RCP, GEF) and HTML GUI's". *The Opensource [[http://www.eclipse.org/jubula/|Eclipse Jubula Project]] for Java - "Automated Functional Testing". *Blog [[http://bxapps.bredex.de/blog/|BREDEX GmbH "BREDEX on Software"]]. *In 2017-12, experts told me that there are now 2 options to create tests, by: *A GUI interface, i.e. by manual mouse clicking. *An API, so that you can write your tests in Java. *The OpenSource [[http://maveryx.sourceforge.net/|SourceForge "maveryx - Open Source Test Automation Framework"]], [[http://www.sourceforge.net/projects/maveryx|SourceForge "Maveryx"]] for Java - "Automated Java GUI Testing". *[[http://en.wikipedia.org/wiki/Maveryx|Wikipedia "Maveryx"]]. *An Eclipse plugin is available. *The OpenSource [[http://jemmy.java.net/|Java.net "Jemmy framework. Ultimate UI testing solution"]]. *The commercial [[http://www.froglogic.com/squish/|froglogic GmbH "Squish"]] for testing of Windows, Java, QT, HTML5 applications. *[[http://www.froglogic.com/squish/coco/community-edition.php|froglogic GmbH "Squish Coco CE"]] - "Squish Coco is available as a Commercial Edition for usage with commercial and proprietary applications and as a Non Commercial Community Edition (CE) for non-commercial, private use, such as in Open Source projects or educational University projects". *[[http://en.wikipedia.org/wiki/Squish_%28Froglogic%29|EN.Wikipedia "Squish (Froglogic)"]]. *[[http://eclipse.org/swtbot/|Eclipse "SWTBot"]], [[http://swtbot.sourceforge.net/|SourceForge "SWTBot"]], [[http://www.sourceforge.net/projects/swtbot|SourceForge "SWTBot - SWT/Eclipse functional testing"]] - "UI Testing for SWT and Eclipse". *[[http://en.wikipedia.org/wiki/SWTBot|EN.Wikipedia "SWTBot"]]. === Linux, X Window === *The Opensource [[http://ldtp.freedesktop.org/|Linux Desktop Testing Project]] for Linux desktops. *[[http://en.wikipedia.org/wiki/Linux_Desktop_Testing_Project|EN.Wikipedia "Linux Desktop Testing Project"]]. *The OpenSource [[http://itupw056.itu.chalmers.se/project-xnee/|GNU Xnee]] - "A suite of programs that can record, replay and distribute user actions under the X11 environment". *[[http://en.wikipedia.org/wiki/Xnee|EN.Wikipedia "Xnee"]]. === PowerShell === *"Test Run" - See [[wscripting02.html|Scripting Languages for Windows 2/2 - Windows Powershell]]. === Python === *The OpenSource [[http://fedorahosted.org/dogtail/|Fedora Hosted "dogtail"]] for Python - "GUI testing tool and automation framework". *[[http://en.wikipedia.org/wiki/Dogtail|Wikipedia "Dogtail"]]. === Tcl/Tk === *DejaGnu / Expect - See [[tickle.html|Tcl / Tk ( tickle) 2/2 - Debugging & Testing]]. === Web / HTML Testing in Python, Java, Javascript, PHP === == Appium == *[[http://appium.io/|Appium]], [[http://www.github.com/appium/|GitHub "Appium - Mobile App Automation Made Awesome"]]. *[[http://www.nuget.org/packages/Appium.WebDriver/|NuGet Packages "Appium Webdriver"]]. *[[http://www.learnseleniumtesting.com/|Learn Selenium Testing]]. *[[http://www.learnseleniumtesting.com/tutorials/app-testing-using-appium-webdriver/|Learn Selenium Testing "App Testing using Appium and Webdriver"]]. *[[http://www.software-testing-tutorials-automation.com/2015/09/appium-tutorials.html|Software testing tutorials and automation "Appium Tutorials Part - 1"]]. == Javascript Tools == *[[http://www.cypress.io/|Cypress]], [[http://www.github.com/cypress-io/cypress|GitHub "cypress-io/cypress"]] - "Fast, easy and reliable testing for anything that runs in a browser". *[[http://www.galenframework.com/|Galen Framework]], [[http://www.github.com/galenframework/|GitHub "galenframework"]] - "Automated testing of look and feel for your responsive websites". A Selenium-based Javascript framework. *[[http://karma-runner.github.io/|GitHub.io "Karma - Spectacular Test Runner for Javascript"]], [[http://github.com/karma-runner|GitHub "Karma - The Spectacular Test Runner for JavaScript"]] - "Karma is essentially a tool which spawns a web server that executes source code against test code for each of the browsers connected". *[[http://www.bradoncode.com/blog/2015/05/19/karma-angularjs-testing/|Bradley Braithwaite "Getting started with Karma for AngularJS Testing"]]. *[[http://www.nightwatchjs.org/|Nightwatch.js]], [[http://www.github.com/beatfactor/nightwatch|GitHub "beatfactor/nightwatch"]]. *"Nightwatch.js is an easy to use Node.js based End-to-End (E2E) testing solution for browser based apps and websites. It uses the powerful [[http://code.google.com/p/selenium/wiki/JsonWireProtocol|Selenium WebDriver API]] to perform commands and assertions on DOM elements". *"Nightwatch.js works with cloud testing providers, such as [[http://www.saucelabs.com/|SauceLabs]] and [[http://www.browserstack.com/|BrowserStack]]. *[[http://www.twitter.com/nightwatchjs|Twitter "Nightwatch.js"]]. *[[http://www.danielundkian.de/2014/06/continuous-deployment-mit-git-codeship-io-und-nightwatch-js-bei-youhear/|Daniel und Kian "Continuous Deployment mit git, codeship.io und nightwatch.js bei youhear.it"]], 2014-06-14. *Installation: -"sudo npm install nightwatch". -Install and run the [[http://www.seleniumhq.org/|Selenium Server]] - "java -jar selenium-server-standalone.2.42.0.jar". -"nightwatch" or "node nightwatch.js" *Configuration on Windows: *On Windows, as shipped, "nightwatch" aborts by the error message "ERROR There was an error while starting the test runner: Error: Failed to load external global file: External global file could not be located - using ./examples/globals.json". *To fix this for Windows, please modifly these lines of the file "./node_modules/nightwatch/examples/tests" of your local node module directory: "output_folder" : "./node_modules/nightwatch/examples/reports", "custom_commands_path" : "./node_modules/nightwatch/examples/custom-commands", "custom_assertions_path" : "", "globals_path" : "./node_modules/nightwatch/examples/globals.json", *Configuration on Linux: *In case of a local installation of "nightwatch", this "nightwatch.js" file worked for me: #!/usr/bin/env node require('./node_modules/nightwatch/bin/runner.js'); *General configuration tips: *You should build your own "nightwatch.json" in your local project directory, see official tutorial :-). *[[http://www.dalekjs.com/|DalekJS]], [[http://www.github.com/dalekjs|GitHub "DalekJS"]]. *[[http://www.dalekjs.com/pages/getStarted.html|DalekJS "Get Started. This ain’t Selenium"]]. *"Dalek's only dependency is node.js, there is no need to install Java or download the Selenium.jar file". *Installation for a certain project directory. Though I was able to install DalekJS on Windows as total local installation, with Linux I must - as instructed by the documentation - dalek-cli as global, but dalekjs as local, else it does not appear with "dalek -v". I decided to follow the instructions and installed the rest of the modules as local, too. -sudo npm install -g dalek-cli. -npm install dalekjs --save-dev This creates the folder "node_modules" in your project directory, and installs some code there. -dalek -v for checking the proper installation. Both "dalek-cli" and "dalek" must be listed, so 2 modules, not just one. -dalek test/my_first_test.js -sudo npm install dalek-browser-chrome --save-dev or npm install dalek-browser-firefox --save-dev *[[http://www.npmjs.org/package/dalek-browser-chrome|dalek-browser-chrome]] - Must be installed with "sudo". *[[http://www.npmjs.org/package/dalek-browser-firefox|dalek-browser-firefox]] - May be installed by a local user. -dalek test/my_first_test.js -b chrome or dalek test/my_first_test.js -b firefox *There is the error on Windows ">> ERROR: dalek-driver-firefox: Binary not found: C:\Program Files\Mozilla Firefox\firefox.exe", if Firefox is not installed at the default location. *There is the error on Windows ">> ERROR: dalek-browser-firefox: Error starting WebDriverServer, port 9006 in use". *[[http://www.github.com/dalekjs/dalek-browser-firefox/issues/11|GitHub Issues for "dalekjs/dalek-browser-firefox"]] - "Firefox won't start on any port #11". *If I set a larger timeout at "my_project\node_modules\dalek-browser-firefox\node_modules\portscanner\lib\portscanner.js", I get the error "net.js:1236: throw new Error('Not running');": *Original: *"var timeout = options.timeout || 400" *Changed to: *"var timeout = options.timeout || 4000" -npm install -g dalek-reporter-html --save-dev -mkdir report -mkdir cd report -mkdir dalek -mkdir cd .. -dalek test/my_first_test.js -r console,html This command expects that the folder "report/dalek" exists. If so, it creates the file "index.html" in that directory with all the information from your test run. *My personal experience of 2014-08: The current version of Dalek "hangs" if an assertion is not passed succesfully :-( *[[http://www.github.com/puppeteer/puppeteer|GitHub "puppeteer/puppeteer"]] - "Headless Chrome Node.js API", "A Node library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol. Puppeteer runs headless by default, but can be configured to run full (non-headless) Chrome or Chromium". *Resources: *[[http://www.chercher.tech/puppeteer/puppeteer-vs-cypress|chercher.tech "Puppeteer vs Cypress"]]. *[[http://www.testim.io/blog/puppeteer-selenium-playwright-cypress-how-to-choose/|testim Blog "Puppeteer, Selenium, Playwright, Cypress – how to choose?"]]. == Katalon Studio == *[[http://www.katalon.com/|Katalon Studio]] - "Simplify API, Web, Mobile Automation Tests". *[[http://chrome.google.com/webstore/detail/katalon-recorder-selenium/ljdobmomdgdljniojadhoplhkpialdid|Google Chrome Store "Katalon Recorder (Selenium IDE for Chrome)"]]. *[[http://en.wikipedia.org/wiki/Katalon_Studio|EN.Wikipedia "Katalon Studio"]] - "A free automation testing solution developed by Katalon LLC. The software is built on top of open-source automation frameworks Selenium, Appium with a specialized IDE interface for API, Web and Mobile testing". == Playwright == *[[http://www.playwright.dev/|Playwright]] for Node.js, Python, Java, .NET - "Enables reliable end-to-end testing for modern web apps". *Playwright for Python *[[http://www.github.com/microsoft/playwright-python|GitHub " microsoft / playwright-python"]]. *[[http://pypi.org/project/playwright/|PyPI "playwright"]]. *[[http://playwright.dev/python/docs/intro/|Playwright for Python "Documentation"]] ( without "www." ). *Resources: *Experts told me, it'S also ok for webscrapting :-). *Works with iPhython, doesn´t work with Jupyter notebooks. *Best to use with websites which provide auto complete :-). == Selenium == *The "slow" OpenSource Web application testing system "Selenium". *[[http://www.selenium.dev/documentation/|Selenium automates browsers. That's it! What you do with that power is entirely up to you]], [[http://www.seleniumhq.org/|SeleniumHQ "Selenium"]]. *[[http://www.github.com/seleniumhq/|GitHub "Selenium"]]. *[[http://code.google.com/p/selenium/|Google Code "selenium. Browser automation framework"]], [[http://selenium-release.storage.googleapis.com/index.html|GoogleAPIs - Download of outdated "Selenium" versions]] #. *Experts feedback: Selenium is "slow", and no replacement for the "fast" Canoo WebTest :-(. *[[http://www.selenium.dev/documentation/|Selenium "Documentation"]] - "The Selenium Browser Automation Project". *[[http://www.selenium.dev/ecosystem/|Selenium "Ecosystem"]]. *"Selenium can be extended in different ways. Here are a number of drivers, bindings, plugins, and frameworks created and maintained by third parties". *[[http://www.github.com/teodesian/Selenium-Remote-Driver|GitHub "teodesian/Selenium-Remote-Driver"]], 2022-04 - "WARNING. Selenium has essentially been leapfrogged technologically by Playwright. (using the devtools protocol for all browsers) Use Chrome::DevToolsProtocol (or the Playwright interface on CPAN) instead of this unless you want to be frustrated by a tool which doesn't do half of what you want. Even then you are probably shooting yourself in the foot not using Javascript directly to automate the testing of webpages" :-(. *"Language Bindings" - Go, Haskell, JavaScript, Perl, PHP, R, Dart. *[[http://www.selenium.dev/documentation/webdriver/|Selenium "WebDriver"]]. *[[http://www.selenium.dev/documentation/webdriver/remote_webdriver/|Selenium "Remote WebDriver"]]. *Annual conferences. *Events. *[[http://www.seleniumconf.com/|Selenium Conference]]. *[[http://web.archive.org/web/*/http://www.seleniumconf.com/|Archive.org "Selenium Conference"]] ( - 2021-02-27 ) - "Bengaluru, India. September 10 - 12, 2020" & "Chicago, USA. Postponed to 2021". *[[http://web.archive.org/web/*/http://www.seleniumconf.com/|Archive.org "Selenium Conference"]] ( - 2019-12-02 ). *"Bengaluru, India. June 18-20, 2020". *"Berlin 2017". *[[http://www.seleniumconf.de/|SeleniumConf Berlin 2017]] in Berlin, 2017-10-09 - 2017-10-10. *[[http://www.seleniumconf.us/|SeleniumConf Chicago]] in Chicago, USA, 2018-10-18 - 2018-10-19. *[[http://conf.selenium.jp/|SeleniumConf Tokyo]] in Tokyo, Japan, 2019-04-18 - 2019-04-19. *[[https://seleniumconf.co.uk/|SeleniumConf London]] in London, UK, 2019-10-07 - 2019-10-08. *[[http://www.seleniumconf.in/|Selenium Conference India]]. *[[http://2014.seleniumconf.in/|Selenium Conference India 2014 - SeConf 2014, 4th Annual Selenium Conference]]. *[[http://2016.seleniumconf.in/|Selenium Conference India 2016]]. *[[http://2018.seleniumconf.in/|Selenium Conference India 2018]]. *[[http://2020.seleniumconf.in/|Selenium Conference India 2020]]. *Videos [[http://www.youtube.com/user/seleniumconf/|YouTube "Selenium Conference"]] - 2019 ( London ), 2018 ( Chicago ), 2017 ( Berlin & Austin ), 2015 ( Portland ). *Language driver APIs: *Python. *[[http://pypi.python.org/pypi/selenium|Python Package Index "Python bindings for Selenium"]] for Python 2.x & 3.x. *[[http://selenium.googlecode.com/git/docs/api/py/api.html|Google Code "Selenium Documentation"]] for Python. *[[http://www.code.google.com/p/selenium/wiki/|Google Code Wiki "Selenium"]]. *[[http://www.code.google.com/p/selenium/wiki/PythonBindings|Google Code Wiki "Selenium" - "PythonBindings. A guide to using the python bindings for Selenium/Webdriver"]]. *[[http://docs.python.org/2/library/unittest.html|The Python Standard Library "25.3. unittest — Unit testing framework"]]. *Java. *[[http://seleniumhq.github.io/selenium/docs/api/java/|Github.io "JavaDoc API"]]. *C# *Ruby. *Javascript (Node). *Resources for the legacy Selenium 1 RC: *[[http://docs.seleniumhq.org/|Selenium HQ Browser Automation "Documentation"]]. *[[http://docs.seleniumhq.org/docs/05_selenium_rc.jsp|Selenium HQ Browser Automation "Documentation / Selenium 1 (Selenium RC)"]]. *[[http://www.jimmyg.org/blog/2009/getting-started-with-selenium-and-python.html|James Gardner: "Getting Started with Selenium and Python"]]. *[[http://www.coreygoldberg.blogspot.de/2009/09/selenium-rc-with-python-in-30-seconds.html|Corey Goldberg "Selenium RC with Python in 30 Seconds"]]. *Resources for Selenium 2 WebDriver: *[[http://code.google.com/p/selenium/wiki/FrequentlyAskedQuestions|Google Code Wiki "selenium" - "FrequentlyAskedQuestions"]]. *[[http://docs.seleniumhq.org/|Selenium HQ Browser Automation "Documentation"]]. *[[http://docs.seleniumhq.org/docs/03_webdriver.jsp|Selenium HQ Browser Automation "Documentation / Selenium WebDriver"]]. *[[http://docs.seleniumhq.org/docs/04_webdriver_advanced.jsp|Selenium HQ Browser Automation "Documentation / WebDriver: Advanced Usage"]]. *[[http://www.coreygoldberg.blogspot.de/2011/07/python-getting-started-with-selenium.html|Corey Goldberg "Python - Getting Started With Selenium WebDriver on Ubuntu/Debian"]]. *[[http://selenium-python.readthedocs.org/|Baiju Muthukadan "Selenium with Python"]]. *[[http://selenium-python.readthedocs.org/en/latest/locating-elements.html|Baiju Muthukadan "Selenium with Python / 4. Locating Elements"]]. *[[http://selenium-tutorial.blogspot.de/|Selenium Tutorial]]. *[[http://selenium-tutorial.blogspot.de/2012/09/selenium-2-webdriver-python.html|Selenium Tutorial "Selenium-2 / Webdriver / Python"]]. *[[http://www.saucelabs.com/docs/ondemand/getting-started/env/python/se2/mac|Sauce Labs "Automated Testing Tutorials"]]. *[[http://simeonvisser.com/posts/running-tests-in-python-with-selenium-2-and-webdriver.html|Simeon Visser "Running Tests in Python with Selenium 2 and WebDriver"]]. *[[http://www.stackoverflow.com/questions/17540971/how-to-use-selenium-with-python|Stack Overflow "How to use Selenium with Python?"]]. *[[http://www.youtube.com/watch?v=2OA941RLbmU|YouTube "Selenium For Pythonistas"]]. *How to catch a link on a website ? *[[http://selenium-python.readthedocs.org/en/latest/locating-elements.html|Read The Docs " Selenium Python Bindings 2 Documentation - 4. Locating Elements"]] - "find_element_by_xpath" *[[http://selenium.10932.n7.nabble.com/how-to-identify-xpath-for-a-link-td7344.html|Selenium IDE - Users "how to identify xpath for a link?"]] *xpath=//a[text()="Pizza Hut"] or xpath=//a[@href="http://yoururl"] *[[http://www.stackoverflow.com/questions/13124942/xpath-for-href-element|Stack Overflow "Xpath for href element"]]. *selenium.click("css=a[href*='listDetails.do'][id='oldcontent']") *selenium.click("xpath=//a[contains(@href,'listDetails.do') and @id='oldcontent']") *Resources for XPATH: *See [[[databases.html|Databases, Webserver, Webservices, SQL, XML]]. *Browser plugins: *The Firefox browser plugin [[http://seleniumhq.org/projects/ide/|SeleniumHQ "Selenium IDE"]]. *The Firefox browser plugin [[http://addons.mozilla.org/en-US/firefox/addon/selenium-ide-sel-blocks/|SelBlocks (for Selenium IDE)]]. *[[http://refactoror.wikia.com/wiki/Selblocks_Reference|Refactoror Wiki "Selblocks Reference"]]. *Selblocks may use blocks of data in Json or XML format, stored in files. However, the script export of "Selenium IDE" doesn´t work with recordings using "Selblocks" features :-(. *The MSIE browser plugin [[http://code.google.com/p/selenium/downloads/detail?name=IEDriverServer_Win32_2.39.0.zip|Google Code "InternetExplorerDriver standalone server for 32-bit IE"]]. *With the browser plugin for Chrome, you may export recorded sessions in different target languages, e.g. "Python 2". *Cloud Services. *[[http://www.saucelabs.com/|Sauce Labs]]. *"Run your web and mobile app tests across hundreds of real browsers and platforms instantly". *"Run your Selenium tests in the cloud". *[[http://www.saucelabs.com/pricing|Sauce Labs - Pricing]] - There is a free account with "30 manual minutes, 100 Win/Linux/Android minutes, 40 Mac/iOS minutes" per month. *The Opensource [[http://www.brominefoundation.org/|Bromine]], [[http://bromine.sourceforge.net/|SourceForge "Bromine"]], [[http://www.sourceforge.net/projects/bromine/|SourceForge "Bromine"]] for Java and PHP. *"Its lofty aim is to be the open source alternative to commercial tools (such as HP Quality Center)". *"An open source QA tool that uses selenium RC as its testing engine. It provides project management, OS/browser specification, test-case creation as well as user management". *The OpenSource [[http://code.google.com/p/aost/|Google Code "aost - Tellurium Automated Testing Framework"]]. *[[http://en.wikipedia.org/wiki/Tellurium_%28software%29|EN.Wikipedia "Tellurium (software)"]]. *The OpenSouce [[http://cubictest.seleniumhq.org/|OpenQA "CubicTest"]] - "Functional web testing", "A graphical Eclipse plug-in for writing Selenium and Watir tests". *[[http://en.wikipedia.org/wiki/CubicTest|EN.Wikipedia "CubicTest"]]. == Selenium with Geb == *[[http://www.gebish.org/|Geb]] - "(pronounced "jeb"). Very groovy browser automation… web testing, screen scraping and more". *[[http://www.github.com/geb/|GitHub "Geb"]]. *[[http://www.github.com/geb/geb-example-gradle|GitHub "geb/geb-example-gradle"]] - "An example project for using Geb in a Gradle build (Spock and JUnit 4)". *[[http://www.entwicklertag.de/karlsruhe/2015/spock-und-geb-bersichtlich-und-nachvollziehbar-testen-f-r-alle|Entwicklertag Karlsruhe "Spock und Geb: Übersichtlich und nachvollziehbar Testen für alle!"]]. *Experts told me, that the option "@stepwise" of "Geb" is important for Selenium debugging to process the tasks one after another in a forced and determined sequence. == Selenium with Codeception == *The OpenSource Selenium-based PHP framework [[http://www.codeception.com/|Codeception]], [[http://www.github.com/Codeception|GitHub "Codeception Testing Framework"]]. == SOAPSonar == *[[http://www.crosschecknet.com/products/soapsonar.php|Crosscheck Networks "SOAPSonar"]] - "Global Leader in Service and API Testing. HTML, XML, SOAP, REST, and JSON. Test over HTTP/s FTP/s, SFTP, IBM MQ, Tibco EMS, Weblogic JMS. Functional, Automation, Performance, Compliance, and Security Testing. Comprehensive out-of-the box standards support for OASIS and W3C standards"]]. *The free [[http://www.crosschecknet.com/products/soapsonardetails_personal.php|Crosscheck Networks "SOAPSonar Personal Edition (Free)"]]. == SoupUI == *The OpenSource web service testing application for service-oriented architectures (SOA) and representational state transfers (REST) [[http://www.soapui.org/|SoupUI]], [[http://soapui.sourceforge.net/|SourceForge "SoupUI"]], [[http://www.sourceforge.net/projects/soapui/|SourceForge "SoupUI"]] by [[http://smartbear.com|Smart Bear Software, Inc.]]. *[[http://www.soapui.org/Dojo/overview.html|SoapUI "API Testing Dojo"]]. *[[http://en.wikipedia.org/wiki/SoapUI|EN.Wikipedia "SoapUI"]], [[http://de.wikipedia.org/wiki/SoapUI|DE.Wikipedia "SoapUI"]]. == Some other Tools == *The free Add-ons for browsers (IE, Firefox, Chrome) [[http://www.iopus.com/imacros/|iOpus GmbH "iMacros"]] - "The unique tool for instant Web Automation, Web Testing & Data Extraction". *[[http://www.iopus.com/imacros/compare/|iOpus GmbH - iMacros Feature Comparison Chart]]. *[[http://en.wikipedia.org/wiki/IMacros|EN.Wikipedia "iMacros"]] *The OpenSource [[http://www.watir.com/|Watir]] - "A family of Ruby libraries for automating web browsers", "They support Internet Explorer on Windows, Firefox and Chrome on Windows, Mac and Linux and Safari on Mac". *[[http://en.wikipedia.org/wiki/Watir|EN.Wikipedia "Watir"]]. *The "fast" OpenSource [[http://webtest.canoo.com/|Canoo WebTest]] in Java. == Online Services == *[[http://www.browserstack.com/|BrowserStack]] - "Live, Web-Based Browser Testing. Instant access to all real mobile and desktop browsers. Say goodbye to your lab of devices and virtual machines". *[[http://en.wikipedia.org/wiki/BrowserStack|EN.Wikipedia "BrowserStack"]]. *[[http://www.saucelabs.com/|Sauce Labs]]. *[[http://en.wikipedia.org/wiki/Sauce_Labs|EN.Wikipedia "Sauce Labs"]] - "Cloud-hosted, web and mobile application automated testing platform company". === Web Automation by direct HTTP Automation === *[[http://twill.idyll.org/|twill: a simple scripting language for Web browsing]] - "twill supports automated Web testing and has a simple Python interface". *[[http://www.github.com/brynary/webrat|WebRat]] - "Webrat - Ruby Acceptance Testing for Web applications". *[[http://code.google.com/p/selenium/wiki/HtmlUnitDriver|Selenium Browser automation framework, HtmlUnitDriver]]. === Windows Macro Recorders === == Basics == *Many Windows macro recorders work on Vista / Win7 just with deacitivated UAC ( [[http://en.wikipedia.org/wiki/User_Account_Control|EN.Wikipedia "User Account Control"]], [[http://de.wikipedia.org/wiki/Benutzerkontensteuerung|DE.Wikipedia "Benutzerkontensteuerung"]] ). == Tools == *AutoHotkey. *The OpenSource [[http://www.autohotkey.com/|AutoHotkey]], [[http://ahk.sourceforge.net/|SourceForge "AutoHotkey - Automation and Hotkeys"]], [[http://www.sourceforge.net/projects/ahk/|SourceForge "AutoHotkey - Automation and Hotkeys"]] for Windows - "Mouse and Keyboard Macro Program with Hotkeys and AutoText" #. *[[http://www.autohotkey.com/docs/commands/IfWinActive.htm|AutoHotkey Documentation "#IfWinActive / #IfWinExist"]] - "Variable references such as %Var% are not currently supported. Therefore, percent signs must be escaped via `% to allow future support for them." :-(. *[[http://www.autohotkey.com/docs/FAQ.htm|AutoHotkey "Frequently Asked Questions (FAQ)"]]. *[[http://www.autohotkey.net/~faqbot/faq.html|AutoHotkey "Unofficial AutoHotkey FAQ"]]. *[[http://www.autohotkey.com/docs/Tutorial.htm|AutoHotkey "Tutorial"]]. *[[http://www.autohotkey.com/board/topic/78993-autohotkey-as-an-automation-testing-aid-tool/|AutoHotkey Forums "AutoHotkey as an automation testing aid tool"]]. *The OpenSource "AutoHotkey_L". *[[http://www.autohotkey.net/|autohotkey.net]]. *The OpenSource [[http://l.autohotkey.net/|AutoHotkey_L]], *[[http://www.github.com/Lexikos/|GitHub "Lexikos"]]. *[[http://www.github.com/Lexikos/AutoHotkey_L|GitHub "Lexikos / AutoHotkey_L"]] - "Continuation of Chris Mallett's AutoHotkey, by Lexikos. [[http://www.ahkscript.org/|http://ahkscript.org/]]". *[[http://www.ahkscript.org/|AHKScript.org]] - "A new community founded by a number of enthusiasts to promote the use of AutoHotkey". *[[http://en.wikipedia.org/wiki/AutoHotkey|EN.Wikipedia "AutoHotkey"]], [[http://de.wikipedia.org/wiki/AutoHotkey|DE.Wikipedia "AutoHotkey"]]. *Video [[http://www.youtube.com/watch?v=10KM27uzoIE|YouTube "Using AutoHotKey For Windows Macro Recording"]]. *The free [[http://www.autoitscript.com/|Jonathan Bennett & AutoIt Consulting Ltd "AutoIt"]] - "Automation and Scripting Language" #. *[[http://www.autoitscript.com/wiki/Main_Page|Jonathan Bennett & AutoIt Consulting Ltd - AutoIT Wiki]]. *[[http://en.wikipedia.org/wiki/AutoIt|EN.Wikipedia "AutoIt"]], [[http://de.wikipedia.org/wiki/AutoIt|DE.Wikipedia "AutoIt"]]. *The free [[http://www.ghost-mouse.com/|AutomaticSolution Software "GhostMouse"]]. *The free [[http://www.bitdreamers.com/|bitdreamers - quality driven solutions "TimeComX Basic"]]. *[[http://www.freeware.de/blog/tipps/tipps-tricks/timecomx-windows-automatisierung-freeware/|freeware.de "Windows Automatisierung Freeware"]]. *The free [[http://freelabs.info/MacroRecorder.aspx|Free Labs Software. "Windows Macro Recorder"]]. *The free [[http://www.perfectautomation.com/|Gentee, Inc "Perfect Automation"]]. *The OpenSource programming language [[http://www.gentee.com/|Gentee]], [[http://gentee.sourceforge.net/|SourceForge "Gentee Programming Language"]], [[http://www.sourceforge.net/projects/gentee/|SourceForge "Gentee Programming Language"]]. *[[http://fr.wikipedia.org/wiki/Gentee|FR.Wikipedia "Gentee"]]. *The free Donationware [[http://www.s-a-t.fr/|Thierry Haurie "Smart Automatic Test ( SAT )"]]. *[[http://www.hintenaus.at/|Mag. Marina Hintenaus]] ( = "Walter Hintenaus" ). *The free [[http://members.inode.at/m.hintenaus/makro%20-%20uebersicht.htm|Mag. Marina Hintenaus "Makro"]]. *[[http://www.hiteksoftware.com/|Hitek Software LLC]]. *The free [[http://www.fileguru.com/Acemacro/info|Fileguru "AceMacro 2.0"]]. *[[http://senthilthecoder.com/|S. Senthil Kumar]]. *The free [[http://senthilthecoder.com/software/winmacro/index.html|S. Senthil Kumar "WinMacro. A Macro Recorder/Player for Windows"]] - "WinMacro v1.2.1". *[[http://winmacro.codeplex.com/|CodePlex "WinMacro"]] -> certificate installation required :-(. *The free Donationware [[http://members.ij.net/anthonymathews/MacroMaker.htm|Anthony Mathews "MacroMaker"]]. *The free [[http://www.mybits-home.de/|MyBits Home, Alexander Bolli "GhostHand "]]. *The free [[http://www.neowise.com/freeware/|Neowise Software "RoboTask Lite - Freeware automation utility"]]. *The free [[http://www.phantomtest.com/|Phantom Automated Solutions "Phantom Automation"]] for Windows. *[[http://en.wikipedia.org/wiki/Phantom_automation_language|EN.Wikipedia "Phantom automation language"]]. *[[http://en.wikipedia.org/wiki/User:Aeroslacker/Phantom_automation|EN.Wikipedia "User:Aeroslacker/Phantom automation"]]. *[[http://wayback.archive.org/web/*/http://www.freewarehits.de/|Archive.org "Detlef Schaefer - freewarehits.de"]]. *The free [[http://wayback.archive.org/web/*/http://www.freewarehits.de/RemoteKeys.htm|Archive.org "Detlef Schaefer 'RemoteKeys'"]]. *[[http://www.chip.de/downloads/RemoteKeys-8.7_12995935.html|CHIP Online "RemoteKeys 8.7"]]. *The free Donationware [[http://www.spacetornado.com/DoItAgain/|Spacetornado Software "Do It Again"]]. *[[http://www.vtaskstudio.com/support.php|Vista Software - Free Software Tools]]. *The free tools "TinyTask", "TyperTask". *The free [[http://www.camiweb.com/zenkey/|ZenCODE "ZenKEY"]]. === Windows Automation & Batch Systems === *KiXtart. *The free [[http://www.kixtart.org/|KiXtart]] - "A free-format scripting language and has rich built-in functionality for easy scripting. It supports COM (providing access to ADSI, ADO, WMI, etc) and thus is easily extensible". *The free [[http://www.kixforms.org/|KiXforms]] - "The most powerful graphical plug-in for the popular KiXtart scripting language". *[[http://en.wikipedia.org/wiki/KiXtart|EN.Wikipedia "KiXtart"]], [[http://de.wikipedia.org/wiki/KiXtart|DE.Wikipedia "KiXtart"]]. *The free [[http://www.thinbasic.com/|ThinBasic - passion powered script interpreter for Windows]]. *[[http://en.wikipedia.org/wiki/ThinBasic|EN.Wikipedia "ThinBasic"]]. === Macro Recorders in Desktop Applications === == The Macro Recorder in OpenOffice == *[[http://wiki.openoffice.org/wiki/Documentation/OOo3_User_Guides/Calc_Guide/Using_the_macro_recorder|OpenOffice Wiki "Using the macro recorder"]]. ==== Just-Commercial GUI Testing Tools / Capture & Replay Tools ==== === Web, Windows, WPF, HTML5, Flash, Flex, Silverlight, .NET, VCL and Java === *[[http://www.smartbear.com/products/qa-tools/automated-testing-tools/| SmartBear Software "Automated Testing - TestComplete"]]. *[[http://en.wikipedia.org/wiki/TestComplete|EN.Wikipedia "TestComplete"]] - "It automates front-end UI/functional testing and back-end testing like database testing". *[[http://www.twitter.com/TestComplete|Twitter "TestComplete"]]. === Java & Web === *[[http://www.qfs.de/|QF-Test]] - "Das GUI Testtool für Java und Web". === .NET === *[[http://www.telerik.com/|Telerik]]. *[[http://www.telerik.com/automated-testing-tools/|Telerik "Test Studio"]] ( formerly: "Telerik WebUI Test Studio" ) - "Functional Testing ( HTML, Silverlight, AJAX, WPF ), Load Testing, Performance Testing, Testing in Visual Studio, Explorative Testing, Manual Testing, Mobile Testing". *Automated UI tests for WPF projects with Visual Studio. *[[http://msdn.microsoft.com/de-de/library/dd286726.aspx|Microsoft MSDN Library "Testing the User Interface with Automated UI Tests"]] - "You can use Visual Studio 2010 Ultimate or Visual Studio 2010 Premium to create automated tests of the user interface (UI) known as coded UI tests". === Windows & Windows GUI === *[[http://www.autoitscript.com/|AutoIt Consulting Ltd "AutoIt"]] - "AutoIt v3 is a freeware BASIC-like scripting language designed for automating the Windows GUI and general scripting". *[[http://www.tethyssolutions.com/|Automation Anywhere, Inc]], [[http://www.automationanywhere.com/|Automation Anywhere, Inc.]] ( previously known as Tethys Solutions, LLC. ). *[[http://www.automationanywhere.com/Testing/|Automation Anywhere, Inc. "Testing Anywhere"]]. *Supportet test types: *Automated Software Testing. *Automated Load Testing. *Cross-browser Testing. *Regression Testing. *Black Box Testing. *Keyword-driven Testing. *Smoke Testing. *Compatibility Testing. *System Testing. *Automated Flex Testing. *Mainframe Application Testing. *WPF Testing. *Automated Mobile Testing. *Automated Web Testing. *Distributed Load Testing. *Functional Testing. *Acceptance Testing. *Data-driven Testing. *Integration Testing. *Performance Testing. *GUI Testing. *Silverlight Application Testing. *Java Application Testing. *Automated Unit Testing. *[[http://www.twitter.com/TestingAnywhere|Twitter "Testing Anywhere"]]. *[[http://www.slideshare.net/AutomationAnywhere|SlideShare "Automation Anywhere"]]. *[[http://en.wikipedia.org/wiki/Automation_Anywhere|EN.Wikipedia "Automation Anywhere"]], [[http://en.wikipedia.org/wiki/Testing_Anywhere|EN.Wikipedia "Testing Anywhere"]]. *Hewlett-Packard ALM -> See [[alm.html|Application Lifecycle Management ( ALM )]]. *IBM. *[[http://www.ibm.com/software/awdtools/tester/functional/|IBM Rational Functional Tester]]. *[[http://www.ibm.com/software/awdtools/tester/robot/|IBM Rational Robot]] ( formerly: Rational Teamtest, SQA Teamtest ). *[[http://www.ibm.com/developerworks/rational/products/robot/|IBM developerWorks "Rational Robot"]]. *IBM Rational Visual Test (formerly: Microsoft Visual Test, MS Test). *[[http://en.wikipedia.org/wiki/Visual_Test|EN.Wikipedia "Visual Test"]]. *[[http://www.microfocus.com/|Micro Focus International]]. *[[http://www.borland.com/products/silktest/|Borland - A Micro Focus Company "SilkTest"]] ( once a Borland product, then supplied by Micro Focus International, now by Borland again ). *[[http://en.wikipedia.org/wiki/SilkTest|EN.Wikipedia "SilkTest"]]. *[[http://www.microfocus.com/products/TestPartner/|MicroFocus TestPartner]] ( formerly: Compuware TestPartner ). *[[http://en.wikipedia.org/wiki/TestPartner|EN.Wikipedia "TestPartner"]]. *SilkCentral Test Manager ( SCTM ). *Micro Focus QARun ( formerly: Compuware QARun ). *Oracle. *[[http://www.oracle.com/us/products/enterprise-manager/|Oracle Enterprise Manager]] ( formerly Empirix e-TEST, RSW e-TEST, Oracle Enterprise Manager ). *[[http://www.oracle.com/us/corporate/Acquisitions/empirix|Oracle and Empirix]] - "Oracle has aquired the e-TEST suite products from Empirix". *[[http://www.ranorex.com/|Ranorex GmbH "Ranorex - Next Generation Automated Testing"]] for Windows. *GUI Testing of .NET Application on Windows and of GUI testing of Labview applications. *[[http://en.wikipedia.org/wiki/Ranorex|EN.Wikipedia "Ranorex"]]. === Windows Macro Recorders === == Basics == *Many Windows macro recorders work on Vista / Win7 just with deacitivated UAC ( [[http://en.wikipedia.org/wiki/User_Account_Control|EN.Wikipedia "User Account Control"]], [[http://de.wikipedia.org/wiki/Benutzerkontensteuerung|DE.Wikipedia "Benutzerkontensteuerung"]] ). == Tools == *[[http://www.autoitscript.com/|AutoIt Consulting Ltd "AutoIt"]] - "AutoIt v3 is a freeware BASIC-like scripting language designed for automating the Windows GUI and general scripting". *[[http://www.tethyssolutions.com/|Automation Anywhere, Inc]], [[http://www.automationanywhere.com/|Automation Anywhere, Inc.]] ( previously known as Tethys Solutions, LLC. ). *[[http://www.tethyssolutions.com/product.htm|Automation Anywhere, Inc. "Workspace Macro recorder"]] - Free trial software version available. *[[http://www.tethyssolutions.com/automation-software.htm|Automation Anywhere, Inc. "Automation Anywhere"]] - "The Intelligent Automation Software. Automate & Schedule business processes & IT tasks easily". Free trial software version available. *[[http://www.tethyssolutions.com/compare-macro-software.htm|Automation Anywhere, Inc. "Compare Our Macro Software & Automation Software"]]. *[[http://www.slideshare.net/AutomationAnywhere|SlideShare "Automation Anywhere"]]. *[[http://en.wikipedia.org/wiki/Automation_Anywhere|EN.Wikipedia "Automation Anywhere"]], [[http://en.wikipedia.org/wiki/Workspace_Macro|EN.Wikipedia "Workspace Macro"]]. *[[http://www.chosensoft.com/keyboard-macro-recorder/|Chosen Software "Journal Macro"]] - Free trial software version available. *[[http://www.quickmacros.com/|Gintaras Didzgalvis "Quick Macros"]]. *[[http://www.flashplayerpro.com/MacroRecorder/|GoldSolution Software, Inc. "Easy Macro Recorder"]]. *[[http://www.graphicaldynamics.com/|Graphical Dynamics, Inc. "AutoIntern"]] - "Small-Business Process Automation". Free trial software version available. *[[http://www.macro-expert.com/|GrassSoftware]]. *[[http://www.macro-expert.com/|GrassSoftware "Macro Expert"]] - Free trial software version available. *[[http://mouse-recorder.macro-expert.com/|GrassSoftware "Advanced Key and Mouse Recorder"]] - Free trial software version available. *[[http://www.hiteksoftware.com/|Hitek Software LLC "Automize"]] - Free trial software version available. *[[http://www.macroexpress.com/|Insight Software Solutions, Inc. "MacroExpess - The Windows Automation Tool"]] - Free trial software version available. *[[http://en.wikipedia.org/wiki/Macro_Express|EN.Wikipedia "Macro Express"]]. *[[http://www.jitbit.com/|Jitbit Software]]. *[[http://www.jitbit.com/macro-recorder/|Jitbit Software "Macro Recorder", "Macro Recorder LITE"]] - Free trial software version available. *[[http://www.jitbit.com/macro-recorder/free-macro-recorder/|Jitbit Software "Free Macro Recorder"]]. *[[http://www.macrox.de/| Michael Milawski Software "MacroX - Automatisierungssoftware für Windows"]] - Free trial software version available. *[[http://www.mjtnet.com/|MJT Net Ltd]] - Free trial software version available. *[[http://www.mjtnet.com/macro_scheduler.htm|MJT Net Ltd "mjtnet Macro Scheduler - Windows Automation Made Easy"]]. *[[http://www.mjtnet.com/mouse-recorder.htm|MJT Net Ltd "Mouse Recorder"]]. *[[http://www.robotask.com/|Neowise Software "RoboTask"]] - Free trial software version available. *[[http://www.macro-recorder.com/|Readmesoft Company, Inc. "Auto Macro Recorder"]] - Free trial software version available. *[[http://www.vtaskstudio.com/|Vista Software "vTask Studio"]] - Free trial software version available. *[[http://www.winautomation.com/|Softomotive Ltd "WinAutomation"]] - "The most advanced Windows Automation app, featuring a Macro Recorder and a Web Recorder". Free trial software version available. === Windows Automation & Batch Systems === *[[http://www.winbatch.com/|WinBatch, the Batch Language for Windows]]. === Macro Recorders in Desktop Applications === == The Macro Recorders in Microsoft Excel == *[[http://spreadsheets.about.com/od/advancedexcel/ss/excel_macro.htm|About.com "Excel 2003 Macro Tutorial"]]. *[[http://www.excel-vba-easy.com/vba-how-to-excel-macro-recorder.html|#1 Source for Excel macros on the net "Excel Macro Recorder"]]. *[[http://www.dummies.com/how-to/content/how-to-record-a-macro-to-automate-tasks-in-excel-2.html|Dummies.com - Make everything easier "How to Record a Macro to Automate Tasks in Excel 2010"]]. *Cookbook instructions for development of Excel automation solutions: -Use the built-in macro recorder of Excel to do what you want to do automatically. -Modify the recorded VBA code to make it run indepedantly. Especially replace all "Select" instructions. *Literature selection tip: Get a book which deals with both Excel & VBA automation, instead of a book about Excel ( wnich might handle macros in one of the last chapters, and enventually Excel automation with VBA not at all ) and another book about VBA ( which might not deal with the specialties of Excel automation ). == The Macro Recorder in Microsoft Visual Studio == *[[http://msdn.microsoft.com/en-us/library/b4c73967%28v=vs.80%29|MSDN Library "Visual Studio Macros"]] for Visual Studio 2005. == The Macro Recorder in Microsoft Word == === Addons === *The free [[http://www.qatools.de/|QA-Tools GmbH "SmarTest Framework"]] for use with commercial capture & replay tools. ==== OpenSource Software for End-to-End Testing of Databases ==== === ORAYLIS BI.Quality == *[[http://biquality.codeplex.com/|CodePlex "ORAYLIS BI.Quality"]]. *I was told that "ORAYLIS BI.Quality" was popular, until ist was superceded by "NBi". === NBi === == The Tool == *[[http://www.nbi.io|NBi]], [[http://www.github.com/Seddryck/NBi/|GitHub "Seddryck/NBi"]], [[http://nbi.codeplex.com/|CodePlex "NBi"]]. *[[http://www.nbi.io/automation/genbil/|NBi "Getting started with genbiL"]] - "GenbiL is a language to automate the generation of test suites through Genbi". *"Genbi" generates the necessary XML from templates. *[[http://www.twitter.com/seddryck|Twitter "Cédric L. Charlier, @Seddryck"]]. *[[http://www.seddryck.wordpress.com/|Ambiguity vs Information. A journey in a world made of data, information, knowledge and wisdom]]. *[[http://www.seddryck.wordpress.com/category/quality/testing/nbi/|Ambiguity vs Information. A journey in a world made of data, information, knowledge and wisdom: "Testing a Power BI Desktop solution with NBi"]]. == Resources == *NBi makes use of NUnit as job runner. *Experts suggested to use "Visual Studio Professional" with commercial "Integration Services" package. By that, you may call NBi by a "Control Flow" to provide workflow automation. *[[http://blogs.adatis.co.uk/jonathon%20eveoconnor/post/Setup-Unit-Testing-with-NUnit-amp;-NBi|Jonathon Eve-O'Connor's Blog "Setup Unit Testing with NUnit & NBi"]]. *Slides [[http://www.slideshare.net/CdricCharlier1/automating-the-testing-of-your-bi-solution-with-n-bi|SlideShare "Automating the testing of your bi solution with NBi"]]. === Unit Test for Databases == *See [[unittest.html|Unit Test / Module Test]]. ==== Just-Commercial Software for Testing & Test Management ==== *[[http://www.cosmic-software.com/TestIt.php|COSMIC Software GmbH "C-TestIt!]] - "Cosmic Software UNIT TESTING product". *[[http://www.froglogic.com/|froglogic GmbH]] - "Squish GUI Testing", "Squish Central", "Squish Coco". *[[http://www-01.ibm.com/software/awdtools/test/realtime/|IBM Rational Test RealTime]], [[http://www-142.ibm.com/software/products/de/de/realtime/|IBM Deutschland - IBM Rational Test RealTime]] ( RTR, RTRT ). *[[http://de.wikipedia.org/wiki/Rational_Test_Realtime|DE.Wikipedia "IBM Rational Test RealTime"]]. *[[http://www.ibm.com/developerworks/rational/products/testrealtime/|IBM Developerworks "Rational Test RealTime"]]. *[[http://www.ibm.com/developerworks/downloads/product.html|IBM developerworks "Downloads, trials, and cloud. Evaluation software for developers"]]. *[[http://www.ipl.com/products/tools/pt400.uk.php|IPL Information Processing Ltd "Cantata++"]]. *[[http://de.wikipedia.org/wiki/Cantata%2B%2B|DE.Wikipedia "Cantata++"]]. *[[http://www.ldra.com/products.asp|LDRA Software Technology "LDRA Tools Suite"]]. *[[http://www.ldra.com/tbrun.asp|LDRA Software Technology "Unit Testing with TBrun"]]. *[[http://www.averna.com/products/proligent/enterprise/|Averna "Proligent Enterprise"]] - "test lifecycle management system". *[[http://www.testbench.info/|imbus TestBench]], [[http://www.imbus.de/produkte/imbus-testbench/|imbus TestBench]]. *[[http://www.Innovasys.com/products/qas/overview.aspx|innovasys "QA Studio"]], evaluation version is available for download. *[[http://www.parasoft.com/|Parasoft]]. *"Parasoft Insure++" - "Runtime Analysis and Memory Error Detection for C and C++". *"Parasoft Test", "Parasoft Concerto", "Parasoft Virtualize". *[[http://www.qualisystems.com/|Qualisystems "TestShell Personal Edition"]] - "basic stand-alone test automation framework suited to small organizations requiring a single test automation station". *[[http://www.qualisystems.com/site/modules/landing.asp|Qualisystems "TestShell - 60 days risk free evaluation package"]]. *[[http://www.seapine.com/ttstudio.html|Seapine Software "TestTrack Studio"]] - 30 days evaluation version is available. *[[http://www.tricentis.com/products/tricentis-tosca-testsuite/test-management|TRICENTIS Technology & Consulting GmbH "Tricentis Tosca Testsuite. Test Management"]]. *[[http://www.youtube.com/user/TRICENTIS|YouTube "Tricentis"]]. *[[http://plus.google.com/100735323056219282911/|Google+ "Tricentis"]], [[http://plus.google.com/108151335013813449490/|Google+ "Tricentis"]]. *[[http://www.twitter.com/Tricentis|Twitter "Tricentis"]]. *[[http://en.wikipedia.org/wiki/Tricentis|EN.Wikipedia "Tricentis"]]. *[[http://en.wikipedia.org/wiki/Tosca_%28software%29|EN.Wikipedia "Tosca (software)"]], [[http://de.wikipedia.org/wiki/Tosca_%28Software%29|EN.Wikipedia "Tosca (Software)"]]. *[[http://www.vectorcast.com/|Vector Software]] - "Reduce Time, Effort, and Cost for Validating Software". *[[http://www.vectorcast.com/software-testing-products/c++-unit-testinga.php|VectorCAST/C+]]. *[[http://www.vectorcast.com/software-testing-products/embedded-code-coverage.php|VectorCAST/Cover]] - "Code Coverage Analysis Tool". *[[http://www.vectorcast.com/software-testing-products/unit-regression-testing.php|VectorCAST/Manage]] - "Regression Testing Tool". *Webcast [[http://www.vectorcast.com/news/vector-software-monthly-webinar.php|Vektor Software "Using VectorCAST to Automate Safety-Critical Embedded Software Testing"]], timezone [[http://www.timeanddate.com/library/abbreviations/timezones/na/edt.html|EDT]] = UTC-4, i.e. 12:00 EDT -> 17:00 CET ?! ==== Just-Commercial Online Services for Testing & Test Management "In the Cloud" ==== *[[http://www.melioratestlab.com/|Meliora Testlab]] [[http://www.melioratestlab.com/de/|Meliora Testlab - Deutsch]]- "Meliora Testlab is a complete browser-based test management tool for your application lifecycle management". *[[http://www.linkedin.com/company/meliora-oy|LinkedIn Company Profile "Meliora Ltd"]]. *[[http://www.facebook.com/melioraoy|Facebook "Meliora"]] - "Internet/Software. Our mission is to provide best-of-class quality management tools to help you improve your quality. We are passionate about quality improvement and practical enough to aim for best solutions". *Blog & News [[https://www.melioratestlab.com/news/|Meliora Testlab News]]. *[[http://www.crunchbase.com/company/meliora|CrunchBase "Meliora"]]. *[[http://www.testtoolreview.de/en/testtool-overview/tool-list/tooldetail/574_meliora_testlab|Testtool Review "Meliora"]]. *Marketing by [[http://www.balticsalesagency.com/|Baltic Sales Agency]]. *[[http://www.reqtest.com/|ReQtest - WEB-based Testing & Bug Reporting the easy Way]]. *[[http://www.facebook.com/reqtest|Facebook "ReQtest"]]. *[[http://plus.google.com/110513148744600133999|Google+ "ReQtest"]]. *[[http://www.twitter.com/ReQtester|Twitter "ReQtest @ReQtester"]]. *Blog [[http://reqtest.com/testing-blog/|ReQtest Blog "Testing Archives"]] by [[http://www.linkedin.com/in/markdebono|LinkedIn "Mark Debono"]], [[http://mt.linkedin.com/pub/mark-debono/81/978/669|LinkedIn "Mark Debono"]]. *[[http://www.reqtest.com/testing-blog/how-not-to-conduct-usability-tests/|ReQtest Blog, article "How NOT To Conduct Usability Tests"]]. *[[http://www.reqtest.com/testing-blog/positive-user-experience-is-it-important/|ReQtest Blog, article "Positive user experience, is it important?"]]. *[[http://www.reqtest.com/testing-blog/agile-testing-is-the-emperors-new-clothes/|ReQtest Blog, article "Agile testing is the emperor’s new clothes"]]. *[[http://www.getzephyr.com/|Zephyr]]. *[[http://www.facebook.com/getzephyr|Facebook "Zephyr"]]. *[[http://developer.yourzephyr.com/|Zephyr Developer Zone]]. *Blog [[http://blogs.yourzephyr.com/|Blog "Zephyr - Now, Test Management is a breeze and we want to talk about it"]]. *[[http://testmanagement.pbworks.com/|PBworks "testmanagement"]]. *[[http://www.nytimes.com/external/gigaom/2008/11/07/07gigaom-amazon-web-services-not-just-for-early-adopters-28525.html|The New York Times "Amazon Web Services Not Just for Early Adopters"]], 2008-11-07. *[[http://www.getzephyr.com/zephyr/integrations/zephyr_jira_integration.php|Zephyr "Deep integration with JIRA and Bugzilla"]]. ==== Model-based Testing of Embedded Control Systems ==== *The commercial [[http://www.piketec.com/products/tpt.php|PikeTec GmbH "TPT"]]. *Tests. -Test of MATLAB/Simulink models and TargetLink models test and verification of MATLAB Simulink models and TargetLink models. -Test of ASCET models test and verification of ASCET models. -Test of AUTOSAR software test and verification of AUTOSAR Software. -Test of C-Code test and verification of C-Code, C-Programs. -Test via CAN-Bus test and verification via CAN-Bus. -Test via INCA und CANape test and verification via INCA and CANape. -Test at HiL. *[[http://en.wikipedia.org/wiki/TPT_%28software%29|EN.Wikipedia "TPT (software)"]], [[http://de.wikipedia.org/wiki/TPT_%28Software%29|DE.Wikipedia "TPT (Software)"]]. ==== Resources ==== *[[http://en.wikipedia.org/wiki/Test_management_tools|EN.Wikipedia "Test management tools"]]. ===== Test Anything Protocol ( TAP ) ===== *[[http://www.testanything.org/|Test Anything Protocol ( TAP )]]. *"A simple text-based interface between testing modules in a test harness. It decouples the reporting of errors from the presentation of the reports. One of its major uses is for noise reduction; when you have a suite of many tests, making them TAP producers and using a TAP consumer to view them helps ensures that you will see everything you need to notice and diagnose breakage without being distracted by a flood of irrelevant success messages. It can assist other forms of analysis and statistics-gathering as well". *"TAP started life as part of the test harness for Perl but now has implementations in C, C++, Python, PHP, Perl, Java, JavaScript, Go, Rust, and others. Consumers and producers do not have to be written in the same language to interoperate". *Python. *[[http://pypi.org/project/tap.py/|PyPi "tap.py"]]. *[[http://tappy.readthedocs.io/|ReadTheDocs "tappy"]]. *[[http://www.github.com/python-tap/tappy|GitHub "python-tap"]]. *Lua: *See [[lua.html|Lua & eLua]]. *[[http://en.wikipedia.org/wiki/Test_Anything_Protocol|EN.Wikipedia "Test Anything Protocol"]]. ===== TTCN-3 ===== ==== Commercial TTCN Testing Tools ==== *[[http://www.elvior.com/testcast/ttcn-3|Elvior LLC "TTCN-3 Products"]]. *The free online TTCN-3 verification service [[http://www.ttcn3online.com/|Elvior LLC "TTCN-3 verification service"]]. *[[http://www.ibm.com/software/rational/|IBM Rational]]. *[[http://www.ibm.com/software/awdtools/ttcnsuite/|IBM Rational TTCN Suite]]. *[[http://www.ibm.com/software/awdtools/ttester/|IBM Rational Systems Tester]] ( formerly: Telelogic Tester ). *[[http://www.ibm.com/developerworks/downloads/product.html|IBM developerworks "Downloads, trials, and cloud. Evaluation software for developers"]]. *Experts told me, that from their point of view there was no major development of "Telelogic Tester" since it was acquired by IBM :-(. *[[http://www.testingtech.com/|TestingTech]]. *[[http://www.testingtech.com/products/ttworkbench.php|TestingTech - "TTworkbench - The Reliable Test Automation Platform"]], free trial version is available for download. ==== Resources==== *ISO / IEC 9646-4: 1994. *[[http://en.wikipedia.org/wiki/TTCN|EN.Wikipedia "TTCN"]], [[http://de.wikipedia.org/wiki/TTCN|DE.Wikipedia "TTCN"]]. *[[http://www.ttcn-3.org/|ETSI's official TTCN-3 home page]]. *Andrej Pietschker, [[http://www.xing.com/profile/Andrej_Pietschker|XING "Andrej Pietschker"]], [[http://de.linkedin.com/pub/andrej-pietschker/0/28/2a1|LinkedIn "Andrej Pietschker"]]: *[[http://www.hannovermesse.de/veranstaltung/model-based-security-testing-results-of-a-eu-research-project/VOR/56573|Hannover Fair - Forum Industrial IT "Andrej Pietschker: Model-basierte Sicherheitstests - Ergebnisse eines EU Forschungsprojektes"]] - About TTCN-3. *[[http://www.itu.int/ITU-T/studygroups/com10/languages/Z.140_0701_pre.pdf|ITU-T Z.140 "The Tree and Tabular Combined Notation version 3]] ( PDF ). ===== YAML - YAML Ain't Markup Language, RAML, TAML,... ===== ==== YAML Resources ==== *[[http://en.wikipedia.org/wiki/YAML|EN.Wikipedia "YAML"]], [[http://de.wikipedia.org/wiki/YAML|DE.Wikipedia "YAML"]]. *[[http://www.yaml.org/|YAML.Org]] - "The Official YAML Web Site". *[[http://yaml.org/spec/|YAML.Org "YAML™ Specification Index"]]. *[[http://yaml.kwiki.org/|kwiki "YAML"]] *[[http://yaml.kwiki.org/?YamlInFiveMinutes|kwiki "YAML" - "Yaml In Five Minutes"]]. *[[http://www.nt.ntnu.no/users/haugwarb/|Tore Haug-Warberg]]. *[[http://www.nt.ntnu.no/users/haugwarb/Programming/YAML/YAML_for_ruby.html|Tore Haug-Warberg "Yaml Cookbook"]]. *[[http://www.pyyaml.org/|PyYAML.org]] - "The home of various YAML implementations for Python". *[[http://www.bitbucket.org/xi/pyyaml|BitBucket "xi / pyyaml"]] - "PyYAML - The next generation YAML parser and emitter for Python.". *[[https://bitbucket.org/xi/libyaml|BitBucket "xi / libyaml"]] - "LibYAML - A C library for parsing and emitting YAML". *[[http://www.ibm.com/developerworks/library/x-matters23.html|IBM "developerWorks / XML / Technical library" - "XML Matters: YAML improves on XML"]]. ==== RAML ( RESTful API Modeling Language ) ==== *See [[rest.html|Representational State Transfer ( REST )]]. ==== YAML Software ==== *[[http://www.kuwata-lab.com/kwalify/|Kwalify]] - "schema validator and data binding for YAML/JSON". *[[http://kwalify.sourceforge.net/|Sourceforge "Kwalify"]], [[http://www.sourceforge.net/projects/kwalify/|Sourceforge "Kwalify"]] - implementation in Java. *[[http://jvyaml.dev.java.net/|java.net "JvYAML"]] - "A Java YAML 1.1 parser and emitter". *[[http://code.google.com/p/snakeyaml/|Google Code "snakeyaml"]] - "YAML parser and emitter for Java". ==== Free YAML Online Services ==== *Swagger -> See [[rest.html|Representational State Transfer ( REST )]]. ==== TAML ==== === Tools === *[[http://www.toml.io/|TOML [Tom's Obvious Minimal Language]]] - "A config file format for humans". === Resources === *[[http://gist.github.com/oconnor663/9aeb4ed56394cb013a20|GitHub Gist "TOML vs YAML"]]. *[[http://www.stackoverflow.com/questions/65283208/toml-vs-yaml-vs-strictyaml|StackOverflow "TOML vs YAML vs StrictYAML"]]. *[[http://en.wikipedia.org/wiki/TOML|EN.Wikipedia "TOML"]], [[http://de.wikipedia.org/wiki/TOML|DE.Wikipedia "TOML"]]. ==== Dynamic Code Analysis ==== *[[http://en.wikipedia.org/wiki/Dynamic_code_analysis|EN.Wikipedia "Dynamic program analysis"]]. ===== Test Concept for Embedded Systems ===== ==== Test Concept #1 - One-way Communication ==== === Test Concept #1 - The classical "printf()" === *Use "printf()" by an URART to a remote console on the host. In case of multithreading, multitasking this is sometimes the best quick + dirty solution. === Test Concept #1.2 - "Spy" Function of an RTOS === *A "spy" function of an RTOS sends a binary, but ordered or tagged, data stream to the PC (via serial, USB, Ethernet, wireless, etc.) and the PC decodes it for capture and/or display. An advanced diagnostic tool might send this binary data over Ethernet to be captured by Wireshark and IIRC ( a custom filter within Wireshark ). ==== Test Concept #2 - Unit Test with Hardware Emulation ==== -Write a test for any module that will exercise the function at edge and corner cases. -If the module code accesses hardware in the production version, -Either supply adequiate hardware signals to the device under test ( Hardware in the Loop ( HIL ) ). -And / or emulate the hardware and its input and output ( just use an if-query not to access hardware if the code is tested, bzt -to use predefined static values. -to use calculated values. -to use values provided by a state machine. -or values transfered from a host, which generates the values by a script, a calculation or with the help of a state machine. -You might use test concept #1 for one-way communication. -Somehow you have to start your tests, by uploading code which executes the tests instead of executing the application. ==== Test Concept #3 - Script Languages ===== === Test Concept #3.1 - Script Language on the Target ==== == Test Concept #3.1.1 - Dialog by a classical Monitor == *Implement and use an on-target monitor ( e.g. "debug.com" or a monitor running in the firmware ) to transfer informations by UART to a remote console on a host. == Test Concept #3.1.2 - Application-specific Script Language on the Target == -Design a "command language" and a parser to run on the device and its application under test, so that the interface to the module functions can be triggered with various values. -The input to that device under test could be scripted. === Test Concept #3.2 - Script Language on the Host ==== -Install a script language ( Python, Perl,..) which can work by serial communications. -The target "opens" a new console on the host and executes script command by its own output. === Test Concept #3.3 - Script Language both on the Host and the target ==== -Combine concept #3.1.2 and #3.2 to let interact 2 applications by a common interface and interface language. ===== Some other Test Concepts ===== ==== Blinded Experiment ==== *[[http://en.wikipedia.org/wiki/Blinded_experiment|EN.Wikipedia "Blinded experiment"]], [[http://de.wikipedia.org/wiki/Blindstudie|DE.Wikipedia "Blindstudie"]] ( "Blindtest" ). *In German language for technical "Blinded Experiments": *"Ein Blindversuch ist ein Vorversuch unter den gleichen Bedingungen wie das endgültige Experiment durchgeführt wird, ohne das das eigentliche Untersuchungs-Objekt hinzugenommen wird. Und wenn das erste Objekt den Vorversuch besteht, kann das eigentliche Experiment zu den gleichen Voraussetzungen gestartet und zum Abschluss gebracht werden. Wichtig: Es darf nicht das selbe Objekt sein, es müssen 2 ( gleiche ) Objekte sein: Das Test-Objekt und das Untersuchungs-Objekt. Der erste wird getestet und dann wird der gleiche Versuch mit dem zweiten Objekt durchgeführt". ===== Magazines ===== *[[http://www.diazhilterscheid.de/|Diaz & Hilterscheid Unternehmensberatung GmbH]]. *[[http://www.agilerecord.com/|Agile Record - The Magazine for Agile Developers and Agile Testers]] - free PDF and paper magazine. *[[http://www.testingexperience.com/|testing experience - The Magazine for Professional Testers]] - free PDF and paper magazine. *"testing experience", PDF issue "December 2010" - Open Source Tools". *[[http://www.stsc.hill.af.mil/crosstalk/|CrossTalk - Journal of Defense Software Engineering]] by [[http://www.stsc.hill.af.mil/|Software Technology Support Center]] & Department of Defence ( DOD - free PDF magazine. ===== Books ===== ==== General ==== *[[http://www.hs-bremen.de/internet/de/hsb/struktur/mitarbeiter/spillner/|Andreas Spillner]]. *Book [[http://www.amazon.de/exec/obidos/ASIN/3898646424/hemmerling-21/|Andreas Spillner, Tilo Linz: "Basiswissen Softwaretest: Aus- und Weiterbildung zum Certified Tester - Foundation Level nach ISTQB-Standard"]]. *Book [[http://www.amazon.de/exec/obidos/ASIN/3898645576/hemmerling-21/|Andreas Spillner, Thomas Roßner, Mario Winter, Tilo Linz: "Praxiswissen Softwaretest - Testmanagement, Aus- und Weiterbildung zum Certified Tester - Advanced Level nach ISTQB-Standard"]]. *[[http://www.polteq.com/en/about-polteq/martin-pol/|Martin Pol]], [[http://www.polteq.com/|polteq]]. *[[http://www.polteq.com//en/training/test-process-improvement|polteq "Test (Process) Improvement"]] ( TPI ). *[[http://www.polteq.com//en/publications/german|polteq "Management und Optimierung des Testprozesses"]] - "Mit TMap (Test Management Approach) wird eine seit Jahren erfolgreich beim Testen eingesetzte Vorgehensweise an Hand vieler Beispiele erläutert. TPI (Test Process Improvement) bietet de Möglichkeit, einen bereits praktizierten Testprozess zu analysieren und zu optimieren. Beide Ansätze bauen aufeinander auf und ergänzen sich". *Book [[http://www.amazon.de/exec/obidos/ASIN/3898641562/hemmerling-21/|Martin Pol, Tim Koomen, Andreas Spillner: "Management und Optimierung des Testprozesses"]]. *[[http://www.parasoft.com/|Parasoft]]. *The free PDF book [[http://alm.parasoft.com/functional-testing-ebook/|Parasoft "End-to-End Testing. Simplify Complex Testing Across APIs, Cloud, SOA, and Composite Apps"]] -> [[http://parasoft.web6.hubspot.com/Portals/69806/docs/e2e.pdf|Parasoft "End-to-End Testing. Simplify Complex Testing Across APIs, Cloud, SOA, and Composite Apps"]] ( PDF ). *The free PDF book [[http://alm.parasoft.com/techniques-for-unit-testing-embedded-software-systems/|Parasoft "Techniques for Unit Testing Embedded Systems Software"]] -> [[http://blog.parasoft.com/Portals/69806/docs/unit%20testing%20embedded.pdf|Parasoft "Techniques for Unit Testing Embedded Systems Software"]] ( PDF ). ==== Books about Software Testing ==== *Book [[http://www.amazon.de/exec/obidos/ASIN/0321503627/hemmerling-21|Steve Freeman, Nat Pryce: "Growing Object-Oriented Software, Guided by Tests"]] - I was told that this book explains the use of testing & TDD by non-trivial but simple software project throughout the complete book #. ==== Books about Code Review, Cross-Browser Testing ( and Load Testing ) ==== *[[http://smartbear.com|Smart Bear Software, Inc.]]. *The free PDF book [[http://www2.smartbear.com/CrossBrowser_Testing_Guide_ebook_SQA.html|Smart Bear Software, Inc. "A Step-by-Step Guide to Cross-Browser Testing"]]. *The free PDF Book [[http://www2.smartbear.com/outbound-webloaduipro-sqa-performance-maturity-ebook.html|Smart Bear Software, Inc. "A Guide to Effective Load Testing"]]. ==== Books about TTCN ==== *[[http://www.amazon.de/exec/obidos/ASIN/0470663065/hemmerling-21|Colin Willcock, Thomas Deiß, Stephan Tobies, Stephan Schulz, Stefan Keil, Federico Engler: An Introduction to TTCN-3]]. ===== Resources ===== ==== GUI Testing ==== *[[http://www.xing.com/net/qmsoftware/testtools-3080/capture-replay-961343/|XING Group "Qualitätsmanagement für Software-Projekte", Foren / Testtools / Thread "Capture & Replay"]]. *[[http://www.wilsonmar.com/|Wilson Mar]]. *[[http://www.wilsonmar.com/1robot.htm|Wilson Mar "IBM Rational Robot Test Automation Architecture"]]. *[[http://en.wikipedia.org/wiki/GUI_software_testing|EN.Wikipedia "Graphical user interface testing"]], [[http://en.wikipedia.org/wiki/List_of_GUI_testing_tools|EN.Wikipedia "List of GUI testing tools"]]. *[[http://en.wikipedia.org/wiki/Comparison_of_macro_recorder_software|EN.Wikipedia "Comparison of macro recorder software"]]. ==== General ==== *[[http://agile.dzone.com/news/simplest-thing-could-possibly|Agile Zone Software Methodologies for Development Managers, Dave Rooney "The Simplest Thing That Could Possibly Work"]] - "This principle is something that I learned early in my XP days. It goes hand in hand with TDD and says, 'Don't do any more than is required to make the currently failing test pass'". *[[http://www.all-about-test.info/|All About Test]] - "Die führende Informationsplattform zum Test von Elektronik in Entwicklung, Produktion und Service". *[[http://www.aptest.com/resources.html|Applied Testing and Technology, Inc., Aptest software testing specialists "Software QA Testing and Test Tool Resources"]]. *[[http://www.dzone.com/|DZONE - fresh links for developers]]. *[[http://agile.dzone.com/|DZONE, Agile Zone Software Methodologies for Development Managers]]. *Blog [[http://www.java.net/blogs/johnsmart?page=5|John Ferguson "johnsmart's blog"]]. *Blog article [[http://www.wakaleo.com/blog/268-real-developers-dont-need-unit-tests|John Ferguson, Wakaleo Consulting "Real Developers Don't Need Unit Tests"]] - "TDD Basics - The TDD development process: Test - **Write a failing unit test. Ensure that it fails**", 2010-05-06. *[[http://www.imbus.de/|imbus AG]]. *[[http://www.imbus.de/downloads/|imbus AG - Downloads]] - "Trends in Testing. Vorträge". *[[http://www.imbus.de/tool-liste/|imbus AG - "Tool-Liste. Testwerkzeuge im Überblick"]]. *Conference [[http://www.qs-tag.de/|Software QS-TAG]]. *[[http://msdn.microsoft.com/en-us/library/dd264917.aspx|Microsoft MSDN Library "Performing Common Development Tasks. Visual Studio 2010"]]. *[[http://msdn.microsoft.com/en-us/library/dd264975.aspx|Microsoft MSDN Library "Verifying Code by Using Unit Tests"]]. *[[http://msdn.microsoft.com/en-us/library/dd172118.aspx|Microsoft MSDN Library "Verifying Database Code by Using Unit Tests"]]. *[[http://www.modellzentriertestesten.de/|Modellzentriertes Testen]]. *[[http://www.nist.gov/|National Institute of Standards and Technology]]. *[[http://www.nist.gov/director/planning/upload/report02-3.pdf|NIST "The Economic Impacts of Inadequate Infrastructure for Software Testing"]] ( PDF ). *[[http://www.opensourcetesting.org/|opensourcetesting.org - open source testing tools, news and discussion]]. *[[http://www.opensourcetesting.org/testmgt.php|opensourcetesting.org "Test management tools"]] #. *[[http://www.quality-one.com/services/dvpr.php|Quality-One International Q-1 "DVP&R (Design Verification Plan and Report)"]]. *[[http://www.qualitytesting.info/|Quality Testing]] - "A leading social network and resource center for Software Testing Community". *[[http://www.phantomtest.com/phpbb3_forum/|Phantom Automated Solutions Forum]]. *[[http://www.rbcs-us.com/|Rex Black Consulting Services]] ( RBCS ). *[[http://www.rbcs-us.com/software-testing-resources/library/basic-library|RBCS "Software Testing Materials: Basic Resource Library"]]. *[[http://home.c2i.net/schaefer/|Hans Schaefer]]. *[[http://home.c2i.net/schaefer/testinglinks.html|Hans Schaefer "Web links about testing"]]. *[[http://www.12207.com/|12207 - Software Engineering Process Technology (SEPT)]] - "The Expert on ISO/IEC 12207 Software Life Cycle Processes". *[[http://www.servicedesigntools.org/|Service Design Tools - Communication Methods supporting Design Processes]] #. *[[http://www.servicedesigntools.org/tools/31|Service Design Tools - Communication Methods supporting Design Processes "The constructive interaction"]]. *[[http://de.slideshare.net/DominikDary/mobile-test-automation-at-ebay|SlideShare "Dominik Dary: Mobile Test Automation at eBay"]] - Slides of the free speech at OOSE, Hamburg, 2013-05-15. *[[http://www.testingfaqs.org/|Software Testing FAQ - an information resource for software testers]]. *[[http://www.sqs.de/aktuell_white_papers.php|SQS "Software Quality Papers (SQP)"]] - "IT-Outsourcing, Anforderungsmanagement, Code Quality Management oder Testmanagement -- wenn es um Software-Qualität geht, benötigen Manager und Experten oft kompaktes und leicht verständliches Wissen. Dies liefern Software Quality Papers von SQS". *[[http://www.sis.pitt.edu/~gray/ITMgnt/references/swebok/SWEBOK2004.pdf|SWEBOK - Guide to the Software Engineering Body of Knowledge, 2004 Version]] ( PDF ). *[[http://www.scribd.com/doc/944975/SWEBOK-Guide-2004|Scribd "SWEBOK - Guide to the Software Engineering Body of Knowledge, 2004 Version"]]. *[[http://www.techtarget.com/|TechTarget]]. *[[http://searchsoftwarequality.techtarget.com/|TechTarget SearchSoftwareQuality.com]] - "Helping you develop, deploy and manage quality software". *[[http://www.testtoolreview.de/|Testtoolreview. Information platform on the international market of software testing tools]] #. *Wikipedia. *[[http://en.wikipedia.org/wiki/Portal:Software_Testing|EN.Wikipedia "Portal:Software Testing"]]. *[[http://en.wikipedia.org/wiki/Test_automation|EN.Wikipedia "Test automation"]]. *[[http://de.wikipedia.org/wiki/Softwaretest|DE.Wikipedia "Softwaretest"]]. *[[http://en.wikipedia.org/wiki/Test_automation_framework|DE.Wikipedia "Test automation framework"]]. *[[http://en.wikipedia.org/wiki/ISTQB_Certified_Tester|EN.Wikipedia "International Software Testing Qualifications Board Certified Tester"]], [[http://de.wikipedia.org/wiki/ISTQB_Certified_Tester|DE.Wikipedia "ISTQB Certified Tester"]]. *[[http://en.wikipedia.org/wiki/Software_Engineering_Body_of_Knowledge|En.Wikipedia "Software Engineering Body of Knowledge"]]. *[[http://en.wikipedia.org/wiki/Automatic_test_equipment|EN.Wikipedia "Automatic test equipment"]], [[http://de.wikipedia.org/wiki/Automatic_Test_Equipment|DE.Wikipedia "Automatic Test Equipment"]] ( ATE ). *IEEE 1012. *[[http://de.wikipedia.org/wiki/Software_Validation_%26_Verification_Plan|DE.Wikipedia "Software Validation & Verification Plan"]] -> "IEEE 1012". *[[http://en.wikipedia.org/wiki/IEEE_829|EN.Wikipedia "IEEE 829"]] - "Other standards.. IEEE 1012, a standard for Software Verification and Validation". *[[http://en.wikipedia.org/wiki/Functional_testing|EN.Wikipedia "Functional testing"]], [[http://en.wikipedia.org/wiki/Black-box_testing|EN.Wikipedia "Black-box testing"]], [[http://de.wikipedia.org/wiki/Black-Box-Test|DE.Wikipedia "Black-Box-Test"]], [[http://en.wikipedia.org/wiki/White-box_testing|EN.Wikipedia "White-box testing"]], [[http://de.wikipedia.org/wiki/White-Box-Test|DE.Wikipedia "White-Box-Test"]]. ***[[http://en.wikipedia.org/wiki/List_of_unit_testing_frameworks|EN.Wikipedia "List of unit testing frameworks"]], [[http://de.wikipedia.org/wiki/Liste_von_Modultest-Software|DE.Wikipedia "Liste von Modultest-Software"]]** #. *[[http://en.wikipedia.org/wiki/Verification_and_validation_%28software%29|EN.Wikipedia "Verification and validation (software)"]]. *Ekran YILMAZ. *[[http://www.skilledtester.de/|Ekran YILMAZ "skilledtesting"]]. *Wiki Blog [[http://www.iaskquestions.com/|Ekran YILMAZ "I ask questions"]]. ==== Objects for testing your own Web Automation skills ==== === Implementations === *[[http://demo.borland.com/InsuranceWebExtJS/|Borland / MicroFocus "InsuranceWeb. Insurance & Co. Insurance Co. The Company You Can Trust"]] - "This site is a fictitious representation of an online company for the purpose of demonstrating Borland Solutions". *[[http://community.microfocus.com/borland/test/silk_test//f/29/t/9941.aspx|MicroFocus Community "Borland / Test / Silk Test / Silk Test - Forum / SilkTest for Extjs applications"]] -> "[[http://demo.borland.com/InsuranceWebExtJS/|http://demo.borland.com/InsuranceWebExtJS/]]". *[[http://www.grr.org/ParkCalc.php|Gerald R. Ford International Airport "Parking Calculator"]] - Original just-online implementation. *[[http://www.grr.org/ParkingRates.php|Gerald R. Ford International Airport "Parking Map & Rates"]]. *[[http://www.grr.org/Includes/Calculator.inc|grr.org/Includes/Calculator.inc]] - Some of the PHP code. *[[http://www.shino.de/parkcalc/|Markus Gärtner "PARKING COST CALCULATOR"]]. *[[http://www.github.com/mgaertne/airport-de|GitHub "mgaertne/airport-de"]] - "Parkkosten-Berechner Beispiele aus ATDD in der Praxis". *[[http://adam.goucher.ca/parkcalc/|Adam Goucher "Parking Calculator"]] - Another just-online implementation. *[[http://www.github.com/markfink/SelRunner|Github "markfink/SelRunner"]]. *[[http://github.com/markfink/SelRunner/tree/master/test/fitnesse/FitNesseRoot/files/SelRunner|GitHub "SelRunner / test / fitnesse / FitNesseRoot / files / SelRunner"]] - "parkcalc", the sourcecode of an implementation in Javascript. *[[http://www.github.com/mgaertne/ParkCalc/issues/1|GitHub Issues "mgaertne/ParkCalc", Issue " download for parkcalc sample #1"]]. === Search for Resources === *[[http://www.google.de/search?q=parkcalc|Google "parkcalc"]]. *[[http://www.twitter.com/hashtag/parkcalc|Twitter - Search for #parkcalc]]. === Resources === *Markus Gärtner: *[[http://www.shino.de/2010/06/20/parkcalc-automation-getting-started/|Markus Gärtner "ParkCalc automation – Getting started"]], 2010-06-20. *[[http://www.shino.de/2010/06/24/parkcalc-automation-refactoring-a-data-driven-test/|Markus Gärtner "Agile Testing, Testing, Weekend Testing. ParkCalc automation – Refactoring a data-driven test"]], 2010-06-24. *[[http://www.shino.de/2010/07/05/parkcalc-automation-a-short-reflection/|Markus Gärtner "Agile Testing, Retrospectives, Testing, Weekend Testing. ParkCalc automation – A short reflection"]], 2010-07-05. *[[http://www.shino.de/2010/07/18/parkcalc-automation-keyword-driven-tests-in-fitnesse/|Markus Gärtner "Agile Testing, FitNesse, Testing, Weekend Testing. ParkCalc automation – Keyword-driven tests in FitNesse"]], 2010-07-18. *[[http://www.shino.de/2010/06/20/parkcalc-automation-getting-started/|Markus Gärtner "Agile Testing, Testing, Weekend Testing. ParkCalc automation – Getting started"]], 2010-07-20. *[[http://justinrohrman.com/blog/practice-makes-progress/|Rohrman on Quality "Practice makes progress: exercise for stickyminds"]], 2014-01-10. *[[http://www.softwaretestpro.com/Item/4696/Parkcalc---Review-and-Discussion/Software|Software Test Professionals, Community Blog - "Parkcalc - Review and Discussion"]], 2010-04-13. ==== Windows Task Automation ==== *[[http://www.freeware.de/programme/macro-recorder/|freeware.de "macro-recorder Programme"]]. *[[http://www.nonags.com/nonags/auto.html|Nonags "Freeware "Automation Tools"]]. *[[http://www.snapfiles.com/shareware/system/swauto.html|Snapfiles - A simply beter selection! Trusted since 1997 "Task Automation Software"]]. ==== Database Debugging ==== *[[http://datenbanktest.eventbrite.de/|Jens Schauder, JUG-Ostfalen "Und bist du nicht willig, so brauch' ich Gewalt - Testen von Datenbank-Code"]], 2012-10-18. *[[http://blog.schauderhaft.de/2011/03/13/testing-databases-with-junit-and-hibernate-part-1-one-to-rule-them/|Jens Schauder "Testing Databases with JUnit and Hibernate Part 1: One to Rule them"]], 2011. *[[http://blog.schauderhaft.de/2011/03/20/testing-databases-with-junit-and-hibernate-part-2-the-mother-of-all-things/|Jens Schauder "Testing Databases with JUnit and Hibernate Part 2: The Mother of All Things"]]. *[[http://blog.schauderhaft.de/2011/03/27/testing-databases-with-junit-and-hibernate-part-3-cleaning-up-and-further-ideas/|Jens Schauder "Testing Databases with JUnit and Hibernate Part 3: Cleaning up and Further Ideas"]], 2011. ===== Testing Education & Certification Preparation ===== *[[http://www.smartwebapps.de/|Prüfungsvorbereitung Softwaretest Datenbank mit Übungsfragen zum Thema Softwaretest]]. ===== Chat / IRC Communities ===== *Chat Slack community [[http://www.testers.io/|#testers. Software Testing Community Chat ( Testers.io )]]. ===== Forums, Newsgroups, Communities ===== *Advanced QTP Forums. *[[http://www.advancedqtp.com/forums/|Advanced QTP Forums]] - "Register For This Site. ERROR: The email address entered is not within an allowed domain" :-(. Just apply for a freebie ( e.g. [[http://www.advancedqtp.com/scripting-qtp/|Advanced QTP "Scripting QTP by Dani Vainstein"]] ), and you will have the chance to create an account even with a else rejected E-Mail address. *[[http://www.advancedqtp.com/forums/forum-qc/|Advanced QTP Forums, Subforum "Quality Center Q&A"]]. *The read-only forum [[http://www.advancedqtp.com/old_forums/|Advanced QTP Forums. Old Forums - For reference only (R/O)]]. *[[http://www.ahkscript.org/boards/|AHKScript (an AutoHotkey Forum)]]. *[[http://www.autohotkey.com/board/|AutoHotkey Community]]. *[[http://www.autoitscript.com/forum/|AutoIt Forum]]. *[[http://www.autoitscript.com/forum/|Jonathan Bennett & AutoIt Consulting Ltd - AutoIT Forums]]. *[[http://www.automationanywhere.com/forum/forum.php|Automation Anywhere Inc - FORUM]]. *Facebook. *[[http://www.facebook.com/AutomationAnywhereSoftware|Facebook "Automation Anywhere"]]. *[[http://www.facebook.com/AutomationAnywhereFans|Facebook "Automation Anywhere/Testing Anywhere Fans"]]. *[[http://www.facebook.com/btestr/|Betatestr]]. *[[http://www.facebook.com/groups/168683186853/|Facebook "QTP -Testcomplete-Testing-Loadrunner-Selenium-Blog"]]. *[[http://www.facebook.com/groups/358187634238232/|Facebook "TestComplete"]]. *[[http://www.facebook.com/TRICENTIS|Facebook "Tricentis"]]. *[[http://www.facebook.com/ubertesters|Facebook "Ubertesters"]]. *Google Groups. *[[http://groups.google.com/group/cpputest|Google Groups "cpputest"]]. *[[http://groups.google.com/group/mochajs|Google Groups "Mocha"]]. *[[http://groups.google.com/group/nightwatchjs|Google Groups "NightwatchJs"]]. *[[http://groups.google.com/group/nsubstitute|Google Groups "NSubstitute"]]. *[[http://groups.google.com/group/comp.software.extreme-programming/|Google Groups "comp.software.extreme-programming"]]. *[[http://groups.google.com/group/robotframework-users|Google Groups "robotframework-users"]]. *[[http://groups.google.com/group/robotframework-devel|Google Groups "robotframework-devel"]]. *[[http://groups.google.com/group/testng-users|Google Groups "testng-users"]]. *[[http://groups.google.com/group/throwtheswitch|Google Groups "ThrowTheSwitch Forums"]] / [[http://www.throwtheswitch.org/science-forums/|Throw The Switch! - Science Forums]]. *[[http://groups.google.com/forum/#!categories/throwtheswitch/ceedling|Google Groups "ThrowTheSwitch / Ceedling"]]. *[[http://groups.google.com/forum/#!categories/throwtheswitch/cmock|Google Groups "ThrowTheSwitch / CMock"]]. *[[http://groups.google.com/forum/#!categories/throwtheswitch/unity|Google Groups "ThrowTheSwitch / Unity"]]. *[[http://groups.google.com/forum/#!categories/throwtheswitch/cexception|Google Groups "ThrowTheSwitch / CException"]]. *[[http://groups.google.com/forum/#!categories/throwtheswitch/testing-c|Google Groups "ThrowTheSwitch / Testing C"]]. *[[http://groups.google.com/group/zombie-js|Google Groups "zombie.js"]]. *Google+. *[[http://plus.google.com/communities/112757416010738282943|Google+ "TestComplete"]]. *[[http://h30499.www3.hp.com/t5/Products/ct-p/sws-ProductFamilies|HP Enterprise Business Community]]. *[[http://h30501.www3.hp.com/|HP Software Solutions Community "Software"]] -> Vivid. *[[http://h30499.www3.hp.com/t5/Quality-Center-ALM/ct-p/sws-QC|HP Enterprise Business Community "Quality Center / ALM"]]. -Forum "Quality Center Support and News Forum". -"Quality Management Best Practices and Methodology". -"Requirements Management Information and News". -"Quality Center/ALM Knowledge Base". *[[http://h30499.www3.hp.com/t5/LoadRunner-Performance-Center/ct-p/sws-LoadRunner|HP Enterprise Business Community "LoadRunner / Performance Center / StormRunner Load"]]. -"Best Practices and Methodology". -"LoadRunner Information and News". -"LoadRunner Support Forum". -"Performance Center Support and News Forum". -"StormRunner Load Practitioner Forum". -"LoadRunner/Performance Center Knowledge Base". *[[http://www.innovasys.com/cs/forums/|Innovasys Community Forums]]. *[[http://forum.iopus.com/|iOpus Forum]]. *[[http://www.klaros-testmanagement.com/forum|klaros testmanagement Forum]]. *[[http://www.learnqtp.com/forums/|Learn QTP for those with a zest to test - QTP (UFT) Forums]]. *[[http://www.learnqtp.com/search/?q=qc|Learn QTP for those with a zest to test - QTP (UFT) Forums - Search for "qc"]]. *[[http://www.learnqtp.com/search/?q=ota|Learn QTP for those with a zest to test - QTP (UFT) Forums - Search for "ota"]]. *[[http://www.linkedin.com/grp/home?gid=1784477|LinkedIn Group "HP Quality Center OTA Developer"]]. *[[http://www.mjtnet.com/usergroup/|mjtnet - Macro Scheduler and Windows Automation Forum]]. *[[http://www.modellzentriertestesten.de/index.php?id=87|Modellzentriertes Testen - Forum]]. *[[http://www.phptest.club/|PHP test club]] - "PHPTestClub is a discussion board where developers and test engineers share their experience on automated testing PHP projects. Here we talk about various approaches, frameworks, and best practices in testing. We use PHPUnit, Behat, Codeception, PhpSpec, atoum, and other frameworks, as well as Selenium, PhantomJS, Continuous Integration and delivery systems". *Quality Testing. *[[http://www.qualitytesting.info/forum|Quality Testing Discussion Forum]]. *[[http://www.qualitytesting.info/groups|Quality Testing Groups]]. *[[http://www.robotask.com/forum/|Neowise Software "RoboTask Forum"]]. *[[http://wiki.openqa.org/|OpenQA (Confluence) Dashboard - OpenQA Wiki]] - Support for "Selenium", "Watir",.. *[[http://www.opensourcetesting.org/|opensourcetesting.org - open source testing tools, news and discussion]]. *[[http://www.opensourcetesting.org/forums/|opensourcetesting.org - Forum]]. *[[http://web.archive.org/web/*/http://forum.proficom.de/|Archive.org "profi.com AG business solutions Forum"]] ( - 2014-08-24 ) - About HPQC, OTA,... *[[http://community.qualitylogic.com/|QualityLogic Community]]. *[[http://www.quickmacros.com/forum/|Quick Macros Forum]]. *[[http://www.smartwebapps.de/forum|Prüfungsvorbereitung Softwaretest Datenbank mit Übungsfragen zum Thema Softwaretest - Foren]]. *[[http://www.ranorex.com/forum/|Ranorex Forum]]. *[[http://smartbear.com/|Smart Bear Software, Inc.]]. *[[http://feedback.codecollab.com/forums/4652-code-collaborator-features|Smart Bear Software, Inc. "Code Collaborator Features Forum"]]. *[[http://smartbear.com/forums/|Smart Bear Software, Inc. "SmartBear Forums"]]. *[[http://forum.soapui.org/|SoapUI Forum]]. *[[http://www.sqaforums.com/|Software Quality Assurance Forums]] ( SQAforums ) - "The online community for software testing & quality assurance professionals" #. *[[http://www.sqaforums.com/forums/telerik-webui-test-studio/|SQForums - Subforum "Telerik WebUI Test Studio"]]. *[[http://www.sqaforums.com/forums/hp-alm-mercury-quality-center/|SQForums - Subforum "HP ALM / Mercury Quality Center. This forum is now for HP Application Lifecycle Management ALM (Previously known as Mercury Quality Center)"]]. *[[http://lists.sourceforge.net/lists/listinfo/texttest-users|SourceForge mailing list "Texttest-users"]]. *[[http://testing.stackexchange.com/|Stackexchange "Testing"]] - "A place to ask questions about software testing". *[[http://tdforums.tdadmins.com/|TDForums - An HP Software Community]] - TD = Test Director. "[#10123] The administrator is currently not accepting new membership registrations" :-(. *[[http://forum.testlink.org/|TestLink, Test management forum]]. *[[http://www.testtalk.net/|TestTalk - network device testing community]] by [[http://www.ixiacom.com/|Ixia]]. *[[http://forums.pragprog.com/forums/123|The Pragmatic Bookshelf - Pragmatic Forums "Test Driven Development for Embedded C"]]. *[[http://www.thinbasic.com/community/forum.php|ThinBasic Forum]]. *[[http://support.thoughtworks.com/forums/|ThoughtWorks Customer Support - Forums]]. *[[http://forums.utest.com/|uTest Software Testing Forums]]. *[[http://www.vietnamesetestingboard.org/|VietnameseTestingBoard - VTB Software Testing Community]]. *[[http://www.vietnamesetestingboard.org/zbxe/?mid=Testing_Question_Answer|VietnameseTestingBoard - Forum]]. *The read-only forum [[http://www.vtaskstudio.com/forum/YaBB.pl|Vista Software "vTask Forums"]]. *Vivit. *[[http://www.vivit-worldwide.org/forums/|Vivit Forums]]. *[[http://www.vivit-worldwide.org/forums/Topics.aspx?forum=111045|Vivit Forums, Subforum "HP Quality Center"]]. *[[http://vivitworldwide.site-ym.com/forums/Default.aspx?group=80113|Vivit Forums, Subforum "Chapter: Germany Forums"]]. *[[http://www.vivit-worldwide.org/forums/Default.aspx?group=79943|Vivit Forums, Subforum "Special Interest Group: Testing Quality and ALM Forums"]]. *[[http://www.vivit-worldwide.org/?page=HPSolutionsForum|Vivit "HP Software Discover Performance Community for IT Experts"]]. *Yahoo Groups. *[[http://groups.yahoo.com/neo/groups/AgileEmbedded|Yahoo Groups "Agile Embedded"]]. *[[http://groups.yahoo.com/neo/groups/jsunit|Yahoo Groups "JsUnit"]]. *[[http://tech.groups.yahoo.com/group/junit/|Yahoo Groups "junit. JUnit, the Java unit testing framework written by Kent Beck and Erich Gamma"]], [[http://tech.groups.yahoo.com/group/testdrivendevelopment/|Yahoo Groups "testdrivendevelopment. Test-driven Development"]]. *[[http://groups.yahoo.com/group/domaindrivendesign/|Yahoo Groups "Domain-Driven Design"]], [[http://groups.yahoo.com/group/fitnesse/|Yahoo Groups "fitnesse"]]. *[[http://www.xing.com/net/asqf|XING "ASQF"]]. {{tag>testing}}