TMap HD. Test Engineer.

Transcriptie

1 Sogeti Testing University TMap HD. Test Engineer. Working with the TMap Suite for Test Engineers Confidence through built-in Quality Vianen, 3 september 2015 Working with the TMap Suite 2 Werken met de TMap Suite 1

2 Agenda: Welkom en introductie TMap HD en de TMap Suite Workshop: Testen met testontwerptechnieken (maar niet met de hand!!) Terugkoppeling en conclusie Afsluiting Working with the TMap Suite 3 Even kort kennis maken Wie van jullie is: Test Analist / Test Engineer Test Manager Overig (Wat dan?) Wie van jullie heeft: TMap Test Engineer certificaat TMap Test Manager certificaat Working with the TMap Suite 4 Werken met de TMap Suite 2

3 Even voorstellen: Rik Marselis Management Consultant Quality & Testing bij Zo n 35 jaar IT ervaring, zo n 17 jaar kwaliteit & testen Adviseur, procesverbeteraar & coach bij vele organisaties Prince2 Practitioner, CMMI en CISA Docent voor diverse trainingen, bijv. Agile testen TMap, TPI en ISTQB geaccrediteerd Research Auteur div. boeken en artikelen Fellow van SogetiLabs, Spreker op div. conferenties En daarnaast: Voorzitter (vereniging voor & door testers, 1700 Working with the TMap Suite 5 TMap s evolution: TMap HD & the TMap Suite Confidence through built-in Quality Working with the TMap Suite 6 Werken met de TMap Suite 3

4 TMap s evolution Application variant Adaptive Pattern TMap blue TMap NEXT TMap HD Process driven Business driven Human driven Working with the TMap Suite 7 The TMap Suite TMap Suite TMap NEXT certificates remain valid! Working with the TMap Suite 8 Werken met de TMap Suite 4

5 TMap HD: What s new? Confidence through built-in Quality Working with the TMap Suite 9 TMap HD: What s new? 10 Werken met de TMap Suite 5

6 New: the Elements Mr. Mikkel introduces Neil to the elements 11 New: the Elements Mr. Mikkel introduces Neil to the elements 12 Werken met de TMap Suite 6

7 TMap HD: The Elements Integrate People Simplify Confidence Industrialize Human driven Quality driven Working with the TMap Suite 13 How testing is often perceived Two IT people are cycling up a hill on a tandem-bike. When they finally reach the summit the one in front, the developer, says: It was hard but we made it! Then the one at the back, the tester, comments: Yes and I hope you appreciate that I was using the brakes all the time because otherwise we would have rolled down the hill backwards Use TMap HD to make sure you are a tester that helps cycling up the hill!! Working with the TMap Suite 14 Werken met de TMap Suite 7

8 Element People: the T-shaped professional The difference between failure and success is in the People involved Human Driven as opposed to Process Driven Skills, Knowledge and Experience of the individual are crucial Team responsibility vs. Personal responsibility Working with the TMap Suite 15 The modern tester must be: Curious Creative Quality driven Willing to learn Multi-disciplinary needs to possess: People-skills Testing-skills Tooling-skills Observational skills Domain knowledge Working with the TMap Suite 16 Werken met de TMap Suite 8

9 Element: Integrate Collaboration across the entire Application LifeCycle Reviews and clear handovers in traditional lifecycle Integrated cross-functional teams in iterative lifecycles Working with the TMap Suite 17 Element: Simplify IT is rapidly becoming more complex and more difficult to manage. To reverse this trend we must simplify. By using standard components the process and product become simpler. As a tester we can use test design techniques to make sure we have just enough test cases. Don t do unnecessary activities. Work in short cycles with clear goals. Working with the TMap Suite 18 Werken met de TMap Suite 9

10 Element: Industrialize Automate and Standardize The tester needs to develop an additional skill set Recognize opportunities, even if you can t realize them yourself Working with the TMap Suite 19 Element: Industrialize Industrialize is about being efficient and effective Automated test design Automated test execution Automated test data management Automated test environment management But also: Checklists Comparators Tools to specify expected outcomes Etc. Working with the TMap Suite 20 Werken met de TMap Suite 10

11 Quality Driven TMap HD Quality-Driven Working with the TMap Suite 21 The Final Element: Confidence The overarching result! Confidence in: The quality of the end product The team By the team members and By the organization! One self Working with the TMap Suite 22 Werken met de TMap Suite 11

12 The Elements & Continuous improvement continuous improvement People Integrate Simplify Industrialize Confidence Human driven Quality driven Working with the TMap Suite 23 Building Blocks Confidence through built-in Quality Working with the TMap Suite 24 Werken met de TMap Suite 12

13 TMap HD: Building Blocks Working with the TMap Suite 25 Building Block: Test varieties Confidence through built-in Quality Working with the TMap Suite 28 Werken met de TMap Suite 13

14 Testing needs different angles and views Today people are hesitant to use the word Test Level since it seems to imply hierarchy. Testers often struggle to distinguish between Test Levels and Test Types. What should the focus of testing should be? What stakeholders should be involved in testing? Do they have different needs? Inexperienced Agile teams often do unit testing only, they forget the need to look from other perspectives Working with the TMap Suite 29 Test varieties 30 TM ap da g Werken met de TMap Suite 14

15 Implementing test varieties Traditional lifecycles Test levels Test types Blended model Iterative lifecycles Test approaches Working with the TMap Suite 31 Test approaches - Experience based - Coverage based Confidence through built-in Quality Working with the TMap Suite 41 Werken met de TMap Suite 15

16 Test approaches What do these terms mean? What is the difference? Working with the TMap Suite 42 Test approaches with TMap HD Experience based 1. Checklist Used for static & dynamic testing 2. Error guessing Based on previously encountered defects 3. Exploratory testing Learn, design and execute in parallel Coverage based 1. Process e.g. Proces Cycle Test 2. Conditions e.g. Elementary Comparison Test of Decision table 3. Data e.g. Data Combination Test 4. Appearance e.g. Syntactic or using user profile Working with the TMap Suite 43 Werken met de TMap Suite 16

17 Coverage based testing Confidence through built-in Quality Working with the TMap Suite 44 Welke testontwerptechnieken ken je? 45 Exp lora tory Test Werken met de TMap Suite 17

18 Test design techniques & coverage types TMap NEXT Equivalence classes Boundary value analysis Decision points (CC, DC, CDC, MCDC, MCC) Orthogonal arrays Pairwise testing Data cycle test (CRUD) Statistical usage (op.prof. Right paths / Fault paths Checklist Decision table Data Combination Test Elementary comparison tst Process Cycle test Real-life test Semantic test Syntactic test Use case test Error Guessing Exploratory testing Reviews Walkthroughs Inspections ISTQB Equivalence partitioning Boundary value analysis Decision table testing Cause Effect graphing State transition testing Use case testing User story testing Structure based (SC, CC, DC, CDC, MCDC, MCC) Error Guessing Exploratory testing Orthogonal arrays Pairwise testing Domain analysis Defect based techniques Checklist Combinatorial / Class. tree Informal review Technical review Walkthrough Inspection Static analysis Torbjorn Ryber Exploratory testing (this is an approach, not a technique) Inspection Walkthrough Technical review Informal review Modelling Equivalence partitions Boundary values Domain tests Business process testing Use case testing State based testing Decision tables & trees Elementary comparison Combinatorial testing Data cycle testing Syntax testing Time cycle testing Program Logic (SC, BC, PC) Data flow testing Boris Beizer Control-flow testing Loop testing Data-flow testing Transaction-flow testing Domain testing Syntax testing Finite-state testing And more 46 Select from 4 groups of Coverage types Better know & use one technique of each group than all techniques of only one group Working with the TMap Suite 47 Werken met de TMap Suite 18

19 Zo werkt testen met een testontwerptechniek Ontwerp alle testgevallen met een bepaalde techniek Voer alle testgevallen uit Rapporteer over de resultaten Working with the TMap Suite 48 Waaruit bestaat een testgeval? Uitgangssituatie Actie & Input Verwacht resultaat Working with the TMap Suite 49 Werken met de TMap Suite 19

20 Coverage based testing + Industrialize = COVER Confidence through built-in Quality Working with the TMap Suite 50 COVER: de testontwerptool van Sogeti Ontwerpen van: testsituaties, testgevallen en fysieke testgevallen Diverse technieken Working with the TMap Suite 51 Werken met de TMap Suite 20

21 COVER Demo Working with the TMap Suite 52 Workshop Confidence through built-in Quality Working with the TMap Suite 53 Werken met de TMap Suite 21

22 Workshop; De OV-korting-case Working with the TMap Suite 54 Voorbeeld COVER Condities Elementaire Vergelijkingen Test Working with the TMap Suite 55 Werken met de TMap Suite 22

23 Uitleg workshop In teams van + 4 mensen: Ontwerp testgevallen, m.b.v. COVER met PCT en DCT Noteer de testgevallen op de logsheet Voer de testgevallen uit Rapporteer je resultaten Als je klaar bent: vraag om de exploratory testing charter Working with the TMap Suite 56 Workshop; De OV-korting-case Working with the TMap Suite 57 Werken met de TMap Suite 23

24 Toelichting PCT PCT: - Teken de procesflow met - Exporteer de flow als XML (plain) - Importeer de XML in COVER - Genereer de logische testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit Working with the TMap Suite 58 Toelichting DCT DCT: - Bepaal de verschillende gegevens - Bepaal per gegeven de equivalentieklassen - Ga naar data in COVER, en kies genereer testgevallen - Vul de gegevens in en de verschillende klassen - Genereer de testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit Working with the TMap Suite 59 Werken met de TMap Suite 24

25 Terugkoppeling Hoeveel testgevallen heb je gemaakt? Wat zijn je testresultaten (passed/failed/observations) Heb je bevindingen? Met welk testgeval heb je de bevinding gevonden? Working with the TMap Suite 60 Terugkoppeling en conclusie Coverage based testen met tooling zodat je op een efficiënte manier een aantoonbare dekking hebt Experience based testen om aanvullende dekking, en vooral vertrouwen te krijgen Combinatie van gegenereerde dekking en hersenkracht geeft optimaal testen. Working with the TMap Suite 61 Werken met de TMap Suite 25

26 Omgaan met een complete gereedschapskist Working with the TMap Suite 62 Conclusie Met de TMap Suite ga je van: Werken volgens TMap Naar: Werken met TMap Working with the TMap Suite 63 Werken met de TMap Suite 26

27 The TMap Suite summarized TMap HD and TMap NEXT and tmap.net Confidence through built-in Quality Not just for true Lean or Agile environments, but also in traditional and hybrid environments. Human Driven Quality Driven Elements People Simplify Integrate Industrialize Building Blocks Patterns Tooling (bijv. COVER) Confidence Working with the TMap Suite 64 Meer lezen? Download vanaf of neem een printje mee. Working with the TMap Suite 65 Werken met de TMap Suite 27

28 The end. Happy Testing! Werken met de TMap Suite 28