Unit testing Unit testing TDD with JUnit. Unit Testing Unit testing with JUnit 2 Testing concepts Unit testing Testing tools JUnit Practical use of tools

  • Published on
    31-Dec-2015

  • View
    216

  • Download
    1

Embed Size (px)

Transcript

  • Unit testing

    TDD with JUnit

    Unit testing with JUnit

  • Unit TestingUnit testing with JUnit*Testing conceptsUnit testingTesting toolsJUnitPractical use of toolsExamplesHow to create JUnit TestCase in Eclipse

    Unit testing with JUnit

  • Why?Unit testing with JUnit*Why testing?Improve software designMake software easier to understandReduce debugging timeCatch integration errorsIn short, to Produce Better CodePreconditionsWorking codeGood set of unit tests

    Unit testing with JUnit

  • What should be tested ?Unit testing with JUnit*

    Test for boundary conditionsTest for both success and failureTest for general functionalityEtc..

    Unit testing with JUnit

  • When to start testingUnit testing with JUnit*

    Software quality and testing is alife-cycle process

    Unit testing with JUnit

  • When to start testing...Unit testing with JUnit*

    At the time of starting the projectsHow we start the projects ??Do we have any formal way ??

    Unit testing with JUnit

  • The V-model of developmentUnit testing with JUnit*

    Unit testing with JUnit

  • Fact of testingUnit testing with JUnit*

    Testing does not guaranteethe absence of defects

    Unit testing with JUnit

  • What is test caseUnit testing with JUnit*

    A test case is a document that describes an input, action, or event and an expected response, to determine if a feature of an application is working correctly

    Unit testing with JUnit

  • Good test case designUnit testing with JUnit*An good test case satisfies the following criteria:Reasonable probability of catching an errorDoes interesting thingsDoesnt do unnecessary thingsNeither too simple nor too complexNot redundant with other testsMakes failures obviousMutually Exclusive, Collectively Exhaustive

    Unit testing with JUnit

  • Test case design techniqueUnit testing with JUnit*Test case design techniques can be broadly split into two main categories

    Black box (functional)

    White box (structural)

    Unit testing with JUnit

  • Black Box testsUnit testing with JUnit*Targeted at the apparent simplicity of the softwareMakes assumptions about implementationGood for testing component interactionsTests the interfaces and behavior

    Unit testing with JUnit

  • White Box testsUnit testing with JUnit*Targeted at the underlying complexity of the softwareIntimate knowledge of implementationGood for testing individual functionsTests the implementation and design

    Unit testing with JUnit

  • Test case writing exampleUnit testing with JUnit*

    Suppose we have two parameters we want to cover in a set of tests. Parameters are as follows..

    Operating systemWin98Win2kWinxp

    PrintersHP 4100HP 4200

    How We should write test case for this ??

    Unit testing with JUnit

  • Types of TestsUnit testing with JUnit*UnitIndividual classes or types

    ComponentGroup of related classes or types

    IntegrationInteraction between classes

    Unit testing with JUnit

  • What is a testing framework?Unit testing with JUnit*A test framework provides reusable test functionality which:Is easier to use (e.g. dont have to write the same code for each class)Is standardized and reusableProvides a base for regression tests

    Unit testing with JUnit

  • Why use a testing framework?Unit testing with JUnit*Each class must be tested when it is developedEach class needs a regression testRegression tests need to have standard interfacesThus, we can build the regression test when building the class and have a better, more stable product for less work

    Unit testing with JUnit

  • Regression testingUnit testing with JUnit*New code and changes to old code can affect the rest of the code baseAffect sometimes means breakWe need to run tests on the old code, to verify it works these are regression testsRegression testing is required for a stable, maintainable code base

    Unit testing with JUnit

  • Testing toolsUnit testing with JUnit*

    Tools are part of the qualityequation, but not the entireequation

    Unit testing with JUnit

  • JUnitUnit testing with JUnit*JUnit is a framework for writing unit testsA unit test is a test of a single classA test case is a single test of a single methodA test suite is a collection of test casesUnit testing is particularly important when software requirements change frequentlyCode often has to be refactored to incorporate the changesUnit testing helps ensure that the refactored code continues to work

    Unit testing with JUnit

  • JUnit..Unit testing with JUnit*JUnit helps the programmer:Define and execute tests and test suitesFormalize requirements and clarify architectureWrite and debug codeIntegrate code and always be ready to release a working version

    Unit testing with JUnit

  • What JUnit doesUnit testing with JUnit*JUnit runs a suite of tests and reports resultsFor each test in the test suite:JUnit calls setUp()This method should create any objects you may need for testing

    Unit testing with JUnit

  • What JUnit doesUnit testing with JUnit*JUnit calls one test methodThe test method may comprise multiple test cases; that is, it may make multiple calls to the method you are testingIn fact, since its your code, the test method can do anything you wantThe setUp() method ensures you entered the test method with a virgin set of objects; what you do with them is up to youJUnit calls tearDown()This method should remove any objects you created

    Unit testing with JUnit

  • Creating a test class in JUnitUnit testing with JUnit*Define a subclass of TestCase Override the setUp() method to initialize object(s) under test. Override the tearDown() method to release object(s) under test. Define one or more public testXXX() methods that exercise the object(s) under test and assert expected results. Define a static suite() factory method that creates a TestSuite containing all the testXXX() methods of the TestCase. Optionally define a main() method that runs the TestCase in batch mode.

    Unit testing with JUnit

  • FixturesUnit testing with JUnit*A fixture is just a some code you want run before every testYou get a fixture by overriding the method protected void setUp() { }The general rule for running a test is:protected void runTest() { setUp(); tearDown(); }so we can override setUp and/or tearDown, and that code will be run prior to or after every test case

    Unit testing with JUnit

  • Implementing setUp() methodUnit testing with JUnit*Override setUp() to initialize the variables, and objectsSince setUp() is your code, you can modify it any way you like (such as creating new objects in it)Reduces the duplication of code

    Unit testing with JUnit

  • Implementing the tearDown() methodUnit testing with JUnit*In most cases, the tearDown() method doesnt need to do anythingThe next time you run setUp(), your objects will be replaced, and the old objects will be available for garbage collectionLike the finally clause in a try-catch-finally statement, tearDown() is where you would release system resources (such as streams)

    Unit testing with JUnit

  • The structure of a test methodUnit testing with JUnit*A test method doesnt return a resultIf the tests run correctly, a test method does nothingIf a test fails, it throws an AssertionFailedErrorThe JUnit framework catches the error and deals with it; you dont have to do anything

    Unit testing with JUnit

  • Test suitesUnit testing with JUnit*In practice, you want to run a group of related tests (e.g. all the tests for a class)To do so, group your test methods in a class which extends TestCaseRunning suites we will see in examples

    Unit testing with JUnit

  • assertX methodsUnit testing with JUnit*static void assertTrue(boolean test)static void assertFalse(boolean test)assertEquals(expected, actual) This method is heavily overloaded: arg1 and arg2 must be both objects or both of the same primitive typeFor objects, uses your equals method, if you have defined it properly, as public boolean equals(Object o) --otherwise it uses ==.assertSame(Objectexpected, Objectactual)Asserts that two objects refer to the same object (using ==) assertNotSame(Objectexpected, Objectactual)assertNull(Objectobject)

    Unit testing with JUnit

  • assertX methodsUnit testing with JUnit*assertNotNull(Objectobject) fail()Causes the test to fail and throw an AssertionFailedErrorUseful as a result of a complex test, when the other assert methods arent quite what you want .

    All the above may take an optional String message as the first argument, for example, static void assertTrue(String message, boolean test)

    Unit testing with JUnit

  • Organize The Tests Unit testing with JUnit*Create test cases in the same package as the code under testFor each Java package in your application, define a TestSuite class that contains all the tests for validating the code in the packageDefine similar TestSuite classes that create higher-level and lower-level test suites in the other packages (and sub-packages) of the applicationMake sure your build process includes the compilation of all tests

    Unit testing with JUnit

  • JUnit frameworkUnit testing with JUnit*

    Unit testing with JUnit

    Testing client

    run(TestResult)setUp()runTest()tearDown()

    TestCase

    fName

    setUp()runTest()tearDown()test1()test2()

    ConcreteTestCase

    action()

    TestedClass

    setUp()runTest()tearDown()

    TestResult

    runTest()

    test1()ortest2()

    Test

    run(TestResult)addTest(Test)

    TestSuite

    fTests

    forall test in fTests test.run(TestResult)

  • Example: Counter classUnit testing with JUnit*For the sake of example, we will create and test a trivial counter classThe constructor will create a counter and set it to zeroThe increment method will add one to the counter and return the new valueThe decrement method will subtract one from the counter and return the new value

    Unit testing with JUnit

  • Example: Counter classUnit testing with JUnit*We write the test methods before we write the codeThis has the advantages described earlierDepending on the JUnit tool we use, we may have to create the class first, and we may have to populate it with stubs (methods with empty bodies)Dont be alarmed if, in this simple example, the JUnit tests are more code than the class itself

    Unit testing with JUnit

  • JUnit tests for Counter Unit testing with JUnit*public class CounterTest extends junit.framework.TestCase { Counter counter1; public CounterTest() { } // default constructor protected void setUp() { // creates a (simple) test fixture counter1 = new Counter(); } protected void tearDown() { } // no resources to release

    Unit testing with JUnit

  • JUnit tests for CounterUnit testing with JUnit* public void testIncrement() { assertTrue(counter1.increment() == 1); assertTrue(counter1.increment() == 2); } public void testDecrement() { assertTrue(counter1.decrement() == -1); } }// End from last slide

    Unit testing with JUnit

  • The Counter class itselfUnit testing with JUnit*public class Counter { int count = 0; public int increment() { return ++count; } public int decrement() { return --count; } public int getCount() { return count; } }

    Unit testing with JUnit

  • TestCase lifecycleUnit testing with JUnit*setUptestXXX()tearDown()Repeats 1 through 3 for each testXXX method

    Unit testing with JUnit

  • Test SuitesUnit testing with JUnit*

    import junit.framework.Test;import junit.framework.TestCase;import junit.framework.TestSuite;

    import example.SimpleTest;import example.HtmlDocumentTest;

    public class AllTests { static public Test suite() { TestSuite suite = new TestSuite(); suite.addTestSuite(SimpleTest.class); suite.addTestSuite(HtmlDocumentTest.class); return suite; }}

    Demo

    Unit testing with JUnit

  • JUnit Best PracticesUnit testing with JUnit*Separate production and test codeBut typically in the same packagesCompile into separate trees, allowing deployment without testsDont forget OO techniques, base classingTest-driven developmentWrite failing test firstWrite enough code to passRefactorRun tests againRepeat until software meets goalWrite new code only when test is failing

    Unit testing with JUnit

  • Why JUnitUnit testing with JUnit*Allow you to write code faster while increasing qualityElegantly simple Check their own results and provide immediate feedback Tests is inexpensive Increase the stability of software Developer tests Written in Java Free Gives proper uniderstanding of unit testing

    Unit testing with JUnit

  • Problems with unit testingUnit testing with JUnit*JUnit is designed to call methods and compare the results they return against expected resultsThis ignores:Programs that do work in response to GUI commandsMethods that are used primary to produce output

    Unit testing with JUnit

  • Problems with unit testingUnit testing with JUnit*Heavy use of JUnit encourages a functional style, where most methods are called to compute a value, rather than to have side effectsThis can actually be a good thingMethods that just return results, without side effects (such as printing), are simpler, more general, and easier to reuse

    Unit testing with JUnit

    **Black box: Testers tests make assumptions about how things work, and then create tests to try to exploit weaknesses or holes in the software.

    In general, useful for testing interaction (or aggregate behavior). Also useful for testing UI elements or other event-driven or non-deterministic scenarios. Exercising unusual situations (out of memory, our of disk space, network failure, power failure, etc.) typically falls under black box testing.

    Apparent simplicity: Black box testing tries to ignore the implementation and interact with the software the same way a user might. Ignoring implementation details often leads the tester to find edge cases that the developer did not anticipate, or usage scenarios that are unsupported (or partially supported) and dont work at all (or only work partially). This also exploits the fact that most software is designed to make things easy by hiding the complexity of the software from the user but just because the complexity is hidden doesnt mean it goes away. Often times the steps taken to hide complexity from the user introduce completely new bugs!

    Interfaces: tests the surface of the component and its interactions with other pieces of softwareBehavior: tests how the software reacts do inputs (i.e., poke it like and see what happens)

    *White box: Developers tests typically confirm known-good behavior, or target implementation-specific weaknesses.

    In general, good for function-level tests.

    Too much knowledge can sometimes be a bad thing. If the code looks good, there is a temptation to avoid tests because they look like they should pass.

    Underlying complexity: The software may try to appear simple to the user, but the underlying implementation details are often extremely complex. By testing with knowledge of the implementation, testers can create tests that are designed to exacerbate the internal details of the software that the user is normally hidden from. This includes interactions with other software components, etc. These bugs often occur because the capabilities of the underlying software are often much larger than the features exposed directly to the user. Since the user doesnt (normally) exercise many of these capabilities, the...