Failed test is not failing in html test reports, its failing only in eclipse console

[babita92]

Hello
I am comparing the text entered in the user name field with the text i have mention below, and the text should fail in the html report generated by appium. But this is not the actual case the test is failing in eclipse console which is the desired behaviour but passing in the appium html report.
Please let me know what have i missed?

WebElement userName = driver.findElement(By.id(“custom_onboard_edittext_txt”));
driver.getKeyboard().sendKeys(“BABita @%^$&$* 1234567890 qwerty )(&&^^%%% ASDFGHJK");
assertEquals(userName.getText(), "BABita @%^$&$ 1234567890 qwerty )(”);

[Tom]

You need to catch the assertions who have failed and add them to the report

the way it’s usually done is by using the testing framework configuration methods to run a step after each test and check to see if there were an assertion that needs to be present in the report

e.g -

@AfterMethod
//runs after each @Test Method, checks if the test throw an error of type assertion and adds
the assertion content to the report along with a screen shot from the device
    public void addAssertionsToReport(ITestResult testResult)
    {
        Throwable throwable = testResult.getThrowable();
        if (throwable!=null && throwable instanceof AssertionError && driver!=null)
            driver.executeScript("client:client.report('Assertion failed : " + throwable.getMessage() + "',false)");

    }

This method needs to be present in the class that runs the test, or a member of a super class (e.g - LoginTests extends TestBase)

[pmaristani]

What is the method for junit?

[Tom]

JUnit 4.11 get test result in @After

The closest thing to what you’re asking for would probably be the TestWatcher rule. That won’t give you access to a returned result or anything, but you can use it (or create your own TestRule and combined with the Description object, you could annotate your methods differently to indicate what sort of clean-up is necessary.

Something like

 public static class WatchmanTest {
  private static String watchedLog;

  @Rule
  public TestWatcher watchman= new TestWatcher() {
      @Override
      protected void failed(Throwable e, Description description) {
          watchedLog+= description + "\n";
          driver.executeScript("client:client.setTestStatus(true,'"+watchedLog + "')");
      }

      @Override
      protected void succeeded(Description description) {
          watchedLog+= description + " " + "success!\n";
          driver.executeScript("client:client.setTestStatus(false,'"+watchedLog + "')");



         }
     };

  @Test
  public void fails() {
      fail();
  }

  @Test
  public void succeeds() {
     }
 }

[pmaristani]

I’m having the problem with no assertion, no eclipse failed and no supporting report.

[Tom]

I can’t even tell the language

You could place a breakpoint and debug the line that fails… I might got the test rules wrong for your version also…

[pmaristani]

[Step Eclipse]

public void checkdeletemessage(String resultado) {
WebDriverWait wait = new WebDriverWait(driver, 5);
wait.until(ExpectedConditions.visibilityOfElementLocated(By.id(“feedback_message”)));
WebElement mensagem = driver.findElement(By.xpath("//*[@text=‘Meio de pagamento excluído com sucesso!’]"));
assertEquals(mensagem.getText(), resultado);

}

[Step Appium Studio]

Note:

The positive message has the same id, the negative message.

The appium is comparing the ids, and the eclipse can identify the divergence of the message.

[Tom]

did you add the commands with the test rule?

can you see if the test rule is running or not by debugging the test (place a break point in the failed & success functions)

the code that should fail the test needs to run… (executeScript…)