Ant PDE Tests Run with JUnit4

Question

I am trying to automate pde tests, using pde-maven-plugin, maven calls, or ant tasks. I followed instructions from the article Automating Eclipse PDE Unit Tests using Ant to create the test.xml

Tests failed, first because No Tests Found

junit.framework.AssertionFailedError: junit.framework.AssertionFailedError: No tests found in com.example.TestSuite
    at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:130)
    at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)

I searched and found that I should use JUnit4Adapter, but doing that I got ClassCastException, here's the stack trace

java.lang.ClassCastException: junit.framework.JUnit4TestAdapter cannot be cast to junit.framework.Test
    at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestLoader.getTest(JUnit3TestLoader.java:108)
    at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestLoader.loadTests(JUnit3TestLoader.java:59)
    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:452)
    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
    at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
    at org.eclipse.pde.internal.junit.runtime.RemotePluginTestRunner.main(RemotePluginTestRunner.java:62)
    at org.eclipse.pde.internal.junit.runtime.CoreTestApplication.run(CoreTestApplication.java:23)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.eclipse.equinox.internal.app.EclipseAppContainer.callMethodWithException(EclipseAppContainer.java:574)
    at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
    at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110)
    at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79)
    at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:368)
    at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:559)
    at org.eclipse.equinox.launcher.Main.basicRun(Main.java:514)
    at org.eclipse.equinox.launcher.Main.run(Main.java:1311)
    at org.eclipse.equinox.launcher.Main.main(Main.java:1287)

Here's my plugin dependencies:

Require-Bundle: 
 org.eclipse.ui,
 org.eclipse.core.runtime,
 org.eclipse.jdt.core;bundle-version="3.4.2",
 org.eclipse.jdt.launching;bundle-version="3.4.1",
 org.eclipse.core.resources;bundle-version="3.4.1",
 org.apache.xerces;bundle-version="2.9.0",
 org.junit4;bundle-version="4.3.1"

and the test class

package com.example;

import junit.framework.JUnit4TestAdapter;
import junit.framework.Test;

import org.junit.runner.RunWith;
import org.junit.runners.Suite;
import org.junit.runners.Suite.SuiteClasses;

@RunWith(Suite.class)
@SuiteClasses( { SimpleTests.class})
public class TestSuite {

    public static Test suite() {

        return new JUnit4TestAdapter(TestSuite.class);
    }

}

any idea how to fix?

Answer 1

It is fixed by adding next lines when invoking org.eclipse.equinox.launcher.Main:

<arg line="-testLoaderClass org.eclipse.jdt.internal.junit4.runner.JUnit4TestLoader"/>
<arg line="-loaderpluginname org.eclipse.jdt.junit4.runtime"/>

Here's the full java ant task:

<java dir="${plugin.dir}"  
    fork="yes"
    classname="org.eclipse.equinox.launcher.Main"
    classpathref="equinox.launcher.class.path"
    jvm="${jvm}">
    <arg line="-application ${application}"/>
    <arg line="-data ${test.reports.dir}/output/ws"/>
    <arg line="-port ${pde.test.port}"/>
    <arg line="-dev bin -clean -debug"/>
    <arg line="-testpluginname ${plugin.name}"/>
    <arg line="-testLoaderClass org.eclipse.jdt.internal.junit4.runner.JUnit4TestLoader"/>
    <arg line="-loaderpluginname org.eclipse.jdt.junit4.runtime"/>
    <arg line="-classnames ${test.classes.list}"/>
    <jvmarg line="${vmargs}"/>
</java>    

Answer 2

I had the same problem as Noura and tried the fix they provided, which, unfortunately, only solved part of the problem. Instead of throwing the aforementioned ClassCastException, I got junit4 java.lang.Exception: No runnable methods, despite my 29 tests being carefully annotated with @Test.

After a few hours of searching (and only finding really old bugs back when JUnit 4 was new) and experimenting (this SO post didn't help either), I discovered the second part of my fix was related to the class path.

I had defined my classpath (which was used to launch PDETestResultsCollector, PDETestPortLocator and the test plugin) to be:

<path id="test.class.path">
   <pathelement location="build/my-bundled-jar-with-tests.jar" /> <!-- contains my app and the PDE* helper classes -->
   <fileset dir="${test.eclipse.dir}/plugins">
      <include name="org.junit_4.*/**/junit.jar" />
      <include name="org.hamcrest.core_*.jar" />
      <include name="org.apache.ant_*/**/ant.jar" />
      <include name="org.apache.ant_*/**/ant-junit.jar" />
      <include name="org.eclipse.jdt.core_*.jar" />
      <include name="org.eclipse.jdt.junit_*.jar" />
      <include name="org.eclipse.jdt.junit.core_*.jar" />
      <include name="org.eclipse.equinox.common_*.jar" />
      <include name="org.eclipse.debug.core_*.jar" />
      <include name="org.eclipse.osgi_*.jar" />
      <include name="org.eclipse.core.resources_*.jar" />
      <include name="org.eclipse.core.runtime_*.jar" />
      <include name="org.eclipse.core.jobs_*.jar" />
      <include name="org.eclipse.ui.workbench_*.jar" />
      <include name="org.eclipse.swt_*.jar" />
      <include name="org.eclipse.equinox.preferences_*.jar" />
      <include name="org.eclipse.equinox.launcher_*.jar" />
   </fileset>
</path>

and launched it like:

<java classpathref="test.class.path" classname="org.eclipse.equinox.launcher.Main" fork="yes" dir="${basedir}" >
   <arg line="-application org.eclipse.pde.junit.runtime.uitestapplication" />
   <arg line="-data reports/output/ws" />
   <arg line="-dev bin -clean -port ${pde.test.port}" />
   <arg line="-testApplication org.eclipse.ui.ide.workbench" />
   <arg line="-testpluginname my-bundled-plugin-with-tests" />
   <arg line="-testLoaderClass org.eclipse.jdt.internal.junit4.runner.JUnit4TestLoader" />
   <arg line="-loaderpluginname org.eclipse.jdt.junit4.runtime" />
   <arg line="-classnames TestAllMyCode" />
</java>

As it turns out, having build/my-bundled-jar-with-tests.jar on the classpath confused the test runner, so I had to make a new jar that contained just class files for PDETestListener, PDETestPortLocator and PDETestResultsCollector (called pde-test.jar). My fixed path was:

<path id="test.class.path">
   <pathelement location="build/pde-test.jar" /> <!-- fixed the problem -->
   <fileset dir="${test.eclipse.dir}/plugins">
      <include name="org.junit_4.*/**/junit.jar" />
      <include name="org.hamcrest.core_*.jar" />
      ... <!-- same as before -->

And all 29 tests were found and ran.