[GLASSFISH-16321] Improve Hudson testing of ORB Created: 06/Apr/11  Updated: 08/Dec/11

Status: Open
Project: glassfish
Component/s: orb
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Critical
Reporter: Ken Cavanaugh Assignee: Harshad Vilekar
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   

We are working on a number of improvements for automated ORB testing using Hudson:

  • Split the main Hudson job into separate build and ORB regression test jobs
  • This requires testing against delivered artifacts instead of the build classes in the workspace
    Fixing this requires some changes (ken is working on these):
  • Create a test/orb directory for the artifacts to test against
  • Have the ORB build automatically copy build/release/lib/bundles/*jar to test/orb
  • Modify test classpath accordingly
  • Package ORB activation/ORBD code in a bundle for testing purposes
  • Package IDL compiler in a bundle for testing purposes
  • Anything else that breaks the tests?
  • Create a Hudson job for iiop-folb-dev-test (Harshad)
  • Needs to report results in a JUnit XML report (Ken is fixing in iiop-folb-dev-test)
  • Need to introduce a means of customizing run.sh, probably something like ~/.iiop-folb-dev-test
  • Create Hudson jobs for CORBA SQE tests (Harshad)
  • CORBA SQE tests are available in the locked project corba-sqe-tests (I just added Harshad as a member).
  • Create Hudson job(s) for performance testing
  • First one is StandardTest (in ORB regression tests)
  • Want both local and remote testing
  • Want to run it under Japex to gather performance info
  • Test is already complete and works, just need to automate under Hudson
  • Others?
  • Maribor is a candidate (currently in the perf team's reference workload)
  • Maribor needs quite a bit of work
  • Create Hudson jobs for GF integration test (Harshad)
  • This part is underway


 Comments   
Comment by Harshad Vilekar [ 08/Dec/11 ]

Following hudson jobs are deployed on hudson-sca.us.oracle.com:

  • Corba Master Workspace + GlassFish 3.1.2 Workspace
    corba-build-test-orb
    corba-orb-iiop-folb-devtest
  • Corba Staging Workspace + GlassFish Trunk Workspace
    corba-staging-build-test-orb
    corba-staging-iiop-folb-devtest
  • Corba/GlassFish Pre Integration Test
    corba-glassfish-preint-test
Generated at Mon Aug 29 01:00:43 UTC 2016 using JIRA 6.2.3#6260-sha1:63ef1d6dac3f4f4d7db4c1effd405ba38ccdc558.