glassfish
  1. glassfish
  2. GLASSFISH-16696

3.1.1 startup/deployment performance regression due to corba integration

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 3.1.1
    • Fix Version/s: 3.1.1
    • Component/s: orb
    • Labels:
      None

      Description

      To track down the cause of the performance regression in 3.1.1 from 3.1, Sathyan and Amit have done iterative performance testing on the builds. Their data shown
      one of the regressions (happened around Jan 26th-27th) was due to the corba integration:
      http://svnsearch.org/svnsearch/repos/GLASSFISH/search?from=20110126&to=20110127&path=%2Ftrunk%2Fv3&author=kcavanaugh

      I am attaching some of the their data below:

      Build 44709 from http://hudson-sca.us.oracle.com/job/v3.1.1-PerfRegression/34/
      Regular build
      ==============================================================================
      logs/10.1.1/nightly_44709_iterations.jdk25/:
      Benchmark Samples Mean Stdev %Diff P Significant
      as_developerScenari 10 8.62 0.03 -5.59 0.000 Yes
      elapsed_time 10 8.62 0.03 -5.59 0.000 Yes
      server_startup 10 3.00 0.02 -6.38 0.001 Yes
      deployNaccess 10 3.11 0.02 0.25 0.929 *
      footprint 10 143988.00 101.32 -11.12 0.000 Yes
      average_redeployN 10 0.84 0.00 -12.76 0.000 Yes
      ==============================================================================

      Web build
      ==============================================================================
      logs/10.1.1/nightly_44709-web_10_iterations.jdk25/:
      Benchmark Samples Mean Stdev %Diff P Significant
      as_developerScenari 10 7.77 0.03 -1.50 0.026 *
      elapsed_time 10 7.77 0.03 -1.50 0.026 *
      server_startup 10 2.81 0.02 -4.84 0.000 Yes
      deployNaccess 10 2.78 0.02 1.82 0.170 *
      footprint 10 124031.20 245.59 -6.28 0.000 Yes
      average_redeployN 10 0.73 0.00 -1.70 0.000 Yes
      ==============================================================================
      =========================================================================================

      Build 44713 from http://hudson-sca.us.oracle.com/job/v3.1.1-PerfRegression/33/
      Regular build
      ==============================================================================
      logs/10.1.1/nightly_44713_10_iterations.jdk25/:
      Benchmark Samples Mean Stdev %Diff P Significant
      as_developerScenari 10 8.61 0.03 -5.41 0.000 Yes
      elapsed_time 10 8.61 0.03 -5.41 0.000 Yes
      server_startup 10 2.98 0.04 -5.75 0.001 Yes
      deployNaccess 10 3.12 0.01 0.05 0.985 *
      footprint 10 144116.00 267.45 -11.22 0.000 Yes
      average_redeployN 10 0.84 0.00 -12.59 0.000 Yes
      ==============================================================================

      Web build
      ==============================================================================
      logs/10.1.1/nightly_44713-web_10_iterations.jdk25/:
      Benchmark Samples Mean Stdev %Diff P Significant
      as_developerScenari 10 7.80 0.07 -1.88 0.010 *
      elapsed_time 10 7.80 0.07 -1.88 0.010 *
      server_startup 10 2.74 0.07 -2.33 0.018 *
      deployNaccess 10 2.88 0.01 -1.77 0.177 *
      footprint 10 126166.80 85.94 -8.11 0.000 Yes
      average_redeployN 10 0.72 0.00 -1.46 0.000 Yes
      ==============================================================================
      =========================================================================================

      Build 44706 from http://hudson-sca.us.oracle.com/job/v3.1.1-PerfRegression/31/
      Regular build
      ==============================================================================
      logs/10.1.1/nightly_44706_10_iterations.jdk25/:
      Benchmark Samples Mean Stdev %Diff P Significant
      as_developerScenari 10 8.60 0.02 -5.26 0.001 Yes
      elapsed_time 10 8.60 0.02 -5.26 0.001 Yes
      server_startup 10 2.98 0.03 -5.71 0.001 Yes
      deployNaccess 10 3.11 0.01 0.35 0.898 *
      footprint 10 144105.60 181.42 -11.21 0.000 Yes
      average_redeployN 10 0.84 0.00 -12.55 0.000 Yes
      ==============================================================================

      Web build
      ==============================================================================
      logs/10.1.1/nightly_44706-web_10_iterations.jdk25/:
      Benchmark Samples Mean Stdev %Diff P Significant
      as_developerScenari 10 7.74 0.09 -1.10 0.121 *
      elapsed_time 10 7.74 0.09 -1.10 0.121 *
      server_startup 10 2.72 0.03 -1.74 0.000 Yes
      deployNaccess 10 2.80 0.03 1.26 0.338 *
      footprint 10 125772.80 498.43 -7.78 0.000 Yes
      average_redeployN 10 0.74 0.03 -3.43 0.032 *
      ==============================================================================

        Activity

        Hide
        scatari added a comment -

        Pre approving for 3.1.1.

        Show
        scatari added a comment - Pre approving for 3.1.1.
        Hide
        scatari added a comment -

        This slow down in perf. has been reduced through improvements obtain through successive checkins(not in ORB) in 3.1.1. Closing this.

        Show
        scatari added a comment - This slow down in perf. has been reduced through improvements obtain through successive checkins(not in ORB) in 3.1.1. Closing this.
        Hide
        Joe Di Pol added a comment -

        Reopening to correct fixVersion

        Show
        Joe Di Pol added a comment - Reopening to correct fixVersion

          People

          • Assignee:
            Ken Cavanaugh
            Reporter:
            Hong Zhang
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: