glassfish
  1. glassfish
  2. GLASSFISH-16276

get-health reports incorrect status using jdk7 b136 after cluster is stopped

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.1_b43
    • Fix Version/s: 3.1.1_b01, 4.0_b37
    • Labels:
      None
    • Environment:

      10-machine cluster setup on linux 64bit

      Description

      used jdk7_b136 on b43 and get-health reported incorrect status after a successful cluster shutdown.
      However, after stopping the cluster I get:
      n1c1m1 failed since Mon Mar 28 02:32:24 UTC 2011
      n1c1m2 failed since Mon Mar 28 02:32:24 UTC 2011
      n1c1m3 stopped since Mon Mar 28 02:32:16 UTC 2011
      n1c1m4 failed since Mon Mar 28 02:32:24 UTC 2011
      n1c1m5 failed since Mon Mar 28 02:32:26 UTC 2011
      n1c1m6 failed since Mon Mar 28 02:32:24 UTC 2011
      n1c1m7 failed since Mon Mar 28 02:32:24 UTC 2011
      n1c1m8 failed since Mon Mar 28 02:32:24 UTC 2011
      n1c1m9 failed since Mon Mar 28 02:32:24 UTC 2011
      Command get-health executed successfully.

      http://aras2.us.oracle.com:8080/logs/gf31/gms//set_03_27_11_t_19_33_25/scenario_installonecluster_Sun_Mar_27_19_33_48_PDT_2011.html

        Activity

        Hide
        Joe Fialli added a comment -

        The instances are being stopped by stop-cluster. All instances are stopped in their server.log

        >[#|2011-03-28T02:32:16.172+0000|INFO|glassfish3.1|ShoalLogger|_ThreadID=18;_ThreadName=Thread-1;|
        > GMS1015: Received Group Shutting down message from member: server of group: clusterz1|#]
        >
        >[#|2011-03-28T02:32:16.315+0000|INFO|glassfish3.1|
        >javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=115;_ThreadName=Thread-1;|
        >Server shutdown initiated|#]
        >
        >[#|2011-03-28T02:32:16.322+0000|INFO|glassfish3.1|ShoalLogger|_ThreadID=115;_ThreadName=Thread-1;|
        >GMS1096: member: n1c1m1 is leaving group: clusterz1|#]

        The UDP notification message from the stopped instance to the DAS is being lost for 8 out of the 9
        instances. The planned shutdown notification for n1c1m3 is received in DAS.

        Could the test be rerun with following log-level set to FINEST to help track what is going wrong.

        % asadmin set-log-level --target clusterz1 ShoalLogger=FINEST // enable FINEST ShoalLogger in clustered instances
        % asadmin set-log-level ShoalLogger=FINEST // enable ShoalLogger in DAS server.log

        Show
        Joe Fialli added a comment - The instances are being stopped by stop-cluster. All instances are stopped in their server.log >[#|2011-03-28T02:32:16.172+0000|INFO|glassfish3.1|ShoalLogger|_ThreadID=18;_ThreadName=Thread-1;| > GMS1015: Received Group Shutting down message from member: server of group: clusterz1|#] > >[#|2011-03-28T02:32:16.315+0000|INFO|glassfish3.1| >javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=115;_ThreadName=Thread-1;| >Server shutdown initiated|#] > >[#|2011-03-28T02:32:16.322+0000|INFO|glassfish3.1|ShoalLogger|_ThreadID=115;_ThreadName=Thread-1;| >GMS1096: member: n1c1m1 is leaving group: clusterz1|#] The UDP notification message from the stopped instance to the DAS is being lost for 8 out of the 9 instances. The planned shutdown notification for n1c1m3 is received in DAS. Could the test be rerun with following log-level set to FINEST to help track what is going wrong. % asadmin set-log-level --target clusterz1 ShoalLogger=FINEST // enable FINEST ShoalLogger in clustered instances % asadmin set-log-level ShoalLogger=FINEST // enable ShoalLogger in DAS server.log
        Hide
        Joe Fialli added a comment -

        recreated failure and verified fix.

        fix integrated into glassfish 3 trunk. should be in next build.

        Show
        Joe Fialli added a comment - recreated failure and verified fix. fix integrated into glassfish 3 trunk. should be in next build.
        Hide
        Joe Fialli added a comment -

        fix integrated into 3.1.1 branch.

        Show
        Joe Fialli added a comment - fix integrated into 3.1.1 branch.

          People

          • Assignee:
            Joe Fialli
            Reporter:
            zorro
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: