glassfish
  1. glassfish
  2. GLASSFISH-19080

Exception in JarURIPattern causes failures in webapp.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.2
    • Fix Version/s: 4.0_b60
    • Component/s: web_container
    • Labels:
      None
    • Environment:
      • Any OS, any platform
      • GF3.1.x & GF 3.1.2

      Description

      When there is some invalid jar files in the filesystem,
      the GlassFish cannot load web application. For example
      the Admin console will fail to work. Even though
      an invalid jar is added, the GF server should not
      fail to start. THE WORST thing about this is there
      is TOTALLY no indication of what/where this file is.

      [#|2012-09-16T12:22:55.459+0000|SEVERE|oracle-glassfish3.1.2|org.apache.catalina.core.ContainerBase|_ThreadID=21;_ThreadName=Thread-2;|ContainerBase.addChild: start:
      org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
      at org.apache.catalina.core.StandardContext.start(StandardContext.java:5332)
      at com.sun.enterprise.web.WebModule.start(WebModule.java:498)
      at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:917)
      at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:901)
      at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:733)
      at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:2019)
      at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:1669)
      at com.sun.enterprise.web.WebApplication.start(WebApplication.java:109)
      at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130)
      at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269)
      at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301)
      at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461)
      at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375)
      at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210)
      at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108)
      Caused by: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
      at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:88)
      at org.glassfish.web.LibrariesTldProvider.postConstruct(LibrariesTldProvider.java:119)
      at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131)
      at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91)
      at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82)
      at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67)
      at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingIn at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationL
      ifecycle.java:461)
      at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplicat
      ion(ApplicationLoaderService.java:375)
      at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThr
      ead.java:210)
      at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThre
      ad.java:108)
      Caused by: java.lang.RuntimeException: java.util.zip.ZipException: error in open
      ing zip file
      at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern
      .java:88)
      at org.glassfish.web.LibrariesTldProvider.postConstruct(LibrariesTldProv
      ider.java:119)
      at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.
      java:131)
      at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreato
      r.java:91)
      at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.jav
      a:82)
      at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.jav
      a:67)
      at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingIn
      habitant.java:139)
      at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78)
      at org.jvnet.hk2.component.Habitat$5.get(Habitat.java:703)
      at java.util.AbstractList$Itr.next(AbstractList.java:345)
      at com.sun.enterprise.web.WebModuleListener.configureJsp(WebModuleListener.java:187)
      at com.sun.enterprise.web.WebModuleListener.lifecycleEvent(WebModuleListener.java:148)
      at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:149)
      at org.apache.catalina.core.StandardContext.start(StandardContext.java:5329)
      ... 14 more
      Caused by: java.util.zip.ZipException: error in opening zip file
      at java.util.zip.ZipFile.open(Native Method)
      at java.util.zip.ZipFile.<init>(ZipFile.java:127)
      at java.util.jar.JarFile.<init>(JarFile.java:135)
      at java.util.jar.JarFile.<init>(JarFile.java:99)
      at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:78)
      at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78)
      at org.jvnet.hk2.component.Habitat$5.get(Habitat.java:703)
      at java.util.AbstractList$Itr.next(AbstractList.java:345)
      at com.sun.enterprise.web.WebModuleListener.configureJsp(WebModuleListener.java:187)
      at com.sun.enterprise.web.WebModuleListener.lifecycleEvent(WebModuleListener.java:148)
      at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:149)
      at org.apache.catalina.core.StandardContext.start(StandardContext.java:5329)
      ... 14 more
      Caused by: java.util.zip.ZipException: error in opening zip file
      at java.util.zip.ZipFile.open(Native Method)
      at java.util.zip.ZipFile.<init>(ZipFile.java:127)
      at java.util.jar.JarFile.<init>(JarFile.java:135)
      at java.util.jar.JarFile.<init>(JarFile.java:99)
      at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:78)
      .java:78)
      ... 27 more

      #]

      [#|2012-09-16T12:22:55.466+0000|WARNING|oracle-glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=21;_ThreadName=Thread-2;|java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
      [#|2012-09-16T12:22:55.497+0800|SEVERE|oracle-glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=21;_ThreadName=Thread-2;|Exception while loading the app|#]

      [#|2012-09-16T12:22:55.550+0000|SEVERE|oracle-glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=21;_ThreadName=Thread-2;|Exception while loading the app|#]

      Cause:
      ------
      1) The com.sun.enterprise.util.net.JarURIPattern.getJarEntries should
      should be robust to ZipException.
      I believe it should continue instead of bailing out entirely if it sees
      a bad JAR. Imagine for example, we have a corrupt JAR or a JAR that
      have permission denied.

      2) Even if fail-fast, AT LEAST the default SHOULD have it LOG in WARNING
      what this FILE is to have use do CORRECTIVE action.
      As it is now, there just no easy way to know what file this is....

        Activity

        Hide
        Tom Mueller added a comment -

        Shing Wai, can you please take a look at this?

        Show
        Tom Mueller added a comment - Shing Wai, can you please take a look at this?
        Hide
        bernaps added a comment -

        Please note that our production system did exactly the same thing after rebooting our DAS server with around 8 clusters defined in it. This server did not reboot for a few month.

        Error is the same as above. Here is more info. We are not able to load the DAS at all. in this directory there is only one zip file which is the configuration

        Here is startup log

        [#|2012-09-25T10:30:44.322+0800|WARNING|glassfish3.1.2|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin|_ThreadID=37;_ThreadName=Thread-2;|There should be only 1 primordial module but 0 primordial modules were found.|#]

        Sep 25, 2012 10:30:45 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info
        INFO: JVM invocation command line:
        -XX:+UnlockDiagnosticVMOptions
        -XX:MaxPermSize=1024m
        -XX:PermSize=768m
        -XX:NewRatio=2
        -XX:+UseLinuxPosixThreadCPUClocks
        -Xms2048m
        -Xmx2048m
        -javaagent:/home/gfuser/glassfish312/glassfish/lib/monitor/flashlight-agent.jar
        -server
        -Dfelix.fileinstall.disableConfigSave=false
        -Djavax.net.ssl.keyStore=/home/gfuser/glassfish312/glassfish/domains/domain1/config/keystore.jks
        -Djava.awt.headless=true
        -Dfelix.fileinstall.poll=5000
        -Djava.endorsed.dirs=/home/gfuser/glassfish312/glassfish/modules/endorsed:/home/gfuser/glassfish312/glassfish/lib/endorsed
        -Djava.net.preferIPv4Stack=true
        -Dfelix.fileinstall.bundles.startTransient=true
        -Djavax.net.ssl.trustStore=/home/gfuser/glassfish312/glassfish/domains/domain1/config/cacerts.jks
        -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as
        -Djava.security.auth.login.config=/home/gfuser/glassfish312/glassfish/domains/domain1/config/login.conf
        -DANTLR_USE_DIRECT_CLASS_LOADING=true
        Dgosh.args=-nointeractive
        -Dosgi.shell.telnet.maxconn=1
        -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver
        -Dfelix.fileinstall.dir=/home/gfuser/glassfish312/glassfish/modules/autostart/
        -Dosgi.shell.telnet.port=7777
        -Djava.security.policy=/home/gfuser/glassfish312/glassfish/domains/domain1/config/server.policy
        -Dfelix.fileinstall.log.level=3
        -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory
        -Dosgi.shell.telnet.ip=127.0.0.1
        -Dcom.sun.aas.instanceRoot=/home/gfuser/glassfish312/glassfish/domains/domain1
        -Dcom.sun.aas.installRoot=/home/gfuser/glassfish312/glassfish
        -Djava.ext.dirs=/home/gfuser/jdk1.6.0_31/lib/ext:/home/gfuser/jdk1.6.0_31/jre/lib/ext:/home/gfuser/glassfish312/glassfish/domains/domain1/lib/ext
        -Dfelix.fileinstall.bundles.new.start=true
        Sep 25, 2012 10:30:47 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info
        INFO: Successfully launched in 41 msec.
        [#|2012-09-25T10:30:54.445+0800|INFO|glassfish3.1.2|com.sun.enterprise.server.logging.GFFileHandler|_ThreadID=1;_ThreadName=Thread-2;|Running GlassFish Version: GlassFish Server Open Source Edition 3.1.2 (build 23)|#]

        [#|2012-09-25T10:30:54.804+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-dcs-stress ...|#]

        [#|2012-09-25T10:30:54.887+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#]

        [#|2012-09-25T10:30:54.890+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#]

        [#|2012-09-25T10:30:54.896+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|
        GrizzlyNetworkManager1_9 Configuration
        BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null
        TCPSTARTPORT..TCPENDPORT:9090..9200
        MULTICAST_ADDRESS:MULTICAST_PORT:228.9.171.155:18290 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default
        FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000
        MAX_PARALLEL:15
        START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000
        MAX_WRITE_SELECTOR_POOL_SIZE:30

        #]

        [#|2012-09-25T10:30:54.902+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#]

        [#|2012-09-25T10:30:54.961+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=11;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#]

        [#|2012-09-25T10:30:55.001+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9118. Controller started in 48 ms|#]

        [#|2012-09-25T10:30:55.008+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#]

        [#|2012-09-25T10:30:55.014+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:18290 network interface: name:null multicast address:/228.9.171.155 timeToLive=4|#]

        [#|2012-09-25T10:30:55.041+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#]

        [#|2012-09-25T10:30:55.043+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-dcs-stress for member:server|#]

        [#|2012-09-25T10:30:55.050+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.068+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.068+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.082+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server

        #]

        [#|2012-09-25T10:30:55.082+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.091+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.097+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=13;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-dcs-stress memberType: SPECTATOR startTime: Sep 25, 2012 10:30:54 AM HKT ID:10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server TCP uri(s):[tcp://10.11.1.207:4000]|#]

        [#|2012-09-25T10:30:55.102+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=13;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID[10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server]
        CUSTOMTAGS[GROUP_NAME:cluster-dcs-stress, MEMBER_TYPE:SPECTATOR, START_TIME[10:30:54 AM HKT on Sep 25, 2012]], ENDPONTADDRESSES[[tcp://10.11.1.207:4000]], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#]

        [#|2012-09-25T10:30:55.122+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-dcs-prod ...|#]

        [#|2012-09-25T10:30:55.129+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#]

        [#|2012-09-25T10:30:55.130+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#]

        [#|2012-09-25T10:30:55.130+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|
        GrizzlyNetworkManager1_9 Configuration
        BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null
        TCPSTARTPORT..TCPENDPORT:9090..9200
        MULTICAST_ADDRESS:MULTICAST_PORT:228.9.224.35:10733 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default
        FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000
        MAX_PARALLEL:15
        START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000
        MAX_WRITE_SELECTOR_POOL_SIZE:30

        #]

        [#|2012-09-25T10:30:55.131+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: dcs-gf05-stress, MemberType: CORE, Address: 10.11.1.237:9177:228.9.171.155:18290:cluster-dcs-stress:dcs-gf05-stress
        2: MemberId: dcs-gf06-stress, MemberType: CORE, Address: 10.11.1.238:9126:228.9.171.155:18290:cluster-dcs-stress:dcs-gf06-stress
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server

        #]

        [#|2012-09-25T10:30:55.131+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: dcs-gf06-stress of group: cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.131+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: dcs-gf06-stress of group: cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.132+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf05-stress group: cluster-dcs-stress StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.133+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf06-stress group: cluster-dcs-stress StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.136+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for ADD_EVENT(before change analysis) are :
        1: MemberId: dcs-gf05-stress, MemberType: CORE, Address: 10.11.1.237:9177:228.9.171.155:18290:cluster-dcs-stress:dcs-gf05-stress
        2: MemberId: dcs-gf06-stress, MemberType: CORE, Address: 10.11.1.238:9126:228.9.171.155:18290:cluster-dcs-stress:dcs-gf06-stress
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server

        #]

        [#|2012-09-25T10:30:55.137+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-dcs-stress|#]

        [#|2012-09-25T10:30:55.145+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#]

        [#|2012-09-25T10:30:55.146+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=14;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#]

        [#|2012-09-25T10:30:55.157+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9196. Controller started in 11 ms|#]

        [#|2012-09-25T10:30:55.158+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#]

        [#|2012-09-25T10:30:55.159+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:10733 network interface: name:null multicast address:/228.9.224.35 timeToLive=4|#]

        [#|2012-09-25T10:30:55.166+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#]

        [#|2012-09-25T10:30:55.166+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-dcs-prod for member:server|#]

        [#|2012-09-25T10:30:55.167+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.178+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.179+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.185+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server

        #]

        [#|2012-09-25T10:30:55.185+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.185+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.186+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=16;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-dcs-prod memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server TCP uri(s):[tcp://10.11.1.207:4000]|#]

        [#|2012-09-25T10:30:55.187+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=16;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID[10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server]
        CUSTOMTAGS[GROUP_NAME:cluster-dcs-prod, MEMBER_TYPE:SPECTATOR, START_TIME[10:30:55 AM HKT on Sep 25, 2012]], ENDPONTADDRESSES[[tcp://10.11.1.207:4000]], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#]

        [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: dcs-gf07-prod, MemberType: CORE, Address: 10.11.1.211:9195:228.9.224.35:10733:cluster-dcs-prod:dcs-gf07-prod
        2: MemberId: dcs-gf08-prod, MemberType: CORE, Address: 10.11.1.212:9182:228.9.224.35:10733:cluster-dcs-prod:dcs-gf08-prod
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server

        #]

        [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: dcs-gf07-prod of group: cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: dcs-gf07-prod of group: cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf07-prod group: cluster-dcs-prod StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.209+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf08-prod group: cluster-dcs-prod StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.210+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for ADD_EVENT(before change analysis) are :
        1: MemberId: dcs-gf07-prod, MemberType: CORE, Address: 10.11.1.211:9195:228.9.224.35:10733:cluster-dcs-prod:dcs-gf07-prod
        2: MemberId: dcs-gf08-prod, MemberType: CORE, Address: 10.11.1.212:9182:228.9.224.35:10733:cluster-dcs-prod:dcs-gf08-prod
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server

        #]

        [#|2012-09-25T10:30:55.211+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-dcs-prod|#]

        [#|2012-09-25T10:30:55.230+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-ccws-prod ...|#]

        [#|2012-09-25T10:30:55.235+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#]

        [#|2012-09-25T10:30:55.235+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#]

        [#|2012-09-25T10:30:55.236+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|
        GrizzlyNetworkManager1_9 Configuration
        BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null
        TCPSTARTPORT..TCPENDPORT:9090..9200
        MULTICAST_ADDRESS:MULTICAST_PORT:228.9.75.35:22027 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default
        FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000
        MAX_PARALLEL:15
        START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000
        MAX_WRITE_SELECTOR_POOL_SIZE:30

        #]

        [#|2012-09-25T10:30:55.236+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#]

        [#|2012-09-25T10:30:55.237+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=17;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#]

        [#|2012-09-25T10:30:55.253+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9094. Controller started in 16 ms|#]

        [#|2012-09-25T10:30:55.254+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#]

        [#|2012-09-25T10:30:55.255+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:22027 network interface: name:null multicast address:/228.9.75.35 timeToLive=4|#]

        [#|2012-09-25T10:30:55.257+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#]

        [#|2012-09-25T10:30:55.260+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-ccws-prod for member:server|#]

        [#|2012-09-25T10:30:55.260+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.273+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.274+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.282+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=18;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-ccws-prod memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server TCP uri(s):[tcp://10.11.1.207:4000]|#]

        [#|2012-09-25T10:30:55.282+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=18;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID[10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server]
        CUSTOMTAGS[GROUP_NAME:cluster-ccws-prod, MEMBER_TYPE:SPECTATOR, START_TIME[10:30:55 AM HKT on Sep 25, 2012]], ENDPONTADDRESSES[[tcp://10.11.1.207:4000]], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#]

        [#|2012-09-25T10:30:55.389+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server

        #]

        [#|2012-09-25T10:30:55.390+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.390+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.401+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: ccws-gf01-prod, MemberType: CORE, Address: 10.11.1.208:9128:228.9.75.35:22027:cluster-ccws-prod:ccws-gf01-prod
        2: MemberId: ccws-gf02-prod, MemberType: CORE, Address: 10.11.1.210:9145:228.9.75.35:22027:cluster-ccws-prod:ccws-gf02-prod
        3: MemberId: ccws-gf03-prod, MemberType: CORE, Address: 10.11.1.213:9118:228.9.75.35:22027:cluster-ccws-prod:ccws-gf03-prod
        4: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server

        #]

        [#|2012-09-25T10:30:55.401+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: ccws-gf01-prod of group: cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: ccws-gf01-prod of group: cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf01-prod group: cluster-ccws-prod StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf02-prod group: cluster-ccws-prod StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf03-prod group: cluster-ccws-prod StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.404+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for ADD_EVENT(before change analysis) are :
        1: MemberId: ccws-gf01-prod, MemberType: CORE, Address: 10.11.1.208:9128:228.9.75.35:22027:cluster-ccws-prod:ccws-gf01-prod
        2: MemberId: ccws-gf02-prod, MemberType: CORE, Address: 10.11.1.210:9145:228.9.75.35:22027:cluster-ccws-prod:ccws-gf02-prod
        3: MemberId: ccws-gf03-prod, MemberType: CORE, Address: 10.11.1.213:9118:228.9.75.35:22027:cluster-ccws-prod:ccws-gf03-prod
        4: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server

        #]

        [#|2012-09-25T10:30:55.404+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-ccws-prod|#]

        [#|2012-09-25T10:30:55.407+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-ccws-stress ...|#]

        [#|2012-09-25T10:30:55.417+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#]

        [#|2012-09-25T10:30:55.421+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#]

        [#|2012-09-25T10:30:55.422+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|
        GrizzlyNetworkManager1_9 Configuration
        BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null
        TCPSTARTPORT..TCPENDPORT:9090..9200
        MULTICAST_ADDRESS:MULTICAST_PORT:228.9.54.166:6369 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default
        FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000
        MAX_PARALLEL:15
        START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000
        MAX_WRITE_SELECTOR_POOL_SIZE:30

        #]

        [#|2012-09-25T10:30:55.422+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#]

        [#|2012-09-25T10:30:55.426+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=20;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#]

        [#|2012-09-25T10:30:55.433+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9153. Controller started in 10 ms|#]

        [#|2012-09-25T10:30:55.434+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#]

        [#|2012-09-25T10:30:55.435+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:6369 network interface: name:null multicast address:/228.9.54.166 timeToLive=4|#]

        [#|2012-09-25T10:30:55.437+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#]

        [#|2012-09-25T10:30:55.439+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-ccws-stress for member:server|#]

        [#|2012-09-25T10:30:55.439+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.442+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.442+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.456+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=21;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-ccws-stress memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server TCP uri(s):[tcp://10.11.1.207:4000]|#]

        [#|2012-09-25T10:30:55.456+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=21;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID[10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server]
        CUSTOMTAGS[GROUP_NAME:cluster-ccws-stress, MEMBER_TYPE:SPECTATOR, START_TIME[10:30:55 AM HKT on Sep 25, 2012]], ENDPONTADDRESSES[[tcp://10.11.1.207:4000]], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#]

        [#|2012-09-25T10:30:55.457+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server

        #]

        [#|2012-09-25T10:30:55.457+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.457+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.468+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-cci-prod ...|#]

        [#|2012-09-25T10:30:55.484+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: ccws-gf02-stress, MemberType: CORE, Address: 10.11.1.210:9164:228.9.54.166:6369:cluster-ccws-stress:ccws-gf02-stress
        2: MemberId: ccws-gf03-stress, MemberType: CORE, Address: 10.11.1.213:9160:228.9.54.166:6369:cluster-ccws-stress:ccws-gf03-stress
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server

        #]

        [#|2012-09-25T10:30:55.487+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: ccws-gf02-stress of group: cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.487+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: ccws-gf02-stress of group: cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.487+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf02-stress group: cluster-ccws-stress StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.488+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf03-stress group: cluster-ccws-stress StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.489+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for ADD_EVENT(before change analysis) are :
        1: MemberId: ccws-gf02-stress, MemberType: CORE, Address: 10.11.1.210:9164:228.9.54.166:6369:cluster-ccws-stress:ccws-gf02-stress
        2: MemberId: ccws-gf03-stress, MemberType: CORE, Address: 10.11.1.213:9160:228.9.54.166:6369:cluster-ccws-stress:ccws-gf03-stress
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server

        #]

        [#|2012-09-25T10:30:55.484+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#]

        [#|2012-09-25T10:30:55.489+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-ccws-stress|#]

        [#|2012-09-25T10:30:55.490+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#]

        [#|2012-09-25T10:30:55.491+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|
        GrizzlyNetworkManager1_9 Configuration
        BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null
        TCPSTARTPORT..TCPENDPORT:9090..9200
        MULTICAST_ADDRESS:MULTICAST_PORT:228.9.47.209:5433 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default
        FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000
        MAX_PARALLEL:15
        START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000
        MAX_WRITE_SELECTOR_POOL_SIZE:30

        #]

        [#|2012-09-25T10:30:55.491+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#]

        [#|2012-09-25T10:30:55.498+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=23;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#]

        [#|2012-09-25T10:30:55.506+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9192. Controller started in 9 ms|#]

        [#|2012-09-25T10:30:55.506+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#]

        [#|2012-09-25T10:30:55.507+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:5433 network interface: name:null multicast address:/228.9.47.209 timeToLive=4|#]

        [#|2012-09-25T10:30:55.509+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#]

        [#|2012-09-25T10:30:55.509+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-cci-prod for member:server|#]

        [#|2012-09-25T10:30:55.509+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-cci-prod|#]

        [#|2012-09-25T10:30:55.515+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-cci-prod|#]

        [#|2012-09-25T10:30:55.515+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-cci-prod|#]

        [#|2012-09-25T10:30:55.520+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-cci-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server

        #]

        [#|2012-09-25T10:30:55.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-cci-prod|#]

        [#|2012-09-25T10:30:55.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-cci-prod|#]

        [#|2012-09-25T10:30:55.526+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=25;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-cci-prod memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server TCP uri(s):[tcp://10.11.1.207:4000]|#]

        [#|2012-09-25T10:30:55.526+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=25;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID[10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server]
        CUSTOMTAGS[GROUP_NAME:cluster-cci-prod, MEMBER_TYPE:SPECTATOR, START_TIME[10:30:55 AM HKT on Sep 25, 2012]], ENDPONTADDRESSES[[tcp://10.11.1.207:4000]], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#]

        [#|2012-09-25T10:30:55.550+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-dcs-test ...|#]

        [#|2012-09-25T10:30:55.552+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#]

        [#|2012-09-25T10:30:55.552+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#]

        [#|2012-09-25T10:30:55.553+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|
        GrizzlyNetworkManager1_9 Configuration
        BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null
        TCPSTARTPORT..TCPENDPORT:9090..9200
        MULTICAST_ADDRESS:MULTICAST_PORT:228.9.134.222:14372 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default
        FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000
        MAX_PARALLEL:15
        START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000
        MAX_WRITE_SELECTOR_POOL_SIZE:30

        #]

        [#|2012-09-25T10:30:55.553+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#]

        [#|2012-09-25T10:30:55.554+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=26;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#]

        [#|2012-09-25T10:30:55.555+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9198. Controller started in 1 ms|#]

        [#|2012-09-25T10:30:55.555+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#]

        [#|2012-09-25T10:30:55.556+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:14372 network interface: name:null multicast address:/228.9.134.222 timeToLive=4|#]

        [#|2012-09-25T10:30:55.558+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#]

        [#|2012-09-25T10:30:55.558+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-dcs-test for member:server|#]

        [#|2012-09-25T10:30:55.561+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.563+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.563+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.574+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server

        #]

        [#|2012-09-25T10:30:55.574+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.574+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.576+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=28;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-dcs-test memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server TCP uri(s):[tcp://10.11.1.207:4000]|#]

        [#|2012-09-25T10:30:55.576+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=28;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID[10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server]
        CUSTOMTAGS[GROUP_NAME:cluster-dcs-test, MEMBER_TYPE:SPECTATOR, START_TIME[10:30:55 AM HKT on Sep 25, 2012]], ENDPONTADDRESSES[[tcp://10.11.1.207:4000]], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#]

        [#|2012-09-25T10:30:55.616+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: dcs-gf01-test, MemberType: CORE, Address: 10.11.1.208:9183:228.9.134.222:14372:cluster-dcs-test:dcs-gf01-test
        2: MemberId: dcs-gf02-test, MemberType: CORE, Address: 10.11.1.210:9128:228.9.134.222:14372:cluster-dcs-test:dcs-gf02-test
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server

        #]

        [#|2012-09-25T10:30:55.616+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: dcs-gf02-test of group: cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.616+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: dcs-gf02-test of group: cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.617+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf01-test group: cluster-dcs-test StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.617+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf02-test group: cluster-dcs-test StartupState: INSTANCE_STARTUP |#]

        [#|2012-09-25T10:30:55.618+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for ADD_EVENT(before change analysis) are :
        1: MemberId: dcs-gf01-test, MemberType: CORE, Address: 10.11.1.208:9183:228.9.134.222:14372:cluster-dcs-test:dcs-gf01-test
        2: MemberId: dcs-gf02-test, MemberType: CORE, Address: 10.11.1.210:9128:228.9.134.222:14372:cluster-dcs-test:dcs-gf02-test
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server

        #]

        [#|2012-09-25T10:30:55.618+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-dcs-test|#]

        [#|2012-09-25T10:30:55.892+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=29;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 55ms - bound to [0.0.0.0:9090]|#]

        [#|2012-09-25T10:30:55.910+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=30;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 26ms - bound to [0.0.0.0:9191]|#]

        [#|2012-09-25T10:30:55.970+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=31;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 9ms - bound to [0.0.0.0:4949]|#]

        [#|2012-09-25T10:30:55.998+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=32;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 21ms - bound to [0.0.0.0:4700]|#]

        [#|2012-09-25T10:30:56.002+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=33;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 5ms - bound to [0.0.0.0:9696]|#]

        [#|2012-09-25T10:30:56.376+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=10;_ThreadName=Thread-2;|The Admin Console is already installed, but not yet loaded.|#]

        [#|2012-09-25T10:30:56.514+0800|INFO|glassfish3.1.2|org.glassfish.ha.store.spi.BackingStoreFactoryRegistry|_ThreadID=10;_ThreadName=Thread-2;|Registered org.glassfish.ha.store.adapter.cache.ShoalBackingStoreProxy for persistence-type = replicated in BackingStoreFactoryRegistry|#]

        [#|2012-09-25T10:31:00.375+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.ejb.com.sun.ejb.containers|_ThreadID=10;_ThreadName=Thread-2;|Created EjbThreadPoolExecutor with thread-core-pool-size 16 thread-max-pool-size 32 thread-keep-alive-seconds 60 thread-queue-capacity 2147483647 allow-core-thread-timeout false |#]

        [#|2012-09-25T10:31:00.449+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1002: Security Manager is OFF.|#]

        [#|2012-09-25T10:31:00.501+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1010: Entering Security Startup Service|#]

        [#|2012-09-25T10:31:00.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=34;_ThreadName=Thread-2;|GMS1058: Assuming Master Node designation member: server for group: cluster-cci-prod|#]

        [#|2012-09-25T10:31:00.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-cci-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server

        #]

        [#|2012-09-25T10:31:00.522+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-cci-prod|#]

        [#|2012-09-25T10:31:00.522+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-cci-prod|#]

        [#|2012-09-25T10:31:00.533+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=34;_ThreadName=Thread-2;|GMS1057: Announcing Master Node designation for member: server of group: cluster-cci-prod. Local view contains 1 entries|#]

        [#|2012-09-25T10:31:00.551+0800|INFO|glassfish3.1.2|org.glassfish.flashlight.transformer.ProbeProviderClassFileTransformer|_ThreadID=10;_ThreadName=Thread-2;|Successfully got INSTRUMENTATION: sun.instrument.InstrumentationImpl@4873e835|#]

        [#|2012-09-25T10:31:00.598+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1143: Loading policy provider com.sun.enterprise.security.provider.PolicyWrapper.|#]

        [#|2012-09-25T10:31:00.727+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [admin-realm] of classtype [com.sun.enterprise.security.auth.realm.file.FileRealm] successfully created.|#]

        [#|2012-09-25T10:31:00.735+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [file] of classtype [com.sun.enterprise.security.auth.realm.file.FileRealm] successfully created.|#]

        [#|2012-09-25T10:31:00.751+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [certificate] of classtype [com.sun.enterprise.security.auth.realm.certificate.CertificateRealm] successfully created.|#]

        [#|2012-09-25T10:31:00.827+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|LARAJDBCRealm Version 2012/05/02 19:09|#]

        [#|2012-09-25T10:31:00.981+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [LARADCS] of classtype [com.cmacgm.LaraJdbcRealm] successfully created.|#]

        [#|2012-09-25T10:31:01.015+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1011: Security Service(s) Started Successfully|#]

        [#|2012-09-25T10:31:01.654+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0169: Created HTTP listener [http-listener-1] on host/port [0.0.0.0:9090]|#]

        [#|2012-09-25T10:31:01.688+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0169: Created HTTP listener [http-listener-2] on host/port [0.0.0.0:9191]|#]

        [#|2012-09-25T10:31:01.711+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0169: Created HTTP listener [admin-listener] on host/port [0.0.0.0:4949]|#]

        [#|2012-09-25T10:31:01.804+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0171: Created virtual server [server]|#]

        [#|2012-09-25T10:31:01.816+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0171: Created virtual server [__asadmin]|#]

        [#|2012-09-25T10:31:02.790+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0172: Virtual server [server] loaded default web module []|#]

        [#|2012-09-25T10:31:04.211+0800|SEVERE|glassfish3.1.2|org.apache.catalina.core.ContainerBase|_ThreadID=10;_ThreadName=Thread-2;|PWC1240: Container StandardEngine[glassfish-web].StandardHost[server].StandardContext[] has not been started
        org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:5332)
        at com.sun.enterprise.web.WebModule.start(WebModule.java:498)
        at org.apache.catalina.core.ContainerBase.startChildren(ContainerBase.java:1518)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1184)
        at org.apache.catalina.core.StandardHost.start(StandardHost.java:995)
        at org.apache.catalina.core.ContainerBase.startChildren(ContainerBase.java:1518)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1184)
        at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:529)
        at org.apache.catalina.startup.Embedded.start(Embedded.java:942)
        at com.sun.enterprise.web.WebContainer.postConstruct(WebContainer.java:604)
        at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131)
        at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91)
        at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82)
        at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67)
        at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139)
        at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78)
        at org.glassfish.internal.data.EngineInfo.getContainer(EngineInfo.java:93)
        at com.sun.enterprise.v3.server.ApplicationLifecycle.startContainers(ApplicationLifecycle.java:956)
        at com.sun.enterprise.v3.server.ApplicationLifecycle.setupContainerInfos(ApplicationLifecycle.java:666)
        at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:368)
        at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375)
        at com.sun.enterprise.v3.server.ApplicationLoaderService.postConstruct(ApplicationLoaderService.java:219)
        at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131)
        at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91)
        at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82)
        at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67)
        at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139)
        at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78)
        at com.sun.enterprise.v3.server.AppServerStartup.run(AppServerStartup.java:253)
        at com.sun.enterprise.v3.server.AppServerStartup.doStart(AppServerStartup.java:145)
        at com.sun.enterprise.v3.server.AppServerStartup.start(AppServerStartup.java:136)
        at com.sun.enterprise.glassfish.bootstrap.GlassFishImpl.start(GlassFishImpl.java:79)
        at com.sun.enterprise.glassfish.bootstrap.GlassFishDecorator.start(GlassFishDecorator.java:63)
        at com.sun.enterprise.glassfish.bootstrap.osgi.OSGiGlassFishImpl.start(OSGiGlassFishImpl.java:69)
        at com.sun.enterprise.glassfish.bootstrap.GlassFishMain$Launcher.launch(GlassFishMain.java:117)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.glassfish.bootstrap.GlassFishMain.main(GlassFishMain.java:97)
        at com.sun.enterprise.glassfish.bootstrap.ASMain.main(ASMain.java:55)
        Caused by: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:88)
        at org.glassfish.web.LibrariesTldProvider.postConstruct(LibrariesTldProvider.java:119)
        at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131)
        at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91)
        at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82)
        at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67)
        at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139)
        at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78)
        at org.jvnet.hk2.component.Habitat$5.get(Habitat.java:703)
        at java.util.AbstractList$Itr.next(AbstractList.java:345)
        at com.sun.enterprise.web.WebModuleListener.configureJsp(WebModuleListener.java:187)
        at com.sun.enterprise.web.WebModuleListener.lifecycleEvent(WebModuleListener.java:148)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:149)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:5329)
        ... 40 more
        Caused by: java.util.zip.ZipException: error in opening zip file
        at java.util.zip.ZipFile.open(Native Method)
        at java.util.zip.ZipFile.<init>(ZipFile.java:127)
        at java.util.jar.JarFile.<init>(JarFile.java:135)
        at java.util.jar.JarFile.<init>(JarFile.java:99)
        at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:78)
        ... 53 more

        #]

        [#|2012-09-25T10:31:06.421+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application CCWS done in 9,640 ms|#]

        [#|2012-09-25T10:31:07.802+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application CCInvoice_1_0_5 done in 1,377 ms|#]

        [#|2012-09-25T10:31:15.894+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application dcsTest1_0_55_02_JAAS done in 8,090 ms|#]

        [#|2012-09-25T10:31:18.114+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application dcsProd_1_0_60_04_base64_ha_JAAS done in 2,217 ms|#]

        [#|2012-09-25T10:31:18.718+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application arolstreet_cluster-ccws-stress done in 602 ms|#]

        [#|2012-09-25T10:31:22.460+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application dcsStress_1_1_1_641_01_ha_NOJAAS done in 3,740 ms|#]

        [#|2012-09-25T10:31:22.468+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|GlassFish Server Open Source Edition 3.1.2 (23) startup time : Felix (5,673ms), startup services(29,216ms), total(34,889ms)|#]

        [#|2012-09-25T10:31:22.469+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-dcs-stress|#]

        [#|2012-09-25T10:31:22.471+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-dcs-prod|#]

        [#|2012-09-25T10:31:22.472+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-ccws-prod|#]

        [#|2012-09-25T10:31:22.474+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for JOINED_AND_READY_EVENT(before change analysis) are :
        1: MemberId: dcs-gf05-stress, MemberType: CORE, Address: 10.11.1.237:9177:228.9.171.155:18290:cluster-dcs-stress:dcs-gf05-stress
        2: MemberId: dcs-gf06-stress, MemberType: CORE, Address: 10.11.1.238:9126:228.9.171.155:18290:cluster-dcs-stress:dcs-gf06-stress
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server

        #]

        [#|2012-09-25T10:31:22.474+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-dcs-stress|#]

        [#|2012-09-25T10:31:22.476+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-ccws-stress|#]

        [#|2012-09-25T10:31:22.477+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-cci-prod|#]

        [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for JOINED_AND_READY_EVENT(before change analysis) are :
        1: MemberId: ccws-gf01-prod, MemberType: CORE, Address: 10.11.1.208:9128:228.9.75.35:22027:cluster-ccws-prod:ccws-gf01-prod
        2: MemberId: ccws-gf02-prod, MemberType: CORE, Address: 10.11.1.210:9145:228.9.75.35:22027:cluster-ccws-prod:ccws-gf02-prod
        3: MemberId: ccws-gf03-prod, MemberType: CORE, Address: 10.11.1.213:9118:228.9.75.35:22027:cluster-ccws-prod:ccws-gf03-prod
        4: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server

        #]

        [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-ccws-prod|#]

        [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for JOINED_AND_READY_EVENT(before change analysis) are :
        1: MemberId: ccws-gf02-stress, MemberType: CORE, Address: 10.11.1.210:9164:228.9.54.166:6369:cluster-ccws-stress:ccws-gf02-stress
        2: MemberId: ccws-gf03-stress, MemberType: CORE, Address: 10.11.1.213:9160:228.9.54.166:6369:cluster-ccws-stress:ccws-gf03-stress
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server

        #]

        [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-ccws-stress|#]

        [#|2012-09-25T10:31:22.482+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-cci-prod : Members in view for JOINED_AND_READY_EVENT(before change analysis) are :
        1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server

        #]

        [#|2012-09-25T10:31:22.482+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-cci-prod|#]

        [#|2012-09-25T10:31:22.490+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for JOINED_AND_READY_EVENT(before change analysis) are :
        1: MemberId: dcs-gf07-prod, MemberType: CORE, Address: 10.11.1.211:9195:228.9.224.35:10733:cluster-dcs-prod:dcs-gf07-prod
        2: MemberId: dcs-gf08-prod, MemberType: CORE, Address: 10.11.1.212:9182:228.9.224.35:10733:cluster-dcs-prod:dcs-gf08-prod
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server

        #]

        [#|2012-09-25T10:31:22.490+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-dcs-prod|#]

        [#|2012-09-25T10:31:22.484+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-dcs-test|#]

        [#|2012-09-25T10:31:22.497+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for JOINED_AND_READY_EVENT(before change analysis) are :
        1: MemberId: dcs-gf01-test, MemberType: CORE, Address: 10.11.1.208:9183:228.9.134.222:14372:cluster-dcs-test:dcs-gf01-test
        2: MemberId: dcs-gf02-test, MemberType: CORE, Address: 10.11.1.210:9128:228.9.134.222:14372:cluster-dcs-test:dcs-gf02-test
        3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server

        #]

        [#|2012-09-25T10:31:22.498+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-dcs-test|#]

        [#|2012-09-25T10:31:24.009+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=35;_ThreadName=Thread-2;|java.rmi.server.ExportException: Port already in use: 9696; nested exception is:
        java.net.BindException: Address already in use
        at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:310)
        at sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:218)
        at sun.rmi.transport.tcp.TCPEndpoint.exportObject(TCPEndpoint.java:393)
        at sun.rmi.transport.LiveRef.exportObject(LiveRef.java:129)
        at sun.rmi.server.UnicastServerRef.exportObject(UnicastServerRef.java:188)
        at sun.rmi.registry.RegistryImpl.setup(RegistryImpl.java:100)
        at sun.rmi.registry.RegistryImpl.<init>(RegistryImpl.java:76)
        at java.rmi.registry.LocateRegistry.createRegistry(LocateRegistry.java:222)
        at org.glassfish.admin.mbeanserver.RMIConnectorStarter._startRegistry(RMIConnectorStarter.java:236)
        at org.glassfish.admin.mbeanserver.RMIConnectorStarter.startRegistry(RMIConnectorStarter.java:217)
        at org.glassfish.admin.mbeanserver.RMIConnectorStarter.<init>(RMIConnectorStarter.java:152)
        at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.startConnector(JMXStartupService.java:278)
        at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.run(JMXStartupService.java:322)
        Caused by: java.net.BindException: Address already in use
        at java.net.PlainSocketImpl.socketBind(Native Method)
        at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383)
        at java.net.ServerSocket.bind(ServerSocket.java:328)
        at java.net.ServerSocket.<init>(ServerSocket.java:194)
        at java.net.ServerSocket.<init>(ServerSocket.java:106)
        at sun.rmi.transport.proxy.RMIDirectSocketFactory.createServerSocket(RMIDirectSocketFactory.java:27)
        at sun.rmi.transport.proxy.RMIMasterSocketFactory.createServerSocket(RMIMasterSocketFactory.java:333)
        at sun.rmi.transport.tcp.TCPEndpoint.newServerSocket(TCPEndpoint.java:649)
        at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:299)
        ... 12 more

        #]

        [#|2012-09-25T10:31:24.032+0800|WARNING|glassfish3.1.2|javax.enterprise.system.jmx.org.glassfish.admin.mbeanserver|_ThreadID=35;_ThreadName=Thread-2;|JMX007: Cannot start JMX connector JmxConnector config:

        { name = system, Protocol = rmi_jrmp, Address = 0.0.0.0, Port = 9696, AcceptAll = false, AuthRealmName = admin-realm, SecurityEnabled = false}

        having exception java.lang.RuntimeException: Port 9696 is not available for the internal rmi registry. This means that a call was made with the same port, without closing earlier registry instance. This has to do with the system jmx connector configuration in admin-service element of the configuration associated with this instance|#]

        [#|2012-09-25T10:31:24.032+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=35;_ThreadName=Thread-2;|java.lang.RuntimeException: Port 9696 is not available for the internal rmi registry. This means that a call was made with the same port, without closing earlier registry instance. This has to do with the system jmx connector configuration in admin-service element of the configuration associated with this instance
        at org.glassfish.admin.mbeanserver.RMIConnectorStarter._startRegistry(RMIConnectorStarter.java:240)
        at org.glassfish.admin.mbeanserver.RMIConnectorStarter.startRegistry(RMIConnectorStarter.java:217)
        at org.glassfish.admin.mbeanserver.RMIConnectorStarter.<init>(RMIConnectorStarter.java:152)
        at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.startConnector(JMXStartupService.java:278)
        at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.run(JMXStartupService.java:322)

        #]

        [#|2012-09-25T10:31:24.153+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=36;_ThreadName=Thread-2;|The Admin Console is already installed, but not yet loaded.|#]

        [#|2012-09-25T10:31:24.158+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=36;_ThreadName=Thread-2;|The Admin Console is starting. Please wait.|#]

        [#|2012-09-25T10:31:26.921+0800|SEVERE|glassfish3.1.2|org.apache.catalina.core.ContainerBase|_ThreadID=36;_ThreadName=Thread-2;|ContainerBase.addChild: start:
        org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:5332)
        at com.sun.enterprise.web.WebModule.start(WebModule.java:498)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:917)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:901)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:733)
        at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:2018)
        at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:1669)
        at com.sun.enterprise.web.WebApplication.start(WebApplication.java:109)
        at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130)
        at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269)
        at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301)
        at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461)
        at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375)
        at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210)
        at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108)
        Caused by: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:88)
        at org.glassfish.web.LibrariesTldProvider.postConstruct(LibrariesTldProvider.java:119)
        at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131)
        at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91)
        at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82)
        at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67)
        at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139)
        at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78)
        at org.jvnet.hk2.component.Habitat$5.get(Habitat.java:703)
        at java.util.AbstractList$Itr.next(AbstractList.java:345)
        at com.sun.enterprise.web.WebModuleListener.configureJsp(WebModuleListener.java:187)
        at com.sun.enterprise.web.WebModuleListener.lifecycleEvent(WebModuleListener.java:148)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:149)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:5329)
        ... 14 more
        Caused by: java.util.zip.ZipException: error in opening zip file
        at java.util.zip.ZipFile.open(Native Method)
        at java.util.zip.ZipFile.<init>(ZipFile.java:127)
        at java.util.jar.JarFile.<init>(JarFile.java:135)
        at java.util.jar.JarFile.<init>(JarFile.java:99)
        at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:78)
        ... 27 more

        #]

        [#|2012-09-25T10:31:26.931+0800|WARNING|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=36;_ThreadName=Thread-2;|java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:921)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:901)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:733)
        at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:2018)
        at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:1669)
        at com.sun.enterprise.web.WebApplication.start(WebApplication.java:109)
        at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130)
        at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269)
        at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301)
        at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461)
        at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375)
        at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210)
        at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108)

        #]

        [#|2012-09-25T10:31:26.943+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=36;_ThreadName=Thread-2;|Exception while invoking class com.sun.enterprise.web.WebApplication start method
        java.lang.Exception: java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file
        at com.sun.enterprise.web.WebApplication.start(WebApplication.java:138)
        at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130)
        at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269)
        at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301)
        at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461)
        at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375)
        at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210)
        at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108)

        #]

        [#|2012-09-25T10:31:26.943+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=36;_ThreadName=Thread-2;|Exception while loading the app|#]

        [#|2012-09-25T10:31:26.960+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=36;_ThreadName=Thread-2;|Exception while loading the app|#]

        [#|2012-09-25T10:31:26.966+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=36;_ThreadName=Thread-2;|The Admin Console application is loaded.|#]

        [#|2012-09-25T10:32:29.399+0800|INFO|glassfish3.1.2|org.hibernate.validator.util.Version|_ThreadID=37;_ThreadName=Thread-2;|Hibernate Validator 4.2.0.Final|#]

        Show
        bernaps added a comment - Please note that our production system did exactly the same thing after rebooting our DAS server with around 8 clusters defined in it. This server did not reboot for a few month. Error is the same as above. Here is more info. We are not able to load the DAS at all. in this directory there is only one zip file which is the configuration Here is startup log [#|2012-09-25T10:30:44.322+0800|WARNING|glassfish3.1.2|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin|_ThreadID=37;_ThreadName=Thread-2;|There should be only 1 primordial module but 0 primordial modules were found.|#] Sep 25, 2012 10:30:45 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info INFO: JVM invocation command line: -XX:+UnlockDiagnosticVMOptions -XX:MaxPermSize=1024m -XX:PermSize=768m -XX:NewRatio=2 -XX:+UseLinuxPosixThreadCPUClocks -Xms2048m -Xmx2048m -javaagent:/home/gfuser/glassfish312/glassfish/lib/monitor/flashlight-agent.jar -server -Dfelix.fileinstall.disableConfigSave=false -Djavax.net.ssl.keyStore=/home/gfuser/glassfish312/glassfish/domains/domain1/config/keystore.jks -Djava.awt.headless=true -Dfelix.fileinstall.poll=5000 -Djava.endorsed.dirs=/home/gfuser/glassfish312/glassfish/modules/endorsed:/home/gfuser/glassfish312/glassfish/lib/endorsed -Djava.net.preferIPv4Stack=true -Dfelix.fileinstall.bundles.startTransient=true -Djavax.net.ssl.trustStore=/home/gfuser/glassfish312/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Djava.security.auth.login.config=/home/gfuser/glassfish312/glassfish/domains/domain1/config/login.conf -DANTLR_USE_DIRECT_CLASS_LOADING=true Dgosh.args= -nointeractive -Dosgi.shell.telnet.maxconn=1 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/home/gfuser/glassfish312/glassfish/modules/autostart/ -Dosgi.shell.telnet.port=7777 -Djava.security.policy=/home/gfuser/glassfish312/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=3 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.aas.instanceRoot=/home/gfuser/glassfish312/glassfish/domains/domain1 -Dcom.sun.aas.installRoot=/home/gfuser/glassfish312/glassfish -Djava.ext.dirs=/home/gfuser/jdk1.6.0_31/lib/ext:/home/gfuser/jdk1.6.0_31/jre/lib/ext:/home/gfuser/glassfish312/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true Sep 25, 2012 10:30:47 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info INFO: Successfully launched in 41 msec. [#|2012-09-25T10:30:54.445+0800|INFO|glassfish3.1.2|com.sun.enterprise.server.logging.GFFileHandler|_ThreadID=1;_ThreadName=Thread-2;|Running GlassFish Version: GlassFish Server Open Source Edition 3.1.2 (build 23)|#] [#|2012-09-25T10:30:54.804+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-dcs-stress ...|#] [#|2012-09-25T10:30:54.887+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#] [#|2012-09-25T10:30:54.890+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#] [#|2012-09-25T10:30:54.896+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;| GrizzlyNetworkManager1_9 Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.171.155:18290 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 #] [#|2012-09-25T10:30:54.902+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#] [#|2012-09-25T10:30:54.961+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=11;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#] [#|2012-09-25T10:30:55.001+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9118. Controller started in 48 ms|#] [#|2012-09-25T10:30:55.008+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2012-09-25T10:30:55.014+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:18290 network interface: name:null multicast address:/228.9.171.155 timeToLive=4|#] [#|2012-09-25T10:30:55.041+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2012-09-25T10:30:55.043+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-dcs-stress for member:server|#] [#|2012-09-25T10:30:55.050+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-dcs-stress|#] [#|2012-09-25T10:30:55.068+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-dcs-stress|#] [#|2012-09-25T10:30:55.068+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-dcs-stress|#] [#|2012-09-25T10:30:55.082+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server #] [#|2012-09-25T10:30:55.082+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-dcs-stress|#] [#|2012-09-25T10:30:55.091+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-dcs-stress|#] [#|2012-09-25T10:30:55.097+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=13;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-dcs-stress memberType: SPECTATOR startTime: Sep 25, 2012 10:30:54 AM HKT ID:10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server TCP uri(s): [tcp://10.11.1.207:4000] |#] [#|2012-09-25T10:30:55.102+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=13;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID [10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server] CUSTOMTAGS[GROUP_NAME:cluster-dcs-stress, MEMBER_TYPE:SPECTATOR, START_TIME [10:30:54 AM HKT on Sep 25, 2012] ], ENDPONTADDRESSES[ [tcp://10.11.1.207:4000] ], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2012-09-25T10:30:55.122+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-dcs-prod ...|#] [#|2012-09-25T10:30:55.129+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#] [#|2012-09-25T10:30:55.130+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#] [#|2012-09-25T10:30:55.130+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;| GrizzlyNetworkManager1_9 Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.224.35:10733 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 #] [#|2012-09-25T10:30:55.131+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: dcs-gf05-stress, MemberType: CORE, Address: 10.11.1.237:9177:228.9.171.155:18290:cluster-dcs-stress:dcs-gf05-stress 2: MemberId: dcs-gf06-stress, MemberType: CORE, Address: 10.11.1.238:9126:228.9.171.155:18290:cluster-dcs-stress:dcs-gf06-stress 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server #] [#|2012-09-25T10:30:55.131+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: dcs-gf06-stress of group: cluster-dcs-stress|#] [#|2012-09-25T10:30:55.131+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: dcs-gf06-stress of group: cluster-dcs-stress|#] [#|2012-09-25T10:30:55.132+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf05-stress group: cluster-dcs-stress StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.133+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf06-stress group: cluster-dcs-stress StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.136+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: dcs-gf05-stress, MemberType: CORE, Address: 10.11.1.237:9177:228.9.171.155:18290:cluster-dcs-stress:dcs-gf05-stress 2: MemberId: dcs-gf06-stress, MemberType: CORE, Address: 10.11.1.238:9126:228.9.171.155:18290:cluster-dcs-stress:dcs-gf06-stress 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server #] [#|2012-09-25T10:30:55.137+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-dcs-stress|#] [#|2012-09-25T10:30:55.145+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#] [#|2012-09-25T10:30:55.146+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=14;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#] [#|2012-09-25T10:30:55.157+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9196. Controller started in 11 ms|#] [#|2012-09-25T10:30:55.158+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2012-09-25T10:30:55.159+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:10733 network interface: name:null multicast address:/228.9.224.35 timeToLive=4|#] [#|2012-09-25T10:30:55.166+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2012-09-25T10:30:55.166+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-dcs-prod for member:server|#] [#|2012-09-25T10:30:55.167+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-dcs-prod|#] [#|2012-09-25T10:30:55.178+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-dcs-prod|#] [#|2012-09-25T10:30:55.179+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-dcs-prod|#] [#|2012-09-25T10:30:55.185+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server #] [#|2012-09-25T10:30:55.185+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-dcs-prod|#] [#|2012-09-25T10:30:55.185+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-dcs-prod|#] [#|2012-09-25T10:30:55.186+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=16;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-dcs-prod memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server TCP uri(s): [tcp://10.11.1.207:4000] |#] [#|2012-09-25T10:30:55.187+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=16;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID [10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server] CUSTOMTAGS[GROUP_NAME:cluster-dcs-prod, MEMBER_TYPE:SPECTATOR, START_TIME [10:30:55 AM HKT on Sep 25, 2012] ], ENDPONTADDRESSES[ [tcp://10.11.1.207:4000] ], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: dcs-gf07-prod, MemberType: CORE, Address: 10.11.1.211:9195:228.9.224.35:10733:cluster-dcs-prod:dcs-gf07-prod 2: MemberId: dcs-gf08-prod, MemberType: CORE, Address: 10.11.1.212:9182:228.9.224.35:10733:cluster-dcs-prod:dcs-gf08-prod 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server #] [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: dcs-gf07-prod of group: cluster-dcs-prod|#] [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: dcs-gf07-prod of group: cluster-dcs-prod|#] [#|2012-09-25T10:30:55.208+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf07-prod group: cluster-dcs-prod StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.209+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf08-prod group: cluster-dcs-prod StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.210+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: dcs-gf07-prod, MemberType: CORE, Address: 10.11.1.211:9195:228.9.224.35:10733:cluster-dcs-prod:dcs-gf07-prod 2: MemberId: dcs-gf08-prod, MemberType: CORE, Address: 10.11.1.212:9182:228.9.224.35:10733:cluster-dcs-prod:dcs-gf08-prod 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server #] [#|2012-09-25T10:30:55.211+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-dcs-prod|#] [#|2012-09-25T10:30:55.230+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-ccws-prod ...|#] [#|2012-09-25T10:30:55.235+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#] [#|2012-09-25T10:30:55.235+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#] [#|2012-09-25T10:30:55.236+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;| GrizzlyNetworkManager1_9 Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.75.35:22027 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 #] [#|2012-09-25T10:30:55.236+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#] [#|2012-09-25T10:30:55.237+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=17;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#] [#|2012-09-25T10:30:55.253+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9094. Controller started in 16 ms|#] [#|2012-09-25T10:30:55.254+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2012-09-25T10:30:55.255+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:22027 network interface: name:null multicast address:/228.9.75.35 timeToLive=4|#] [#|2012-09-25T10:30:55.257+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2012-09-25T10:30:55.260+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-ccws-prod for member:server|#] [#|2012-09-25T10:30:55.260+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-ccws-prod|#] [#|2012-09-25T10:30:55.273+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-ccws-prod|#] [#|2012-09-25T10:30:55.274+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-ccws-prod|#] [#|2012-09-25T10:30:55.282+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=18;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-ccws-prod memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server TCP uri(s): [tcp://10.11.1.207:4000] |#] [#|2012-09-25T10:30:55.282+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=18;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID [10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server] CUSTOMTAGS[GROUP_NAME:cluster-ccws-prod, MEMBER_TYPE:SPECTATOR, START_TIME [10:30:55 AM HKT on Sep 25, 2012] ], ENDPONTADDRESSES[ [tcp://10.11.1.207:4000] ], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2012-09-25T10:30:55.389+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server #] [#|2012-09-25T10:30:55.390+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-ccws-prod|#] [#|2012-09-25T10:30:55.390+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-ccws-prod|#] [#|2012-09-25T10:30:55.401+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: ccws-gf01-prod, MemberType: CORE, Address: 10.11.1.208:9128:228.9.75.35:22027:cluster-ccws-prod:ccws-gf01-prod 2: MemberId: ccws-gf02-prod, MemberType: CORE, Address: 10.11.1.210:9145:228.9.75.35:22027:cluster-ccws-prod:ccws-gf02-prod 3: MemberId: ccws-gf03-prod, MemberType: CORE, Address: 10.11.1.213:9118:228.9.75.35:22027:cluster-ccws-prod:ccws-gf03-prod 4: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server #] [#|2012-09-25T10:30:55.401+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: ccws-gf01-prod of group: cluster-ccws-prod|#] [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: ccws-gf01-prod of group: cluster-ccws-prod|#] [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf01-prod group: cluster-ccws-prod StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf02-prod group: cluster-ccws-prod StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.402+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf03-prod group: cluster-ccws-prod StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.404+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: ccws-gf01-prod, MemberType: CORE, Address: 10.11.1.208:9128:228.9.75.35:22027:cluster-ccws-prod:ccws-gf01-prod 2: MemberId: ccws-gf02-prod, MemberType: CORE, Address: 10.11.1.210:9145:228.9.75.35:22027:cluster-ccws-prod:ccws-gf02-prod 3: MemberId: ccws-gf03-prod, MemberType: CORE, Address: 10.11.1.213:9118:228.9.75.35:22027:cluster-ccws-prod:ccws-gf03-prod 4: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server #] [#|2012-09-25T10:30:55.404+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-ccws-prod|#] [#|2012-09-25T10:30:55.407+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-ccws-stress ...|#] [#|2012-09-25T10:30:55.417+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#] [#|2012-09-25T10:30:55.421+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#] [#|2012-09-25T10:30:55.422+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;| GrizzlyNetworkManager1_9 Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.54.166:6369 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 #] [#|2012-09-25T10:30:55.422+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#] [#|2012-09-25T10:30:55.426+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=20;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#] [#|2012-09-25T10:30:55.433+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9153. Controller started in 10 ms|#] [#|2012-09-25T10:30:55.434+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2012-09-25T10:30:55.435+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:6369 network interface: name:null multicast address:/228.9.54.166 timeToLive=4|#] [#|2012-09-25T10:30:55.437+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2012-09-25T10:30:55.439+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-ccws-stress for member:server|#] [#|2012-09-25T10:30:55.439+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-ccws-stress|#] [#|2012-09-25T10:30:55.442+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-ccws-stress|#] [#|2012-09-25T10:30:55.442+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-ccws-stress|#] [#|2012-09-25T10:30:55.456+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=21;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-ccws-stress memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server TCP uri(s): [tcp://10.11.1.207:4000] |#] [#|2012-09-25T10:30:55.456+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=21;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID [10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server] CUSTOMTAGS[GROUP_NAME:cluster-ccws-stress, MEMBER_TYPE:SPECTATOR, START_TIME [10:30:55 AM HKT on Sep 25, 2012] ], ENDPONTADDRESSES[ [tcp://10.11.1.207:4000] ], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2012-09-25T10:30:55.457+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server #] [#|2012-09-25T10:30:55.457+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-ccws-stress|#] [#|2012-09-25T10:30:55.457+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-ccws-stress|#] [#|2012-09-25T10:30:55.468+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-cci-prod ...|#] [#|2012-09-25T10:30:55.484+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: ccws-gf02-stress, MemberType: CORE, Address: 10.11.1.210:9164:228.9.54.166:6369:cluster-ccws-stress:ccws-gf02-stress 2: MemberId: ccws-gf03-stress, MemberType: CORE, Address: 10.11.1.213:9160:228.9.54.166:6369:cluster-ccws-stress:ccws-gf03-stress 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server #] [#|2012-09-25T10:30:55.487+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: ccws-gf02-stress of group: cluster-ccws-stress|#] [#|2012-09-25T10:30:55.487+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: ccws-gf02-stress of group: cluster-ccws-stress|#] [#|2012-09-25T10:30:55.487+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf02-stress group: cluster-ccws-stress StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.488+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1024: Adding Join member: ccws-gf03-stress group: cluster-ccws-stress StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.489+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: ccws-gf02-stress, MemberType: CORE, Address: 10.11.1.210:9164:228.9.54.166:6369:cluster-ccws-stress:ccws-gf02-stress 2: MemberId: ccws-gf03-stress, MemberType: CORE, Address: 10.11.1.213:9160:228.9.54.166:6369:cluster-ccws-stress:ccws-gf03-stress 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server #] [#|2012-09-25T10:30:55.484+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#] [#|2012-09-25T10:30:55.489+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-ccws-stress|#] [#|2012-09-25T10:30:55.490+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#] [#|2012-09-25T10:30:55.491+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;| GrizzlyNetworkManager1_9 Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.47.209:5433 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 #] [#|2012-09-25T10:30:55.491+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#] [#|2012-09-25T10:30:55.498+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=23;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#] [#|2012-09-25T10:30:55.506+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9192. Controller started in 9 ms|#] [#|2012-09-25T10:30:55.506+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2012-09-25T10:30:55.507+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:5433 network interface: name:null multicast address:/228.9.47.209 timeToLive=4|#] [#|2012-09-25T10:30:55.509+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2012-09-25T10:30:55.509+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-cci-prod for member:server|#] [#|2012-09-25T10:30:55.509+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-cci-prod|#] [#|2012-09-25T10:30:55.515+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-cci-prod|#] [#|2012-09-25T10:30:55.515+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-cci-prod|#] [#|2012-09-25T10:30:55.520+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-cci-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server #] [#|2012-09-25T10:30:55.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-cci-prod|#] [#|2012-09-25T10:30:55.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-cci-prod|#] [#|2012-09-25T10:30:55.526+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=25;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-cci-prod memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server TCP uri(s): [tcp://10.11.1.207:4000] |#] [#|2012-09-25T10:30:55.526+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=25;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID [10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server] CUSTOMTAGS[GROUP_NAME:cluster-cci-prod, MEMBER_TYPE:SPECTATOR, START_TIME [10:30:55 AM HKT on Sep 25, 2012] ], ENDPONTADDRESSES[ [tcp://10.11.1.207:4000] ], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2012-09-25T10:30:55.550+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1095: member: server is joining group: cluster-dcs-test ...|#] [#|2012-09-25T10:30:55.552+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.grizzly1_9.GrizzlyNetworkManager1_9|#] [#|2012-09-25T10:30:55.552+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS MAX_MESSAGE_LENGTH=4,196,352|#] [#|2012-09-25T10:30:55.553+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;| GrizzlyNetworkManager1_9 Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.134.222:14372 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 #] [#|2012-09-25T10:30:55.553+0800|INFO|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=10;_ThreadName=Thread-2;|Grizzly 1.9 NetworkManager|#] [#|2012-09-25T10:30:55.554+0800|INFO|glassfish3.1.2|grizzly|_ThreadID=26;_ThreadName=Thread-2;|GRIZZLY0001: Starting Grizzly Framework 1.9.46 - 9/25/12 10:30 AM|#] [#|2012-09-25T10:30:55.555+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Grizzly controller listening on /0.0.0.0:9198. Controller started in 1 ms|#] [#|2012-09-25T10:30:55.555+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2012-09-25T10:30:55.556+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:14372 network interface: name:null multicast address:/228.9.134.222 timeToLive=4|#] [#|2012-09-25T10:30:55.558+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2012-09-25T10:30:55.558+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|starting cluster cluster-dcs-test for member:server|#] [#|2012-09-25T10:30:55.561+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1061: MasterNode message listener is registered for member: server group: cluster-dcs-test|#] [#|2012-09-25T10:30:55.563+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1005: Member server joined group cluster-dcs-test|#] [#|2012-09-25T10:30:55.563+0800|INFO|glassfish3.1.2|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=10;_ThreadName=Thread-2;|GMSAD1004: Started GMS for instance server in group cluster-dcs-test|#] [#|2012-09-25T10:30:55.574+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server #] [#|2012-09-25T10:30:55.574+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-dcs-test|#] [#|2012-09-25T10:30:55.574+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-dcs-test|#] [#|2012-09-25T10:30:55.576+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=28;_ThreadName=Thread-2;|MySystemAdvertisement(summary): GMSMember name: server group: cluster-dcs-test memberType: SPECTATOR startTime: Sep 25, 2012 10:30:55 AM HKT ID:10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server TCP uri(s): [tcp://10.11.1.207:4000] |#] [#|2012-09-25T10:30:55.576+0800|CONFIG|glassfish3.1.2|ShoalLogger|_ThreadID=28;_ThreadName=Thread-2;|MySystemAdvertisement(dump)=PEERID [10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server] CUSTOMTAGS[GROUP_NAME:cluster-dcs-test, MEMBER_TYPE:SPECTATOR, START_TIME [10:30:55 AM HKT on Sep 25, 2012] ], ENDPONTADDRESSES[ [tcp://10.11.1.207:4000] ], NAME:server, OSNAME:Linux, OSVERSION:3.0.0-15-server, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2012-09-25T10:30:55.616+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: dcs-gf01-test, MemberType: CORE, Address: 10.11.1.208:9183:228.9.134.222:14372:cluster-dcs-test:dcs-gf01-test 2: MemberId: dcs-gf02-test, MemberType: CORE, Address: 10.11.1.210:9128:228.9.134.222:14372:cluster-dcs-test:dcs-gf02-test 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server #] [#|2012-09-25T10:30:55.616+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: dcs-gf02-test of group: cluster-dcs-test|#] [#|2012-09-25T10:30:55.616+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: dcs-gf02-test of group: cluster-dcs-test|#] [#|2012-09-25T10:30:55.617+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf01-test group: cluster-dcs-test StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.617+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1024: Adding Join member: dcs-gf02-test group: cluster-dcs-test StartupState: INSTANCE_STARTUP |#] [#|2012-09-25T10:30:55.618+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: dcs-gf01-test, MemberType: CORE, Address: 10.11.1.208:9183:228.9.134.222:14372:cluster-dcs-test:dcs-gf01-test 2: MemberId: dcs-gf02-test, MemberType: CORE, Address: 10.11.1.210:9128:228.9.134.222:14372:cluster-dcs-test:dcs-gf02-test 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server #] [#|2012-09-25T10:30:55.618+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: cluster-dcs-test|#] [#|2012-09-25T10:30:55.892+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=29;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 55ms - bound to [0.0.0.0:9090] |#] [#|2012-09-25T10:30:55.910+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=30;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 26ms - bound to [0.0.0.0:9191] |#] [#|2012-09-25T10:30:55.970+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=31;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 9ms - bound to [0.0.0.0:4949] |#] [#|2012-09-25T10:30:55.998+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=32;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 21ms - bound to [0.0.0.0:4700] |#] [#|2012-09-25T10:30:56.002+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.services.impl|_ThreadID=33;_ThreadName=Thread-2;|Grizzly Framework 1.9.46 started in: 5ms - bound to [0.0.0.0:9696] |#] [#|2012-09-25T10:30:56.376+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=10;_ThreadName=Thread-2;|The Admin Console is already installed, but not yet loaded.|#] [#|2012-09-25T10:30:56.514+0800|INFO|glassfish3.1.2|org.glassfish.ha.store.spi.BackingStoreFactoryRegistry|_ThreadID=10;_ThreadName=Thread-2;|Registered org.glassfish.ha.store.adapter.cache.ShoalBackingStoreProxy for persistence-type = replicated in BackingStoreFactoryRegistry|#] [#|2012-09-25T10:31:00.375+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.ejb.com.sun.ejb.containers|_ThreadID=10;_ThreadName=Thread-2;|Created EjbThreadPoolExecutor with thread-core-pool-size 16 thread-max-pool-size 32 thread-keep-alive-seconds 60 thread-queue-capacity 2147483647 allow-core-thread-timeout false |#] [#|2012-09-25T10:31:00.449+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1002: Security Manager is OFF.|#] [#|2012-09-25T10:31:00.501+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1010: Entering Security Startup Service|#] [#|2012-09-25T10:31:00.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=34;_ThreadName=Thread-2;|GMS1058: Assuming Master Node designation member: server for group: cluster-cci-prod|#] [#|2012-09-25T10:31:00.521+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-cci-prod : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server #] [#|2012-09-25T10:31:00.522+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: cluster-cci-prod|#] [#|2012-09-25T10:31:00.522+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: cluster-cci-prod|#] [#|2012-09-25T10:31:00.533+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=34;_ThreadName=Thread-2;|GMS1057: Announcing Master Node designation for member: server of group: cluster-cci-prod. Local view contains 1 entries|#] [#|2012-09-25T10:31:00.551+0800|INFO|glassfish3.1.2|org.glassfish.flashlight.transformer.ProbeProviderClassFileTransformer|_ThreadID=10;_ThreadName=Thread-2;|Successfully got INSTRUMENTATION: sun.instrument.InstrumentationImpl@4873e835|#] [#|2012-09-25T10:31:00.598+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1143: Loading policy provider com.sun.enterprise.security.provider.PolicyWrapper.|#] [#|2012-09-25T10:31:00.727+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [admin-realm] of classtype [com.sun.enterprise.security.auth.realm.file.FileRealm] successfully created.|#] [#|2012-09-25T10:31:00.735+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [file] of classtype [com.sun.enterprise.security.auth.realm.file.FileRealm] successfully created.|#] [#|2012-09-25T10:31:00.751+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [certificate] of classtype [com.sun.enterprise.security.auth.realm.certificate.CertificateRealm] successfully created.|#] [#|2012-09-25T10:31:00.827+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|LARAJDBCRealm Version 2012/05/02 19:09|#] [#|2012-09-25T10:31:00.981+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security.auth.realm|_ThreadID=10;_ThreadName=Thread-2;|SEC1115: Realm [LARADCS] of classtype [com.cmacgm.LaraJdbcRealm] successfully created.|#] [#|2012-09-25T10:31:01.015+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.security.com.sun.enterprise.security|_ThreadID=10;_ThreadName=Thread-2;|SEC1011: Security Service(s) Started Successfully|#] [#|2012-09-25T10:31:01.654+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0169: Created HTTP listener [http-listener-1] on host/port [0.0.0.0:9090] |#] [#|2012-09-25T10:31:01.688+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0169: Created HTTP listener [http-listener-2] on host/port [0.0.0.0:9191] |#] [#|2012-09-25T10:31:01.711+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0169: Created HTTP listener [admin-listener] on host/port [0.0.0.0:4949] |#] [#|2012-09-25T10:31:01.804+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0171: Created virtual server [server] |#] [#|2012-09-25T10:31:01.816+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0171: Created virtual server [__asadmin] |#] [#|2012-09-25T10:31:02.790+0800|INFO|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=10;_ThreadName=Thread-2;|WEB0172: Virtual server [server] loaded default web module []|#] [#|2012-09-25T10:31:04.211+0800|SEVERE|glassfish3.1.2|org.apache.catalina.core.ContainerBase|_ThreadID=10;_ThreadName=Thread-2;|PWC1240: Container StandardEngine [glassfish-web] .StandardHost [server] .StandardContext[] has not been started org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file at org.apache.catalina.core.StandardContext.start(StandardContext.java:5332) at com.sun.enterprise.web.WebModule.start(WebModule.java:498) at org.apache.catalina.core.ContainerBase.startChildren(ContainerBase.java:1518) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1184) at org.apache.catalina.core.StandardHost.start(StandardHost.java:995) at org.apache.catalina.core.ContainerBase.startChildren(ContainerBase.java:1518) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1184) at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:529) at org.apache.catalina.startup.Embedded.start(Embedded.java:942) at com.sun.enterprise.web.WebContainer.postConstruct(WebContainer.java:604) at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131) at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91) at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82) at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67) at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139) at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78) at org.glassfish.internal.data.EngineInfo.getContainer(EngineInfo.java:93) at com.sun.enterprise.v3.server.ApplicationLifecycle.startContainers(ApplicationLifecycle.java:956) at com.sun.enterprise.v3.server.ApplicationLifecycle.setupContainerInfos(ApplicationLifecycle.java:666) at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:368) at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375) at com.sun.enterprise.v3.server.ApplicationLoaderService.postConstruct(ApplicationLoaderService.java:219) at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131) at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91) at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82) at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67) at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139) at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78) at com.sun.enterprise.v3.server.AppServerStartup.run(AppServerStartup.java:253) at com.sun.enterprise.v3.server.AppServerStartup.doStart(AppServerStartup.java:145) at com.sun.enterprise.v3.server.AppServerStartup.start(AppServerStartup.java:136) at com.sun.enterprise.glassfish.bootstrap.GlassFishImpl.start(GlassFishImpl.java:79) at com.sun.enterprise.glassfish.bootstrap.GlassFishDecorator.start(GlassFishDecorator.java:63) at com.sun.enterprise.glassfish.bootstrap.osgi.OSGiGlassFishImpl.start(OSGiGlassFishImpl.java:69) at com.sun.enterprise.glassfish.bootstrap.GlassFishMain$Launcher.launch(GlassFishMain.java:117) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at com.sun.enterprise.glassfish.bootstrap.GlassFishMain.main(GlassFishMain.java:97) at com.sun.enterprise.glassfish.bootstrap.ASMain.main(ASMain.java:55) Caused by: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:88) at org.glassfish.web.LibrariesTldProvider.postConstruct(LibrariesTldProvider.java:119) at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131) at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91) at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82) at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67) at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139) at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78) at org.jvnet.hk2.component.Habitat$5.get(Habitat.java:703) at java.util.AbstractList$Itr.next(AbstractList.java:345) at com.sun.enterprise.web.WebModuleListener.configureJsp(WebModuleListener.java:187) at com.sun.enterprise.web.WebModuleListener.lifecycleEvent(WebModuleListener.java:148) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:149) at org.apache.catalina.core.StandardContext.start(StandardContext.java:5329) ... 40 more Caused by: java.util.zip.ZipException: error in opening zip file at java.util.zip.ZipFile.open(Native Method) at java.util.zip.ZipFile.<init>(ZipFile.java:127) at java.util.jar.JarFile.<init>(JarFile.java:135) at java.util.jar.JarFile.<init>(JarFile.java:99) at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:78) ... 53 more #] [#|2012-09-25T10:31:06.421+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application CCWS done in 9,640 ms|#] [#|2012-09-25T10:31:07.802+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application CCInvoice_1_0_5 done in 1,377 ms|#] [#|2012-09-25T10:31:15.894+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application dcsTest1_0_55_02_JAAS done in 8,090 ms|#] [#|2012-09-25T10:31:18.114+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application dcsProd_1_0_60_04_base64_ha_JAAS done in 2,217 ms|#] [#|2012-09-25T10:31:18.718+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application arolstreet_cluster-ccws-stress done in 602 ms|#] [#|2012-09-25T10:31:22.460+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|CORE10010: Loading application dcsStress_1_1_1_641_01_ha_NOJAAS done in 3,740 ms|#] [#|2012-09-25T10:31:22.468+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=10;_ThreadName=Thread-2;|GlassFish Server Open Source Edition 3.1.2 (23) startup time : Felix (5,673ms), startup services(29,216ms), total(34,889ms)|#] [#|2012-09-25T10:31:22.469+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-dcs-stress|#] [#|2012-09-25T10:31:22.471+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-dcs-prod|#] [#|2012-09-25T10:31:22.472+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-ccws-prod|#] [#|2012-09-25T10:31:22.474+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-stress : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: dcs-gf05-stress, MemberType: CORE, Address: 10.11.1.237:9177:228.9.171.155:18290:cluster-dcs-stress:dcs-gf05-stress 2: MemberId: dcs-gf06-stress, MemberType: CORE, Address: 10.11.1.238:9126:228.9.171.155:18290:cluster-dcs-stress:dcs-gf06-stress 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9118:228.9.171.155:18290:cluster-dcs-stress:server #] [#|2012-09-25T10:31:22.474+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=12;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-dcs-stress|#] [#|2012-09-25T10:31:22.476+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-ccws-stress|#] [#|2012-09-25T10:31:22.477+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-cci-prod|#] [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-prod : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: ccws-gf01-prod, MemberType: CORE, Address: 10.11.1.208:9128:228.9.75.35:22027:cluster-ccws-prod:ccws-gf01-prod 2: MemberId: ccws-gf02-prod, MemberType: CORE, Address: 10.11.1.210:9145:228.9.75.35:22027:cluster-ccws-prod:ccws-gf02-prod 3: MemberId: ccws-gf03-prod, MemberType: CORE, Address: 10.11.1.213:9118:228.9.75.35:22027:cluster-ccws-prod:ccws-gf03-prod 4: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9094:228.9.75.35:22027:cluster-ccws-prod:server #] [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=19;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-ccws-prod|#] [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-ccws-stress : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: ccws-gf02-stress, MemberType: CORE, Address: 10.11.1.210:9164:228.9.54.166:6369:cluster-ccws-stress:ccws-gf02-stress 2: MemberId: ccws-gf03-stress, MemberType: CORE, Address: 10.11.1.213:9160:228.9.54.166:6369:cluster-ccws-stress:ccws-gf03-stress 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9153:228.9.54.166:6369:cluster-ccws-stress:server #] [#|2012-09-25T10:31:22.481+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=22;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-ccws-stress|#] [#|2012-09-25T10:31:22.482+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-cci-prod : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9192:228.9.47.209:5433:cluster-cci-prod:server #] [#|2012-09-25T10:31:22.482+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=24;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-cci-prod|#] [#|2012-09-25T10:31:22.490+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-prod : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: dcs-gf07-prod, MemberType: CORE, Address: 10.11.1.211:9195:228.9.224.35:10733:cluster-dcs-prod:dcs-gf07-prod 2: MemberId: dcs-gf08-prod, MemberType: CORE, Address: 10.11.1.212:9182:228.9.224.35:10733:cluster-dcs-prod:dcs-gf08-prod 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9196:228.9.224.35:10733:cluster-dcs-prod:server #] [#|2012-09-25T10:31:22.490+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=15;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-dcs-prod|#] [#|2012-09-25T10:31:22.484+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=10;_ThreadName=Thread-2;|GMS1099: GMS:Reporting Joined and Ready state to group: cluster-dcs-test|#] [#|2012-09-25T10:31:22.497+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1092: GMS View Change Received for group: cluster-dcs-test : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: dcs-gf01-test, MemberType: CORE, Address: 10.11.1.208:9183:228.9.134.222:14372:cluster-dcs-test:dcs-gf01-test 2: MemberId: dcs-gf02-test, MemberType: CORE, Address: 10.11.1.210:9128:228.9.134.222:14372:cluster-dcs-test:dcs-gf02-test 3: MemberId: server, MemberType: SPECTATOR, Address: 10.11.1.207:9198:228.9.134.222:14372:cluster-dcs-test:server #] [#|2012-09-25T10:31:22.498+0800|INFO|glassfish3.1.2|ShoalLogger|_ThreadID=27;_ThreadName=Thread-2;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: cluster-dcs-test|#] [#|2012-09-25T10:31:24.009+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=35;_ThreadName=Thread-2;|java.rmi.server.ExportException: Port already in use: 9696; nested exception is: java.net.BindException: Address already in use at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:310) at sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:218) at sun.rmi.transport.tcp.TCPEndpoint.exportObject(TCPEndpoint.java:393) at sun.rmi.transport.LiveRef.exportObject(LiveRef.java:129) at sun.rmi.server.UnicastServerRef.exportObject(UnicastServerRef.java:188) at sun.rmi.registry.RegistryImpl.setup(RegistryImpl.java:100) at sun.rmi.registry.RegistryImpl.<init>(RegistryImpl.java:76) at java.rmi.registry.LocateRegistry.createRegistry(LocateRegistry.java:222) at org.glassfish.admin.mbeanserver.RMIConnectorStarter._startRegistry(RMIConnectorStarter.java:236) at org.glassfish.admin.mbeanserver.RMIConnectorStarter.startRegistry(RMIConnectorStarter.java:217) at org.glassfish.admin.mbeanserver.RMIConnectorStarter.<init>(RMIConnectorStarter.java:152) at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.startConnector(JMXStartupService.java:278) at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.run(JMXStartupService.java:322) Caused by: java.net.BindException: Address already in use at java.net.PlainSocketImpl.socketBind(Native Method) at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383) at java.net.ServerSocket.bind(ServerSocket.java:328) at java.net.ServerSocket.<init>(ServerSocket.java:194) at java.net.ServerSocket.<init>(ServerSocket.java:106) at sun.rmi.transport.proxy.RMIDirectSocketFactory.createServerSocket(RMIDirectSocketFactory.java:27) at sun.rmi.transport.proxy.RMIMasterSocketFactory.createServerSocket(RMIMasterSocketFactory.java:333) at sun.rmi.transport.tcp.TCPEndpoint.newServerSocket(TCPEndpoint.java:649) at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:299) ... 12 more #] [#|2012-09-25T10:31:24.032+0800|WARNING|glassfish3.1.2|javax.enterprise.system.jmx.org.glassfish.admin.mbeanserver|_ThreadID=35;_ThreadName=Thread-2;|JMX007: Cannot start JMX connector JmxConnector config: { name = system, Protocol = rmi_jrmp, Address = 0.0.0.0, Port = 9696, AcceptAll = false, AuthRealmName = admin-realm, SecurityEnabled = false} having exception java.lang.RuntimeException: Port 9696 is not available for the internal rmi registry. This means that a call was made with the same port, without closing earlier registry instance. This has to do with the system jmx connector configuration in admin-service element of the configuration associated with this instance|#] [#|2012-09-25T10:31:24.032+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=35;_ThreadName=Thread-2;|java.lang.RuntimeException: Port 9696 is not available for the internal rmi registry. This means that a call was made with the same port, without closing earlier registry instance. This has to do with the system jmx connector configuration in admin-service element of the configuration associated with this instance at org.glassfish.admin.mbeanserver.RMIConnectorStarter._startRegistry(RMIConnectorStarter.java:240) at org.glassfish.admin.mbeanserver.RMIConnectorStarter.startRegistry(RMIConnectorStarter.java:217) at org.glassfish.admin.mbeanserver.RMIConnectorStarter.<init>(RMIConnectorStarter.java:152) at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.startConnector(JMXStartupService.java:278) at org.glassfish.admin.mbeanserver.JMXStartupService$JMXConnectorsStarterThread.run(JMXStartupService.java:322) #] [#|2012-09-25T10:31:24.153+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=36;_ThreadName=Thread-2;|The Admin Console is already installed, but not yet loaded.|#] [#|2012-09-25T10:31:24.158+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=36;_ThreadName=Thread-2;|The Admin Console is starting. Please wait.|#] [#|2012-09-25T10:31:26.921+0800|SEVERE|glassfish3.1.2|org.apache.catalina.core.ContainerBase|_ThreadID=36;_ThreadName=Thread-2;|ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file at org.apache.catalina.core.StandardContext.start(StandardContext.java:5332) at com.sun.enterprise.web.WebModule.start(WebModule.java:498) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:917) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:901) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:733) at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:2018) at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:1669) at com.sun.enterprise.web.WebApplication.start(WebApplication.java:109) at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130) at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269) at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301) at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461) at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375) at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210) at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108) Caused by: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:88) at org.glassfish.web.LibrariesTldProvider.postConstruct(LibrariesTldProvider.java:119) at com.sun.hk2.component.AbstractCreatorImpl.inject(AbstractCreatorImpl.java:131) at com.sun.hk2.component.ConstructorCreator.initialize(ConstructorCreator.java:91) at com.sun.hk2.component.AbstractCreatorImpl.get(AbstractCreatorImpl.java:82) at com.sun.hk2.component.SingletonInhabitant.get(SingletonInhabitant.java:67) at com.sun.hk2.component.EventPublishingInhabitant.get(EventPublishingInhabitant.java:139) at com.sun.hk2.component.AbstractInhabitantImpl.get(AbstractInhabitantImpl.java:78) at org.jvnet.hk2.component.Habitat$5.get(Habitat.java:703) at java.util.AbstractList$Itr.next(AbstractList.java:345) at com.sun.enterprise.web.WebModuleListener.configureJsp(WebModuleListener.java:187) at com.sun.enterprise.web.WebModuleListener.lifecycleEvent(WebModuleListener.java:148) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:149) at org.apache.catalina.core.StandardContext.start(StandardContext.java:5329) ... 14 more Caused by: java.util.zip.ZipException: error in opening zip file at java.util.zip.ZipFile.open(Native Method) at java.util.zip.ZipFile.<init>(ZipFile.java:127) at java.util.jar.JarFile.<init>(JarFile.java:135) at java.util.jar.JarFile.<init>(JarFile.java:99) at com.sun.enterprise.util.net.JarURIPattern.getJarEntries(JarURIPattern.java:78) ... 27 more #] [#|2012-09-25T10:31:26.931+0800|WARNING|glassfish3.1.2|javax.enterprise.system.container.web.com.sun.enterprise.web|_ThreadID=36;_ThreadName=Thread-2;|java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:921) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:901) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:733) at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:2018) at com.sun.enterprise.web.WebContainer.loadWebModule(WebContainer.java:1669) at com.sun.enterprise.web.WebApplication.start(WebApplication.java:109) at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130) at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269) at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301) at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461) at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375) at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210) at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108) #] [#|2012-09-25T10:31:26.943+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=36;_ThreadName=Thread-2;|Exception while invoking class com.sun.enterprise.web.WebApplication start method java.lang.Exception: java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.RuntimeException: java.util.zip.ZipException: error in opening zip file at com.sun.enterprise.web.WebApplication.start(WebApplication.java:138) at org.glassfish.internal.data.EngineRef.start(EngineRef.java:130) at org.glassfish.internal.data.ModuleInfo.start(ModuleInfo.java:269) at org.glassfish.internal.data.ApplicationInfo.start(ApplicationInfo.java:301) at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:461) at com.sun.enterprise.v3.server.ApplicationLoaderService.processApplication(ApplicationLoaderService.java:375) at com.sun.enterprise.v3.admin.adapter.InstallerThread.load(InstallerThread.java:210) at com.sun.enterprise.v3.admin.adapter.InstallerThread.run(InstallerThread.java:108) #] [#|2012-09-25T10:31:26.943+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=36;_ThreadName=Thread-2;|Exception while loading the app|#] [#|2012-09-25T10:31:26.960+0800|SEVERE|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=36;_ThreadName=Thread-2;|Exception while loading the app|#] [#|2012-09-25T10:31:26.966+0800|INFO|glassfish3.1.2|javax.enterprise.system.core.com.sun.enterprise.v3.admin.adapter|_ThreadID=36;_ThreadName=Thread-2;|The Admin Console application is loaded.|#] [#|2012-09-25T10:32:29.399+0800|INFO|glassfish3.1.2|org.hibernate.validator.util.Version|_ThreadID=37;_ThreadName=Thread-2;|Hibernate Validator 4.2.0.Final|#]
        Hide
        bernaps added a comment -

        Since I found only one zip file for the config under glassfish312/glassfish/domains/domain1/config/glassfish1205579867436504600.zip

        After testing the zip file to see if it was valid. It was not

        unzip -t config/glassfish1205579867436504600.zip

        Archive: config/glassfish1205579867436504600.zip
        End-of-central-directory signature not found. Either this file is not
        a zipfile, or it constitutes one disk of a multi-part archive. In the
        latter case the central directory and zipfile comment will be found on
        the last disk(s) of this archive.
        unzip: cannot find zipfile directory in one of config/glassfish1205579867436504600.zip or
        config/glassfish1205579867436504600.zip.zip, and cannot find config/glassfish1205579867436504600.zip.ZIP, period.

        Somehow this file was created with errors.

        Could it be due to out of memory for being started for many months ? Why is this file created ? when we have domain/config/domain.xml ?

        Show
        bernaps added a comment - Since I found only one zip file for the config under glassfish312/glassfish/domains/domain1/config/glassfish1205579867436504600.zip After testing the zip file to see if it was valid. It was not unzip -t config/glassfish1205579867436504600.zip Archive: config/glassfish1205579867436504600.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of config/glassfish1205579867436504600.zip or config/glassfish1205579867436504600.zip.zip, and cannot find config/glassfish1205579867436504600.zip.ZIP, period. Somehow this file was created with errors. Could it be due to out of memory for being started for many months ? Why is this file created ? when we have domain/config/domain.xml ?
        Hide
        Shing Wai Chan added a comment -

        Hi bemaps,
        The original issue is about having a message to indicate which jar is corrupted.
        Your issue is about an unknown zip file.
        You may like to file a different issue to track the problem.

        Show
        Shing Wai Chan added a comment - Hi bemaps, The original issue is about having a message to indicate which jar is corrupted. Your issue is about an unknown zip file. You may like to file a different issue to track the problem.
        Hide
        Shing Wai Chan added a comment -

        add a WARNING message on which jar file has issue
        Sending common-util/src/main/java/com/sun/enterprise/util/net/JarURIPattern.java
        Adding common-util/src/main/java/com/sun/enterprise/util/net/LocalStrings.properties
        Transmitting file data ..
        Committed revision 56711.

        Show
        Shing Wai Chan added a comment - add a WARNING message on which jar file has issue Sending common-util/src/main/java/com/sun/enterprise/util/net/JarURIPattern.java Adding common-util/src/main/java/com/sun/enterprise/util/net/LocalStrings.properties Transmitting file data .. Committed revision 56711.

          People

          • Assignee:
            Shing Wai Chan
            Reporter:
            gfuser9999
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: