Issue Details (XML | Word | Printable)

Key: SAILFIN-1035
Type: Bug Bug
Status: Open Open
Priority: Minor Minor
Assignee: Yamini K B
Reporter: sonymanuel
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
sailfin

Memory leak while running with callflow monitoring enabled.

Created: 11/Jul/08 11:03 AM   Updated: 03/Nov/08 09:43 PM
Component/s: admin
Affects Version/s: 1.0
Fix Version/s: milestone 1

Time Tracking:
Not Specified

File Attachments: 1. Text File histo.1 (382 kB) 11/Jul/08 11:04 AM - sonymanuel
2. Text File histo.2 (359 kB) 11/Jul/08 11:05 AM - sonymanuel

Image Attachments:

1. vm_snapshot.png
(18 kB)
Environment:

Operating System: All
Platform: All


Issuezilla Id: 1,035
Tags: shark-na
Participants: jagadesh, prasads, sanandal, sonymanuel and Yamini K B


 Description  « Hide

Running the scenario described in 1032 for about 90 minutes with callflow
enabled causes the instance to hit max heap size and full GC cycles. I have
taken couple of jmap histo. 1st one taken around 10 minutes and the 2nd one
taken after few full gc cycles.



sonymanuel added a comment - 11/Jul/08 11:04 AM

Created an attachment (id=551)
1st jmap histo after 10 minutes


sonymanuel added a comment - 11/Jul/08 11:05 AM

Created an attachment (id=552)
2nd jmap


sanandal added a comment - 14/Jul/08 03:59 AM

Modifying keyword to shark-approved


sanandal added a comment - 14/Jul/08 04:01 AM

Modifying keyword to shark-approved


sanandal added a comment - 14/Jul/08 04:26 AM

update keyword


Yamini K B added a comment - 14/Jul/08 10:05 PM

Callflow is not recommended for production environment i.e under load. I used
Netbeans profiler to monitor heap usage, please see the attached screenshot.

1. Call rate 10cps
2. The spike (where memory touches 300+MB is during startup)
3. The time marking 10:00 is where I ran sipp


Yamini K B added a comment - 14/Jul/08 10:06 PM

Created an attachment (id=555)
Netbeans VM telemetry


prasads added a comment - 20/Jul/08 10:21 PM

Marking as shark-approved


Yamini K B added a comment - 23/Jul/08 12:03 AM

Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/AsyncHandlerProducer.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/AsyncHandlerProducer.java,v
<-- AsyncHandlerProducer.java
new revision: 1.3.6.1; previous revision: 1.3
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/EndTimeAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/EndTimeAccessObjectImpl.java,v
<-- EndTimeAccessObjectImpl.java
new revision: 1.11.6.1; previous revision: 1.11
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/MethodEndAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/MethodEndAccessObjectImpl.java,v
<-- MethodEndAccessObjectImpl.java
new revision: 1.13.6.1; previous revision: 1.13
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/MethodStartAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/MethodStartAccessObjectImpl.java,v
<-- MethodStartAccessObjectImpl.java
new revision: 1.14.6.1; previous revision: 1.14
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/RequestEndAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/RequestEndAccessObjectImpl.java,v
<-- RequestEndAccessObjectImpl.java
new revision: 1.12.6.1; previous revision: 1.12
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/RequestStartAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/RequestStartAccessObjectImpl.java,v
<-- RequestStartAccessObjectImpl.java
new revision: 1.13.6.1; previous revision: 1.13
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/StartTimeAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/StartTimeAccessObjectImpl.java,v
<-- StartTimeAccessObjectImpl.java
new revision: 1.11.6.1; previous revision: 1.11
done

Shark branch:
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/AsyncHandlerProducer.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/AsyncHandlerProducer.java,v
<-- AsyncHandlerProducer.java
new revision: 1.3.12.1; previous revision: 1.3
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/EndTimeAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/EndTimeAccessObjectImpl.java,v
<-- EndTimeAccessObjectImpl.java
new revision: 1.11.12.1; previous revision: 1.11
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/MethodEndAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/MethodEndAccessObjectImpl.java,v
<-- MethodEndAccessObjectImpl.java
new revision: 1.13.12.1; previous revision: 1.13
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/MethodStartAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/MethodStartAccessObjectImpl.java,v
<-- MethodStartAccessObjectImpl.java
new revision: 1.14.12.1; previous revision: 1.14
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/RequestEndAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/RequestEndAccessObjectImpl.java,v
<-- RequestEndAccessObjectImpl.java
new revision: 1.12.12.1; previous revision: 1.12
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/RequestStartAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/RequestStartAccessObjectImpl.java,v
<-- RequestStartAccessObjectImpl.java
new revision: 1.13.12.1; previous revision: 1.13
done
Checking in
src/java/com/sun/enterprise/admin/monitor/callflow/StartTimeAccessObjectImpl.java;
/cvs/glassfish/admin/monitor/src/java/com/sun/enterprise/admin/monitor/callflow/StartTimeAccessObjectImpl.java,v
<-- StartTimeAccessObjectImpl.java
new revision: 1.11.12.1; previous revision: 1.11
done


Yamini K B added a comment - 23/Jul/08 12:58 AM

The leak is fixed to some extent. Have raised GlassFish issue 5357 for a
complete solution.

Lowering the priority and keeping this issue open to track the GlassFish issue.


Yamini K B added a comment - 23/Jul/08 03:14 AM

GlassFish issue 5357 will be addressed later, hence changing the keyword
accordingly.


jagadesh added a comment - 06/Aug/08 11:25 AM

"This bug will be scrubbed and will be upgraded for next relevant milestone builds".


prasads added a comment - 14/Aug/08 11:38 AM

Marking all of them as P3


Yamini K B added a comment - 26/Sep/08 07:01 AM

Must fix


Yamini K B added a comment - 03/Nov/08 09:43 PM

Issue 5357 is being deferred for now. Hence lowering the priority of current
issue. Will be kept open as a tracking issue.