Effective October 27, 2012, online and email support for FuseSource products will move to Red Hat support channels. For more information, please see the JIRA Migration to Red Hat FAQ.
As of October 27th, please open all new issues in the Red Hat Customer Portal .
Issue Details (XML | Word | Printable)

Key: ESB-1447
Type: Bug Bug
Status: Resolved Resolved
Resolution: Fixed
Priority: Critical Critical
Assignee: Unassigned
Reporter: Claudio Corsi
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
FUSE ESB

Pooled Sessions are not being returned during the deployment of services.

Created: 27/Apr/11 02:47 PM   Updated: 30/Jun/11 06:05 PM
Component/s: None
Affects Version/s: 3.3.1.3-fuse
Fix Version/s: 3.3.1.26-fuse, 3.6.0-fuse-00-35


 Description  « Hide
There are some services that when you try to hot deploy them they generate a ClassNotFoundException for the referencing bean in the xbean.xml file for that service.

Those same services will be deployed successfully when the system is restarted but this issue only happens when they are hot deployed.

The process of deploying these services causes the pooled sessions to be borrow but they are not being released.



 All   Comments   Change History      Sort Order: Ascending order - Click to sort in descending order
Claudio Corsi made changes - 27/Apr/11 02:47 PM
Field Original Value New Value
Link This issue blocks PROD-639 [ PROD-639 ]
Claudio Corsi added a comment - 06/Jun/11 03:25 PM
The problem is that the pooled sessions are not being returned causing these sessions to be exhausted. Then the call to borrow another session caused the system to hang because the borrowObject call will cause the thread to wait until a session has been returned. Which never happens.

Here is the stack trace that shows the issue:

"Timer-3" daemon prio=3 tid=0x001c3800 nid=0x3d in Object.wait() [0xd3ffe000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:485)
	at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:748)
	- locked <0xdbe5a748> (a org.apache.commons.pool.impl.GenericObjectPool)
	at org.apache.activemq.pool.SessionPool.borrowSession(SessionPool.java:54)
	at org.apache.activemq.pool.ConnectionPool.createSession(ConnectionPool.java:118)
	at org.apache.activemq.pool.PooledConnection.createSession(PooledConnection.java:141)
	at org.apache.servicemix.jbi.nmr.flow.jms.AbstractJMSFlow.broadcast(AbstractJMSFlow.java:380)
	at org.apache.servicemix.jbi.nmr.flow.jms.AbstractJMSFlow.onInternalEndpointRegistered(AbstractJMSFlow.java:354)
	at org.apache.servicemix.jbi.nmr.flow.jms.AbstractJMSFlow$1.internalEndpointRegistered(AbstractJMSFlow.java:180)
	at org.apache.servicemix.jbi.framework.EndpointRegistry.fireEvent(EndpointRegistry.java:526)
	at org.apache.servicemix.jbi.framework.EndpointRegistry.registerInternalEndpoint(EndpointRegistry.java:215)
	at org.apache.servicemix.jbi.framework.Registry.activateEndpoint(Registry.java:194)
	at org.apache.servicemix.jbi.framework.ComponentContextImpl.activateEndpoint(ComponentContextImpl.java:126)
	at org.apache.servicemix.common.endpoints.ProviderEndpoint.start(ProviderEndpoint.java:58)
	at org.apache.servicemix.jms.endpoints.JmsProviderEndpoint.start(JmsProviderEndpoint.java:473)
	- locked <0xfa414490> (a org.apache.servicemix.jms.endpoints.JmsProviderEndpoint)
	at org.apache.servicemix.common.endpoints.SimpleEndpoint.activate(SimpleEndpoint.java:55)
	- locked <0xfa414490> (a org.apache.servicemix.jms.endpoints.JmsProviderEndpoint)
	at org.apache.servicemix.common.ServiceUnit.start(ServiceUnit.java:53)
	at org.apache.servicemix.common.BaseServiceUnitManager.start(BaseServiceUnitManager.java:151)
	- locked <0xdc0e9790> (a org.apache.servicemix.common.BaseServiceUnitManager)
	at org.apache.servicemix.jbi.framework.ServiceUnitLifeCycle.start(ServiceUnitLifeCycle.java:103)
	at org.apache.servicemix.jbi.framework.ServiceAssemblyLifeCycle.start(ServiceAssemblyLifeCycle.java:132)
	- locked <0xfa471c98> (a org.apache.servicemix.jbi.framework.ServiceAssemblyLifeCycle)
	at org.apache.servicemix.jbi.framework.DeploymentService.start(DeploymentService.java:378)
	at org.apache.servicemix.jbi.framework.AutoDeploymentService.updateServiceAssembly(AutoDeploymentService.java:355)
	at org.apache.servicemix.jbi.framework.AutoDeploymentService.updateArchive(AutoDeploymentService.java:256)
	at org.apache.servicemix.jbi.framework.AutoDeploymentService.monitorDirectory(AutoDeploymentService.java:664)
	at org.apache.servicemix.jbi.framework.AutoDeploymentService.access$800(AutoDeploymentService.java:62)
	at org.apache.servicemix.jbi.framework.AutoDeploymentService$1.run(AutoDeploymentService.java:628)
	at java.util.TimerThread.mainLoop(Timer.java:512)
	at java.util.TimerThread.run(Timer.java:462)

The problem is this issue will exhaust all 500 pooled objects.


Claudio Corsi made changes - 06/Jun/11 03:27 PM
Summary Hotdeploy fails with ClassNotFoundException for successfully deployed services when starting servicemix Pooled Sessions are not being returned during the deployment of services.
Description There are some services that when you try to hot deploy them they generate a ClassNotFoundException for the referencing bean in the xbean.xml file for that service.

Those same services will be deployed successfully when the system is restarted but this issue only happens when they are hot deployed.
There are some services that when you try to hot deploy them they generate a ClassNotFoundException for the referencing bean in the xbean.xml file for that service.

Those same services will be deployed successfully when the system is restarted but this issue only happens when they are hot deployed.

The process of deploying these services causes the pooled sessions to be borrow but they are not being released.
Matt Hernon added a comment - 17/Jun/11 02:42 PM
BQ:High

Matt Hernon made changes - 30/Jun/11 05:21 PM
Fix Version/s 3.6.0-fuse-00-35 [ 11383 ]
Matt Hernon made changes - 30/Jun/11 05:22 PM
Status Open [ 1 ] Resolved [ 5 ]
Resolution Fixed [ 1 ]
Gert Vanthienen made changes - 30/Jun/11 06:05 PM
Fix Version/s 3.3.1.26-fuse [ 11391 ]
Fix Version/s 3.3.1.25-fuse [ 10871 ]