I have an application of Websphere application server 7.0 (Parent Last)
Please read through the description to understand the problem.
I created a new websphere profile. Configured my application on it and started the application and now when I test the application. It works Good.
Now, I went to websphere console and re-start my application. This time when I test my application. I get error.
The log says a classCastException :
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R java.lang.ClassCastException: com.csc.fs.ra.SimpleConnectionSpecImpl incompatible with com.csc.fs.ra.SimpleConnectionSpecImpl
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.ra.ip.ConnectionFactoryImpl.getConnection(ConnectionFactoryImpl.java:69)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.InteractionHandlerBase.getConnection(InteractionHandlerBase.java:165)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.InteractionHandlerBase.execute(InteractionHandlerBase.java:95)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.InteractionHandlerBase.process(InteractionHandlerBase.java:230)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.SystemAccessBase.invokeInteraction(SystemAccessBase.java:374)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.SystemAccessBase.internalInvoke(SystemAccessBase.java:242)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.SystemAccessBase.invoke(SystemAccessBase.java:55)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.sa.SystemAccessBase.login(SystemAccessBase.java:106)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.session.AuthenticatorBase.logonSystemSession(AuthenticatorBase.java:153)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.session.AuthenticatorBase.addSystemSessions(AuthenticatorBase.java:132)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.session.standalone.AuthenticatorBase.logon(AuthenticatorBase.java:224)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.session.AuthenticatorBase.logon(AuthenticatorBase.java:93)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.service.ServiceControllerAbstract.logon(ServiceControllerAbstract.java:387)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.delegate.DirectServiceController.logon(DirectServiceController.java:132)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.delegate.ServiceDelegateDirect.logon(ServiceDelegateDirect.java:133)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.ui.BaseServiceAction.logon(BaseServiceAction.java:124)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.ui.action.desktop.Logon.perform(Logon.java:47)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.ui.ServiceDelegator.execute(ServiceDelegator.java:506)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.ui.ServiceDelegator.processEvent(ServiceDelegator.java:240)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.ui.BeanBase.executeEvent(BeanBase.java:779)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at pagecode.authorization.Logon.submit(Logon.java:66)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at java.lang.reflect.Method.invoke(Method.java:600)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at org.apache.el.parser.AstValue.invoke(AstValue.java:131)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at org.apache.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:276)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at org.apache.jasper.el.JspMethodExpression.invoke(JspMethodExpression.java:67)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at javax.faces.component.MethodBindingMethodExpressionAdapter.invoke(MethodBindingMethodExpressionAdapter.java:88)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:102)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at javax.faces.component.UICommand.broadcast(UICommand.java:315)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:775)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:1267)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.sun.faces.lifecycle.InvokeApplicationPhase.execute(InvokeApplicationPhase.java:82)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:118)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at javax.faces.webapp.FacesServlet.service(FacesServlet.java:312)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1661)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1595)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:131)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.csc.fs.accel.ui.filters.ResponseHeaderFilter.doFilter(ResponseHeaderFilter.java:82)
[3/21/13 6:06:18:616 EDT] 0000001d SystemErr R at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:188)
The reason behind this ClassCastException is multiple version of the class SimpleConnectionSpecImpl .
This class is being supplied by Resource adapters that I have configured externally through websphere admin console.
But now when I stop the server and restart the server, I can again use the application with no error.
So my closest guess websphere is caching class files because of which I am seeing the exception.
Any thoughts? Ideas?
Please let me know if you require any more details
You see the exception because there are different class loaders that have loaded that class, which technically makes them different classes.
We've solved this problem before by have the class be apart of the server classpath and only have the server load it. This way there is only one class loader for the class and all applications running on the server can use it from there.
The only other options I can see here is don't restart your app unless you plan to restart the server as well. I would only see this as a pain in a development environment but once you hit production I doubt you're frequently restarting apps.
Related
I am trying to start my websphere traditional application server from rational application developer. At the first time server started properly but after stopping it and starting it again next day it is giving admin exception: null pointer exception in the console
[12/7/22 14:47:15:934 IST] 00000001 SystemErr R com.ibm.websphere.management.exception.AdminException: java.lang.NullPointerException
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.management.MBeanFactoryImpl.deactivateMBean(MBeanFactoryImpl.java:1168)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.batch.endpointsensor.BatchSensorComponent.destroy(BatchSensorComponent.java:100)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.runtime.component.ContainerHelper.destroyComponent(ContainerHelper.java:341)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.runtime.component.ContainerHelper.destroyComponents(ContainerHelper.java:325)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.runtime.component.ContainerImpl.destroyComponents(ContainerImpl.java:607)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.runtime.component.ContainerImpl.destroy(ContainerImpl.java:598)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.runtime.component.ServerImpl.destroy(ServerImpl.java:501)
[12/7/22 14:47:15:935 IST] 00000001 SystemErr R at com.ibm.ws.runtime.WsServerImpl.bootServerContainer(WsServerImpl.java:334)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at com.ibm.ws.runtime.WsServerImpl.start(WsServerImpl.java:238)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at com.ibm.ws.runtime.WsServerImpl.main(WsServerImpl.java:711)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at com.ibm.ws.runtime.WsServer.main(WsServer.java:59)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at java.lang.reflect.Method.invoke(Method.java:508)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at com.ibm.wsspi.bootstrap.WSLauncher.launchMain(WSLauncher.java:234)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at com.ibm.wsspi.bootstrap.WSLauncher.main(WSLauncher.java:101)
[12/7/22 14:47:15:936 IST] 00000001 SystemErr R at com.ibm.wsspi.bootstrap.WSLauncher.run(WSLauncher.java:82)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at java.lang.reflect.Method.invoke(Method.java:508)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at org.eclipse.equinox.internal.app.EclipseAppContainer.callMethodWithException(EclipseAppContainer.java:587)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:198)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:354)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:181)
[12/7/22 14:47:15:937 IST] 00000001 SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[12/7/22 14:47:15:938 IST] 00000001 SystemErr R at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90)
[12/7/22 14:47:15:938 IST] 00000001 SystemErr R at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[12/7/22 14:47:15:938 IST] 00000001 SystemErr R at java.lang.reflect.Method.invoke(Method.java:508)
[12/7/22 14:47:15:938 IST] 00000001 SystemErr R at org.eclipse.core.launcher.Main.invokeFramework(Main.java:340)
[12/7/22 14:47:15:939 IST] 00000001 SystemErr R at org.eclipse.core.launcher.Main.basicRun(Main.java:282)
[12/7/22 14:47:15:939 IST] 00000001 SystemErr R at org.eclipse.core.launcher.Main.run(Main.java:981)
[12/7/22 14:47:15:939 IST] 00000001 SystemErr R at com.ibm.wsspi.bootstrap.WSPreLauncher.launchEclipse(WSPreLauncher.java:423)
[12/7/22 14:47:15:939 IST] 00000001 SystemErr R at com.ibm.wsspi.bootstrap.WSPreLauncher.main(WSPreLauncher.java:180)
[12/7/22 14:47:15:939 IST] 00000001 SystemErr R Caused by: java.lang.NullPointerException
[12/7/22 14:47:15:939 IST] 00000001 SystemErr R at com.ibm.ws.management.MBeanFactoryImpl.deactivateMBean(MBeanFactoryImpl.java:1141)
[12/7/22 14:47:15:940 IST] 00000001 SystemErr R ... 36 more
i am totally new to this can anyone explain me what can be issue as it worked before perfectly.
What are some alternate steps that could be used to identify the root cause of this access violation read crash. I don't have access to source code or the customer env so need to specify steps to collect required information.
The issue only occurs when 3rd party firewall software is running, of which it's driver can be seen in stack traces of the process when using ProcMon stack summary feature. However I need to work out more explicitly how the issue is caused to enable a fix from 3rd party firewall vendor.
I have tried to walk customer through capturing API Monitor traces and Time Travel Debugging Trace however they are triggering the application to crash before issue can be reproduced.
The application seems to be built with PowerBuilder 10.2.1.0.
Crash dump output shows the following:
0:000> !analyze -v
ADDITIONAL_XML: 1
OS_BUILD_LAYERS: 1
NTGLOBALFLAG: 0
PROCESS_BAM_CURRENT_THROTTLED: 0
PROCESS_BAM_PREVIOUS_THROTTLED: 0
APPLICATION_VERIFIER_FLAGS: 0
CONTEXT: (.ecxr)
eax=00000010 ebx=009c653c ecx=06da3ce4 edx=0019ccf8 esi=00000000 edi=00a63f88
eip=756afcbf esp=0019cb7c ebp=0019cbc0 iopl=0 nv up ei pl nz na pe nc
cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00210206
combase!CStdMarshal::UnmarshalIPID+0xb8:
756afcbf 8b5804 mov ebx,dword ptr [eax+4] ds:002b:00000014=????????
Resetting default scope
EXCEPTION_RECORD: (.exr -1)
ExceptionAddress: 756afcbf (combase!CStdMarshal::UnmarshalIPID+0x000000b8)
ExceptionCode: c0000005 (Access violation)
ExceptionFlags: 00000000
NumberParameters: 2
Parameter[0]: 00000000
Parameter[1]: 00000014
Attempt to read from address 00000014
PROCESS_NAME: appname.exe
READ_ADDRESS: 00000014
ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.
EXCEPTION_CODE_STR: c0000005
EXCEPTION_PARAMETER1: 00000000
EXCEPTION_PARAMETER2: 00000014
STACK_TEXT:
0019cbc0 756c62a5 0019ccf8 0019cd08 009c5aa0 combase!CStdMarshal::UnmarshalIPID+0xb8
0019cc48 756d61b0 0019ccf0 0019cf1c 00000000 combase!CStdMarshal::UnmarshalObjRef+0x155
0019ce54 5b309fe8 009ef828 5b2f5fa4 0019cf1c combase!CoUnmarshalInterface+0xdc0
0019ceec 5b312666 5b2f5fa4 0019cf1c 0000003d oleacc!SharedBuffer_Free+0x2b8
0019cf7c 5b3097fb 00002728 0000003d 00000001 oleacc!SharedBuffer_Allocate+0x8e36
0019cfa0 1123c095 11437d18 ffffffff 03d977cc oleacc!EXTERNAL_LresultFromObject+0x4b
WARNING: Stack unwind information not available. Following frames may be wrong.
0019cfd4 112363b7 0007079e ffffffff fffffffc pbvm100!FN_EvtTimerWnd+0xa75
0019d068 75db44bb 0007079e 0000003d ffffffff pbvm100!FN_DataWindowWnd+0x4a7
0019d094 75d94ffc 11235f10 0007079e 0000003d user32!_InternalCallWinProc+0x2b
0019d178 75d94b9a 11235f10 00000000 0000003d user32!UserCallWinProcCheckWow+0x3ac
0019d1dc 75d9e1df 01098290 00000000 0000003d user32!DispatchClientMessage+0xea
0019d218 7758428d 0019d234 00000020 0019d408 user32!__fnDWORD+0x3f
0019d250 759a2c0c 75db2d92 0007079e 0000003d ntdll!KiUserCallbackDispatcher+0x4d
0019d254 75db2d92 0007079e 0000003d ffffffff win32u!NtUserMessageCall+0xc
0019d298 75db2cf2 ffffffff fffffffc 00000002 user32!SendMessageTimeoutWorker+0x9b
0019d2bc 5b309695 0007079e 0000003d ffffffff user32!SendMessageTimeoutW+0x22
0019d2f8 5b30954b 0007079e fffffffc 5b2f5cc4 oleacc!NativeIAccessibleFromWindow+0x70
0019d328 5b32f49e 5b2f5cc4 0019d348 fffffffc oleacc!AccessibleObjectFromWindow+0x27
0019d360 5b32fa57 00000000 0019d3f8 0019d3c0 oleacc!AccessibleObjectFromEvent+0x5e
0019d374 76080c8b 0007079e fffffffc 00000000 oleacc!EXTERNAL_AccessibleObjectFromEvent+0x27
0019d39c 76080bae 00000000 0019d3f8 0019d3c0 msctf!AccessibleObjectFromEvent+0x38
0019d418 7606a0c5 0007079e fffffffc 00000000 msctf!CThreadInputMgr::OnAccFocusEvent+0x9f
0019d468 76069320 00008005 0007079e fffffffc msctf!CThreadInputMgr::OnCiceroEvent+0xa5
0019d4c4 75d9f019 001f02b7 00008005 0007079e msctf!WinEventProc+0xf0
0019d508 7758428d 0019d524 00000020 0019d928 user32!__ClientCallWinEventProc+0x39
0019d540 11297886 0007079e 0007079e 0704d628 ntdll!KiUserCallbackDispatcher+0x4d
0019d558 11234dd9 000b0736 00000000 00000000 pbvm100!FN_WndProc+0x766
0019d828 75db44bb 000b0736 00000007 00360360 pbvm100!FN_WindowWnd+0x14e9
0019d854 75d94ffc 112338f0 000b0736 00000007 user32!_InternalCallWinProc+0x2b
0019d938 75d9454f 112338f0 00000000 00000007 user32!UserCallWinProcCheckWow+0x3ac
0019d970 10b8f24d 112338f0 000b0736 00000007 user32!CallWindowProcW+0x7f
0019d998 75db44bb 000b0736 00000007 00360360 pbshr100!PBC_MainProc3D+0x16d
0019d9c4 75d94ffc 10b8f0e0 000b0736 00000007 user32!_InternalCallWinProc+0x2b
0019daa8 75d94b9a 10b8f0e0 00000000 00000007 user32!UserCallWinProcCheckWow+0x3ac
0019db0c 75d9e1df 010832e0 00000000 00000007 user32!DispatchClientMessage+0xea
0019db48 7758428d 0019db64 00000020 0019dce4 user32!__fnDWORD+0x3f
0019db80 759a30ac 75da6b6e 000b0736 00000007 ntdll!KiUserCallbackDispatcher+0x4d
0019db84 75da6b6e 000b0736 00000007 00000000 win32u!NtUserSetFocus+0xc
0019dbc4 75dee1b9 0102ab40 00000000 00000007 user32!MDIClientWndProcWorker+0x14e
0019dbe4 75db44bb 00360360 00000007 00360360 user32!MDIClientWndProcW+0x29
0019dc10 75d94ffc 75dee190 00360360 00000007 user32!_InternalCallWinProc+0x2b
0019dcf4 75d9454f 75dee190 00000000 00000007 user32!UserCallWinProcCheckWow+0x3ac
0019dd2c 10b8cdd2 75dee190 00360360 00000007 user32!CallWindowProcW+0x7f
0019dd54 75d952a1 00000000 77554470 112338f0 pbshr100!PBC_NormalProc3D+0x72
0019dd90 75d94ffc 10b8cd60 00360360 00000007 user32!UserCallWinProcCheckWow+0x651
0019de74 75d9454f 10b8cd60 00000000 00000007 user32!UserCallWinProcCheckWow+0x3ac
0019deac 112380fd 10b8cd60 00360360 00000007 user32!CallWindowProcW+0x7f
0019deec 75db44bb 00360360 00000007 00360360 pbvm100!FN_MDIClientWnd+0x2dd
0019df18 75d94ffc 11237e20 00360360 00000007 user32!_InternalCallWinProc+0x2b
0019dffc 75d947ad 11237e20 00000000 00000007 user32!UserCallWinProcCheckWow+0x3ac
0019e060 75d94473 0102ab40 00000000 00000000 user32!SendMessageWorker+0x1fd
0019e094 75da669a 00360360 00000007 00360360 user32!SendMessageW+0x123
0019e0d0 75da62a7 0102ab40 00000000 010832e0 user32!xxxMDIActivate+0x201
0019e114 75deea18 00000000 00000000 00000000 user32!DefMDIChildProcWorker+0x1f7
0019e128 112971f8 000b0736 00000022 00000000 user32!DefMDIChildProcW+0x18
0019e150 112dcf2a 000b0736 00000022 00000000 pbvm100!FN_WndProc+0xd8
0019e168 112dcba9 11297120 000b0736 00000022 pbvm100!fn_txnservice_create_instance+0x912a
0019e18c 11235260 11297120 000b0736 00000022 pbvm100!fn_txnservice_create_instance+0x8da9
0019e470 75db44bb 000b0736 00000022 00000000 pbvm100!FN_WindowWnd+0x1970
0019e49c 75d94ffc 112338f0 000b0736 00000022 user32!_InternalCallWinProc+0x2b
0019e580 75d9454f 112338f0 00000000 00000022 user32!UserCallWinProcCheckWow+0x3ac
0019e5b8 10b8f24d 112338f0 000b0736 00000022 user32!CallWindowProcW+0x7f
0019e5e0 75db44bb 000b0736 00000022 00000000 pbshr100!PBC_MainProc3D+0x16d
0019e60c 75d94ffc 10b8f0e0 000b0736 00000022 user32!_InternalCallWinProc+0x2b
0019e6f0 75d94b9a 10b8f0e0 00000000 00000022 user32!UserCallWinProcCheckWow+0x3ac
0019e754 75d9e1df 010832e0 00000000 00000022 user32!DispatchClientMessage+0xea
0019e790 7758428d 0019e7ac 00000020 0019ea6c user32!__fnDWORD+0x3f
0019e7c8 759a2ddc 75dcaa02 000b0736 00000000 ntdll!KiUserCallbackDispatcher+0x4d
0019e7cc 75dcaa02 000b0736 00000000 00000000 win32u!NtUserSetWindowPos+0xc
0019e820 75d8fa58 00000001 00000000 0019ee94 user32!MDICompleteChildCreation+0x1b895
0019e8d8 75da6be3 03d994c4 16cf0000 80000000 user32!CreateWindowInternal+0x2ec
0019e94c 75dee1b9 0102ab40 00000000 00000220 user32!MDIClientWndProcWorker+0x1c3
0019e96c 75db44bb 00360360 00000220 00000000 user32!MDIClientWndProcW+0x29
0019e998 75d94ffc 75dee190 00360360 00000220 user32!_InternalCallWinProc+0x2b
0019ea7c 75d9454f 75dee190 00000000 00000220 user32!UserCallWinProcCheckWow+0x3ac
0019eab4 10b8cdd2 75dee190 00360360 00000220 user32!CallWindowProcW+0x7f
0019eaec 75db44bb 00360360 00000220 00000000 pbshr100!PBC_NormalProc3D+0x72
00000000 00000000 00000000 00000000 00000000 user32!_InternalCallWinProc+0x2b
SYMBOL_NAME: oleacc!SharedBuffer_Free+2b8
MODULE_NAME: oleacc
IMAGE_NAME: oleacc.dll
STACK_COMMAND: ~0s ; .ecxr ; kb
FAILURE_BUCKET_ID: NULL_CLASS_PTR_READ_c0000005_oleacc.dll!SharedBuffer_Free
OS_VERSION: 10.0.18362.239
BUILDLAB_STR: 19h1_release_svc_prod1
OSPLATFORM_TYPE: x86
OSNAME: Windows 10
IMAGE_VERSION: 7.2.18362.1
FAILURE_ID_HASH: {2506b308-0659-fc20-d871-5cc908d8929d}
Followup: MachineOwner
The parameters passed to the COM APIs are:
0c 0019cbc0 756c62a5 combase!CStdMarshal::UnmarshalIPID(struct _GUID * riid = 0x0019ccf8 {618736E0-3C3D-11CF-810C-00AA00389B71}, struct tagSTDOBJREF * pStd = 0x0019cd08, class OXIDEntry * pOXIDEntry = 0x009c5aa0, void ** ppv = 0x0019cf1c)+0xb8 [onecore\com\combase\dcomrem\marshal.cxx # 2406]
0d 0019cc48 756d61b0 combase!CStdMarshal::UnmarshalObjRef(struct tagOBJREF * objref = 0x0019ccf0, void ** ppv = 0x0019cf1c)+0x155 [onecore\com\combase\dcomrem\marshal.cxx # 2194]
0e (Inline) -------- combase!UnmarshalSwitch(void)+0xe7 [onecore\com\combase\dcomrem\marshal.cxx # 1825]
0f (Inline) -------- combase!UnmarshalObjRef(void)+0x1f8 [onecore\com\combase\dcomrem\marshal.cxx # 1963]
10 0019ce54 5b309fe8 combase!CoUnmarshalInterface(struct IStream * pStm = 0x009ef828, struct _GUID * riid = 0x5b2f5fa4 {00000000-0000-0000-C000-000000000046}, void ** ppv = 0x0019cf1c)+0xdc0 [onecore\com\combase\dcomrem\coapi.cxx # 1993]
This seems to reference IAccessible interface which has the following registry info:
Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\interface\{618736E0-3C3D-11CF-810C-00AA00389B71}]
#="IAccessible"
[HKEY_CLASSES_ROOT\interface\{618736E0-3C3D-11CF-810C-00AA00389B71}\ProxyStubClsid32]
#="{00020424-0000-0000-C000-000000000046}"
[HKEY_CLASSES_ROOT\interface\{618736E0-3C3D-11CF-810C-00AA00389B71}\TypeLib]
#="{1EA4DBF0-3C3B-11CF-810C-00AA00389B71}"
"Version"="1.1"
This then seems to refer to PSOAInterface:
Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\clsid\{00020424-0000-0000-C000-000000000046}]
#="PSOAInterface"
[HKEY_CLASSES_ROOT\clsid\{00020424-0000-0000-C000-000000000046}\InprocServer32]
#="C:\\Windows\\System32\\oleaut32.dll"
"ThreadingModel"="Both"
Reversing the crashing function to psuedocode this code is within the PowerBuilder runtime i.e. pbvm100.dll:
0:000> lmvm pbvm100
Browse full module list
start end module name
111e0000 11528000 pbvm100 (export symbols) pbvm100.dll
Loaded symbol image file: pbvm100.dll
Image path: C:\Program Files\AppName\pbvm100.dll
Image name: pbvm100.dll
Browse all global symbols functions data
Timestamp: Wed Aug 15 13:28:53 2007 (46C272F5)
CheckSum: 004132DA
ImageSize: 00348000
File version: 10.2.1.9948
Product version: 10.2.1.0
File flags: 2 (Mask 3) Pre-release
File OS: 10001 DOS Win16
File type: 1.65 App
File date: 00000000.00000000
Translations: 0409.04e4
Information from resource tables:
CompanyName: Sybase Inc.
ProductName: PowerBuilder/InfoMaker
InternalName: PB 10.0
FileVersion: 10.2.1.9948
FileDescription: Sybase Inc. Product File
LegalCopyright: Copyright Sybase Inc. 2004
LRESULT __stdcall FN_DataWindowWnd(HWND hWnd, UINT Msg, WPARAM wParam, LPARAM lParam)
{
etc..
if ( Msg <= 0x106 )
{
if ( Msg == 262 )
return CallWindowProcW(*((WNDPROC *)v12 + 3), hWnd, 0x106u, wParam, lParam);
switch ( Msg )
{
case 0x3Du:
if ( lParam != -4 )
goto LABEL_72;
result = CrashingFunction(hWnd, wParam, -4, 0);
break;
etc...
}
}
}
int __cdecl CrashingFunction(HWND hWnd, int a2, int a3, int a4)
{
int result; // eax
int v5; // [esp+Ch] [ebp-14h]
int v6; // [esp+14h] [ebp-Ch]
int v7; // [esp+18h] [ebp-8h] BYREF
int v8; // [esp+1Ch] [ebp-4h]
v8 = 0;
v7 = 0;
v6 = GetWindowProperties(hWnd);
if ( !v6 )
return 0;
if ( *(_DWORD *)(v6 + 628) || (v8 = PB_CreateAccessibleService(v6 + 628)) == 0 && *(_DWORD *)(v6 + 628) )
{
v5 = GetWinProp(hWnd);
if ( v5 )
{
if ( *(_DWORD *)v5 == 16509 )
{
v8 = (*(int (__stdcall **)(_DWORD, HWND, int))(**(_DWORD **)(v6 + 628) + 16))(
*(_DWORD *)(v6 + 628),
hWnd,
v5 + 256);
if ( !v8 && *(_DWORD *)(v5 + 256) )
{
if ( a4 )
{
(*(void (__stdcall **)(_DWORD, int, int *))(**(_DWORD **)(v5 + 256) + 116))(*(_DWORD *)(v5 + 256), a4, &v7);
if ( v7 )
result = PB_LresultFromObject(&unk_11437D18, a2, v7);
else
result = 0;
}
else
{
result = PB_LresultFromObject(&unk_11437D18, a2, *(_DWORD *)(v5 + 256));
}
}
else
{
switch ( v8 )
{
case -2147467261:
DisplayErrorMsg(0x4B0u, 0x4B4u);
break;
case -2147024890:
DisplayErrorMsg(0x4B0u, 0x4B2u);
break;
case -2147024882:
DisplayErrorMsg(0x4B0u, 0x4B6u);
break;
}
result = 0;
}
}
else
{
result = 0;
}
}
else
{
result = 0;
}
}
else
{
if ( v8 == -2147024882 )
DisplayErrorMsg(0x4B0u, 0x4B6u);
else
DisplayErrorMsg(0x4B0u, 0x4B1u);
result = 0;
}
return result;
}
So, I see this line in one of the callstacks of a dump (x86/Windows 7) I am looking at. I have heavily snipped it as my question is pertaining only to this call.
Args to Child
01111111 04444444 05555555 ntdll!KiUserExceptionDispatcher+0xf
and going by: http://www.nynaeve.net/Code/KiUserExceptionDispatcher.c
It looks like the first two arguments on the stack must be the context record and the exception record. However with some experimentation I noted that 01111111 is not the first argument. It actually starts from 04444444. So, in this case .cxr 04444444 and .exr 05555555 display sane output.
Now, I understand the debugger might just show whatever is on the stack at that point and I shouldn't probably rely on that alone but if everything below that line is marked with "stack unwind information not available. Following frames may be wrong", how am I to know that I should ignore 01111111?
UPDATE
Lets try a different approach. Here are 2 relevant pieces of information:
Args to Child
0ccccccc 77895ac4 00000000 kernel32!UnhandledExceptionFilter+0x9e
[... various other calls here, leading up to ...]
0eeeeeee 0aaaaaaa 0bbbbbbb ntdll!KiUserExceptionDispatcher+0xf
So, check this out. The lone parameter to UnhandledExceptionFilter is an EXCEPTION_POINTERS* structure, right?
0:010> dd 0ccccccc l2
0ddddddd 0bbbbbbb 0aaaaaaa
In the EXCEPTION_POINTERS struct, the first field is the EXCEPTION_RECORD (0bbbbbbb) while the second is the CONTEXT_RECORD (0aaaaaaa). However in the call to KiUserEceptionDispatcher, these arguments appear in the opposite way. Not to mention the fact 0eeeeeee is NOT the first parameter to KiUserExceptionDispatcher but 0ccccccc IS the first parameter to UnhandledExceptionFilter.
I am SO confused!
windows 7 x86 32 bit machine
winkey + r -> windbg calc
bp ntdll!KiUserExceptionDispatcher
f5
divide 0/0 in calculator to raise an exception
(ac8.c8c): C++ EH exception - code e06d7363 (first chance)
Breakpoint 0 hit
eax=0023e1ec ebx=02b12fd0 ecx=00000003 edx=00000000 esi=02b13178 edi=00000001
eip=76e77048 esp=0023dee0 ebp=0023e23c iopl=0 nv up ei pl nz na po nc
cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202
ntdll!KiUserExceptionDispatcher:
76e77048 fc cld
your post shows the return address to be + 0xf so lets see whats upto that point
0:000> u . .+f
ntdll!KiUserExceptionDispatcher:
76e77048 fc cld
76e77049 8b4c2404 mov ecx,dword ptr [esp+4]
76e7704d 8b1c24 mov ebx,dword ptr [esp]
76e77050 51 push ecx
76e77051 53 push ebx
76e77052 e85d88fdff call ntdll!RtlDispatchException (76e4f8b4)
76e77057 0ac0 or al,al
so it appears you have broken after entering RtlDispatchException from your call stack
breaking to enter the call
0:000> tc
eax=0023e1ec ebx=0023dee8 ecx=0023df08 edx=00000000 esi=02b13178 edi=00000001
eip=76e77052 esp=0023ded8 ebp=0023e23c iopl=0 nv up ei pl nz na po nc
cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202
ntdll!KiUserExceptionDispatcher+0xa:
76e77052 e85d88fdff call ntdll!RtlDispatchException (76e4f8b4)
0:000> t
eax=0023e1ec ebx=0023dee8 ecx=0023df08 edx=00000000 esi=02b13178 edi=00000001
eip=76e4f8b4 esp=0023ded4 ebp=0023e23c iopl=0 nv up ei pl nz na po nc
cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202
ntdll!RtlDispatchException:
76e4f8b4 8bff mov edi,edi
looking at stack if you ask windbg to be verbose it will even decipher the context for you
0:000> kb 3
# ChildEBP RetAddr Args to Child
00 0023ded0 76e77057 0023dee8 0023df08 0023dee8 ntdll!RtlDispatchException
01 0023ded0 7521b760 0023dee8 0023df08 0023dee8 ntdll!KiUserExceptionDispatcher+0xf
02 0023e23c 7579359c e06d7363 00000001 00000003 KERNELBASE!RaiseException+0x58
0:000> kv 3
# ChildEBP RetAddr Args to Child
00 0023ded0 76e77057 0023dee8 0023df08 0023dee8 ntdll!RtlDispatchException (FPO: [Non-Fpo])
01 0023ded0 7521b760 0023dee8 0023df08 0023dee8 ntdll!KiUserExceptionDispatcher+0xf (FPO: [2,0,0]) (CONTEXT # 0023df08)
02 0023e23c 7579359c e06d7363 00000001 00000003 KERNELBASE!RaiseException+0x58 (FPO: [Non-Fpo])
exr output
0:000> .exr poi(#esp+4)
ExceptionAddress: 7521b760 (KERNELBASE!RaiseException+0x00000058)
ExceptionCode: e06d7363 (C++ EH exception)
ExceptionFlags: 00000001
NumberParameters: 3
Parameter[0]: 19930520
Parameter[1]: 0023e294
Parameter[2]: 007c15b4
unable to find C-Runtime symbols, even with unqualified search
context record output
0:000> dt ntdll!_CONTEXT poi(#esp+8)
+0x000 ContextFlags : 0x1003f
+0x004 Dr0 : 0
+0x008 Dr1 : 0
+0x00c Dr2 : 0
+0x010 Dr3 : 0
+0x014 Dr6 : 0
+0x018 Dr7 : 0
+0x01c FloatSave : _FLOATING_SAVE_AREA
+0x08c SegGs : 0
+0x090 SegFs : 0x3b
+0x094 SegEs : 0x23
+0x098 SegDs : 0x23
+0x09c Edi : 1
+0x0a0 Esi : 0x2b13178
+0x0a4 Ebx : 0x2b12fd0
+0x0a8 Edx : 0
+0x0ac Ecx : 3
+0x0b0 Eax : 0x23e1ec
+0x0b4 Ebp : 0x23e23c
+0x0b8 Eip : 0x7521b760
+0x0bc SegCs : 0x1b
+0x0c0 EFlags : 0x202
+0x0c4 Esp : 0x23e1ec
+0x0c8 SegSs : 0x23
+0x0cc ExtendedRegisters : [512] "???"
you can even get both by use .extptr (note you may need to reset context to default scope using .cxr after using this command)
0:000> .exptr (#esp+4)
----- Exception record at 0023dee8:
ExceptionAddress: 7521b760 (KERNELBASE!RaiseException+0x00000058)
ExceptionCode: e06d7363 (C++ EH exception)
ExceptionFlags: 00000001
NumberParameters: 3
Parameter[0]: 19930520
Parameter[1]: 0023e294
Parameter[2]: 007c15b4
unable to find C-Runtime symbols, even with unqualified search
----- Context record at 0023df08:
eax=0023e1ec ebx=02b12fd0 ecx=00000003 edx=00000000 esi=02b13178 edi=00000001
eip=7521b760 esp=0023e1ec ebp=0023e23c iopl=0 nv up ei pl nz na po nc
cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202
KERNELBASE!RaiseException+0x58:
7521b760 c9 leave
0:000> kb 3
# ChildEBP RetAddr Args to Child
00 0023e23c 7579359c e06d7363 00000001 00000003 KERNELBASE!RaiseException+0x58
01 0023e274 0079eee0 0023e294 007c15b4 02b13178 msvcrt!_CxxThrowException+0x48
02 0023e288 0079146e 02b13178 80000002 c87a3f02 calc!divrat+0x69
0:000> .cxr
Resetting default scope
0:000> kb 3
# ChildEBP RetAddr Args to Child
00 0023ded0 76e77057 0023dee8 0023df08 0023dee8 ntdll!RtlDispatchException
01 0023ded0 7521b760 0023dee8 0023df08 0023dee8 ntdll!KiUserExceptionDispatcher+0xf
02 0023e23c 7579359c e06d7363 00000001 00000003 KERNELBASE!RaiseException+0x58
hope this suffices to research on your own for your specific situation for which you cant divulge the actual windbg stack trace
I am trying to transfer file from one server to another server using SI SFTP adapater. It worked for 1st time. after that I am started getting below error. Can anyone through some light how to resolve it.
[7/18/14 18:05:26:273 EDT] 00000034 SystemErr R at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)
[7/18/14 18:05:26:273 EDT] 00000034 SystemErr R at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)
[7/18/14 18:05:26:273 EDT] 00000034 SystemErr R at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1690)
[7/18/14 18:05:26:273 EDT] 00000034 SystemErr R Caused by: java.lang.IllegalStateException: failed to create SFTP Session
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R at org.springframework.integration.sftp.session.DefaultSftpSessionFactory.getSession(DefaultSftpSessionFactory.java:321)
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R at org.springframework.integration.file.remote.session.CachingSessionFactory$1.createForPool(CachingSessionFactory.java:74)
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R at org.springframework.integration.file.remote.session.CachingSessionFactory$1.createForPool(CachingSessionFactory.java:71)
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R at org.springframework.integration.util.SimplePool.doGetItem(SimplePool.java:187)
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R at org.springframework.integration.util.SimplePool.getItem(SimplePool.java:167)
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R ... 198 more
[7/18/14 18:05:26:274 EDT] 00000034 SystemErr R Caused by: java.lang.IllegalStateException: failed to connect
[7/18/14 18:05:26:275 EDT] 00000034 SystemErr R at org.springframework.integration.sftp.session.SftpSession.connect(SftpSession.java:250)
[7/18/14 18:05:26:275 EDT] 00000034 SystemErr R at org.springframework.integration.sftp.session.DefaultSftpSessionFactory.getSession(DefaultSftpSessionFactory.java:316)
[7/18/14 18:05:26:275 EDT] 00000034 SystemErr R ... 202 more
[7/18/14 18:05:26:275 EDT] 00000034 SystemErr R Caused by: com.jcraft.jsch.JSchException: SSH_MSG_DISCONNECT: 2 Too many authentication failures for webadm
[7/18/14 18:05:26:276 EDT] 00000034 SystemErr R at com.jcraft.jsch.Session.read(Session.java:987)
[7/18/14 18:05:26:276 EDT] 00000034 SystemErr R at com.jcraft.jsch.UserAuthPublicKey.start(UserAuthPublicKey.java:83)
[7/18/14 18:05:26:276 EDT] 00000034 SystemErr R at com.jcraft.jsch.Session.connect(Session.java:463)
[7/18/14 18:05:26:276 EDT] 00000034 SystemErr R at com.jcraft.jsch.Session.connect(Session.java:183)
[7/18/14 18:05:26:276 EDT] 00000034 SystemErr R at org.springframework.integration.sftp.session.SftpSession.connect(SftpSession.java:241)
[7/18/14 18:05:26:276 EDT] 00000034 SystemErr R ... 203 more
Scenario: Running a debootstrapped Ubuntu 11.4 lxc guest on a Ubuntu 12.4 lxc host (both 64 bit)
Inside the lxc guest, rsyslogd is constantly crashing with SIGABRT stating:
libgcc_s.so.1 must be installed for pthread_cancel to work
0334.380551272:7f4128a84700:
Signal 6 (SIGABRT) occured, execution must be terminated.
I'm not sure why libgcc_s.so.1 cannot be found. If I run ldconfig -p:
$# ldconfig -p | grep libgcc
libgcc_s.so.1 (libc6,x86-64) => /lib/x86_64-linux-gnu/libgcc_s.so.1
libgcc_s.so.1 (libc6) => /usr/lib32/libgcc_s.so.1
It is listed. And both of those links are valid.
How do I resolve this problem?
EDIT: objdump -T output by request:
/lib/x86_64-linux-gnu/libgcc_s.so.1: file format elf64-x86-64
DYNAMIC SYMBOL TABLE:
00000000000025d8 l d .init 0000000000000000 .init
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 memset
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 abort
0000000000000000 w D *UND* 0000000000000000 __gmon_start__
0000000000000000 w D *UND* 0000000000000000 _Jv_RegisterClasses
0000000000000000 w D *UND* 0000000000000000 pthread_key_create
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 malloc
0000000000000000 w D *UND* 0000000000000000 pthread_once
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 free
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 strlen
0000000000000000 w D *UND* 0000000000000000 pthread_getspecific
0000000000000000 w DF *UND* 0000000000000000 GLIBC_2.2.5 __cxa_finalize
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 memcpy
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 dl_iterate_phdr
0000000000000000 w D *UND* 0000000000000000 pthread_cancel
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 calloc
0000000000000000 w DF *UND* 0000000000000000 GLIBC_2.2.5 pthread_mutex_lock
0000000000000000 DF *UND* 0000000000000000 GLIBC_2.2.5 realloc
0000000000000000 w DF *UND* 0000000000000000 GLIBC_2.2.5 pthread_mutex_unlock
0000000000000000 w D *UND* 0000000000000000 pthread_setspecific
0000000000002de0 g DF .text 0000000000000028 GCC_3.0 __mulvsi3
000000000000a8c0 g DF .text 000000000000034c GCC_4.3.0 __floatuntitf
000000000000c160 g DF .text 00000000000001cf GCC_4.3.0 __letf2
00000000000050a0 g DF .text 0000000000000223 GCC_3.0 __modti3
0000000000009530 g DF .text 0000000000000094 GCC_4.3.0 __unordtf2
0000000000004660 g DF .text 0000000000000007 GCC_4.3.0 __bswapdi2
0000000000004ea0 g DF .text 0000000000000045 GCC_4.2.0 __floatuntixf
0000000000011d80 g DF .text 000000000000017f GCC_4.3.0 __emutls_get_address
0000000000000000 g DO *ABS* 0000000000000000 GCC_3.0 GCC_3.0
0000000000006ac0 g DF .text 0000000000000a0f GCC_4.3.0 __divtf3
0000000000002b70 g DF .text 0000000000000032 GCC_3.0 __ucmpti2
0000000000000000 g DO *ABS* 0000000000000000 GCC_3.3 GCC_3.3
0000000000000000 g DO *ABS* 0000000000000000 GCC_3.4 GCC_3.4
0000000000002ac0 g DF .text 0000000000000062 GCC_3.0 __ashrti3
0000000000002c60 g DF .text 000000000000002d GCC_3.0 __addvdi3
0000000000003270 g DF .text 0000000000000036 GCC_3.4 __paritydi2
0000000000002cc0 g DF .text 0000000000000042 GCC_3.4.4 __addvti3
00000000000032b0 g DF .text 0000000000000039 GCC_3.4 __parityti2
00000000000098b0 g DF .text 00000000000000ee GCC_4.3.0 __floatsitf
0000000000002a60 g DF .text 000000000000005f GCC_3.0 __ashlti3
000000000000f830 g DF .text 00000000000000e5 GCC_3.0 _Unwind_Resume
000000000000fa40 g DF .text 00000000000000ab GCC_3.3 _Unwind_Backtrace
0000000000000000 g DO *ABS* 0000000000000000 GCC_3.4.2 GCC_3.4.2
00000000000036a0 g DF .text 00000000000002e7 GCC_4.0.0 __muldc3
000000000000cb30 g DF .text 0000000000000630 GCC_4.3.0 __multc3
000000000000cb30 g DF .text 0000000000000630 (GCC_4.0.0) __multc3
0000000000000000 g DO *ABS* 0000000000000000 GCC_3.4.4 GCC_3.4.4
00000000000029d0 g DF .text 0000000000000026 GCC_3.0 __negti2
000000000000c330 g DF .text 0000000000000132 GCC_4.3.0 __eqtf2
0000000000003340 g DF .text 000000000000004d GCC_4.0.0 __powidf2
000000000000d160 g DF .text 00000000000000a7 GCC_4.3.0 __powitf2
0000000000003180 g DF .text 0000000000000009 GCC_3.4 __clzdi2
000000000000d160 g DF .text 00000000000000a7 (GCC_4.0.0) __powitf2
0000000000003190 g DF .text 0000000000000022 GCC_3.4 __clzti2
00000000000052d0 g DF .text 0000000000000113 GCC_3.0 __udivti3
0000000000009e00 g DF .text 00000000000000fe GCC_4.3.0 __floatditf
000000000000b540 g DF .text 000000000000052f GCC_4.3.0 __trunctfdf2
0000000000004b10 g DF .text 00000000000000ca GCC_3.0 __floattisf
0000000000009c80 g DF .text 0000000000000173 GCC_4.3.0 __fixunstfdi
000000000000ac10 g DF .text 0000000000000172 GCC_4.3.0 __extendsftf2
000000000000d6a0 g DF .text 0000000000000008 GCC_3.0 _Unwind_GetLanguageSpecificData
000000000000d6c0 g DF .text 0000000000000023 GCC_3.3 _Unwind_FindEnclosingFunction
000000000000d670 g DF .text 0000000000000015 GCC_4.2.0 _Unwind_GetIPInfo
000000000000a2a0 g DF .text 000000000000024a GCC_4.3.0 __fixunstfti
00000000000112c0 g DF .text 0000000000000132 GCC_3.0 __deregister_frame_info_bases
0000000000003150 g DF .text 0000000000000010 GCC_3.0 __ffsdi2
0000000000003160 g DF .text 000000000000001e GCC_3.0 __ffsti2
00000000000047c0 g DF .text 0000000000000039 GCC_3.0 __fixxfti
000000000000d6f0 g DF .text 0000000000000008 GCC_3.0 _Unwind_GetDataRelBase
0000000000004070 g DF .text 00000000000002ef GCC_4.0.0 __divdc3
000000000000c470 g DF .text 00000000000006b1 GCC_4.3.0 __divtc3
000000000000c470 g DF .text 00000000000006b1 (GCC_4.0.0) __divtc3
0000000000000000 g DO *ABS* 0000000000000000 GCC_4.2.0 GCC_4.2.0
0000000000002dc0 g DF .text 0000000000000020 GCC_3.0 __mulvdi3
0000000000002c00 g DF .text 000000000000001b GCC_3.0 __absvsi2
0000000000002e10 g DF .text 000000000000028c GCC_3.4.4 __mulvti3
00000000000112a0 g DF .text 000000000000001a GCC_3.0 __register_frame_table
0000000000008170 g DF .text 00000000000013ba GCC_4.3.0 __subtf3
000000000000af30 g DF .text 000000000000016b GCC_4.3.0 __extendxftf2
0000000000003990 g DF .text 0000000000000413 GCC_4.0.0 __mulxc3
0000000000007e30 g DF .text 000000000000033e GCC_4.3.0 __negtf2
0000000000011210 g DF .text 0000000000000072 GCC_3.0 __register_frame_info_table_bases
0000000000003390 g DF .text 000000000000005f GCC_4.0.0 __powixf2
0000000000004be0 g DF .text 00000000000000ca GCC_3.0 __floattidf
000000000000d6b0 g DF .text 0000000000000008 GCC_3.0 _Unwind_GetRegionStart
000000000000a4f0 g DF .text 00000000000003c1 GCC_4.3.0 __floattitf
0000000000004cb0 g DF .text 000000000000002d GCC_3.0 __floattixf
000000000000ba70 g DF .text 0000000000000503 GCC_4.3.0 __trunctfxf2
0000000000011440 g DF .text 00000000000001fd GCC_3.0 _Unwind_Find_FDE
000000000000d690 g DF .text 0000000000000008 GCC_3.0 _Unwind_SetIP
00000000000053f0 g DF .text 000000000000018e GCC_3.0 __umodti3
000000000000d660 g DF .text 0000000000000008 GCC_3.0 _Unwind_GetIP
00000000000046d0 g DF .text 000000000000006b GCC_3.0 __fixunsxfdi
0000000000011130 g DF .text 000000000000009a GCC_3.0 __register_frame_info_bases
0000000000004940 g DF .text 00000000000001ce GCC_3.0 __fixunsxfti
0000000000004360 g DF .text 00000000000002e6 GCC_4.0.0 __divxc3
0000000000002d40 g DF .text 000000000000002c GCC_3.0 __subvsi3
0000000000004740 g DF .text 0000000000000037 GCC_3.0 __fixsfti
00000000000057c0 g DF .text 00000000000012f7 GCC_4.3.0 __addtf3
0000000000000000 g DO *ABS* 0000000000000000 GCC_4.3.0 GCC_4.3.0
00000000000030d0 g DF .text 0000000000000024 GCC_3.0 __negvsi2
0000000000002bd0 g DF .text 0000000000000025 GCC_3.0 __absvdi2
0000000000002980 g DF .text 000000000000004c GCC_3.0 __multi3
000000000000fa20 g DF .text 000000000000001a GCC_3.0 _Unwind_DeleteException
0000000000002c20 g DF .text 0000000000000034 GCC_3.4.4 __absvti2
000000000000d600 g DF .text 0000000000000008 GCC_3.3 _Unwind_GetCFA
0000000000002a00 g DF .text 000000000000005f GCC_3.0 __lshrti3
0000000000002bc0 g DF .text 0000000000000002 GCC_3.4.2 __enable_execute_stack
00000000000031f0 g DF .text 000000000000002c GCC_3.4 __popcountdi2
0000000000000000 g DO *ABS* 0000000000000000 GCC_4.0.0 GCC_4.0.0
0000000000003220 g DF .text 0000000000000045 GCC_3.4 __popcountti2
0000000000002bb0 g DF .text 0000000000000002 GCC_3.0 __clear_cache
000000000000c330 g DF .text 0000000000000132 (GCC_3.0) __netf2
000000000000c330 g DF .text 0000000000000132 GCC_4.3.0 __netf2
0000000000004780 g DF .text 0000000000000040 GCC_3.0 __fixdfti
00000000000099a0 g DF .text 00000000000000db GCC_4.3.0 __floatunsitf
00000000000095d0 g DF .text 0000000000000190 GCC_4.3.0 __fixtfsi
0000000000002b30 g DF .text 0000000000000032 GCC_3.0 __cmpti2
000000000000ad90 g DF .text 0000000000000195 GCC_4.3.0 __extenddftf2
0000000000004650 g DF .text 0000000000000005 GCC_4.3.0 __bswapsi2
000000000000f5d0 g DF .text 000000000000016c GCC_3.0 _Unwind_RaiseException
0000000000009f00 g DF .text 00000000000000d3 GCC_4.3.0 __floatunditf
0000000000002c90 g DF .text 000000000000002c GCC_3.0 __addvsi3
0000000000004ce0 g DF .text 00000000000000d6 GCC_4.2.0 __floatuntisf
000000000000bf80 g DF .text 00000000000001df (GCC_3.0) __gttf2
000000000000bf80 g DF .text 00000000000001df GCC_4.3.0 __gttf2
0000000000011410 g DF .text 0000000000000021 GCC_3.0 __deregister_frame
0000000000000000 g DO *ABS* 0000000000000000 GCC_3.3.1 GCC_3.3.1
00000000000031c0 g DF .text 0000000000000005 GCC_3.4 __ctzdi2
0000000000004ef0 g DF .text 00000000000001ab GCC_3.0 __divti3
00000000000033f0 g DF .text 00000000000002a5 GCC_4.0.0 __mulsc3
00000000000031d0 g DF .text 000000000000001b GCC_3.4 __ctzti2
0000000000011290 g DF .text 0000000000000009 GCC_3.0 __register_frame_info_table
00000000000111e0 g DF .text 0000000000000026 GCC_3.0 __register_frame
00000000000032f0 g DF .text 000000000000004b GCC_4.0.0 __powisf2
000000000000bf80 g DF .text 00000000000001df GCC_4.3.0 __getf2
0000000000004670 g DF .text 000000000000002c GCC_3.0 __fixunssfdi
000000000000b0a0 g DF .text 000000000000049b GCC_4.3.0 __trunctfsf2
00000000000074d0 g DF .text 000000000000095f GCC_4.3.0 __multf3
000000000000f920 g DF .text 00000000000000f9 GCC_3.3 _Unwind_Resume_or_Rethrow
0000000000011f00 g DF .text 0000000000000035 GCC_4.3.0 __emutls_register_common
0000000000002d10 g DF .text 000000000000002d GCC_3.0 __subvdi3
0000000000004800 g DF .text 000000000000009f GCC_3.0 __fixunssfti
0000000000002d70 g DF .text 0000000000000042 GCC_3.4.4 __subvti3
0000000000009a80 g DF .text 00000000000001fc GCC_4.3.0 __fixtfdi
00000000000111d0 g DF .text 0000000000000009 GCC_3.0 __register_frame_info
00000000000030a0 g DF .text 000000000000002a GCC_3.0 __negvdi2
0000000000005590 g DF .text 000000000000022a GCC_3.0 __udivmodti4
000000000000c160 g DF .text 00000000000001cf (GCC_3.0) __lttf2
0000000000003100 g DF .text 000000000000004e GCC_3.4.4 __negvti2
000000000000c160 g DF .text 00000000000001cf GCC_4.3.0 __lttf2
00000000000046a0 g DF .text 0000000000000030 GCC_3.0 __fixunsdfdi
0000000000009fe0 g DF .text 00000000000002b6 GCC_4.3.0 __fixtfti
0000000000011400 g DF .text 0000000000000005 GCC_3.0 __deregister_frame_info
0000000000009760 g DF .text 000000000000014b GCC_4.3.0 __fixunstfsi
0000000000011800 g DF .text 000000000000045c GCC_3.3.1 __gcc_personality_v0
00000000000048a0 g DF .text 0000000000000097 GCC_3.0 __fixunsdfti
000000000000d610 g DF .text 0000000000000050 GCC_3.0 _Unwind_SetGR
0000000000004dc0 g DF .text 00000000000000d6 GCC_4.2.0 __floatuntidf
0000000000003db0 g DF .text 00000000000002b8 GCC_4.0.0 __divsc3
000000000000d5b0 g DF .text 0000000000000048 GCC_3.0 _Unwind_GetGR
000000000000d700 g DF .text 0000000000000008 GCC_3.0 _Unwind_GetTextRelBase
000000000000f740 g DF .text 00000000000000ef GCC_3.0 _Unwind_ForcedUnwind
/usr/lib32/libgcc_s.so.1: file format elf32-i386
DYNAMIC SYMBOL TABLE:
00000000 DF *UND* 00000000 GLIBC_2.0 abort
00000000 w D *UND* 00000000 __gmon_start__
00000000 w D *UND* 00000000 _Jv_RegisterClasses
00000000 DF *UND* 00000000 GLIBC_2.0 realloc
00000000 DF *UND* 00000000 GLIBC_2.0 calloc
00000000 w D *UND* 00000000 pthread_key_create
00000000 DF *UND* 00000000 GLIBC_2.0 memset
00000000 w D *UND* 00000000 pthread_once
00000000 DF *UND* 00000000 GLIBC_2.0 free
00000000 w D *UND* 00000000 pthread_getspecific
00000000 w DF *UND* 00000000 GLIBC_2.0 pthread_mutex_unlock
00000000 DF *UND* 00000000 GLIBC_2.0 memcpy
00000000 DF *UND* 00000000 GLIBC_2.0 strlen
00000000 DF *UND* 00000000 GLIBC_2.0 malloc
00000000 w DF *UND* 00000000 GLIBC_2.0 pthread_mutex_lock
00000000 w D *UND* 00000000 pthread_cancel
00000000 DF *UND* 00000000 GLIBC_2.2.4 dl_iterate_phdr
00000000 w DF *UND* 00000000 GLIBC_2.1.3 __cxa_finalize
00000000 w D *UND* 00000000 pthread_setspecific
00007c10 g DF .text 000001d0 GLIBC_2.0 __moddi3
00002450 g DF .text 00000038 GCC_3.0 __mulvsi3
0000c120 g DF .text 00000225 GCC_4.4.0 __letf2
000103e0 g DF .text 00000096 GCC_4.4.0 __unordtf2
000074b0 g DF .text 0000000f GCC_4.3.0 __bswapdi2
000187b0 g DF .text 000001a8 GCC_4.3.0 __emutls_get_address
00000000 g DO *ABS* 00000000 GCC_3.0 GCC_3.0
00002200 g DF .text 0000003d GCC_3.0 __ucmpdi2
0000a810 g DF .text 0000156b GCC_4.4.0 __divtf3
00002160 g DF .text 00000060 GCC_3.0 __ashrdi3
00015da0 g DF .text 000000d9 GLIBC_2.0 __frame_state_for
00000000 g DO *ABS* 00000000 GCC_3.3 GCC_3.3
00000000 g DO *ABS* 00000000 GCC_3.4 GCC_3.4
00002330 g DF .text 00000069 GCC_3.0 __addvdi3
000028d0 g DF .text 0000002f GCC_3.4 __paritydi2
00013490 g DF .text 00000033 GCC_4.4.0 __fabstf2
000020f0 g DF .text 00000061 GCC_3.0 __ashldi3
000109a0 g DF .text 000001e8 GCC_4.4.0 __floatsitf
00016100 g DF .text 000000e2 GCC_3.0 _Unwind_Resume
00016300 g DF .text 00000089 GCC_3.3 _Unwind_Backtrace
00000000 g DO *ABS* 00000000 GCC_3.4.2 GCC_3.4.2
00002fd0 g DF .text 00000408 GCC_4.0.0 __muldc3
00002050 g DF .text 00000031 GCC_3.0 __negdi2
000037e0 g DF .text 000018a8 GCC_4.4.0 __multc3
0000bd80 g DF .text 00000185 GCC_4.4.0 __eqtf2
00002960 g DF .text 00000054 GCC_4.0.0 __powidf2
00007950 g DF .text 0000002c GCC_3.0 __floatdidf
00002790 g DF .text 00000020 GCC_3.4 __clzdi2
00002a20 g DF .text 000001ad GCC_4.4.0 __powitf2
00007de0 g DF .text 00000104 GLIBC_2.0 __udivdi3
000112f0 g DF .text 00000210 GCC_4.4.0 __floatditf
00012720 g DF .text 0000067b GCC_4.4.0 __trunctfdf2
00007980 g DF .text 0000002c GCC_3.0 __floatdixf
00011050 g DF .text 00000294 GCC_4.4.0 __fixunstfdi
000116f0 g DF .text 0000039e GCC_4.4.0 __extendsftf2
00013980 g DF .text 0000000b GCC_3.0 _Unwind_GetLanguageSpecificData
000139a0 g DF .text 00000037 GCC_3.3 _Unwind_FindEnclosingFunction
00013950 g DF .text 00000016 GCC_4.2.0 _Unwind_GetIPInfo
000076b0 g DF .text 00000047 GCC_3.0 __fixxfdi
00017c20 g DF .text 0000010f GCC_3.0 __deregister_frame_info_bases
00002750 g DF .text 0000002f GCC_3.0 __ffsdi2
00000000 g DO *ABS* 00000000 GCC_4.5.0 GCC_4.5.0
000139e0 g DF .text 0000000b GCC_3.0 _Unwind_GetDataRelBase
000075a0 g DF .text 00000062 GCC_3.0 __fixunsxfsi
00005390 g DF .text 000002f9 GCC_4.0.0 __divdc3
00005990 g DF .text 00001b0f GCC_4.4.0 __divtc3
00000000 g DO *ABS* 00000000 GCC_4.2.0 GCC_4.2.0
00002490 g DF .text 000001fe GCC_3.0 __mulvdi3
00002260 g DF .text 00000033 GCC_3.0 __absvsi2
00017be0 g DF .text 00000033 GLIBC_2.0 __register_frame_table
0000dd70 g DF .text 00002668 GCC_4.4.0 __subtf3
00011ea0 g DF .text 00000293 GCC_4.5.0 __extendxftf2
000027f0 g DF .text 00000050 GCC_3.4 __popcountsi2
000033e0 g DF .text 000003f8 GCC_4.0.0 __mulxc3
0000d7c0 g DF .text 000005a9 GCC_4.4.0 __negtf2
00017b00 g DF .text 00000093 GCC_3.0 __register_frame_info_table_bases
000029c0 g DF .text 00000054 GCC_4.0.0 __powixf2
00013990 g DF .text 0000000b GCC_3.0 _Unwind_GetRegionStart
00012da0 g DF .text 000006ab GCC_4.4.0 __trunctfxf2
00017da0 g DF .text 000001de GCC_3.0 _Unwind_Find_FDE
00013970 g DF .text 0000000e GCC_3.0 _Unwind_SetIP
00007ef0 g DF .text 00000145 GLIBC_2.0 __umoddi3
00013940 g DF .text 0000000b GCC_3.0 _Unwind_GetIP
000027b0 g DF .text 00000009 GCC_3.4 __ctzsi2
000077e0 g DF .text 000000e0 GCC_3.0 __fixunsxfdi
00013450 g DF .text 0000003e GCC_4.4.0 __copysigntf3
000179c0 g DF .text 000000a7 GCC_3.0 __register_frame_info_bases
000079b0 g DF .text 00000059 GCC_4.2.0 __floatundisf
00005690 g DF .text 000002fb GCC_4.0.0 __divxc3
00007610 g DF .text 00000047 GCC_3.0 __fixsfdi
000023a0 g DF .text 0000003c GCC_3.0 __subvsi3
00008230 g DF .text 000025da GCC_4.4.0 __addtf3
00000000 g DO *ABS* 00000000 GCC_4.3.0 GCC_4.3.0
00002010 g DF .text 00000035 GCC_3.0 __muldi3
00002690 g DF .text 00000036 GCC_3.0 __negvsi2
000022a0 g DF .text 00000050 GCC_3.0 __absvdi2
000162e0 g DF .text 0000001f GCC_3.0 _Unwind_DeleteException
000074c0 g DF .text 00000062 GCC_3.0 __fixunssfsi
00002090 g DF .text 0000005f GCC_3.0 __lshrdi3
000138c0 g DF .text 0000000b GCC_3.3 _Unwind_GetCFA
00007660 g DF .text 00000047 GCC_3.0 __fixdfdi
00002250 g DF .text 00000005 GCC_3.4.2 __enable_execute_stack
00002840 g DF .text 0000005b GCC_3.4 __popcountdi2
00000000 g DO *ABS* 00000000 GCC_4.0.0 GCC_4.0.0
00002240 g DF .text 00000005 GCC_3.0 __clear_cache
0000bd80 g DF .text 00000185 GCC_4.4.0 __netf2
00010b90 g DF .text 000001a7 GCC_4.4.0 __floatunsitf
00010480 g DF .text 000002b2 GCC_4.4.0 __fixtfsi
000021c0 g DF .text 0000003d GCC_3.0 __cmpdi2
00011a90 g DF .text 00000401 GCC_4.4.0 __extenddftf2
00007530 g DF .text 00000062 GCC_3.0 __fixunsdfsi
000074a0 g DF .text 0000000a GCC_4.3.0 __bswapsi2
00007a10 g DF .text 00000037 GCC_4.2.0 __floatundidf
00015e90 g DF .text 0000018e GCC_3.0 _Unwind_RaiseException
00011500 g DF .text 000001e7 GCC_4.4.0 __floatunditf
000022f0 g DF .text 0000003c GCC_3.0 __addvsi3
000028a0 g DF .text 0000002a GCC_3.4 __paritysi2
00007a50 g DF .text 00000037 GCC_4.2.0 __floatundixf
0000bf10 g DF .text 00000206 GCC_4.4.0 __gttf2
00017d60 g DF .text 00000031 GLIBC_2.0 __deregister_frame
00000000 g DO *ABS* 00000000 GCC_3.3.1 GCC_3.3.1
00007a90 g DF .text 00000177 GLIBC_2.0 __divdi3
000027c0 g DF .text 00000025 GCC_3.4 __ctzdi2
00002bd0 g DF .text 000003f0 GCC_4.0.0 __mulsc3
00017ba0 g DF .text 0000003a GLIBC_2.0 __register_frame_info_table
00017ab0 g DF .text 00000042 GLIBC_2.0 __register_frame
00002900 g DF .text 00000054 GCC_4.0.0 __powisf2
00002780 g DF .text 0000000c GCC_3.4 __clzsi2
0000bf10 g DF .text 00000206 GCC_4.4.0 __getf2
00007700 g DF .text 0000006c GCC_3.0 __fixunssfdi
00012140 g DF .text 000005d4 GCC_4.4.0 __trunctfsf2
0000c350 g DF .text 0000146a GCC_4.4.0 __multf3
000161f0 g DF .text 000000e2 GCC_3.3 _Unwind_Resume_or_Rethrow
00018960 g DF .text 00000033 GCC_4.3.0 __emutls_register_common
000023e0 g DF .text 00000069 GCC_3.0 __subvdi3
00000000 g DO *ABS* 00000000 GLIBC_2.0 GLIBC_2.0
00010d40 g DF .text 0000030d GCC_4.4.0 __fixtfdi
00017a70 g DF .text 0000003a GLIBC_2.0 __register_frame_info
00002730 g DF .text 00000014 GCC_4.3.0 __ffssi2
00008050 g DF .text 000001d8 GCC_3.0 __udivmoddi4
000078c0 g DF .text 0000008f GCC_3.0 __floatdisf
000026d0 g DF .text 0000005a GCC_3.0 __negvdi2
00000000 g DO *ABS* 00000000 GCC_4.4.0 GCC_4.4.0
0000c120 g DF .text 00000225 GCC_4.4.0 __lttf2
00007770 g DF .text 0000006c GCC_3.0 __fixunsdfdi
00017d30 g DF .text 00000023 GLIBC_2.0 __deregister_frame_info
00010740 g DF .text 0000025a GCC_4.4.0 __fixunstfsi
000181d0 g DF .text 00000463 GCC_3.3.1 __gcc_personality_v0
000138d0 g DF .text 0000006d GCC_3.0 _Unwind_SetGR
00005090 g DF .text 000002f1 GCC_4.0.0 __divsc3
00013850 g DF .text 00000065 GCC_3.0 _Unwind_GetGR
000139f0 g DF .text 0000000b GCC_3.0 _Unwind_GetTextRelBase
00016020 g DF .text 000000d8 GCC_3.0 _Unwind_ForcedUnwind
This sounds somewhat similar to a reported bug with rsyslogd on ubuntu. If you run out of options then upgrading to a later version of rsyslogd might be the way to go. You may have to build it from source.
Just for reference:
maybe it caused by 64bit system maybe NOT. I'm NOT sure, but I met some similar problems before, I just use 32bit lib, it seems OK. However, I'm now moving to openSUSE-12.X, seems problem solved...
You need to install libgcc 32 bit. If you check under /libs you will find a x86_64-linux-gnu folder but not i386-linux-gnu. This is due to unavailability of 32 bit library in 64 bit machine. You need to execute command:
aptitude install libgcc1:i386
After that you will find the folder i386-linux-gnu is created in libs and libgcc_s.so.1 is existing under that. This should solve the problem.