Websphere app server start issues even when no EARs in it - websphere

In RAD 7 I created a new server profile (using version 6.1) and tried to start this server without any projects added to it, with the intention of making sure the server starts up fine and then adding projects via the Add/Remove projects option. While I have done this many times before I have started getting this problem now:
1) Console says 'Server server1 open for e-business` but the server tab still shows that server is 'Starting...'
2) After several minutes I get the error saying server failed startup failed after 300 seconds.
3) Opening the FFDC log file shows the following exception
------Start of DE processing------ = [9/16/13 16:40:06:745 EDT] , key =
javax.naming.NameNotFoundException
com.ibm.ws.naming.ipcos.WsnOptimizedNamingImpl.do_resolve_complete_info 1133
Exception = javax.naming.NameNotFoundException
Source = com.ibm.ws.naming.ipcos.WsnOptimizedNamingImpl.do_resolve_complete_info
probeid = 1133
Stack Dump = javax.naming.NameNotFoundException: Name "RMIConnector" not found in context "".
at com.ibm.ws.naming.ipbase.NameSpace.lookupInternal(NameSpace.java:1095)
at com.ibm.ws.naming.ipbase.NameSpace.lookup(NameSpace.java:991)
at com.ibm.ws.naming.ipcos.WsnOptimizedNamingImpl.do_resolve_complete_info(WsnOptimizedNamingImpl.java:566)
at com.ibm.ws.naming.cosbase.WsnOptimizedNamingImplBase.resolve_complete_info(WsnOptimizedNamingImplBase.java:2226)
at com.ibm.WsnOptimizedNaming._NamingContextImplBase._invoke(_NamingContextImplBase.java:284)
at com.ibm.CORBA.iiop.ServerDelegate.dispatchInvokeHandler(ServerDelegate.java:627)
at com.ibm.CORBA.iiop.ServerDelegate.dispatch(ServerDelegate.java:480)
at com.ibm.rmi.iiop.ORB.process(ORB.java:512)
at com.ibm.CORBA.iiop.ORB.process(ORB.java:1571)
at com.ibm.rmi.iiop.Connection.respondTo(Connection.java:2665)
at com.ibm.rmi.iiop.Connection.doWork(Connection.java:2530)
at com.ibm.rmi.iiop.WorkUnitImpl.doWork(WorkUnitImpl.java:62)
at com.ibm.ejs.oa.pool.PooledThread.run(ThreadPool.java:118)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1551)
4)I also see a server1_exception file with the following line in it
Index Count Time of last Occurrence Exception SourceId ProbeId
------+------+---------------------------+--------------------------
1 1 9/16/13 16:40:06:745 EDT javax.naming.NameNotFoundException
com.ibm.ws.naming.ipcos.WsnOptimizedNamingImpl.do_resolve_complete_info 1133
------+------+---------------------------+--------------------------
I do have other server profiles created for other versions of the workspace but I'm sure none of them are running while I try to run the profile in question. I noticed this started happening when I stopped one profile, then switched to another one and tried to start that up. Since then I haven't been able to start any of the profiles old or new and I keep getting this error/exception. Any help would be appreciated.

This is usually due to connectivity problems between RAD and the application server. The causes of these errors are many different possible:
Change of credentials of the user you are trying to connect with. There should be error messages in your SystemOut.log of the server to support this.
Pure connectivity errors, such as the port configuration being wrong. Check which RMI/SOAP ports you are using by accessing your administrative console directly in a browser and make sure that you have the same ports configured in your RAD configuration. Try both SOAP and RMI and most important, do not trust the automatic settings (I have found them to be wrong in more than one time).

Related

Running JPOS Client and Server Simulator on the same machine throws error

I am following the instructions from here : http://jpos.org/blog/2013/07/setting-up-the-client-simulator/ to set up the client and server simulator. I am able to start one of them on my machine. If i start the server after the client is run, it throws this error :
"An instance of Q2 is already running. Shutting this instance"
I know its kind of self explanatory. But was wondering if there is a way to run both server and client simulators on the same machine.
Check your src/dist/deploy directory and remove the file 01_multi_instance_prevention.xml. That descriptor wasn't present in jPOS by the time the blog post was written and was installed when you calledinstallResources` as it's now part of the jPOS jar. We'll consider making that file optional.

WebSphere Returning 503 Error(Servlet has become temporarily unavailable for service) on Static File

I have a WebSphere 8.5.0 application server for development. It is returning a 503 error on a static JavaScript file.
This is the HTML that is returned with the error:
<H1>Servlet has become temporarily unavailable for service</H1><BR><H3></H3><BR><I>IBM WebSphere Application Server</I>
I tried replacing the file with a blank text file. The server still returned the same 503 error.
I tried changing the name of the file, and it returned the file correctly with the new name and the server returned 404 if I tried the original name.
I figured there would be a solution somewhere online for this, but I couldn't find it.
I found two possible leads:
The file is somehow locked on the server.
There is a routing issue.
If it matters, I deploy the application to the server as an ear file.
I checked all the logs and the only thing that appears in any of them is this in SystemOut:
[2/10/15 8:50:31:696 PST] 00001b48 webcontainer E com.ibm.ws.webcontainer.internal.WebContainer sendUnavailableException Servlet.has.become.temporarily.unavailable.for.service
[2/10/15 8:50:33:120 PST] 00001b48 webcontainer E com.ibm.ws.webcontainer.internal.WebContainer sendUnavailableException Servlet.has.become.temporarily.unavailable.for.service
And I should probably mention that the exact same ear file is deployed on my local machine and 2 production servers with no problems. It is just my development server that has the problem.
After deploying an new version of an application, the
this message appear in the Websphere output
This then requires a restart of the server in order for app
processing to continue. The problem is due to the way that
cached servlet wrappers are handled when an application
is destroyed upon redeploy.
Restarting the server after redeploy is the current local fix.
you can visit :
http://www-01.ibm.com/support/docview.wss?uid=swg1PK47748
I had a similar problem with was 8.0.0, I tried using a blank file, also changing the file name, but nothing works. The log didn't tell me anything about the problem. Always the same message:
<H1>Servlet has become temporarily unavailable for service</H1><BR><H3></H3><BR><I>IBM WebSphere Application Server</I>
The solution was restart the server, maybe the problem was that the file was locked by some kind of process.

timeout index not present on ravendb

tl;dr:
my web api service is running slow, added logging
logging is giving me errors about not being able to find timeouts
didn't see the ravendb database for the webapi project on the server, but dev machines have it
raven is running and running on 8080
tried reinstalling nservicebus via platform installer(downloaded from nservicebus yesterday)
still have the same issue
i think i either messed up the deployment or I need to do a clean install somehow
What do I need to do in order for the webapi project to read the timeouts?
I'm trying to get our application working on a production machine in preparation for an alpha.
Our application has multiple web api sites and many service hosts.
The errors I'm seeing are currently in the web api host on production only:
2014-08-06 01:55:24,789 [52] DEBUG NServiceBus.Timeout.Hosting.Windows.TimeoutPersisterReceiver [(null)] - Polling for timeouts at 08/06/2014 01:55:24.
2014-08-06 01:55:24,793 [46] WARN NServiceBus.Timeout.Hosting.Windows.TimeoutPersisterReceiver [(null)] - Failed to fetch timeouts from the timeout storage
This gets repeated awhile. Eventually (about 2 minutes) the endpoint gives up and just dies
2014-08-06 01:57:03,645 [17] WARN NServiceBus.CircuitBreakers.RepeatedFailuresOverTimeCircuitBreaker [(null)] - The circuit breaker for TimeoutStorageConnectivity will now be triggered
2014-08-06 01:57:03,645 [17] FATAL NServiceBus [(null)] - Repeated failures when fetching timeouts from storage, endpoint will be terminated.
System.InvalidOperationException: There is no index named: dynamic/TimeoutData
I'm getting these logs by enabling log4net file appender for nservicebus to figure out whats going on with the web api services.
The host services work fine on our dev machines, but for some reason they're really slow on the production machines. We don't see the errors on our dev machines. We have the licenses installed on the production machines so its not like we're being throttled by an expired license.
The weird thing is that on our dev machines we see the database for our web api projects, but on the production machines, only the installed service hosts have database entries.
We've been in dev for this particular application for about 18 months. It could be that when we installed nservicebus, the timeouts were not set to be installed. However, I have tried running the platform installer (downloaded yesterday) and the timeouts are still not present. I'm assuming that when I install the service host, the timeouts are stupposed to be installed then, but they're not showing up for some reason.
At this point I'm contemplating uninstaling nservicebus and ravendb, but i'm not sure how to go about getting a clean reinstall.
Here's some relevant lines from my global.asax
IContainer container = IoC.Initialize();
DependencyResolver.SetResolver(new StructureMapDependencyResolver(container));
GlobalConfiguration.Configuration.DependencyResolver = new StructureMapDependencyResolver(container);
Configure.Transactions.Enable();
Configure.Serialization.Json();
Configure.With()
.DefiningEventsAs(t => t.Namespace != null && t.Namespace.Contains(".Events"))
.DefiningCommandsAs(t => t.Namespace != null && t.Namespace.Contains(".Commands"))
.StructureMapBuilder(container)
.Log4Net()
.UseTransport<Msmq>()
.UnicastBus()
.CreateBus()
.Start(() => Configure.Instance.ForInstallationOn<NServiceBus.Installation.Environments.Windows>().Install());
To fix this, perform the following steps
Open the the RavenDB control panel, usually located at http://RAVEN_DB_SERVER:8080
Select the database of your endpoint
Go to Indexes tab
Click at Delete All Indexes
The indexes will be recreated as soon as the service endpoint is started.
It looks like Raven is not installed in your production environment.
For install instructions please take a look here
HTH

Could not load the Tomcat server configuration

I edited catalina.properties trying to change the port of the server, it didn't work and restored the original values and now I am getting the following error:
Could not load the Tomcat server configuration at /Servers/VMware
vFabric tc Server Developer Edition v2.9-config. The configuration may
be corrupt or incomplete. Resource is out of sync with the file
system: '/Servers/VMware vFabric tc Server Developer Edition
v2.9-config/catalina.properties'.
This is the default server provided by Spring Tool Suite.
The solutions I found did not help me, like copying all the TOMCAT_DIR/conf files to my server location, which is in workspace/Servers.
Any help?
I am not sure, that my problem is the same, I had similar issue about ports conflict.
My solution was based on changing ports in catalina.properties. I deleted default Pivotal tc Server, than found in installation catalina.properties on the path
sts-bundle/pivotal-tc-server-developer-3.0.0.RELEASE/tcServer/conf.
The last 4 lines in file are:
base.shutdown.port=-1
base.jmx.port=6969
bio.http.port=8080
bio.https.port=8443
Change ports as you like (to have unused ports).
Create a new server. select Pivotal -> Pivotal tc Server... next.
On the next page push radio button Existing Instance and select tcServer. Finish.
Than try to start server to check, if ports are unused yet. If yes, the server should start.
To change a Tomcat port, you need to edit server.xml, not catalina.properties See: link.
Try reinstall/unzip again, and start from scratch. I often mess up servers, and can never work out what happened. It is much faster in the long run to reinstall.
Also, before you do that, try F5 in your IDE, because 'out of sync with file system' usually means you need to press F5 (refresh).

IISExpress fails with message "failed to translate IP address + Hostname to Site Id"

I have a .NET 4 webservice running on IIS Express 7.5 on a 2008 Server
the service runs fine for a couple of hours or even a day but after some time the process crashes with an error message failed to translate IP address + Hostname to Site Id which is displayed red in the console output.
I streamlined the applicationhost.config to only contain a single site and the binding is only to an ip address and localhost but no success.
I use this command line to start IISExpress
iisexpress.exe /config:c:\myconfig\applicationhost.config /site:mysite
First of all a solution for the error would be great but any information on how to optain more data for this error would also help. I already checked the eventlog but can't find anything.
Well, I upgraded to IISExpress 8 which runs stable now.
I did not know what caused this issue, but I belive it was somehow related to heavy load on the server since to often (but not exclusively) happend during a scheduled backup.

Resources