how to do performance testing of fix protocol - performance

I need to do FIX-API based performance testing.
Can you please let me know few way ahead.
Also if I need to develop the in-house plugin then please can you point in some direction that how to do that?
Also does any 3rd party tool like loadrunner or neoload directly support FIX-API protocol testing?
Thanks

This has been asked many times before in many different forums. Please leverage Google for keywords of LoadRunner and FIX for FIXML as aprpopriate

If you want to do a test in FIX protocol over a FIX connection you can try using the FIXRobot. FIXRobot allows to easily write the tests in python. You can include a loop in the test script to pump messages and calculate the perf statistics from your application logs writing some scripts.

Related

How can I effectively use jmeter test to run every hour for monitoring?

I have written jmeter script. Now I want to use that for monitoring purposes. I know that there are some monitoring tools available like Datadog etc. for API monitoring but those are quite expensive. I am looking for a cheap solution that fulfills my purpose. Can someone please help? Thanks in advance!
The fastest and the easiest way is just going for JMeter PerfMon Plugin which can collect > 70 various metrics and save them into .csv file and/or plot the chart(s).
If this is something which is sufficient for you check out How to Monitor Your Server Health & Performance During a JMeter Load Test for more details.
In case if you're still looking for Datadog-like experience you will need to choose an APM tool, there are several which are free and open source including but not limited to:
Apache SkyWalking
PinPoint
Scouter

Measure performance of web application?

What are the best tools to test the performance of a (not deployed) application using Play framework? Things like, how long takes a request to execute, with different parameters, simulating a lot of requests (stress test), etc.
I'm searching a while but the problem is that the keyword "performance", "benchmarks" etc. lead me to pages about the performance of Play framework.
I thought maybe functional tests, could be used to measure performance (print difference between method start time and end...). But this doesn't look suitable for this kind of task.
I could just write a script, that triggers the requests, writes the timestamps to a log file... but maybe there's something finished, with extras, like e.g. charts, etc.
Any hint in the right direction greatly appreciated.
Iago is a load generation tool by Twitter written in Scala. Also, I've used the Loader.io addon on Heroku to do performance testing. Loader.io also has a non-heroku service that I have not used. Iago is probably your best bet for local testing of a non-public app.
A good example is a project used by Versal to choose their Scala stack for production.
The project is Scamper.

Network traffic simulation test

I've got a PHP site up and running, and the db is mysql. before launching the site, I would like to test the traffic handling. Now am assuming that there are soe softwares that would simulate the traffic and log the processes running on my site. Any recommendation of software I should use? the traffic doesn't have to be real, but nonetheless, I would like to generate a high traffic to investigate the threshold of the site.
Appreciate the help
You can use Gatling https://github.com/excilys/gatling.
It's a stress tool written in Scala which aims at being more efficient and lighter than Jmeter.
Basically you record a scenario on your website and then run it 'n' times in parallel.
Here is the wiki for more infos https://github.com/excilys/gatling/wiki/Basic-Usage
You can use Jmeter:
It's free.
it's easy to Start with lot of documentation on its Website and on internet
it has a proxy feature to easily create test plan from browser navigation
It is easy to start up processes on other machines. It remote testing, can be done from GUI or console.
The scripts can be written in beanshell, java, or any jsr223 language ( groovy, Javascript, scala, jexl ...)
it has a lot of built- in samplers and thanks to its plugin architecture it's very Easy to add new ones or use any scripting engine to do what's missing
it has great user mailing list
it has very reactive support
it's now a top Level Apache
it can run thousands of users
professional solutions exist to run it from cloud
...
See:
Performing a Stress Test on Web Application?
Best way to stress test a website
How do you test the performance of a website?

Need Reporting System for Restful API Data

Is there a SaaS tool which will let me interface to a XML based Restful API and do advanced reporting on it? We have a basic report generating system in our application, but need a more advanced solution for some of our customers...
you can find information on GoodData's REST APIs, integration with Talend, Java sample code, and other tips and tricks on our support forum - this is a good place to start: http://support.gooddata.com/forums/46715/entries/77166
Feel free to email support#gooddata.com if you want some help.
Thanks
-Sam [sam#gooddata.com]
What about something like Good Data or Zoho reports?
Are you wanting to have their reports inside your SaaS app? Or is it ok for them to provide the dashboarding?
I'm not sure if I understand what you want to achieve. I assume that you have a REST API based application and you want to analyze it's traffic. The pure Apache log analysis doesn't work as you need more API level analysis (analyzing your application's events).
I think that we something similar. Our application produces an audit log and error log that we load into GoodData and analyze it there.
Let me know if you are interested in more details.

Best practices for performance benchmarking test

I have a J2EE web-application running on Sun hardware with OpenSolaris/Glassfish stack. We're starting our performance bench-marking tests, to prepare for our scalability requirements later.
Any guidelines/best practices would be very useful..
If you are using JUnit? For simple Time Measurement in JUnit there is JUnitPerf which also supports LoadTests. JUnit 4 is not supported very well but it works for me. ContiPerf is an alternative which also supports annotations for easy configuration. I use this before using JMeter.
For a free Open Source tool I've found Apache's Jmeter pretty good:
http://jmeter.apache.org/
As Joe said you'll need to figure out how to model user behaviour and simulate user load.
I'm sure there is many generic ways to test server performance to be found on the web.
But have you thought that perhaps this an opportunity to gather stories and write a test tuned to exactly how your users will use the server? Even if it doesn't perfectly reflect the way that the server will ultimately work, it will let you start learning something rather than being only formal exercise. I think this is the spirit of agile development.

Resources