What are the best practices to test performance and scalability of Message Oriented Middleware (MOM) solutions? [closed] - performance

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 7 years ago.
Improve this question
We are looking for a software that will help to decide which MOM solution should be used in a given case, taking into account throughput and latency figures it measures.
Not to reinvent the wheel we'd like to investigate what solutions already exist on the market.
For example, there are:
JMeter with its Point-to-Point Test Plan and Topic Test Plan
QPID performance and latency test utils
ActiveMQ JMeter performance test
HornetQ performance test
RabbitMQ performance test
etc.
It seems there are no tools to test performance and latency of these MOMs somehow in a general way.
So could you please recommend tools which worth looking at or some ideas how to implement such a tool in a cross-platform, cross-language way.

While someone may know a tool to test them all I'd recommend that you build a testing scenario that resembles your intended use (message sized, integration patterns (e.g. do you need CBR and if so what), required latencies, message rates, target environment etc.)
Synthetic benchmarks can be misleading and will most likely not represent your usage scenario
As a side note I'd say that AMQP has the advantage that it also defines the wire protocol so if you choose one you can change the backend without affecting the client

What about SPEC JMS 2007 ??? I think it would be quite usefull for your case :)

Related

Should I use FrisbyJS for my REST API testing? [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 7 years ago.
Improve this question
I am developing a complicated project with microservice architecture (only provides Rest API). So I need to make sure that the system works stably in development, staging, and production after having a deployment.
I think that a testing framework as Frisby can help me prevent issues. Do you have any suggestion for my case?
Thank you in advance.
Definitely to prevent issues in any application there are different items to consider. For instance, one of them is having unit tests with a good coverage.
However, FrisbyJS is indeed a tool that will help to check that your services are working as expected in the scenarios specified.
Consider that if you plan to apply FrisbyJS, you will need to have some background with NodeJS, and Jasmine-node packages.
Some other alternatives:
SuperAgent, another
JavaScript library
JMeter, java application that besides
validating the functionality of your services it could also help on
testing their performance under different scenarios (i.e. specific
number of concurrent users)

How to test performance of software AG - Web methods implementation? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
I have a requirement to test the performance of an ESB implementation done using software SG - web methods 9.5.
Please let me know the tools that can be used and the approach to be followed for testing.
Thanks
I used SoapUI to performance test webMethods Integration Server a couple of years ago.
I set up requests, number of clients etc in SoapUI that represented different scenarios of usage in the live system.
After the tests I exported data from SoapUI, wrote some scripts to analyze it and used Excel to present it in a pretty way.
Since you don't specify exactly what kind of performance test you want to run this may or may not work for you as well.
It's hard to provide any suggestions because little is known from your "ESB implementation" and little is known from the performance requirements. For example, from which point in your architecture do you want to test performance.
As suggested by ellak, using SOAPUI is an option if your "ESB implementation" exposes a web services and if you want to start load testing at the ESB level.
If you want better advice then you need to provide more information.

How do Morphia, Mongo4j and Spring data for MongoDB compare? [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 6 years ago.
Improve this question
I'm interested in how to they compare to each other, what's more mature, has more features, better for some use cases.
My own use case is to create a real-time monitoring service (think Chartbeat) but if you can talk about other use cases please do it - after all this Q&A might be of interest for others.
Morphia may be the most stable of the three. I have not heard much of Mongo4j lately- probably abandoned. I personally like spring-data because of the hades project... You don't need to implement the DAOs. You just write the interface and spring data automatically provides it to you. However Spring Data Mongodb implementation seems a little buggy in my initial trial. If you have hard dates and is working on a production quality product, probably it is wise to choose Morphia.
Morphia is the way to go. Pretty stable, very good Play integration and offers access to all Mongo driver features if you need more torque. Reference resolution, entity embedding are working as expected. You get lifecycle annotations too, which are pretty useful for boilerplate persistence code (timestamps?)
https://github.com/impetus-opensource/Kundera/wiki/Kundera-Mongo-performance
A performance sheet is compiled over here. Kundera is complete JPA2.0 compliant solution and provide much stronger interface, ease of implement and set of features.
-Vivek
Kundera is another alternative if you're looking for ease of development and good performance. It's JPA compliant.

Benchmarking tool [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 9 years ago.
Improve this question
I'm unable to decide which is a better benchmarking tool-Is it apachebench tool or httperf?
Please help me to decide which one would be the most appropriate tool to be chosen for benchmarking the web application.
I suppose it depends on what kind of testing you want to do.
ApacheBench basically tests a general load, but httperf gives more a surgical precision and can simulate real user activity.
is “ab” or “httperf” better for checking performance of a website?
How do you test the performance of a website?
Most effective and realistic free web-app load tester?
Tools to benchmark web-services
They're both good for doing different types of testing. httperf will just send a barage of data to your server, whether or not it's answered. That gives you the breaking point of your app, and shows you how it fails out. Use this to find bottlenecks.
apachebench is a bit different in that it sends exactly what you tell it, and is more typically used to measure response times (for example, if you optimize). Once the bottlenecks are found and fixed, check the speed with this.
Please Note: That's what I do, but I'm not a master
I'm unable to decide which is a better
benchmarking tool-Is it apachebench
tool or httperf?
There is an extensive discussion about the benefit of each tool here:
http://dsec.com/en_apachebench_httperf.html
The guy went as far as to write a wrapper (public domain C code) around Apache Benchmark and HTTPerf to illustrate the pro and cons of each solution.
He also explains how to make sure system settings will not make the benchmark fail, and how to get the most of a server machine (OS, virtualization, etc.).
Hope this helps!

Buy or build tool for Data Reporting? [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 5 years ago.
Improve this question
We have been asked to provide a data reporting solution. The followng are the requirements:
i. The client has a lot of data which is generated everyday as an outcome of the tests they run. These tests are run at several sites and they get automatically backed up into a central server.
ii. They already have perl scripts which post process them and generates excel based reports.
iii. They need a web based interface for comparing those reports and they need to mark and track issues which might be present in those data.
I am confused if we should build our own tool for this or we should go for already exiting tool(any suggestions?). Can you please provide supportive arguments for the decision that you would suggest?
You need to narrow down your requirements (what kind of data needs to be compared, and in which format?). Then check if there is already a software available (commercial or free) that fulfills your needs. Based on that, decide if its better (i.e. cheaper) to implement the functionality yourself, or use the other software.
Don't reinvent the wheel.
There are quite a few tools out there that specialise in this sort of thing, my gut feeling is that you can find something ready made that does what you need.
As a side note, that tool may also be a better solution for creating those excel reports than the perl scripts.

Resources