JMeter - Aggregate Report with Success response times - jmeter

I found Jmeter captures the Response times of a request that had failed in its aggregate report
If i check Successes Check box, i get only success Response times, Samples, Throughput and KB/sec.
And if dint check anything i could see both Successes and failures in all columns
Is there a way in JMeter to get aggregate report with success response times alone but other columns should get total counts (that include both Successes and failure counts) in #Sample, Total errors, Throughput and KB/Sec as it is
Required Aggregate Report
At present, i collect data through two simple data writers with checking success check box in one (A) and both in another(B). and load it in two aggregate report listeners and manually copy response times section from replace in csv from B so that i get samples, Errors, Throughput & KB/Sec containing both success and failures requests and response times alone from only successes
Simple data writer config
SimpleDataWriterConfiguration
Please let know any other way to acheive this

You have 2 options:
Simple option - add 2 Aggregate Reports:
Successes only
Both successes and failures
Take count from second report, and everything else from the first.
However, saving CSV with raw data is more efficient than having 2 Aggregate Reports, and you already have it (almost) so
Option 2 - save all data into single CSV, and use some tool (linux command line tools, Excel, etc) to sort/parse draw conclusions. You don't need 2 files in this case, since you can always calculate separate totals for success and failure, as well as calculate total of the both from the same file: successes can be filtered by, for example, OK in their responseMessage field.

Related

How to get input/request data for higher load test execution

I have a login scenario to be tested for 10000 users, which contains phone# as input and have given in csv file. Im able to perform load testing for 10000 users and able to show the report with total samples, throughput etc post exporting to a file. However issue is customer wants proof that we are giving input as 10000 users and not using loop eg(500 threads * 2 loops). Kindly help with suggestions if we have any option to show that we are using 10000 unique users.
There is a listener called Active Threads Over Time (can be installed using JMeter Plugins Manager) which shows how many users were active during this or that phase of the test
jmeter.log file contains information how many threads were started for this or that Thread Group
.jtl results file contains number of active threads, both overall and in the current Thread Group
HTML Reporting Dashboard contains the Threads Over Time chart

Is there sum of all response times in JMeter?

Is there sum of all response times in JMeter HTML report?
I know JMeter produces excellent data like median etc, but there is need to have sum of all response times.
Is it possible to see it somehow?
JMeter's .jtl result files are normal CSV files so you can import it into MS Excel or equivalent and invoke SUM function on the elapsed column
If you have only one iteration and several requests - you can put all the requests under the Transaction Controller and it will report the cumulative execution time of all its children
It's possible to use Backend Listener so JMeter would send results to a database, once done you should be able to create a query in the DB or in Grafana to display the cumulative response time
I used option 2 from Dmitri's answer recently and it worked perfectly for me in JMeter 5.4.1.
In the Transaction Controller remember to click the "generate parent sample" tick box.
Then in the results tree and HTML dashboard, you will see individual response times for each call and a parent time for the controller.

Response over time graph becomes very congested for larger number of URLs

I am using this https://jmeter-plugins.org/wiki/ResponseTimesOverTime/ plugin.
I already have a .jtl file, I need to browse this .jtl file into the graph plugin and it would display results.
The .jtl file consists of approx ~ 1500 unique URLs and so graph looks so congested that nothing is visible.
Is there an alternative Response over Time graph? or
I can use the same plugin correctly?
I am not aware of any existing plugin which can smoothly display 1500 lines with legend on a single chart. Theoretically you can try out HTML Reporting Dashboard which provides:
Zoomable chart where you can check/uncheck every transaction to show/hide it for:
Response times Over Time (Includes Transaction Controller Sample Results)
But I strongly doubt it will be a good solution for such a number of unique sample results.
So I would recommend decreasing the number of URLs in your report, you can group them using Transaction Controller and name the controller accordingly so you could distinguish the URL groups
Another option is plotting only those URLs which response time(s) is relatively high, you can get the numbers from Aggregate Listeners which display statistics only.
Once you have a list of URLs which you want to plot you can use Filter Results Tool to create a smaller .jtl file with only "interesting" data.

In the Summary Report CSV outfile not getting the Avg,Min,Max,Std.Deviation Responsetimes

When I looked at the Summary report csv output file, I don't see Min, Max,Avg,Std.Deviation response times there.
Is there any way to get Min, Max,Avg,Std.Deviation response times into the csv output file?
Please advise me!
Thanks,
Raj
These are statistical values so they are being calculated. You have 3 options to get them:
Using Excel (or equivalent) functions get the values out of sampler data (you are interested in elapsed column using the following functions:
MIN
MAX
AVERAGE
STDEVP
You can use the result file to build the HTML Reporting Dashboard which has Statistics table as well as several charts
Use a 3rd-party analysis solution like BM.Sense with enhanced configurable version of Aggregate Report and interactive charts.
But that is not supposed to be written, that is supposed to be calculated basing on sampler results that are actually get written there in this file.
And the calculations are elementary, you may do it yourself, or load that file back into JMeter at any time and get them.

How to exclude Ramp Up and Ramp Down period values in Jmeter Analysis

I have been performing load execution which simulates users concurrently.
However, I don't need the data for the entire run. I need the data during the peak period only.
Can anyone suggest a listener or any method which will provide me the data for a specific period excluding the data of the Ramp Up and Ramp Down period.
Option 1
If you look into 1st line of your .jtl result file you'll see something like:
1403191911666,38,Dummy Sampler,200,OK,Thread Group 1-1,text,true,0,0
Where first column is current time stamp in milliseconds from Unix Epoch start
So if you move out 3 last digits you'll get test start timestamp in seconds.
If your ramp-up is i.e. 300 seconds, just add 300 * 1000 to it and trim your results file to start with 1403192211XXX
Do the same for last N lines depending on your ramp-down time.
Analyze trimmed .jtl file as usual
Option 2
Use free Blazemeter Listener to analyze your test results online, it has:
Possibility to limit time frame to "interesting" slot
Possibility to compare different test runs results
Hope this helps.

Resources