I run test plan by distributed method in 3 remote machine with config as below:
3 Thread Group: Each 100 users - loop 1
Each thread group have 5 request
When i run on each remote machine, i get 500 samples in summary report. But when i run on 3 remote machine in same time, report just display 800 - 1000 samples.
What is problem in my case?
You moT probably have one of the 3 servers that is not reporting the SampleResults to the client.
check jmeter.log of each server.
Related
When number of threads (users): is set below 10, the number of samples is displayed correctly. When number of threads (users): is set to 10, the number of samples is 18 ~ 20.The expected result should be 22. Please point out the problem for me.
JMeter version: 5.4.3
The script settings are as follows:
-- Thread Group
-- Thread Properties
Number of Threads （users）：11
Ramp-up period （seconds）：2
Loop Count:Infinite 2
-- Critical Section Controller
--HTTP Request 1
--HTTP Request 2
--HTTP Request 3
--HTTP Request 4
--HTTP Request 5
-- Aggregate Report # Samples
--HTTP Request 20
--HTTP Request 20
--HTTP Request 19
--HTTP Request 18
--HTTP Request 18
I cannot reproduce your issue:
and I can think of the following reasons:
You have artificial limitation of the test execution time in Thread Group:
You have responses filtering configured in the Aggregate Report listener, i.e. if this box is ticked - you will see only requests which were successful and failed ones won't be displayed:
Try re-running your JMeter test in command-line non-GUI mode and see how many results are in the .jtl results file
Check jmeter.log file for any suspicious entries
And last but not the least, do you realize the concept of the Critical Section Controller? In your setup it means "no concurrency", all HTTP Request samplers will be executed by one thread at a time only so the equivalent setup would be
i set up a 16-hour soak test in jmeter. use a csv file for different users for 10000 users. use ultimate thread group with these settings:
one row
start threads count: 20
initial delay: 0
start up time : 60 sec
hold for load : 57600 sec
shut down time : 10
i run the test 3 times. all of them ended in 8-9 hours.
on the server pc, i look for some settings of iis but didnt see anything.
the second day, in view result tree there was a response such that:
sampler result page
response message: non http response message: en established comnection was aborted by the software in your host machine.
does jmeter any limitation or iis have some timeout value?
JMeter doesn't have any internal "timeouts" for the test, it might be the case you test has.
For example I can think of 2 possible options:
Your CSV Data Set Config has either Recycle on EOF set to True or Stop thread on EOF set to False so when all 10000 lines are used the test stops
Your Ultimate Thread Group is configured to Stop Thread or Stop Test on the error and your test terminates when error occurs
The exact reason for stopping the test can be found in the jmeter.log file
I have to run 1200 users to support my application.
We are running from 4 different machines and from Each machine we are running 300 users.
From Each machine we are getting .jtl files and it is size more than 300 MB..
we are able to get the Aggregate report by adding Listeners and browsing that .jtl files.
Due to the size of jtl files, every one has aggregate csv files only from 4 machine.
Label #Samples Average Median 90% Line 95% Line 99% Line Min Max Error % Throughput Received KB/sec Sent KB/sec
(Machine 1) TOTAL 34114 7200 1747 11853 60155 80773 0 240417 12.18% 14.61536 144.66 23.35
(Machine 2) TOTAL 35537 7927 1758 24698 60550 76834 0 150719 15.33% 14.79504 140.71 23.06
(Machine 3) TOTAL 34447 7189 1750 12280 60220 76963 0 155425 12.24% 14.72585 145.78 23.55
(Machine 4) TOTAL 34454 7316 1748 13595 60557 76975 0 150490 12.60% 14.69896 144.45 23.35
Eg.., Average = (7200+7927+7189+7316)/4 = 7408
How to present as a single report?
It is just some up all columns from 4 machines and divided by is the only way..If it is present in a way, is it correct report?
Or any other way?
Thanks,
You can switch to running your test in Distributed Mode i.e. using 1 master node and 4 slaves. In this setup you will have single results file on "master" host
If you do not plan to re-run your test in future and would just like to convert 4 results files into a single "uber" results file you can use Merge Results tool which main use case is to compare results of different test runs, however you can use it to combine multiple results files into one, just use the same Prefix Label.
You can install Merge Results tool using JMeter Plugins Manager
I configured my test in this way (in windows 7):
1 Virtual machine is master, that run all vm slaves with the command for a distribuited testing (from command line) and show in jmeter GUI some graphs (for example jp#gc Active thread over time , hits/sec, response time, etc..).
3 Virtual machine are slave, to execute the testing;
When master run the "start" to 3 slave, the test works (each slave run 6 thread), and in the GUI on master, there are only 6 thread in the graph (jp#gc - Active Threads Over Time), but in reality are 18 (6 thread for slaves, with 3 slaves).
So my question is: how can I see the total data for all slaves?
jp#gc - Active Threads Over Time = to see 18 thread (thread slave1 +thread slave2+thread slave3)
jp#gc - Hits per Second = Hits slave 1 +Hits slave 2+ Hits slave 3
and so on...
You need to add __machineName or __machineIP function so the listeners could distinguish results coming from different nodes.
Also be aware of mode property which is configured to send results from slave machines each 100 results or each minute (whatever comes the first) so you might want to amend it, i.e. add mode=Standard line to user.properties file on each slave node.
# Remote batching support
# Since JMeter 2.9, default is MODE_STRIPPED_BATCH, which returns samples in
# batch mode (every 100 samples or every minute by default)
# Note also that MODE_STRIPPED_BATCH strips response data from SampleResult, so if you need it change to
# another mode
# Hold retains samples until end of test (may need lots of memory)
# Batch returns samples in batches
# Statistical returns sample summary statistics
# hold_samples was originally defined as a separate property,
# but can now also be defined using mode=Hold
# mode can also be the class name of an implementation of org.apache.jmeter.samplers.SampleSender
#mode=Standard
#mode=Batch
#mode=Hold
#mode=Statistical
See Apache JMeter Properties Customization Guide for more information on working with JMeter properties.
Be aware that sending results in case of severe load may cause network IO overhead so it might be a good idea to consider Backend Listener instead
Add the Machine Info function to the thread group name area as shown below:
I have the next test plan in JMeter:
on the screenshot you can see the settings for the 1st ThreadGroup, wich has 50% of common amout of request in test plan (in each Thread Group are 10 different subrequests placed).
So, +1 request per second is added in average using these settings.
Then I ran this test and saw this picture (Error % column):
I save errors in file and all these errors have the same text:
<sample t="30129" lt="0" ts="1356710138314" s="false" lb="WebService(SOAP) Request 1" rc="000" rm="**Connection reset**" tn="jp#gc - Stepping Thread Group1 3-247" dt="text" by="0"/>
Server's cpu screenshot:
and for database:
After the errors have appeared my comp started work slowly and slowly (although the errors stopped to appear further)...
And in the same time the server's cpu progressively dropped to 0.
Could you tell me, please,
What is the reason of this error?
Have I reached the server timeout? (Because Max is more than 30s in the table).
UPD. I have rerun test with next settings: 1000 users per 02:46:40 (+1 Thread Group per 10 second and 10 requests inside each new Thread in the Loop).
I.e. I have reduced the time of test and total Thread Groups by 2 times, but save intensivity of Thead's adding.
The results are the same (including cpu usage on the server).
I've received the error «Connection reset» after 990 thread started. There are screenshots:
Any idea?
First, WebService(SOAP) Request is not the best way to test Webservices in JMeter, it will be deprecated in upcoming 2.9 version.
HTTP Sampler is the one to choose as it performs much better.
Second, Connection Reset means your server has cut connection. It could be coming from the CPU which seems high but it's not sure.
If what you call "my comp" is the computer hosting JMeter started working slowly then your JMeter instance is overwhelmed by the number of threads (2003 or more?) you've configured. It can come from a lot of factors, read this:
http://www.dzone.com/links/see_how_to_make_jmeter_run_thousands_of_threads_w.html