I am doing Load testing using VSTS 2013. I need to validate the results which was received. For example If, 800 report for created for 200 Users. Results are getting display with some values in Min(0.009), Avg(1.2), Max(9.5), 95%(7.03) etc... I need to know that the values are mentioned here is Transaction time in seconds for each user?
Visual Studio test results are displayed in seconds, you can see how to read the results here. This time is calculated considering all requests, not users (min, max, average, 95%...). Basically, if your average is 1.2s, then a user will most likely have to wait 1.2 seconds per request on average.
Related
I wanted to check how quickly my web application will display results for a query : SELECT * FROM orders.
the query returns about 20k records on one page and it takes about 15 seconds
Why on every browser the response time stops after two seconds? Is it because the browser has trouble displaying so many records per one page? at 70k it gets out of memory.
Database - mysql on hosting
problem
correct response time
If you want to check how long it takes for the web app to process. You can add logging before and after doing the query.
You also could add some logging of the current time, when receiving the request and before returning the response.
As for why the request stops after two seconds, I don't think we have enough information to decide.
It could be from the web server default configuration that you use.
In my opinion, displaying 20k records might not be an efficient approach.
Other than the time to query and response time.
You might want to consider the looping that happens on the front end.
Personally, I would recommend paging at a lower number, and if you need to display all the data at once. You might consider using lazy loading as an option.
I know this is a very generic answer, but hopefully, this could help you out.
Is there sum of all response times in JMeter HTML report?
I know JMeter produces excellent data like median etc, but there is need to have sum of all response times.
Is it possible to see it somehow?
JMeter's .jtl result files are normal CSV files so you can import it into MS Excel or equivalent and invoke SUM function on the elapsed column
If you have only one iteration and several requests - you can put all the requests under the Transaction Controller and it will report the cumulative execution time of all its children
It's possible to use Backend Listener so JMeter would send results to a database, once done you should be able to create a query in the DB or in Grafana to display the cumulative response time
I used option 2 from Dmitri's answer recently and it worked perfectly for me in JMeter 5.4.1.
In the Transaction Controller remember to click the "generate parent sample" tick box.
Then in the results tree and HTML dashboard, you will see individual response times for each call and a parent time for the controller.
I have a web page which contains many filters and some as drop-down options. For example, Filter called (Time Range-- with options Last 24 hours, All, Last 7 Days).
The web page supposes to open by 100 users at the same time and select one option from the Time Range drop-down).
Kindly let me know how to find the duration by 100 users at the same time and select one option from the Time Range drop-down).
Thanks in Advance.
JMeter automatically measures response time for each sampler, if you want to have the total time - open .jtl results file using LibreOffice Calc or Microsoft Excel or equivalent and sum up all the response times for all 100 samplers
In order to guarantee the desired concurrency add a Synchronizing Timer as a child of the request and set Number of Simultaneous Users to Group by to 100
Add View results table Listener to the suite to check the duration and Start time of each thread and connect time of each thread.
As I understood you want to check the load of 100 concurrent users clicking the filter , so the login process and its load should not interfere the load testing of users clicking the filter button. Hence, As mentioned in above comment, you can use Synchronizing Timer as child f the requests. What it does is, it is synchronized with the login requests and wait for the response of all the 100 users getting logged in. Once all the 100 users are logged in, Synchronizing Timer play its role by sending (clicking) requests at the same time same second. Cant ensure same milliseconds. There might be small difference in milliseconds, which you can see in View results table (start time).
I have created a test script with the below scenarios and having thread group count as 100 and ran it for 10 minutes.
Employee Creation took 1 minute during the test script design
Update Employee took 2 minutes during the test script design
In the above mentioned scenario how many concurrent users will be on the system for 10 minutes?
I don't think there is a formula to predict or calculate concurrency as we don't know the number of samplers, response time, etc. so go for one of the following options:
Generate HTML Reporting Dashboard and look into Active Threads Over Time chart - it will show you the actual concurrency.
If you don't want or can not generate the dashboard you can achieve the same using Active Threads Over Time Listener which can be installed using JMeter Plugins Manager as a part of 3 Basic Graphs bundle.
I'm using a JVM to perform API calls to the Google Apps Administrator API.
I've noticed with the User Usage Reports, I'm not getting complete data when it comes to a field I'm interested in (num_docs_externally_visible) and the fields which form that fields calculation. I generally request a single day's usage report at a time, across my entire user base (~40k users).
According to the documentation on the developer's, I should be able to see that in a report 2-6 days after; however after running a report for the first 3 weeks of February, I've only gotten it for 60% of the days. The pattern appears to be random (in that I have up to 4 day in a row streaks of the item appearing and 3 days in a row streaks of it not, but there is no consistency to this).
Has anyone else experienced this issue? And if so, were you able to resolve it? Or should I expect this behavior to continue if this is an issue with what the API is returning outside of my control?
I think it's only natural that the data you get is not yet complete, it takes a certain day to receive the complete data.
This SO question is not exactly the same of your question, but i think it will help you. Especially the part that you need to use your account time zone.