Does Zalenium has any exposed APIs which could be used to view the live execution of the tests.
Zalenium is build on top of Selenium Grid. So you can see the live video execution at here
Related
I want to perform load testing of Single Page Application. So i have created JMeter script for that and it is working fine from my single machine for concurrent users. But i want to create actual concurrent users scenario from different machine or location. For that reason i am trying to use Azure Load Testing service and there want to use JMeter script which i have created on my local machine.
Please let me know if Azure Load testing service support below points : -
Is it possible to test performance of API call which are going to other servers (non Azure).
Is it possible to track performance report like JMeter for each API call individually.
Please let me know if any clue on above problems.
Thanks
As per documentation
Enable developers and testers to generate high-scale load and run simulations that reveal actionable insights into app performance, scalability, and capacity with a fully managed load-testing service. Create tests quickly without prior knowledge of load testing tools, or upload your existing Apache JMeter scripts. Gain specialized recommendations backed by comprehensive metrics and analytics, and support continuous improvement through automated continuous integration and continuous delivery (CI/CD) workflows—all with a testing service built for Azure.
So it should be possible to run your JMeter scripts from Azure. If your system under test is reachable from the Internet you it doesn't matter where it's deployed.
If not and your application is only accessible from your local Intranet - you will have to go for JMeter Distributed Testing
We are using XRAY in our Jira instance for running so far manual test and record metrics for our QA department.
We would like now to move a step further in order to implement Test Automation integrated with X-ray.
X-ray can use cucumber syntax for test case
What is the way to integrate Cypress with X-ray ?
How can we create automation test in Jira and send them to Cypress ?
How to get cypress test result back to X-ray for reporting and tracking ?
We are new to cypress and automation test using those environment, thanks for sharing your findings
regards
If using Cypress, you can use the report produced by the test runner to integrate with Xray. If you're using Cucumber together with Cypress, you'll use "cypress-cucumber-preprocessor" package; you'll need to decide which workflow to adopt - in other words, you need to decide which will be the master for editing/managing your Gherkin specification.
The flows are slightly different depending on that.
This tutorial details the two flows; it is for Xray on Jira Cloud but it can easily be adapted if you are using Jira on-premise (server/Datacenter).
Came across an article https://devblogs.microsoft.com/devops/cloud-based-load-testing-service-eol/ which says that cloud-based load testing service has been deprecated.
in this article, at one point it says that,
"Running a load test in the cloud using Visual Studio (both
auto-provisioned agents and self-provisioned ‘bring-your-own’ agents):
You can continue to run the tests but self-hosted with Test
Controller/Test Agent option outlined above."
If all my load testing agents, controllers are created as VMs in Azure - and I use my VSTS subscription to run these load tests then do I need to worry? The above paragraph is a little confusing, hence asking.
I am looking at few Performance testing features Azure Web Application has. I a following a tutorial given below. I tested a small application. My question is on how I can test an application where I have to login. My application users have to login to get to the home page. How will I do it? Can somone please help me on this
https://learn.microsoft.com/en-us/vsts/test/load-test/app-service-web-app-performance-test?view=vsts
The load test you refer to is very limited. It supports only GET requests, so presumably it is meant for public pages. For more realistic scenarios you need to record (or build) test cases with navigation between multiple pages, where the login page is one and where state such as the login cookie/token is propagated between them.
Personally I work mostly with JMeter, see http://jmeter.apache.org/usermanual/jmeter_proxy_step_by_step.html on how to record a test. The recorded steps need to be edited before they can be used (hard-coded data replaced with variables). There is probably a similar tool from Microsoft, but the function in Azure portal seems overly simplistic.
In summary use another tool for more complex load testing, as the specified one handles only GET requests and can't do the job.
I am trying to test web page performance on a mobile device. I know chrome dev tools can be used for mobile simulation but my requirement is that it should be tested on actual device. Is there any such tool available?
I am little confused about your question since in the title you mentioned load testing, but in the detail load testing is not mentioned at all. So, I'll try to answer both:
You can test mobile via emulation or real devices.
If it is necessary to use real devices you can do it in two general ways:
On premise tools such an Experitest.
Using a cloud service like Perfecto Mobile, mobilelabsinc, amazon aws device farm.
You can test your application performance with these tools without any relation to load. That is, how fast they work on your device.
If you want to test your application performance and see its behavior on the device while loading your server then you need to add a load testing tool into your test. For example, HP/LoadRunner, RadView/WebLOAD has integration with Perfecto Mobile. I heard also that JMeter has an integration well – not sure.
In any case, during the load, the recommendation is that the majority of the back end server load will be created via mobile simulation, and add only a few real mobile devices to the party in order to measure the performance from the device itself – because using real devices will be expensive.
Full disclosure: I work for Radview.
SOASTA CloudTest also supports the integration of API/Transport level virtual users with on-device virtual users in the same scenario