Integrate Selenium Grid and Sikuli API - parallel-processing

Currently, I am working on the automation testing framework, which combines with both Selenium Grid and Sikuli API.
I already implemented a library which includes functionality of Selenium and Sikuli, and it works well when I set up my hub and node on the same machine. However, this is just the same as running Selenium RC on the machine.
So, in order to achieve parallel testing, my next step is to launch the nodes from other machines and register them to the hub machine. The idea environment is Amazon EC2 instance.
Hub: Linux box
Nodes: win server 2008
It works fine if I just ran the tests using the library only contains Selenium functions. However, I
got error message that
"NO X11 DISPLAY variable was set, but this program performed an operation which requires it."
Should I export DISPLAY variable to the node's ip address? And do I need to set the node machine as an X server? What if there are many instances registered to the hub machines?
Sorry for the vague question... but any idea that how to implement this framework is appreciated. I am using selenium grid since there are many action performing graph verification. It would be very efficient if I can do it parallel testings.
Thanks a lot for any help and advice.

There is a project aiming at providing Sikuli capabilities on Selenium Grid.
https://github.com/sterodium/selenium-grid-extensions
It works by adding extensions both on Selenium Grid hub and nodes.

See my blog post about the topic of integrating tools like Sikuli and AutoIt with Selenium Grid. It provides a theoretical approach to implement said automation, though to my knowledge no one has yet implemented a working solution to demonstrate.
http://autumnator.wordpress.com/2011/12/22/autoit-sikuli-and-other-tools-with-selenium-grid/
On a side note, not sure how your X.11 issue came into play, it would be best you work on the framework using local network of machines with Selenium Grid before you convert to an Amazon EC2 deployment. It helps in the design and debug process as EC2 may present its own issues so you want to have the simplest basic Grid setup working first (non-EC2).

Related

Is there any possibility to automate Siebel( High Interactivity framework) application using QTP or selenium

I want to automate Siebel application which is having Siebel HI framework .I tried using qtp and selenium,but the problem is objects ,tables are not recognizable .
Can anyone help me ?
The Siebel STA module is a separately licensed module, as can be seen in the Bookshelf link provided by Motti. Though most Siebel projects have this included, some don't. Please check and confirm that your project is running with this module included: Siebel Test Automation Interfaces.
If you are doing a PoC and want to verify that it works, then Oracle provides the temporary license codes from the same URL.
In Siebel High Interactive (as opposed to Open UI) the HTML interface is a large number of nested iFrames. Although a very diligent Selenium person may be able to automate some scenario's, this is not the best approach for HI. For HI QTP/UFT and serveral other test automation vendors will be able to help you with this.
In case you have the opportunity to run Open UI, then my advice would be to investigate Selenium once more, as the Open UI HTML interface is a single DOM object and makes this much easier.
UFT supports Siebel HI via it's STA framework so the requirements for testing Siebel HI with UFT are:
Install and activate UFT's Siebel add-in on the testing machine
Install STA on the Siebel server
Access the Siebel application via the automation URL
(http://hostname/callcenter/start.swe?SWECmd=AutoOn)

Testing IE on Mac using Selenium Grid?

Is there a way to do this? I am having issues setting up the company's VM, and was wondering if there is an alternative.
If you can afford you can go for Cloud based cross browser testing services like SauceLabs or BrowserStack.Both were easy to configure and works the same way grid works.All you have to do is give the remoteurl.You can try with trial license and see if it suits your need
You can see comparitive study of these and others here
It's Feb 8, 2017 and I'm using BrowserStack to do Selemium Webdriver testing using mocha/node, W7/8.1/10, and IE11 and there are several issues with the platform and ie webdriver (2.3, per their site), e.g. input fields are not in view by default, wrong chars are sent to input fields, etc. It is also slow. I might start looking into running grid if we cannot get better use and value out of $80/month charge.

Been asked to use Selenium to test Windows desktop application UI--how is this possible?

A company I applied to had sent me a "test", which I had to decline, due to it not making a lot of sense: They asked me to use Selenium to test a Win desktop app GUI and produce bug reports in the table form. They claimed that they're using Selenium to test Win desktop applications in their company, but they wouldn't tell how.
I did some research, and my understanding is that Selenium works with web browsers only, as it's been specifically designed for this. How can it connect to Windows desktop app? I just don't see any way possible for this. I found a claim that some integrate it with another open source tool to do this, but this "test" was supposed to take 1 hour of my time and installing some other framework, configuring, integrating with Selenium, etc, etc definitely wouldn't fall into one hour time frame. I had heard from another company too, that they wanted me to use Selenium to automate non-browser stuff if they hired me... Still have no clue about this--is this even possible? -- or is it something simply wrong?
You can't. Selenium can only automate web browsers, and even then, only certain browsers (Chrome, Firefox, Internet Explorer, Opera, and occasionally Safari). It interacts with them at a very deep level, very specific to the browser in question, in ways that don't apply to other Windows applications.
Selenium is meant for GUI tests of web applications and nothing else. But you can include Sikuli in webdriver code and can test the any of the applications either desktop or web applications, since it uses Image recognition.
else if you want to test the desktop application using Selenium thne u need to import Autoit and can test those as well

Testing VXML Applications in a Application Simulator

I am looking for a solution to simulate vxml application in a desktop/web browser.
Challenge
i have few hundreds of unit test cases in every new vxml application development.
it is not possible to always make a test call to test every single unit test cases i have. if i can test vxml application in a simulator it will be more easy to test it..
i am aware of that avaya Dialog designer/AAOD have a feature to test application in their inbuild Application simulator which comes with AAOD/DD Eclipse package but this tool can run AAOD/DD projects in workspace alone.
Please refer : Chapter 16 in Avaya dev guide
AAOD's Tool looks like this
is it possible to customize to use this tool to simulate static VXML / Nuance NDF based VXML application ?
or any other tools available ?
Unit testing of IVR applications is challenging and it is near impossible to hit ever possible path in the call flow for an application of any size. I am not aware if you can customize Avaya's tool for your needs. But there is a product out there that may fit some of your requirements. It is Voiyager by Syntellect. It looks like they have a free trial now if you want to try it out. I saw a demonstration of it at SpeechTEK a few years ago and it was pretty impressive. The only reason I did not pursue it at the time is that it was pretty pricey.
Avaya od/dd is a platform dependent tool(IDE) where you can create (vxml+java), test and debug application in the tool. But code which is created outside(Avaya OD/DD tool) the environment is not possible. Because code generated in avaya OD is java format, while executing in the voice browser it is converted into vxml for that u need to give webLM a license to avaya tool.You can use some ivr automation tools like hammer etc.But you need to pay for the software.
VXML apps are just WARs. The only session information transferred between invocations of pages is the session id. We have used Apache JMeter to create apps.
What you can do it try and see if what you want to do can be done via the web browser, by going to http://<server>/<Application/Start there fill the boxes you require (most of the time just filling the ones marked ANI and DNIS will be enough). If your call can be tested this way you can use the tools for web testing, without using Orchestration Designer.
If your app has a CTI/AES connector you may not be able to do this, because the web server tries to connect to AES upon submitting the first page.
As stated above , there are things that cannot be unit tested .
Nuance NDF and SVF applications come with test pages where you can simulate the call flow ; similar tools exit for grammars .

Is there a way to test Comet applications without a running browser?

I'm trying to connect to an application that uses Comet and is pretty heavy on Javascript and Comet. I've gone as far as I can go in Firebug, HTTP Header examination and am trying to see what's coming over the wire by writing something using Ruby Mechanize.
However, since I have no client run-time, my approach is to mimic the HTTP requests going back and forth (doing this using Ruby Mechanize). I'm looking at the logs and comparing them to LiveHTTPHeader output and it's very similar but the server isn't responding (I don't have access to the server side code).
Are there tools that could help? Has anyone tried simulating the DOM and Javascript runtime using something like Rhino or is that just asking for pain?
The only sane way I've found to run automated tests on web apps involving substantial Javascript (w/ or w/o Comet) is selenium rc -- basically, mechanizing/automating a real browser from your favorite programming language. (There may be other approaches with a similar architecture, but Selenium is popular and it's what I'm familiar with). Simulating browser's DOM and JS is just too painful -- been there, tried that, failed miserably;-).
Visual Studio 2010 Ultimate edition provides very good testing support for web applications. I had tried the web load test and it was impressing.

Resources