Hello I recently started with a new company that has developing a internal website for their finance and have been using TFS with Vis studio for quite some time. However they recently decided they wanted to expand into Automated UI testing and pair it with MTM for the QA dept.. The issue I am having is that the Microsoft Test Manager 2013 is not set up with a build to start using the automated/ lab environment features. Im at a loss of even where to go to merge that build with MTM so that I can then use the Test configuration tool to start creating a lab environment. Is there any documentation or resources that might help with the process to.
1)Create a build in MTM (using the web app I have in Vis studio)
2)Setup a Lab environment in MTM using the above build.
3)Being link my automated test cases(although that is pretty straight forward the above to I cannot seem to grasp.
Anything advice would be greatly!! appreciated.
Thank you for your time
Chris
(using Enterprise/Highest level of TFS and Vis stuido 2013)
For (1) please refer the link from MSDN: Working with builds in MTM
Go to Plan->Properties.
you can use the drop down to set the filter for the build (filter by build definition or build quality)
And finally use the Modify hyperlink to assign a new build.
For (2)(3) please refer the paragraph 'Build and install your application in a lab environment ' & 'View and Update the Test Results ' from MSDN Link: How to: Run Automated Tests In a Lab Environment Using Microsoft Test Manager
Related
I am looking to automate Build and Deployment in Visual Studio T.F.S and going through this link for the same.
https://marketplace.visualstudio.com/items?itemName=ms-vsts.ibm-websphere
It clearly says to install IBM Websphere Extension but i am not sure from where can i get it done?
If you are using the the old Xaml build system (TFS 2013 and earlier version), you can follow the steps mentioned in below link to build and deploy the project:
Automated Web Deployment and Team Build Using TFS 2013
If you are using vNext build (TFS 2015 and later version), you can use the CI/CD. Please see Continuous integration, test, and deployment tutorial and CI/CD Hello world for details.
You do not need websphere in order to automate builds, builds are created by a build server and placed in an output ( drop folder location ).
Deployment can be handed by creating post build scripts, there are a number of solutions for handling larger deployments but start with the basic build deployment workflow and scale from there.
See the following QuickStart to get an idea of build/deployment process.
https://learn.microsoft.com/en-us/vsts/build-release/actions/ci-cd-part-1#create-a-release-definition
I've got some CodedUI tests I'd like to run on a remote machine from visual studio. Now it used to be that you'd install a test controller somewhere, a test agent on the box you want to run on, get them talking, then use a test settings file that was pointed to that controller. I was going through this and installed agents for 2015 update 3 on my run box. I noticed that there is no controller configuration option. After some googling I found this: https://vstfsalm.wordpress.com/2015/08/18/tfs-2015-test-agent-has-not-been-configured-run-the-test-agent-configuration-tool-to-configure-the-test-agent/. Very cool. So I go in to tfs to set up a machine group. Great. The part I don't get is: how can I now tell VS to run at that group? Test settings files require a controller when they are set to remote run. Do I have to downgrade the agents back to 2013? Does anyone know if Microsoft just didn't implement this work style in 2015 (on purpose or otherwise) or if it just isn't implemented yet?
To run the code UI test via vNext build on TFS update3. First make sure the code UI test can be executed successfully in your Visual Studio on your remote machine locally. Also don't forget to configure the build agent to interact with desktop.
Then you just need to add Deploy TestAgent on RemoteTestMachine task and run Functional test. When you queue a build, it will deploy your code ui test solution to the drop folder on the build server machine. Then use MSTEST to run the test assembly. It's same with running code UI test via MSTEST command line on your local machine.
Update
Q: Will the Test Agent 2015 support all the scenarios supported by
Test Controller and Test Agent of Visual Studio 2013?
A: We recommend you use Agents for Visual Studio 2015 in all the new automated testing scenarios. You can use the Deploy Test Agents task in a build definition to download and install the test agents on your machine. The following table shows the scenarios supported by Agents for Visual Studio 2013 and the alternatives for Team Foundation Server (TFS) 2015 and Team Services (TS).
Source Link: Install and configure test agents
Currently, there is no alternative for this scenarion. You may have to use test agent 2013 to achieve it.
Is there a possibility to add a custom file (e.g. custom Selenium report for all tests) into the body of Run summary itself (Runs -> Run Summary -> Attachments).
Tests are executed using the vNext "Run Functional Tests" task, the unit framework used in tests is a TestTools.UnitTesting.
I know that there is a TestContext.AddTestResult but it attaches file to a specific test, while I want to use some sort of a summary file for the whole run.
Test Run Summary in question
If you want to display your custom result in the test run summary or build result summary, seems you will have to write your own extensions. Help link: Overview of extensions for Visual Studio Team Services
Base for this were a lot of examples provided by MS on github:
Visual Studio Team Services Tasks
Visual Studio Team Services Sample Extensions
To get a first feeling what places on your TFS Web Portal can be extended/customized you can download and install this extension Contributions Guide from the Visual Studio Marketplace.
Now on my project we use TFS as TestCase management tool, issue tracking system and code management. But we want to move to JIRA and Bitbucket. In VisualStudio we have ability to bind TC to automation test and then run test suite with automation test. The question is: Is it possible to bind JIRA test case with automation test(UI tests, API tests used MSTest framework)? Is it possible to run automation test and see if test case pass\failed? Some reports?
Maybe there is possibility to develop some extension for this?
Unfortunately, right now there are no built-in JIRA importer for data from Microsoft Team Foundation Server for Visual Studio.
However, there are complete third party solutions available which might help you between JIRA and TFS such as below:
TFS4JIRA
MS TFS Connector for JIRA
UseTFS
I´m new to Visual Studio and this might be very easy to do but i've been researching for almost a week now and haven't got any results.
The thing is i'm trying to do some QA on a web project in visual studio 2010 that is under a TFS. I've recorded and coded some of my tests but i need this tests to run when there is a new check in by any of the developers.
I've read some of the How To's from MSDN but this step by step walkthroughs are not specific enough for the web performance test.
Thank you in advance
In you case you need to edit the build definition to include Build Verification Tests (BVTs) : theses tests can do check post build and also post deploy.
Web Performance Test, Load Test, Coded UI Test ... it's quite the same for TFS : some code to run to check something.
The good starting point is here.