We have project with many NUnit test, and it taken longer to run them, an our build process. Our NUnit test are grouped together in different projects, that compile different assemblies (DLL files), we have about 10 projects full of NUnit tests, in our solution.
We decided to try and run our NUnit assemblies in parallel on our Team Foundation Server 2012, to try and speed up our test time. Note; assemblies in parallel and not each test in parallel, we still want our tests to run one after the other, in it's given assembly.
So how can we setup our Team Foundation Server to run our NUnit assemblies in parallel?
If they are taking longer then they are likely Integration Tests and not Unit Tests, even if they are written in a unit testing framework.
You should do only unit tests (tests that need no instances of your application) at build time. Integration and UI tests should be executed at deployment time. As you deploy the same code to progressive quality environments (DEV->QA->UA->PROD) you can run more and more long running verification tests.
This will reduce your build time significantly.
Related
We have a custom automation framework in place. So for running scripts we have a windows application for trigger some test case. Test cases are simple C# methods and we invoke them using Reflection.
Now My requirement is to integrate this framework with MTM. and would like to have continuous integration in process. This means I want if some build comes then some of the test case will automatically start running to secure our code.
How can I achieve this?
More specifically my requirement is I pushed some code related to some PBI, So the testcase related to that requirement should automatically run.
Generally the CI (continuous integration) is against the build process in TFS.
If you mean run the tests using custom test framework, then you need to create a Test Adapter accordingly, so that VS and the Build server can pick up the tests. Here is a good article for your reference on how to do this: Authoring a new Visual studio unit test adapter
Actually you can run the tests in build process, with the CI set, the new build will be triggered once a new change checked in, then the tests will run automatically. Refer to below articles for details:
vNext build - Testing in Continuous Integration and Continuous
Deployment Workflows
Xaml build - TFS, Automated Testing and Continuous Integration
If you still want to use MTM, you can reference below articles:
Automate a test case in Microsoft Test Manager
Continuous Delivery with TFS: Running Automated Web Tests with
MTM
I was wondering if it would be possible to either write or deploy an existing test runner along side my MVC application. The tests could be referenced from the test Runner application and deployed separately from the main application.
The aim is to run the tests remotely on client site as a sort of diagnostics tool.
It would be great if we could have a little more information when things go wrong.
Is this possible?
I have a parallel mono environment installed to run my app and unit
tests. The app relies on MONO_PATH to find some of the assemblies it
depends on.
Now when I run my unit tests in Monodevelop they don't work because
MONO_PATH gets cleared before running the tests. Setting environment
variables in the project options doesn't help because they don't get set
when running tests.
Any ideas how the tests could be made to work within MD? Are there any
extension points that I could plug in to?
(MD 5.9.8 with Mono 3.12.1; my app requires Mono 3.4)
Make your test project depend on the libraries so they get copied to your bin/DEBUG|RELEASE/ path before execution?
Take in account that MONO_PATH is just a debugging tool and shouldn't be used in production.
I have been trying for a while and I am not able to run Load Tests with my Build Agent. I have a solution with different projects, running Coded UI Tests, Web Performance Tests; all of them running fine on the Build Agent. The problem is that I can't run Load tests.
I started thinking that it was not possible, but I found this at Visual Studio online documentation:
The build agent can run:
Code Coverage
Coded UI Tests (Requires a build server that is running in interactive
mode)
Database Test Data Generation
Database Unit Tests
Generic Tests
Load Tests
Unit Tests
Ordered Tests
Test Impact Analysis
Web Tests
So I guess it is possible somehow. Does anybody know how to do it?
I have a bunch of C# unit tests on my teams Team Foundation Server. Normally we Run these tests using Jetbrains test-suite. However, I've like to make these tests available to the QA department, through a browser.
Is there any way to easily make C# unit test runnable through the web? Anybody who have experience with this?
I have googled it and i'm only able to find client applications to run unittests.
Thanks in advance!
Your Unit Test should be for developers and Continuos Integration process, QA departement should run UI/Web Coded/Performance Test by VS Test Manager; anyway if you configure the execution of the test suite in the build configuration, test result will be available also from TFS Web Access
Run tests in your build process