Hello,
Trying to figure out a way to share test run results. Our test rig (controller and agents) are all in one domain and all of our development work is done in another domain. Currently, I have installed a Visual Studio instance on the machine that host the controller. This is where I have been managing the test runs from but need to be able to share the results with other developers. Other users all have access to Visual Studio but are all installed on a separate domain. When using Visual Studio in a different domain and trying to connect to the controller I get the error "Connecting to the controller on machine '.....' failed. The server has rejected the client credentials."
Is there any way to allow anonymous connection to the controller to view the test results?
The other thing I have tried is exporting a TRX file but after clicking on the test run the status becomes "Reading test results from database..." followed by the error "Could not read result repository: Could not access the load test results repository......". I can connect to the database through Microsoft SQL Server Management Studio using an SQL logon. I can't see anywhere in the TRX file that defines the connection?
Thank!
===================================================================================
Hi discofunk25
Let's say your controller locates in domain A. Your developers use Visual Studio from domain B. If domain A trusts domain B and your developers use accounts from domain B to log in their computers, you can add their account to TeamTestControllerUsers group created when installing test controller. Then those users should be able to connect to the controller via VS.
===================================================================================
Thanks for your response Bill. Unfortunately domain A doesn't trust domain B and we don't have the power to change that. The sites the physical domains are on are geographically separate with lots of firewalls and red tape. The way I setup the agents originally was using the "workgroup" method (same username/password). I'm wondering if the developers run an instance of VS with the same username/password would do the trick?
==================================================================================
The trick of using the same username/password is to work around the NTLM authentication. In a domain environemnt, Windows usually tries kerberos authentication first. When it fails, Windows will try NTML authentication.
The drawback of creating multiple copy of the same username/password on different computers is obvious. It's difficult to maintain, especially you have a great many of accounts and computers.
Have you tried the Export load test feature? See How to: Export Results from a Repository. I think you can export load test in a computer from DomainA. Copy the exported file to a computer in DomainB. Then import the result to a load test database in domainB. In this way, DomainB users should be able to view result. Below are steps you can try:
In a computer in DomainA, export load test result per How to: Export Results from a Repository.
Install SQL Server 2005/2008 on a computer in DomainB. You can also use an existing SQL instance.
In a computer in DomainB where VSTT is installed, locate the script file loadtestresultsrepository.sql in %ProgramFiles%\Microsoft Visual Studio 9.0\Common7\IDE. This file is used to create load test database that store load test results.
Execute loadtestresultsrepository.sql on a SQL instance picked in step 2. It will create a database named "LoadTest".
For computers in DomainB, connect to the local load test host and select it to use repository you created in step 4. See How to: Select a Load Test Results Repository.
Import the load test result you exported in step 1. See How to: Import Results into a Repository.
====================================================================================
The contents of this blog were gathered from the blogger real life experiences and from the different forums related to automated test.
Wednesday, July 15, 2009
Friday, May 15, 2009
How could I show performance issues on other servers compared to load test results
I have some Unix machines that we need to monitor performance on while we run our load tests. Is there a good methodology on how this should be done?
Thanks- Claucher
=======================================================
Hi CLaucher
There's no support to collect Unix/Linux performace information in the Visual Studio load test. I wish I had a more helpful reply.
-Bill.Wang(MSFT)
=======================================================
Hi CLaucher,
I am guesing your database residing on those unix/linux servers. In this case, you can run some unix commands(performance related) on those unix machines to monitor the performance. You can tell DBA who administer those severs to send you the performance matrix(by unix command) during the period of ur load test.
I hope it helps.
Thanks -- Jaeed
=========================================================
Thanks- Claucher
=======================================================
Hi CLaucher
There's no support to collect Unix/Linux performace information in the Visual Studio load test. I wish I had a more helpful reply.
-Bill.Wang(MSFT)
=======================================================
Hi CLaucher,
I am guesing your database residing on those unix/linux servers. In this case, you can run some unix commands(performance related) on those unix machines to monitor the performance. You can tell DBA who administer those severs to send you the performance matrix(by unix command) during the period of ur load test.
I hope it helps.
Thanks -- Jaeed
=========================================================
Thursday, May 14, 2009
VSTestHost.exe uses only one CPU
I recently noticed that while running a load test, VStestHost.exe uses only one CPU. Trying to change the affinity through task manager has no effect and it continues to run on CPU0. Is that expected behavior or there's something wrong in the way I am executing the load.
==============================================================================
Hi Pawan,
This is by design in Visual Studio 2008. To drive additoinal load, and utilize all CPUs, you need the Test Load Agent / Controller to create your test rig.
Robert
==============================================================================
Thanks George,
so what it indirectly means is that I'll have to procure additional licenses for Load Agent and Controller.
Just wondering if both of em are shipped as part of the MSDN subscription?
Pawan
==============================================================================
Hi Pawan,
Each Load Agent license covers a controller, so the controller is part of the Load Agent purchase. For MSDN, they have a trial version, but be warned its double time bombed - I think its 60-days or 25 test runs, whichever comes first.
Robert
==============================================================================
Hi Pawan,
This is by design in Visual Studio 2008. To drive additoinal load, and utilize all CPUs, you need the Test Load Agent / Controller to create your test rig.
Robert
==============================================================================
Thanks George,
so what it indirectly means is that I'll have to procure additional licenses for Load Agent and Controller.
Just wondering if both of em are shipped as part of the MSDN subscription?
Pawan
==============================================================================
Hi Pawan,
Each Load Agent license covers a controller, so the controller is part of the Load Agent purchase. For MSDN, they have a trial version, but be warned its double time bombed - I think its 60-days or 25 test runs, whichever comes first.
Robert
Monday, March 30, 2009
Monitoring and Analyzing a Load Test Result
Please visit the following link:
http://msdn.microsoft.com/en-us/library/aa730850(vs.80).aspx
http://msdn.microsoft.com/en-us/library/aa730850(vs.80).aspx
Web and Load Test FAQs
Please visit the following link:
http://social.msdn.microsoft.com/Forums/en-US/vstswebtest/thread/bd3b1caf-ca7b-408e-b415-3b8e3465bb03
http://social.msdn.microsoft.com/Forums/en-US/vstswebtest/thread/bd3b1caf-ca7b-408e-b415-3b8e3465bb03
Web Test Authoring and Debugging Techniques for VS 2008
Please visit the following link:
http://blogs.msdn.com/edglas/archive/2007/12/02/web-test-authoring-and-debugging-techniques-for-vs-2008.aspx
http://blogs.msdn.com/edglas/archive/2007/12/02/web-test-authoring-and-debugging-techniques-for-vs-2008.aspx
Web Test Authoring and Debugging Techniques--Visual Studio 2005 Technical Articles
Please visit the following link:
http://msdn2.microsoft.com/en-us/library/ms364082(VS.80).aspx
http://msdn2.microsoft.com/en-us/library/ms364082(VS.80).aspx
Friday, March 27, 2009
How to capture multiple browser windows using WebTest?
Dear All,
We have a web application when we click on a hyperlink it opens in a new browser window.i want to check functionality of that hyperlink.but, webtest not recording the hyperlink window.
Please guide how to capture it?
Thanks,
Swaroop
-------------------------------------------------------------------------------
Are you saying that when you click in the new window the requests are not recorded in the origningal window?
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
--------------------------------------------------------------------------------
Hi Kasireddy,
"Web Test Recorder" cannot record more then one browser at a time.
If you want to record both browser request you may want to use Fiddler - Please erad this post on how to Recording Web Test Using Fiddler
Good Luck
-------------------------------------------------------------------
After you record the first webpage(a.webtest), you can also also record the second page (b.webtest)
Just put all of the webrequests in b.webtest into a.webtest.
Besides fiddler, it is another way.
--------------------------------------------------------------------------------
Ray
----------------------------------------------------------------------------------
Hi Slumley,
Copying new browser URL into Record browser window solved the problem.
Thanks,
Swaroop
We have a web application when we click on a hyperlink it opens in a new browser window.i want to check functionality of that hyperlink.but, webtest not recording the hyperlink window.
Please guide how to capture it?
Thanks,
Swaroop
-------------------------------------------------------------------------------
Are you saying that when you click in the new window the requests are not recorded in the origningal window?
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
--------------------------------------------------------------------------------
Hi Kasireddy,
"Web Test Recorder" cannot record more then one browser at a time.
If you want to record both browser request you may want to use Fiddler - Please erad this post on how to Recording Web Test Using Fiddler
Good Luck
-------------------------------------------------------------------
After you record the first webpage(a.webtest), you can also also record the second page (b.webtest)
Just put all of the webrequests in b.webtest into a.webtest.
Besides fiddler, it is another way.
--------------------------------------------------------------------------------
Ray
----------------------------------------------------------------------------------
Hi Slumley,
Copying new browser URL into Record browser window solved the problem.
Thanks,
Swaroop
List separator for csv files in web test
I use csv files in my web tests as data source. On my PC those tests run fine, but sometimes on other PC there is a problem with list separator. Where can I change list separator as I like (it didn't work with computer regional settings)?
Thanks!
----------------------------------------------------------------------------------
Do you mean that you are running on a machine with a different language. Check for this registry key and see what values you have for the 2 different machines:
Key: HKEY_CURRENT_USER\Control Panel\International
Name: sList
Blog - http://blogs.msdn.com/slumley/default.aspx
---------------------------------------------------------------------------------
This issue wont help. When I ran my test from VS, list separator isn't taken from regional settings (this reg key). I'm running my tests on machines with one language (in key sList separator are equal), but in VS on some PC a different list separator is needed...
---------------------------------------------------------------------------------
If you are still having trouble, I suggest using a different datasource such as xml, excel or a database.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
Thanks!
----------------------------------------------------------------------------------
Do you mean that you are running on a machine with a different language. Check for this registry key and see what values you have for the 2 different machines:
Key: HKEY_CURRENT_USER\Control Panel\International
Name: sList
Blog - http://blogs.msdn.com/slumley/default.aspx
---------------------------------------------------------------------------------
This issue wont help. When I ran my test from VS, list separator isn't taken from regional settings (this reg key). I'm running my tests on machines with one language (in key sList separator are equal), but in VS on some PC a different list separator is needed...
---------------------------------------------------------------------------------
If you are still having trouble, I suggest using a different datasource such as xml, excel or a database.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
IP Switching Question
Hi,
When setting a range for the IP switching feature, does it have to be a range of IP addresses that are not in use already? I know about not using an address already configured on the chosen nic from Bill's blog, I am talking about addresses that may be in use by other physical hosts on the network.
The reason I am asking is that common sense says they should be free otherwise there will be a conflict, but I ran a test the other day using a range that I later found out had loads of real hosts! And while none of the IP's were actually used during the test (they were not web tests), the agent logs show that all the binds succeeded with no problems. And then today I ran the same load test with no changes and the moment I started it, the agent went off the network! I checked the event log when it came back and the reason was that on the very final IP address bind of the range, it had a duplicate IP conflict with another box on the network and as a result, disabled its own nic!
So I am really confused now as I did a ping scan and found that virtually all of the addresses I used in my range do have real hosts allocated and also, why did it work first time round, then second time round only fail on the very last one it tried to bind?
Cheers
Dan
----------------------------------------------------------------------------------
can anyone confirm whether the ip addresses for ip switching need to be free ones or if it doesn't matter if they are in use?
i really need to know this as i cannot chance using this again as if it goes bad i have to call out a support guy to physically reset the network card!
----------------------------------------------------------------------------------
They need to be free.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
When setting a range for the IP switching feature, does it have to be a range of IP addresses that are not in use already? I know about not using an address already configured on the chosen nic from Bill's blog, I am talking about addresses that may be in use by other physical hosts on the network.
The reason I am asking is that common sense says they should be free otherwise there will be a conflict, but I ran a test the other day using a range that I later found out had loads of real hosts! And while none of the IP's were actually used during the test (they were not web tests), the agent logs show that all the binds succeeded with no problems. And then today I ran the same load test with no changes and the moment I started it, the agent went off the network! I checked the event log when it came back and the reason was that on the very final IP address bind of the range, it had a duplicate IP conflict with another box on the network and as a result, disabled its own nic!
So I am really confused now as I did a ping scan and found that virtually all of the addresses I used in my range do have real hosts allocated and also, why did it work first time round, then second time round only fail on the very last one it tried to bind?
Cheers
Dan
----------------------------------------------------------------------------------
can anyone confirm whether the ip addresses for ip switching need to be free ones or if it doesn't matter if they are in use?
i really need to know this as i cannot chance using this again as if it goes bad i have to call out a support guy to physically reset the network card!
----------------------------------------------------------------------------------
They need to be free.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
Wednesday, March 25, 2009
Need to get all urls from a web page
Hi ,
I m doing my first webtest using VS i m trying to get all urls from the page and them later use those urls.but i tried different things to get urls for example when i place extrace rule for html tag.start tag = a and attribute = href then it returns only first this is main issue.
2nd how i can get my my context variable value .following is the code.
Thanks
awais
WebTestRequest request1 = new WebTestRequest("http://www.worldgolf.com/courses/usa/alabama/");
ExtractAttributeValue extractionRule1 = new ExtractAttributeValue();
extractionRule1.TagName = "a";
extractionRule1.AttributeName = "href";
extractionRule1.MatchAttributeName = "";
extractionRule1.MatchAttributeValue = "";
extractionRule1.HtmlDecode = true;
extractionRule1.Required = true;
extractionRule1.Index = 0;
extractionRule1.ContextParameterName = "";
extractionRule1.ContextParameterName = "values";
request1.ExtractValues += new EventHandler(extractionRule1.Extract);
//string a = this.Context["address"].ToString();
yield return request1;
aq
-------------------------------------------------------------------------------------
Hi Awais,
Here is a complete coded webtest that shows retreiving all URL's from anchor tags that contain hrefs. The urls are all stored in a List, and will only add unique urls.
1 //------------------------------------------------------------------------------
2 //
3 // This code was generated by a tool.
4 // Runtime Version:2.0.50727.3521
5 //
6 // Changes to this file may cause incorrect behavior and will be lost if
7 // the code is regenerated.
8 //
9 //------------------------------------------------------------------------------
10
11 namespace TestExperimentMar09
12 {
13 using System;
14 using System.Collections.Generic;
15 using System.Text;
16 using Microsoft.VisualStudio.TestTools.WebTesting;
17
18
19 public class WebTest3Coded : WebTest
20 {
21 List urlList = new List();
22
23 public WebTest3Coded()
24 {
25 this.PreAuthenticate = true;
26
27 }
28
29 public override IEnumerator GetRequestEnumerator()
30 {
31
32 this.PostRequest += new EventHandler(WebTest3Coded_PostRequest);
33 WebTestRequest request1 = new WebTestRequest("http://msdn.microsoft.com/");
34 request1.ExpectedResponseUrl = "http://msdn.microsoft.com/en-us/default.aspx";
35 yield return request1;
36 request1 = null;
37
38
39 }
40
41 void WebTest3Coded_PostRequest(object sender, PostRequestEventArgs e)
42 {
43 //lets make sure that we have a valid HTML response before we start to work on the Response.HtmlDocument
44 if (e.Response.IsHtml)
45 {
46 //check a filtered list of html tags that are anchor tags
47 foreach (HtmlTag htmlTag in e.Response.HtmlDocument.GetFilteredHtmlTags(new string[] {"a"}))
48 {
49 //makes sure our htmlTag has some attributes, otherwise no need to continue
50 if (htmlTag.Attributes != null)
51 {
52 //loop through all the htmlTag.attributes to see if what we need is there
53 foreach (HtmlAttribute attributeTag in htmlTag.Attributes)
54 {
55 //lets make sure we dont have a bad htmlTag
56 if ( !string.IsNullOrEmpty(attributeTag.Name) )
57 {
58 //we are only concerned with href attributes , other checks could be done here
59 if (attributeTag.Name.Equals("href", StringComparison.InvariantCultureIgnoreCase))
60 {
61 //if the list has the url we dont need to add it again
62 if (! this.urlList.Contains(attributeTag.Value))
63 {
64 //add the url to our master list
65 this.urlList.Add(htmlTag.GetAttributeValueAsString("href"));
66 }
67
68 }
69 }
70 }
71 }
72 }
73 }
74 }
75 }
76 }
77
------------------------------------------------------------------------------
Thanks a lot :)
awais
-------
aq
I m doing my first webtest using VS i m trying to get all urls from the page and them later use those urls.but i tried different things to get urls for example when i place extrace rule for html tag.start tag = a and attribute = href then it returns only first this is main issue.
2nd how i can get my my context variable value .following is the code.
Thanks
awais
WebTestRequest request1 = new WebTestRequest("http://www.worldgolf.com/courses/usa/alabama/");
ExtractAttributeValue extractionRule1 = new ExtractAttributeValue();
extractionRule1.TagName = "a";
extractionRule1.AttributeName = "href";
extractionRule1.MatchAttributeName = "";
extractionRule1.MatchAttributeValue = "";
extractionRule1.HtmlDecode = true;
extractionRule1.Required = true;
extractionRule1.Index = 0;
extractionRule1.ContextParameterName = "";
extractionRule1.ContextParameterName = "values";
request1.ExtractValues += new EventHandler
//string a = this.Context["address"].ToString();
yield return request1;
aq
-------------------------------------------------------------------------------------
Hi Awais,
Here is a complete coded webtest that shows retreiving all URL's from anchor tags that contain hrefs. The urls are all stored in a List
1 //------------------------------------------------------------------------------
2 //
3 // This code was generated by a tool.
4 // Runtime Version:2.0.50727.3521
5 //
6 // Changes to this file may cause incorrect behavior and will be lost if
7 // the code is regenerated.
8 //
9 //------------------------------------------------------------------------------
10
11 namespace TestExperimentMar09
12 {
13 using System;
14 using System.Collections.Generic;
15 using System.Text;
16 using Microsoft.VisualStudio.TestTools.WebTesting;
17
18
19 public class WebTest3Coded : WebTest
20 {
21 List
22
23 public WebTest3Coded()
24 {
25 this.PreAuthenticate = true;
26
27 }
28
29 public override IEnumerator
30 {
31
32 this.PostRequest += new EventHandler
33 WebTestRequest request1 = new WebTestRequest("http://msdn.microsoft.com/");
34 request1.ExpectedResponseUrl = "http://msdn.microsoft.com/en-us/default.aspx";
35 yield return request1;
36 request1 = null;
37
38
39 }
40
41 void WebTest3Coded_PostRequest(object sender, PostRequestEventArgs e)
42 {
43 //lets make sure that we have a valid HTML response before we start to work on the Response.HtmlDocument
44 if (e.Response.IsHtml)
45 {
46 //check a filtered list of html tags that are anchor tags
47 foreach (HtmlTag htmlTag in e.Response.HtmlDocument.GetFilteredHtmlTags(new string[] {"a"}))
48 {
49 //makes sure our htmlTag has some attributes, otherwise no need to continue
50 if (htmlTag.Attributes != null)
51 {
52 //loop through all the htmlTag.attributes to see if what we need is there
53 foreach (HtmlAttribute attributeTag in htmlTag.Attributes)
54 {
55 //lets make sure we dont have a bad htmlTag
56 if ( !string.IsNullOrEmpty(attributeTag.Name) )
57 {
58 //we are only concerned with href attributes , other checks could be done here
59 if (attributeTag.Name.Equals("href", StringComparison.InvariantCultureIgnoreCase))
60 {
61 //if the list has the url we dont need to add it again
62 if (! this.urlList.Contains(attributeTag.Value))
63 {
64 //add the url to our master list
65 this.urlList.Add(htmlTag.GetAttributeValueAsString("href"));
66 }
67
68 }
69 }
70 }
71 }
72 }
73 }
74 }
75 }
76 }
77
------------------------------------------------------------------------------
Thanks a lot :)
awais
-------
aq
Subscribe to:
Comments (Atom)
Unix/Linux Commands
Flow control Syntax break Exit a loop. continue Exit the current iteration of the loop and proceed with the next iteration. Ctrl+C Key com...
-
%systemroot%\system32\inetsrv\config\applicationHost.config https://docs.microsoft.com/en-us/iis/configuration/system.applicationhos...
-
hi everybody, i am doing load test for 10 users,20users,30users working fine upto to this point if increase to 40 users iam getting error a...