I use csv files in my web tests as data source. On my PC those tests run fine, but sometimes on other PC there is a problem with list separator. Where can I change list separator as I like (it didn't work with computer regional settings)?
Thanks!
----------------------------------------------------------------------------------
Do you mean that you are running on a machine with a different language. Check for this registry key and see what values you have for the 2 different machines:
Key: HKEY_CURRENT_USER\Control Panel\International
Name: sList
Blog - http://blogs.msdn.com/slumley/default.aspx
---------------------------------------------------------------------------------
This issue wont help. When I ran my test from VS, list separator isn't taken from regional settings (this reg key). I'm running my tests on machines with one language (in key sList separator are equal), but in VS on some PC a different list separator is needed...
---------------------------------------------------------------------------------
If you are still having trouble, I suggest using a different datasource such as xml, excel or a database.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
Friday, March 27, 2009
IP Switching Question
Hi,
When setting a range for the IP switching feature, does it have to be a range of IP addresses that are not in use already? I know about not using an address already configured on the chosen nic from Bill's blog, I am talking about addresses that may be in use by other physical hosts on the network.
The reason I am asking is that common sense says they should be free otherwise there will be a conflict, but I ran a test the other day using a range that I later found out had loads of real hosts! And while none of the IP's were actually used during the test (they were not web tests), the agent logs show that all the binds succeeded with no problems. And then today I ran the same load test with no changes and the moment I started it, the agent went off the network! I checked the event log when it came back and the reason was that on the very final IP address bind of the range, it had a duplicate IP conflict with another box on the network and as a result, disabled its own nic!
So I am really confused now as I did a ping scan and found that virtually all of the addresses I used in my range do have real hosts allocated and also, why did it work first time round, then second time round only fail on the very last one it tried to bind?
Cheers
Dan
----------------------------------------------------------------------------------
can anyone confirm whether the ip addresses for ip switching need to be free ones or if it doesn't matter if they are in use?
i really need to know this as i cannot chance using this again as if it goes bad i have to call out a support guy to physically reset the network card!
----------------------------------------------------------------------------------
They need to be free.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
When setting a range for the IP switching feature, does it have to be a range of IP addresses that are not in use already? I know about not using an address already configured on the chosen nic from Bill's blog, I am talking about addresses that may be in use by other physical hosts on the network.
The reason I am asking is that common sense says they should be free otherwise there will be a conflict, but I ran a test the other day using a range that I later found out had loads of real hosts! And while none of the IP's were actually used during the test (they were not web tests), the agent logs show that all the binds succeeded with no problems. And then today I ran the same load test with no changes and the moment I started it, the agent went off the network! I checked the event log when it came back and the reason was that on the very final IP address bind of the range, it had a duplicate IP conflict with another box on the network and as a result, disabled its own nic!
So I am really confused now as I did a ping scan and found that virtually all of the addresses I used in my range do have real hosts allocated and also, why did it work first time round, then second time round only fail on the very last one it tried to bind?
Cheers
Dan
----------------------------------------------------------------------------------
can anyone confirm whether the ip addresses for ip switching need to be free ones or if it doesn't matter if they are in use?
i really need to know this as i cannot chance using this again as if it goes bad i have to call out a support guy to physically reset the network card!
----------------------------------------------------------------------------------
They need to be free.
--------------------------------------------------------------------------------
Blog - http://blogs.msdn.com/slumley/default.aspx
Wednesday, March 25, 2009
Need to get all urls from a web page
Hi ,
I m doing my first webtest using VS i m trying to get all urls from the page and them later use those urls.but i tried different things to get urls for example when i place extrace rule for html tag.start tag = a and attribute = href then it returns only first this is main issue.
2nd how i can get my my context variable value .following is the code.
Thanks
awais
WebTestRequest request1 = new WebTestRequest("http://www.worldgolf.com/courses/usa/alabama/");
ExtractAttributeValue extractionRule1 = new ExtractAttributeValue();
extractionRule1.TagName = "a";
extractionRule1.AttributeName = "href";
extractionRule1.MatchAttributeName = "";
extractionRule1.MatchAttributeValue = "";
extractionRule1.HtmlDecode = true;
extractionRule1.Required = true;
extractionRule1.Index = 0;
extractionRule1.ContextParameterName = "";
extractionRule1.ContextParameterName = "values";
request1.ExtractValues += new EventHandler(extractionRule1.Extract);
//string a = this.Context["address"].ToString();
yield return request1;
aq
-------------------------------------------------------------------------------------
Hi Awais,
Here is a complete coded webtest that shows retreiving all URL's from anchor tags that contain hrefs. The urls are all stored in a List, and will only add unique urls.
1 //------------------------------------------------------------------------------
2 //
3 // This code was generated by a tool.
4 // Runtime Version:2.0.50727.3521
5 //
6 // Changes to this file may cause incorrect behavior and will be lost if
7 // the code is regenerated.
8 //
9 //------------------------------------------------------------------------------
10
11 namespace TestExperimentMar09
12 {
13 using System;
14 using System.Collections.Generic;
15 using System.Text;
16 using Microsoft.VisualStudio.TestTools.WebTesting;
17
18
19 public class WebTest3Coded : WebTest
20 {
21 List urlList = new List();
22
23 public WebTest3Coded()
24 {
25 this.PreAuthenticate = true;
26
27 }
28
29 public override IEnumerator GetRequestEnumerator()
30 {
31
32 this.PostRequest += new EventHandler(WebTest3Coded_PostRequest);
33 WebTestRequest request1 = new WebTestRequest("http://msdn.microsoft.com/");
34 request1.ExpectedResponseUrl = "http://msdn.microsoft.com/en-us/default.aspx";
35 yield return request1;
36 request1 = null;
37
38
39 }
40
41 void WebTest3Coded_PostRequest(object sender, PostRequestEventArgs e)
42 {
43 //lets make sure that we have a valid HTML response before we start to work on the Response.HtmlDocument
44 if (e.Response.IsHtml)
45 {
46 //check a filtered list of html tags that are anchor tags
47 foreach (HtmlTag htmlTag in e.Response.HtmlDocument.GetFilteredHtmlTags(new string[] {"a"}))
48 {
49 //makes sure our htmlTag has some attributes, otherwise no need to continue
50 if (htmlTag.Attributes != null)
51 {
52 //loop through all the htmlTag.attributes to see if what we need is there
53 foreach (HtmlAttribute attributeTag in htmlTag.Attributes)
54 {
55 //lets make sure we dont have a bad htmlTag
56 if ( !string.IsNullOrEmpty(attributeTag.Name) )
57 {
58 //we are only concerned with href attributes , other checks could be done here
59 if (attributeTag.Name.Equals("href", StringComparison.InvariantCultureIgnoreCase))
60 {
61 //if the list has the url we dont need to add it again
62 if (! this.urlList.Contains(attributeTag.Value))
63 {
64 //add the url to our master list
65 this.urlList.Add(htmlTag.GetAttributeValueAsString("href"));
66 }
67
68 }
69 }
70 }
71 }
72 }
73 }
74 }
75 }
76 }
77
------------------------------------------------------------------------------
Thanks a lot :)
awais
-------
aq
I m doing my first webtest using VS i m trying to get all urls from the page and them later use those urls.but i tried different things to get urls for example when i place extrace rule for html tag.start tag = a and attribute = href then it returns only first this is main issue.
2nd how i can get my my context variable value .following is the code.
Thanks
awais
WebTestRequest request1 = new WebTestRequest("http://www.worldgolf.com/courses/usa/alabama/");
ExtractAttributeValue extractionRule1 = new ExtractAttributeValue();
extractionRule1.TagName = "a";
extractionRule1.AttributeName = "href";
extractionRule1.MatchAttributeName = "";
extractionRule1.MatchAttributeValue = "";
extractionRule1.HtmlDecode = true;
extractionRule1.Required = true;
extractionRule1.Index = 0;
extractionRule1.ContextParameterName = "";
extractionRule1.ContextParameterName = "values";
request1.ExtractValues += new EventHandler
//string a = this.Context["address"].ToString();
yield return request1;
aq
-------------------------------------------------------------------------------------
Hi Awais,
Here is a complete coded webtest that shows retreiving all URL's from anchor tags that contain hrefs. The urls are all stored in a List
1 //------------------------------------------------------------------------------
2 //
3 // This code was generated by a tool.
4 // Runtime Version:2.0.50727.3521
5 //
6 // Changes to this file may cause incorrect behavior and will be lost if
7 // the code is regenerated.
8 //
9 //------------------------------------------------------------------------------
10
11 namespace TestExperimentMar09
12 {
13 using System;
14 using System.Collections.Generic;
15 using System.Text;
16 using Microsoft.VisualStudio.TestTools.WebTesting;
17
18
19 public class WebTest3Coded : WebTest
20 {
21 List
22
23 public WebTest3Coded()
24 {
25 this.PreAuthenticate = true;
26
27 }
28
29 public override IEnumerator
30 {
31
32 this.PostRequest += new EventHandler
33 WebTestRequest request1 = new WebTestRequest("http://msdn.microsoft.com/");
34 request1.ExpectedResponseUrl = "http://msdn.microsoft.com/en-us/default.aspx";
35 yield return request1;
36 request1 = null;
37
38
39 }
40
41 void WebTest3Coded_PostRequest(object sender, PostRequestEventArgs e)
42 {
43 //lets make sure that we have a valid HTML response before we start to work on the Response.HtmlDocument
44 if (e.Response.IsHtml)
45 {
46 //check a filtered list of html tags that are anchor tags
47 foreach (HtmlTag htmlTag in e.Response.HtmlDocument.GetFilteredHtmlTags(new string[] {"a"}))
48 {
49 //makes sure our htmlTag has some attributes, otherwise no need to continue
50 if (htmlTag.Attributes != null)
51 {
52 //loop through all the htmlTag.attributes to see if what we need is there
53 foreach (HtmlAttribute attributeTag in htmlTag.Attributes)
54 {
55 //lets make sure we dont have a bad htmlTag
56 if ( !string.IsNullOrEmpty(attributeTag.Name) )
57 {
58 //we are only concerned with href attributes , other checks could be done here
59 if (attributeTag.Name.Equals("href", StringComparison.InvariantCultureIgnoreCase))
60 {
61 //if the list has the url we dont need to add it again
62 if (! this.urlList.Contains(attributeTag.Value))
63 {
64 //add the url to our master list
65 this.urlList.Add(htmlTag.GetAttributeValueAsString("href"));
66 }
67
68 }
69 }
70 }
71 }
72 }
73 }
74 }
75 }
76 }
77
------------------------------------------------------------------------------
Thanks a lot :)
awais
-------
aq
Analysis on 1000 Vusers
Affuu - Posted on Tuesday, March 24, 2009 1:50:06 AM
I want to do an analysis by loading an application with 1000 users and the SUT,controller,agent are on the same system will I be able to do it,if yes I want to know what will be the Run time settings i need to do,I want to go for constant load of 1000 users,please help me by providing more information on this,I need to check out the CPU utilization,RPS,Memory utilization etc.What counters exactly i need to select so that I can come to a conclusion that how many agents i need to add if I increase the load from 1000 to 2000 to 3000....
What will be the best configuration i.e the number of agents,controller,SUT(its only one system) and SQL express(load store)
One more thing when I run the webtest before adding it to load few of the dependant requests are failing but the mail request page is displaying fine do i need to rectify/make it pass completely before adding to load or is it fine as long as the main requests are rendered successfully
please help me as I am new to VSTS 2008 tool
------------------------------------------------------------------------------------
Hi
For hardware sizing and the number of required agents, please refer to Performance Considerations section in Load Agent and Load Controller Installation and Configuration Guide for more information. In a test rig, you just need 1 controller.
There are many performance counter category available by default. You can use counters in Processor and Memory category to check the CPU and memory usage. If you are testing an ASP.NET application, Performance Counters for ASP.NET might also be helpful.
It's correct to fix web tests before adding them in load tests. About the failing of dependent requests, please take a look at Masking a 404 error in a dependent request. If you are in a different situation, could you give us more details?
-------------------------------------------------------------------------------------
Hi Aff,
you basically need more than 1 computer.. try to get such as 1 computer for Controller and a few PCs for Agents.. by putting agent and controller at the same computer, the result will not be accurate.
To load 1000 users for a simple system, that will be fine.
But, make sure you start at small number of users, and check the CPU load if it can handle such number of users.
YOu can check the CPU utilization and etc from the perfmon in ur server.
Run time setting is based on what is ur need. If you think all this 1000 users will be using the system for 1 hour flat, then set it as 1 hour.
Benny.
-------------------------------------------------------------------------------------
Hi Affu,
Let me clairfy one part of your question. Are you saying that your Application you want to test (the System Under Test) will also be on the same box as your Controller, Agent?
This would invalidate the testing given that you want to monitor the CPU utilization, Memory consumption, etc.
The controller, agents also require memory, cpu, etc. Also, if you are executing the load test in the local configuration, not using a controller, agent, then your test process will only use a Single CPU on the system, even if you have more. Thats why its important to size your Controller, Agent(s) correctly so you will not skew your results by overloading your client.
Hope this helps.
Robert
I want to do an analysis by loading an application with 1000 users and the SUT,controller,agent are on the same system will I be able to do it,if yes I want to know what will be the Run time settings i need to do,I want to go for constant load of 1000 users,please help me by providing more information on this,I need to check out the CPU utilization,RPS,Memory utilization etc.What counters exactly i need to select so that I can come to a conclusion that how many agents i need to add if I increase the load from 1000 to 2000 to 3000....
What will be the best configuration i.e the number of agents,controller,SUT(its only one system) and SQL express(load store)
One more thing when I run the webtest before adding it to load few of the dependant requests are failing but the mail request page is displaying fine do i need to rectify/make it pass completely before adding to load or is it fine as long as the main requests are rendered successfully
please help me as I am new to VSTS 2008 tool
------------------------------------------------------------------------------------
Hi
For hardware sizing and the number of required agents, please refer to Performance Considerations section in Load Agent and Load Controller Installation and Configuration Guide for more information. In a test rig, you just need 1 controller.
There are many performance counter category available by default. You can use counters in Processor and Memory category to check the CPU and memory usage. If you are testing an ASP.NET application, Performance Counters for ASP.NET might also be helpful.
It's correct to fix web tests before adding them in load tests. About the failing of dependent requests, please take a look at Masking a 404 error in a dependent request. If you are in a different situation, could you give us more details?
-------------------------------------------------------------------------------------
Hi Aff,
you basically need more than 1 computer.. try to get such as 1 computer for Controller and a few PCs for Agents.. by putting agent and controller at the same computer, the result will not be accurate.
To load 1000 users for a simple system, that will be fine.
But, make sure you start at small number of users, and check the CPU load if it can handle such number of users.
YOu can check the CPU utilization and etc from the perfmon in ur server.
Run time setting is based on what is ur need. If you think all this 1000 users will be using the system for 1 hour flat, then set it as 1 hour.
Benny.
-------------------------------------------------------------------------------------
Hi Affu,
Let me clairfy one part of your question. Are you saying that your Application you want to test (the System Under Test) will also be on the same box as your Controller, Agent?
This would invalidate the testing given that you want to monitor the CPU utilization, Memory consumption, etc.
The controller, agents also require memory, cpu, etc. Also, if you are executing the load test in the local configuration, not using a controller, agent, then your test process will only use a Single CPU on the system, even if you have more. Thats why its important to size your Controller, Agent(s) correctly so you will not skew your results by overloading your client.
Hope this helps.
Robert
Friday, March 20, 2009
Coded web test - How to Send an email after test run and after test success or fail
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=2724147&SiteID=1
Hi,
I want to send a successful email to a user through smtp server if test run success and on the other hand if web test fail, then i want to sent a failed email message to the user as notification.
I can send normal email from the coded scripts.
But I don't know how to retrieve web test run result status: pass or fail .........
I want to know the exact command or code as if I can able to send an email after the test run and after it's run success or fail
I very much appreciate your help. Noted that I am using VSTS 2005
Thanks,
Jaeed
-----------------------------------------------------------------------------------------
Answer Re: Coded web test - How to Send an email after test run and after test success or fail Was this post helpful ?
In VSTS 2008, in your coded web test, you can call this.Outcome.ToString(). In VSTS 2005, the property is not exposed.
Thanks.
------------------------------------------------------------------------------------------------
Re: Coded web test - How to Send an email after test run and after test success or fail
Thanks a lot Yutong. Jaeed
Hi,
I want to send a successful email to a user through smtp server if test run success and on the other hand if web test fail, then i want to sent a failed email message to the user as notification.
I can send normal email from the coded scripts.
But I don't know how to retrieve web test run result status: pass or fail .........
I want to know the exact command or code as if I can able to send an email after the test run and after it's run success or fail
I very much appreciate your help. Noted that I am using VSTS 2005
Thanks,
Jaeed
-----------------------------------------------------------------------------------------
Answer Re: Coded web test - How to Send an email after test run and after test success or fail Was this post helpful ?
In VSTS 2008, in your coded web test, you can call this.Outcome.ToString(). In VSTS 2005, the property is not exposed.
Thanks.
------------------------------------------------------------------------------------------------
Re: Coded web test - How to Send an email after test run and after test success or fail
Thanks a lot Yutong. Jaeed
How to add local text or tif or pdf files from local PC into the web test scripts
How to add local text or tif or pdf files from local PC into the web test scripts
Hello,
One of our site has a feature to upload document(text, tiff or pdf files) through its User Interface and after uploading the documents they get inserted into some database table and finally they show up to the UI.
I tried to record this by using VSTS 2008 beta/VSTS 2005 SP1 as a web test and it was not working.
I wonder - is there any alternative way or best way to make the script workable for uploading document(tiff file) from local location through the website by VSTS
Thanks,
------------------------------------------------------------------------------------------------
Answer Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
add the file to your test solution and add it to the deployment section of your test run configuration.
So far this is what we've had to do any time we had a test that uploads a file of any sort to the server
--Chuck
----------------------------------------------------------------------------------------------
Answer Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
You shouldn't have to add it to the solution, but Chuck is right, you need to add it to the deployment section of your testrunconfig
--Mike
-------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts
Thanks Chuck and Mike. It helped.
------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
Hi Chuck and Mike,Same scenario discussed by Jaeed but let me explain.I have a simple web page with uploading files (any txt, doc or pdf) from any location and after uploading all the files displayed to some UI. I record a web test and during the recording I have successfully upload the text file on my required application. So then according to ur solutions I then add the files to deployment area and then re-run my recorded test, The run successfully but non of the file present in deployment area is uploaded to the required applicaiton. Is there any thing which i missing.Your response in this regard will be highly appreciated.Regards,Waseem.
---------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
I presume you are still at the stage of getting the webtest working, and we are running in webtest mode, not loadtest mode.
So did your test generate any errors?
Open up the test results and walk through and examine the responses from the server for each step of the test.. did everything go as expected, or did you get some kind of error from the server.. (especially if you end up trying to do something like upload a file that already exists.. I'd expect some kind of different response from the server than if the file did not already exist (as in some kind of overwrite confirmation)
One thing to keep in mind with VSTS is that when page content is dynamic, if the right page URL is returned in response to the request, in the abscence of other validation checks VSTS will consider that request to be a success, NO MATTER what is actually on the page.
In that instance a very limited number of things could cause the action to fail:
unable to find a match for an extraction rule
total abscence of any hidden values if hidden values are being extracted from the page
404 error for some dependant resource
For example, if I'm doing something to update a user's credit card data on a commerce site.. after posting the data I might get back a page called updatecc.aspx.. On that page might be text to the effect of "Credit Card Updated" or "Invalid Credit Card" or "expiration date required" or some other error..
If I don't add a validation to that page to look for the success message, or to look for error messages and FAIL if they are found, then VSTS can't tell if the actual page content was correct, and the test will pass by default just because a page with the right URL came back.
--Chuck
----------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
Hi Chuck,I upload the files on my web application using the same recorded script by changing its some parameters. After recording the test I simply go on the step on which upload URL is present, I then change the file path of FileUploadParameter under the FromPostParameters from its properties and give the path of another file to which I want to upload and then re-run the test and I got success. But still confusing with the option which you told me for files uploading through 'Deployment' area under Test -> Edit Test Run Configurations -> Deployment .Could u plz tell me the steps by executing them I am able to upload the files through Test -> Edit Test Run Configurations -> Deployment option instead of changing the file path of FileUploadParameter .Regards,Waseem
-----------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
One of the MS folks might be able to explain this better (and will hopefully correct me if I have any of this wrong), but my general understanding is along these lines.
Webtests get run from more than a single machine.. They could be run by other people in your org (assuming they are checked into source control) and they can end up being run on Agent systems when run as part of a larger scale loadtests or on a dedicated workstation used for smaller scale loadtests.
So the deployment section of the test run configuration is a way to tell the system 'these are files I need to run this test' the items there might be datafiles used for databindings, or files being uploaded, or for some other purpose, but when the test runs it will need access to those files.
This is why (I believe) when a test records a file upload action, what is recorded in the test is only the filename, and not the full path. Because the system is going to expect to find that file in the deployment directory (which is created when the test runs), which is the only place it can reliably know the file will be able to be found. (after all, an agent machine, or a co-worker's system likely does not have access to your hard drive, and may not have access to the same network shares you do.)
So adding the files to the deployment list doesn't upload them anywhere, it's not an alternative to the file upload parameter.. it's a way to make sure whatever you spec in that parameter is available to the test no matter where the test is run.
One thing I'm not clear on is where the system looks for the file when it goes to deploy it. It seems the file needs to be in the same directory as your test. (which is why with my stuff being checked into source control and all, I've been adding the file to the solution.. I'm not sure if it's the 'best' way of dealing with it, but it's working for me so far.)
--Chuck
Hello,
One of our site has a feature to upload document(text, tiff or pdf files) through its User Interface and after uploading the documents they get inserted into some database table and finally they show up to the UI.
I tried to record this by using VSTS 2008 beta/VSTS 2005 SP1 as a web test and it was not working.
I wonder - is there any alternative way or best way to make the script workable for uploading document(tiff file) from local location through the website by VSTS
Thanks,
------------------------------------------------------------------------------------------------
Answer Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
add the file to your test solution and add it to the deployment section of your test run configuration.
So far this is what we've had to do any time we had a test that uploads a file of any sort to the server
--Chuck
----------------------------------------------------------------------------------------------
Answer Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
You shouldn't have to add it to the solution, but Chuck is right, you need to add it to the deployment section of your testrunconfig
--Mike
-------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts
Thanks Chuck and Mike. It helped.
------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
Hi Chuck and Mike,Same scenario discussed by Jaeed but let me explain.I have a simple web page with uploading files (any txt, doc or pdf) from any location and after uploading all the files displayed to some UI. I record a web test and during the recording I have successfully upload the text file on my required application. So then according to ur solutions I then add the files to deployment area and then re-run my recorded test, The run successfully but non of the file present in deployment area is uploaded to the required applicaiton. Is there any thing which i missing.Your response in this regard will be highly appreciated.Regards,Waseem.
---------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
I presume you are still at the stage of getting the webtest working, and we are running in webtest mode, not loadtest mode.
So did your test generate any errors?
Open up the test results and walk through and examine the responses from the server for each step of the test.. did everything go as expected, or did you get some kind of error from the server.. (especially if you end up trying to do something like upload a file that already exists.. I'd expect some kind of different response from the server than if the file did not already exist (as in some kind of overwrite confirmation)
One thing to keep in mind with VSTS is that when page content is dynamic, if the right page URL is returned in response to the request, in the abscence of other validation checks VSTS will consider that request to be a success, NO MATTER what is actually on the page.
In that instance a very limited number of things could cause the action to fail:
unable to find a match for an extraction rule
total abscence of any hidden values if hidden values are being extracted from the page
404 error for some dependant resource
For example, if I'm doing something to update a user's credit card data on a commerce site.. after posting the data I might get back a page called updatecc.aspx.. On that page might be text to the effect of "Credit Card Updated" or "Invalid Credit Card" or "expiration date required" or some other error..
If I don't add a validation to that page to look for the success message, or to look for error messages and FAIL if they are found, then VSTS can't tell if the actual page content was correct, and the test will pass by default just because a page with the right URL came back.
--Chuck
----------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
Hi Chuck,I upload the files on my web application using the same recorded script by changing its some parameters. After recording the test I simply go on the step on which upload URL is present, I then change the file path of FileUploadParameter under the FromPostParameters from its properties and give the path of another file to which I want to upload and then re-run the test and I got success. But still confusing with the option which you told me for files uploading through 'Deployment' area under Test -> Edit Test Run Configurations -> Deployment .Could u plz tell me the steps by executing them I am able to upload the files through Test -> Edit Test Run Configurations -> Deployment option instead of changing the file path of FileUploadParameter .Regards,Waseem
-----------------------------------------------------------------------------------------------
Re: How to add local text or tif or pdf files from local PC into the web test scripts Was this post helpful ?
One of the MS folks might be able to explain this better (and will hopefully correct me if I have any of this wrong), but my general understanding is along these lines.
Webtests get run from more than a single machine.. They could be run by other people in your org (assuming they are checked into source control) and they can end up being run on Agent systems when run as part of a larger scale loadtests or on a dedicated workstation used for smaller scale loadtests.
So the deployment section of the test run configuration is a way to tell the system 'these are files I need to run this test' the items there might be datafiles used for databindings, or files being uploaded, or for some other purpose, but when the test runs it will need access to those files.
This is why (I believe) when a test records a file upload action, what is recorded in the test is only the filename, and not the full path. Because the system is going to expect to find that file in the deployment directory (which is created when the test runs), which is the only place it can reliably know the file will be able to be found. (after all, an agent machine, or a co-worker's system likely does not have access to your hard drive, and may not have access to the same network shares you do.)
So adding the files to the deployment list doesn't upload them anywhere, it's not an alternative to the file upload parameter.. it's a way to make sure whatever you spec in that parameter is available to the test no matter where the test is run.
One thing I'm not clear on is where the system looks for the file when it goes to deploy it. It seems the file needs to be in the same directory as your test. (which is why with my stuff being checked into source control and all, I've been adding the file to the solution.. I'm not sure if it's the 'best' way of dealing with it, but it's working for me so far.)
--Chuck
Is it possible to add console application to the webtest
Is it possible to add console application to the webtest
I wanna give some user input from the console and web test will take this input as a variable and process this variable like console program.
Is it possible???
Thanks
Jaeed
-------------------------------------------------------------------------------------------------
Re: Is it possible to add console application to the webtest Was this post helpful ?
if it was possible, I think it would break things when you went to run the webtest as part of a loadtest with multiple users. And how should the test measure the test time, etc for the test when it spends time waiting on your user input?
Does the input really need to be from the console? or could it be via a datasource such as a file? that would be fairly easy to implement.. but taking console input poses all sorts of problems as far as I could predict..
--Chuck
Re: Is it possible to add console application to the webtest
Thanks
---------------------------------------------------------------------------------------------------------------
Re: Is it possible to add console application to the webtest Was this post helpful ?
I haven't attempted to use this in a loadtest (and don't expect to) but look at:
http://www.mdibb.net/net/using_the_visual_basic_input_box_in_c/
------------------------------------------------------------------------------------------------
Using the Visual Basic Input Box in C#In all versions of Visual Basic as far back as I can remember, there has been the venerable InputBox function which has been great for quickly getting an input from the user. VB.NET has it too, but C# doesn't, and it is sorely missed.
However, there is a simple solution. We can simply "borrow" the InputBox from VB.NET, by adding a reference to the required assemblies. To do this in Visual Studio, follow the steps below
In the Solution Explorer, right click on the "References" folder and select "Add Reference..."
In the ".NET" tab, scroll down and select the "Microsoft.VisualBasic" entry, then click "Ok". If you've done that ok then you should now see the reference added to the References folder. Interestingly, in .NET we can specify the location of the InputBox on screen, which I don't think you could do in the old VB days. Anyway, to use it in your code you could use code based on this example: String Prompt = "Please enter your name"; String Title = "Input Required"; String Default = "Bob"; Int32 XPos = ((SystemInformation.WorkingArea.Width/2)-200); Int32 YPos = ((SystemInformation.WorkingArea.Height/2)-100); String Result = Microsoft.VisualBasic.Interaction.InputBox(Prompt,Title,Default,XPos,YPos) if(Result != "") { MessageBox.Show("Hello " + Result); } else { MessageBox.Show("Hello whoever you are..."); } Here we are just asking for a user's name (with a default of "Bob") using a (roughly) centred InputBox, and then just saying hello with a standard message box. Unfortunately, along with inheriting the InputBox itself, .NET has also inherited its String return type - you wont find a nice object encapsulating the response like we get with the DialogResult. Because of this we need to check the string returned - if the user cancels the dialog, the string will be zero-length, otherwise it will be whatever the user typed into the input box. Note here that I've used the full name for the InputBox function. There is nothing to stop you sticking using Microsoft.VisualBasic; at the top of your class to avoid having to type out the full thing each time. Nothing special is required for compilation or distribution if you use this. I hope you find this useful - it has saved me a fair bit of time and effort when all you need is some simple text input and dont need a dedicated form.
Back 22.07.2006.
Thanks for the info, I have been looking for this for months :)
" src="http://www.mdibb.net/images/commentname.gif"> Function " src="http://www.mdibb.net/images/arrow.gif" width=2> 05.10.2006
Thank you so much!
" src="http://www.mdibb.net/images/commentname.gif"> Pie-Pacifique " src="http://www.mdibb.net/images/arrow.gif" width=2> 01.02.2007
Its a very good article, that helped me a lot
" src="http://www.mdibb.net/images/commentname.gif"> Anand " src="http://www.mdibb.net/images/arrow.gif" width=2> 27.04.2007
Thanks a lot. It was very useful.
" src="http://www.mdibb.net/images/commentname.gif"> Ponnusamy G " src="http://www.mdibb.net/images/arrow.gif" width=2> 07.06.2007
I wanna give some user input from the console and web test will take this input as a variable and process this variable like console program.
Is it possible???
Thanks
Jaeed
-------------------------------------------------------------------------------------------------
Re: Is it possible to add console application to the webtest Was this post helpful ?
if it was possible, I think it would break things when you went to run the webtest as part of a loadtest with multiple users. And how should the test measure the test time, etc for the test when it spends time waiting on your user input?
Does the input really need to be from the console? or could it be via a datasource such as a file? that would be fairly easy to implement.. but taking console input poses all sorts of problems as far as I could predict..
--Chuck
Re: Is it possible to add console application to the webtest
Thanks
---------------------------------------------------------------------------------------------------------------
Re: Is it possible to add console application to the webtest Was this post helpful ?
I haven't attempted to use this in a loadtest (and don't expect to) but look at:
http://www.mdibb.net/net/using_the_visual_basic_input_box_in_c/
------------------------------------------------------------------------------------------------
Using the Visual Basic Input Box in C#In all versions of Visual Basic as far back as I can remember, there has been the venerable InputBox function which has been great for quickly getting an input from the user. VB.NET has it too, but C# doesn't, and it is sorely missed.
However, there is a simple solution. We can simply "borrow" the InputBox from VB.NET, by adding a reference to the required assemblies. To do this in Visual Studio, follow the steps below
In the Solution Explorer, right click on the "References" folder and select "Add Reference..."
In the ".NET" tab, scroll down and select the "Microsoft.VisualBasic" entry, then click "Ok". If you've done that ok then you should now see the reference added to the References folder. Interestingly, in .NET we can specify the location of the InputBox on screen, which I don't think you could do in the old VB days. Anyway, to use it in your code you could use code based on this example: String Prompt = "Please enter your name"; String Title = "Input Required"; String Default = "Bob"; Int32 XPos = ((SystemInformation.WorkingArea.Width/2)-200); Int32 YPos = ((SystemInformation.WorkingArea.Height/2)-100); String Result = Microsoft.VisualBasic.Interaction.InputBox(Prompt,Title,Default,XPos,YPos) if(Result != "") { MessageBox.Show("Hello " + Result); } else { MessageBox.Show("Hello whoever you are..."); } Here we are just asking for a user's name (with a default of "Bob") using a (roughly) centred InputBox, and then just saying hello with a standard message box. Unfortunately, along with inheriting the InputBox itself, .NET has also inherited its String return type - you wont find a nice object encapsulating the response like we get with the DialogResult. Because of this we need to check the string returned - if the user cancels the dialog, the string will be zero-length, otherwise it will be whatever the user typed into the input box. Note here that I've used the full name for the InputBox function. There is nothing to stop you sticking using Microsoft.VisualBasic; at the top of your class to avoid having to type out the full thing each time. Nothing special is required for compilation or distribution if you use this. I hope you find this useful - it has saved me a fair bit of time and effort when all you need is some simple text input and dont need a dedicated form.
Back 22.07.2006.
Thanks for the info, I have been looking for this for months :)
" src="http://www.mdibb.net/images/commentname.gif"> Function " src="http://www.mdibb.net/images/arrow.gif" width=2> 05.10.2006
Thank you so much!
" src="http://www.mdibb.net/images/commentname.gif"> Pie-Pacifique " src="http://www.mdibb.net/images/arrow.gif" width=2> 01.02.2007
Its a very good article, that helped me a lot
" src="http://www.mdibb.net/images/commentname.gif"> Anand " src="http://www.mdibb.net/images/arrow.gif" width=2> 27.04.2007
Thanks a lot. It was very useful.
" src="http://www.mdibb.net/images/commentname.gif"> Ponnusamy G " src="http://www.mdibb.net/images/arrow.gif" width=2> 07.06.2007
Re: Question about the number of total tests in load testing
Question about the number of total tests in load testing Was this post helpful ?
Hi All,
I'm currently working on a load testing of reading one piece of property of a certain piece of equipment. What I'm confused about right now is, no matter how big user load I apply with, the number of passed tests increases to 198 and then stops increasing. The %processor time and %user time goes down to less than 1% immediately when the number of passed tests reaches 198. It's approximately happening around 3mins after the test starts to run, varing a bit depending on the number of users.
After the "198" issue occurs, everything else goes fine until the test finishes. (I set the run duration as 10 mins) So there is no fail tests, there is no other strange signs, but the passed tests number just equals to the total tests number which is 198.
It seems like 198 is a limit or something like that, but i didn't set any threshold to 198 though. Is there anyone who has an idea what it's going on here? Any help is greatly appreciated. Thanks!
Jane
26 Sep 2007, 12:15 AM UTC
Dennis Stone - MSFT
Moderator Posts 361
Re: Question about the number of total tests in load testing Was this post helpful ?
What kind of tests does your loadtest contain (web, unit, both)? Are you using any data sources in those tests, if so what kind of access method do you have specified.
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=1177487&SiteID=1
26 Sep 2007, 1:39 AM UTC
Jaeed Posts 11
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi Jane,
You probably use unique access method for data source binding and that is why you cannot cross 198. Use Other data access method.
In my test, I observed the same situation, but I have overcome that and I got passed thousands of tests.
I think it would help you.
Thanks,
Abdur
26 Sep 2007, 4:12 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hello Abdur,
Thank you for your reply. I just don't quite understand what the "unique access method for data source binding" means...I do use a unique database to store the properties and equipment which are going to be read from. Do you mean the access to database or to a piece of property is unique??
Hope i can get more details. Thanks a lot!!
Jane
26 Sep 2007, 4:20 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi,
My loadtest contains unit tests. In my tests, I created 5 pieces of equipment in the database and then created one property for each of these 5 equipment in a different table but the same database. The test method called "ReadPropertyTest" is going to read properties of equipment one for each read. And the user can only read 1 time each test. This is the basic idea that my test does.
So I don't know how to answer your question...I'm not sure what data sources i'm using and what kinda access method I've specified. Where should i check it out from??
Thanks !!
Jane
26 Sep 2007, 4:29 PM UTC
Michael Taute - MSFT
Moderator Posts 166
Re: Question about the number of total tests in load testing Was this post helpful ?
There are three different methods of accessing the data in a bound datasource. Sequential, random, and unique.
What she's saying is if you have your access method set to unique, one iteration of the test will run for each entry in your database and then it will stop. Ideally in this case though it would bubble up an out of data error and abort the test though.
It's easy enough to check... just highlight the datasource table you're binding to and view its properties.
26 Sep 2007, 5:23 PM UTC
Jaeed Posts 11
Re: Question about the number of total tests in load testing Was this post helpful ?
Jane,
Sorry I was in outside. And you got already answer from Michael.
Thanks Micheal for helping jane while I was not here.
Jaeed
28 Sep 2007, 7:23 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi Michael,
Sorry for the delay in getting back to you. I was moved over to another issue and now i'm back. Regarding to what you've indicated here, I observed my test. In the unit test's property based on which I built up my load test, I noticed that the Data Access Method item is always sequential. And the other choice is Random, no option for unique. So I believe I've been using Sequential data access method all the time, if it is the same data access method as you were talking about.
I doubt i understood correctly because I thought I should check the data table in SQL server database, in which i stored my test data into. I checked actually, but i didn't find a data table's property called Data Access Method. You know what I mean? More specifically, my test is used to add more pieces of equipment or properties to an hierarchy of equipment model, I store all these equipment/property data in a database of SQL server on local host. Do you think I should check the data access method of this table or unit test of visual studio?
No matter which one is the thing you referred to, I didn't see anything set to Unique. Unless SQL server database use Unique data access method by default??
What am i going to do next?? Frustrated....
28 Sep 2007, 7:24 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi Jaeed,
Thank you for your concern. That's totally fine. The issue is I still stucked on this thing...I guess i need more help.
Thanks;
Jane
28 Sep 2007, 7:52 PM UTC
Bill Barnett - MSFT
Moderator Posts 372
Answer Re: Question about the number of total tests in load testing Was this post helpful ?
I'll try to help. First of all, some of the earlier responses were asking about your data binding settings, but it's not clear to me from your responses wether or not your unit tests even use the VSTS data binding feature. In other words, do your unit test methods use data source attributes like the example shown in the docs here: http://msdn2.microsoft.com/en-us/library/ms182527(VS.90).aspx?
If not, then your problem has nothing to do with the VSTS data binding feature.
Do your unit tests do any other database access, or do something like invoke a Web service that access a database?
One possibility is that for some reason the 199th unit test gets stuck and never completes. Do you think that is a possibility? Can you describe what the unit test does? Does it send a request to a server and wait for a response? You could add some code to your unit tests to log to a file upon entering and leaving your unit test method which would help determine if the unit test itself is getting hung.
Bill
Hi All,
I'm currently working on a load testing of reading one piece of property of a certain piece of equipment. What I'm confused about right now is, no matter how big user load I apply with, the number of passed tests increases to 198 and then stops increasing. The %processor time and %user time goes down to less than 1% immediately when the number of passed tests reaches 198. It's approximately happening around 3mins after the test starts to run, varing a bit depending on the number of users.
After the "198" issue occurs, everything else goes fine until the test finishes. (I set the run duration as 10 mins) So there is no fail tests, there is no other strange signs, but the passed tests number just equals to the total tests number which is 198.
It seems like 198 is a limit or something like that, but i didn't set any threshold to 198 though. Is there anyone who has an idea what it's going on here? Any help is greatly appreciated. Thanks!
Jane
26 Sep 2007, 12:15 AM UTC
Dennis Stone - MSFT
Moderator Posts 361
Re: Question about the number of total tests in load testing Was this post helpful ?
What kind of tests does your loadtest contain (web, unit, both)? Are you using any data sources in those tests, if so what kind of access method do you have specified.
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=1177487&SiteID=1
26 Sep 2007, 1:39 AM UTC
Jaeed Posts 11
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi Jane,
You probably use unique access method for data source binding and that is why you cannot cross 198. Use Other data access method.
In my test, I observed the same situation, but I have overcome that and I got passed thousands of tests.
I think it would help you.
Thanks,
Abdur
26 Sep 2007, 4:12 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hello Abdur,
Thank you for your reply. I just don't quite understand what the "unique access method for data source binding" means...I do use a unique database to store the properties and equipment which are going to be read from. Do you mean the access to database or to a piece of property is unique??
Hope i can get more details. Thanks a lot!!
Jane
26 Sep 2007, 4:20 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi,
My loadtest contains unit tests. In my tests, I created 5 pieces of equipment in the database and then created one property for each of these 5 equipment in a different table but the same database. The test method called "ReadPropertyTest" is going to read properties of equipment one for each read. And the user can only read 1 time each test. This is the basic idea that my test does.
So I don't know how to answer your question...I'm not sure what data sources i'm using and what kinda access method I've specified. Where should i check it out from??
Thanks !!
Jane
26 Sep 2007, 4:29 PM UTC
Michael Taute - MSFT
Moderator Posts 166
Re: Question about the number of total tests in load testing Was this post helpful ?
There are three different methods of accessing the data in a bound datasource. Sequential, random, and unique.
What she's saying is if you have your access method set to unique, one iteration of the test will run for each entry in your database and then it will stop. Ideally in this case though it would bubble up an out of data error and abort the test though.
It's easy enough to check... just highlight the datasource table you're binding to and view its properties.
26 Sep 2007, 5:23 PM UTC
Jaeed Posts 11
Re: Question about the number of total tests in load testing Was this post helpful ?
Jane,
Sorry I was in outside. And you got already answer from Michael.
Thanks Micheal for helping jane while I was not here.
Jaeed
28 Sep 2007, 7:23 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi Michael,
Sorry for the delay in getting back to you. I was moved over to another issue and now i'm back. Regarding to what you've indicated here, I observed my test. In the unit test's property based on which I built up my load test, I noticed that the Data Access Method item is always sequential. And the other choice is Random, no option for unique. So I believe I've been using Sequential data access method all the time, if it is the same data access method as you were talking about.
I doubt i understood correctly because I thought I should check the data table in SQL server database, in which i stored my test data into. I checked actually, but i didn't find a data table's property called Data Access Method. You know what I mean? More specifically, my test is used to add more pieces of equipment or properties to an hierarchy of equipment model, I store all these equipment/property data in a database of SQL server on local host. Do you think I should check the data access method of this table or unit test of visual studio?
No matter which one is the thing you referred to, I didn't see anything set to Unique. Unless SQL server database use Unique data access method by default??
What am i going to do next?? Frustrated....
28 Sep 2007, 7:24 PM UTC
JaneQQ Posts 13
Re: Question about the number of total tests in load testing Was this post helpful ?
Hi Jaeed,
Thank you for your concern. That's totally fine. The issue is I still stucked on this thing...I guess i need more help.
Thanks;
Jane
28 Sep 2007, 7:52 PM UTC
Bill Barnett - MSFT
Moderator Posts 372
Answer Re: Question about the number of total tests in load testing Was this post helpful ?
I'll try to help. First of all, some of the earlier responses were asking about your data binding settings, but it's not clear to me from your responses wether or not your unit tests even use the VSTS data binding feature. In other words, do your unit test methods use data source attributes like the example shown in the docs here: http://msdn2.microsoft.com/en-us/library/ms182527(VS.90).aspx?
If not, then your problem has nothing to do with the VSTS data binding feature.
Do your unit tests do any other database access, or do something like invoke a Web service that access a database?
One possibility is that for some reason the 199th unit test gets stuck and never completes. Do you think that is a possibility? Can you describe what the unit test does? Does it send a request to a server and wait for a response? You could add some code to your unit tests to log to a file upon entering and leaving your unit test method which would help determine if the unit test itself is getting hung.
Bill
VSTS 2008 Beta2 close and restart automatically
VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Hi,
I ran a lot of load test by using VSTS 2008 Beta 2 version and I found that this is awsome and is going to beat the Mercury Loadrunner/QTP very soon.
But I notice that VS for tester 2008 beta 2 gets close and restart automatically when I tried to debug and ran some test though this behaviors are not always. It does this once in a while specially when it finds someting unusual I think.
I think it should through error message instead of closing down the VS and restart automatically.
You can share your thought about this and I appreciate that a lot.
Thanks.
-- Jaeed
-------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Hi Jaeed, glad to hear you like the product, but sorry to hear you're having some trouble with it shutting down unexpectedly.
If you are able to get a set of steps that can reproduce the crash consistently it would greatly help us to track down and fix the issue you're seeing.
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=1177487&SiteID=1
------------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
I ran a web test and from web test viewer I closed a pop up window that was came from test scripts(recording script was captured and it had some javascripts window). I wish I can give u the screen shot, but this editor doesn't have attachment capability.
but FYI,
message was : Microsoft Visual Studio has encountered a problem and needs to close... window came up and if i clik on Don't Send error report button, the VS got shut down.
I think this will help you.
Thanks.
-------------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Please send us the screen shot: slumley at domain microsoft.com
Blog - http://blogs.msdn.com/slumley/default.aspx
----------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Please check your email and find out the screen shots and I have reported to by clicking on send report button.
Thanks
--------------------------------------------------------------------------------------------------
Answer Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
I hope you resolved this offline with Sean. Please upgrade to RTM, if the problem persists contact support.
Thanks,
Ed.
Ed Glas [MSFT]
Hi,
I ran a lot of load test by using VSTS 2008 Beta 2 version and I found that this is awsome and is going to beat the Mercury Loadrunner/QTP very soon.
But I notice that VS for tester 2008 beta 2 gets close and restart automatically when I tried to debug and ran some test though this behaviors are not always. It does this once in a while specially when it finds someting unusual I think.
I think it should through error message instead of closing down the VS and restart automatically.
You can share your thought about this and I appreciate that a lot.
Thanks.
-- Jaeed
-------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Hi Jaeed, glad to hear you like the product, but sorry to hear you're having some trouble with it shutting down unexpectedly.
If you are able to get a set of steps that can reproduce the crash consistently it would greatly help us to track down and fix the issue you're seeing.
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=1177487&SiteID=1
------------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
I ran a web test and from web test viewer I closed a pop up window that was came from test scripts(recording script was captured and it had some javascripts window). I wish I can give u the screen shot, but this editor doesn't have attachment capability.
but FYI,
message was : Microsoft Visual Studio has encountered a problem and needs to close... window came up and if i clik on Don't Send error report button, the VS got shut down.
I think this will help you.
Thanks.
-------------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Please send us the screen shot: slumley at domain microsoft.com
Blog - http://blogs.msdn.com/slumley/default.aspx
----------------------------------------------------------------------------------------------
Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
Please check your email and find out the screen shots and I have reported to by clicking on send report button.
Thanks
--------------------------------------------------------------------------------------------------
Answer Re: VSTS 2008 Beta2 close and restart automatically Was this post helpful ?
I hope you resolved this offline with Sean. Please upgrade to RTM, if the problem persists contact support.
Thanks,
Ed.
Ed Glas [MSFT]
What is the relationship between vusers and threads?
What is the relationship between vusers and threads? Was this post helpful ?
What is the relationship between vusers and threads? If set Constant User Count = 1000, is that means the constant 1000 vuser running during the test?
----------------------------------------------------------------------------------------------
Re: What is the relationship between vusers and threads? Was this post helpful ?
That is correct.
If you set a constant user count of 1000 you will see 1000 concurrent scenarios running at any given point during your load test.
----------------------------------------------------------------------------------------------
Re: What is the relationship between vusers and threads? Was this post helpful ?
Thanks for the quick reply!
So can we simply understand as 1 vuser = 1 thread ?
---------------------------------------------------------------------------------------------
Answer Re: What is the relationship between vusers and threads? Was this post helpful ?
The only relationship I know of is that vusers take threads to run on agents, and will likely generate threads on the system under test.. depending on what the tests are doing I suspect that a single vuser might generate more than one thread on the agent system that is running the user. How many threads get spawned to deal with the load generated by the vuser will again depend on what kind of requests the vuser is making, and the software running on the SUT.
Vuser is a Virtual user. the number of vusers you utilize is basically controlling how many webtests or unit tests will run in parallel in a loadtest scenario. How that equates to real users depends on factors like what actions the tests are doing, time between tests, and think times.
the number of vusers you use also controls the maximum simultanious (or nearly so due to travelling over a network) requests that can be generated at the same time against your SUT.
low think times and little to no time betweeen test iterations allows a single vuser to simulate the requests/time load of many real users. This is a good technique for something like a perfomance test, or measuring performance deltas due to code/hardware changes, where you want a consistent repeatable test.
a larger number of vusers, using realistic randomized think times, and longer times between test iterations could generate the same load in terms of transactions/hour as the no-think test, however the load would less constant, with a higher number of potential simultanious requests. This type of config is good for a more realistic classic 'load test' where you want ebb and flow in the level of requests at any one instant and it's not as important the test be repeatable
--Chuck
------------------------------------------------------------------------------------------------
Answer Re: What is the relationship between vusers and threads? Was this post helpful ?
"Threads" are a confusing term which is why we try not to use it.
A better way to think of it is:
1 Concurrent user = 1 user at a machine running through the scenario(s) you have defined.
So 1000 concurrent users = 1000 of those scenarios running at the same time.
What is the relationship between vusers and threads? If set Constant User Count = 1000, is that means the constant 1000 vuser running during the test?
----------------------------------------------------------------------------------------------
Re: What is the relationship between vusers and threads? Was this post helpful ?
That is correct.
If you set a constant user count of 1000 you will see 1000 concurrent scenarios running at any given point during your load test.
----------------------------------------------------------------------------------------------
Re: What is the relationship between vusers and threads? Was this post helpful ?
Thanks for the quick reply!
So can we simply understand as 1 vuser = 1 thread ?
---------------------------------------------------------------------------------------------
Answer Re: What is the relationship between vusers and threads? Was this post helpful ?
The only relationship I know of is that vusers take threads to run on agents, and will likely generate threads on the system under test.. depending on what the tests are doing I suspect that a single vuser might generate more than one thread on the agent system that is running the user. How many threads get spawned to deal with the load generated by the vuser will again depend on what kind of requests the vuser is making, and the software running on the SUT.
Vuser is a Virtual user. the number of vusers you utilize is basically controlling how many webtests or unit tests will run in parallel in a loadtest scenario. How that equates to real users depends on factors like what actions the tests are doing, time between tests, and think times.
the number of vusers you use also controls the maximum simultanious (or nearly so due to travelling over a network) requests that can be generated at the same time against your SUT.
low think times and little to no time betweeen test iterations allows a single vuser to simulate the requests/time load of many real users. This is a good technique for something like a perfomance test, or measuring performance deltas due to code/hardware changes, where you want a consistent repeatable test.
a larger number of vusers, using realistic randomized think times, and longer times between test iterations could generate the same load in terms of transactions/hour as the no-think test, however the load would less constant, with a higher number of potential simultanious requests. This type of config is good for a more realistic classic 'load test' where you want ebb and flow in the level of requests at any one instant and it's not as important the test be repeatable
--Chuck
------------------------------------------------------------------------------------------------
Answer Re: What is the relationship between vusers and threads? Was this post helpful ?
"Threads" are a confusing term which is why we try not to use it.
A better way to think of it is:
1 Concurrent user = 1 user at a machine running through the scenario(s) you have defined.
So 1000 concurrent users = 1000 of those scenarios running at the same time.
VSTS-response time measurement accuracy?
response time measurement accuracy? Was this post helpful ?
results are quite different when benchmark between vsts2005 loadtest and loadrunner, wonder what exactlyvsts and how it measured? and if there are benchmark whitpaper from Microsoft or somewhere? Thanks!
performance and capacity
------------------------------------------------------------------------------------------------
Answer Re: response time measurement accuracy? Was this post helpful ?
In the VSTS results, are you looking at "Avg. Response Time" for requests, or "Avg. Page Time"? Are the values greater or less than the response times reported by LoadRunner?
An important thing to understand in the VSTS load test results is the difference between “Avg. Response Time” for requests and “Avg. Page Time” for pages.
Consider a web page (home.aspx) that contains 10 images. When a Web test that contains a request to home.aspx runs, there will be 11 HTTP requests sent (1 for home.aspx and 1 for each of the 10 images) just as there would be with a browswer (ignoring caching for simplicity). The round trip times for receive each of these 11 individual requests is recorded. The averages for each URL are shown in the "Requests" table in the load test results (and can also be added to the graphs). The average request response time across all URLs is reported in the performance counter "Avg. Response Time" with the instance name "_Total" which is included in the default graph created by VSTS.
However, you may be more interested in the "Avg. Page Time". The page time is the time measured from the time a page request is sent until all bytes for the page and all of the dependent requests (for images and such) are received.
So, going back to the example, if the HTTP response to the request to get home.aspx takes 3.4 seconds and the time to get the 10 embedded images is 0.1 seconds each, the load test results would show:
In the Requests table: Request Response Time home.aspx 3.4 image1.gif 0.1 image2.gif 0.1 etc.
In the Pages table: Page Page Time home.aspx 4.4
On the default graph: Counter Instance Category Avg Avg. Response Time _Total LoadTest:Request 0.4
If you add Page Time to the graph: Avg. Page Time _Total LoadTestage 4.4
The Avg. Response Time for requests is much lower than the Avg. Page Time because there are many fast requests to images.
Other recommended reading:
"Monitoring and Analyzing a Load Test Result": http://msdn2.microsoft.com/en-us/library/aa730850(vs.80).aspx
"Advanced Load Testing Features of Visual Studio Team System": http://msdn2.microsoft.com/en-us/teamsystem/aa718897.aspx
-------------------------------------------------------------------------------------------------
Re: response time measurement accuracy? Was this post helpful ?
Thank you very much Bill!I think if I put BeginTransaction() and EndTransaction(), it will be no confusing.
performance and capacity
results are quite different when benchmark between vsts2005 loadtest and loadrunner, wonder what exactlyvsts and how it measured? and if there are benchmark whitpaper from Microsoft or somewhere? Thanks!
performance and capacity
------------------------------------------------------------------------------------------------
Answer Re: response time measurement accuracy? Was this post helpful ?
In the VSTS results, are you looking at "Avg. Response Time" for requests, or "Avg. Page Time"? Are the values greater or less than the response times reported by LoadRunner?
An important thing to understand in the VSTS load test results is the difference between “Avg. Response Time” for requests and “Avg. Page Time” for pages.
Consider a web page (home.aspx) that contains 10 images. When a Web test that contains a request to home.aspx runs, there will be 11 HTTP requests sent (1 for home.aspx and 1 for each of the 10 images) just as there would be with a browswer (ignoring caching for simplicity). The round trip times for receive each of these 11 individual requests is recorded. The averages for each URL are shown in the "Requests" table in the load test results (and can also be added to the graphs). The average request response time across all URLs is reported in the performance counter "Avg. Response Time" with the instance name "_Total" which is included in the default graph created by VSTS.
However, you may be more interested in the "Avg. Page Time". The page time is the time measured from the time a page request is sent until all bytes for the page and all of the dependent requests (for images and such) are received.
So, going back to the example, if the HTTP response to the request to get home.aspx takes 3.4 seconds and the time to get the 10 embedded images is 0.1 seconds each, the load test results would show:
In the Requests table: Request Response Time home.aspx 3.4 image1.gif 0.1 image2.gif 0.1 etc.
In the Pages table: Page Page Time home.aspx 4.4
On the default graph: Counter Instance Category Avg Avg. Response Time _Total LoadTest:Request 0.4
If you add Page Time to the graph: Avg. Page Time _Total LoadTestage 4.4
The Avg. Response Time for requests is much lower than the Avg. Page Time because there are many fast requests to images.
Other recommended reading:
"Monitoring and Analyzing a Load Test Result": http://msdn2.microsoft.com/en-us/library/aa730850(vs.80).aspx
"Advanced Load Testing Features of Visual Studio Team System": http://msdn2.microsoft.com/en-us/teamsystem/aa718897.aspx
-------------------------------------------------------------------------------------------------
Re: response time measurement accuracy? Was this post helpful ?
Thank you very much Bill!I think if I put BeginTransaction() and EndTransaction(), it will be no confusing.
performance and capacity
Subscribe to:
Comments (Atom)
Unix/Linux Commands
Flow control Syntax break Exit a loop. continue Exit the current iteration of the loop and proceed with the next iteration. Ctrl+C Key com...
-
%systemroot%\system32\inetsrv\config\applicationHost.config https://docs.microsoft.com/en-us/iis/configuration/system.applicationhos...
-
hi everybody, i am doing load test for 10 users,20users,30users working fine upto to this point if increase to 40 users iam getting error a...
