Automation Framework

http://testingideas.wordpress.com/2008/08/12/what-is-a-framework-in-automation/
http://www.ibm.com/developerworks/rational/library/591.html
http://safsdev.sourceforge.net/FRAMESDataDrivenTestAutomationFrameworks.htm
http://www.io.com/~wazmo/papers/seven_steps.html

[agile-testing] Good Test Case Management Tools?

Hi David:
Jay Philips wrote a good round-up of open source test management tools at:
http://www.jayphilips.com/2009/09/10/15-open-source-test-management-tools/
Testlink is on that list.
I am very impressed with Zephyr (http://www.zephyr.com), Collabnet TeamForge (http://www.collab.net/products/ctf/) and we use Jira (http://www.atlassian.com/software/jira/) for bug tracking and release management.
When you begin to look for tools, methodologies, and support to move from manual testing to automated testing, please take a look at PushToTest TestMaker. Details are at http://www.pushtotest.com/webapptesting
-Frank
On Aug 30, 2010, at 9:34 AM, Jairo Ernesto Gutierrez Pizarro wrote:
Hi David

I've Been working with testlink for more than one year, and based on my experience using this tool i think is a pretty good option. Also it's free and completely customizable.



--- El lun, 8/30/10, david.murdoch0 escribió:

De: david.murdoch0
Asunto: [agile-testing] Good Test Case Management Tools?
A: agile-testing@yahoogroups.com
Fecha: lunes, 30 de agosto de 2010, 10:18 am
Hi there,

Can anyone recommend a good Test Case Management Tool?

We are largely doing Manual testing which focuses on Functional and Exploratory testing. Ideally the tool would be open-source too but this is not an absolute requirement.

Many thanks,

David.

Compare Load Runner and HP Service Test: Features Comparison

Hi Rupesh,

Both tool has its own advantage and disadvantage...

HP Service test is a automated functional testing tool for SOA
application and to check the performance of the application you need
buy HP LoadRunner with web service protocol.

For more info see the link

http://forums11.itrc.hp.com/service/forums/questionanswer.do?admit=109447626+1282842482309+28353475&threadId=1320756

Coming to iTKO LISA - SOA testing tool, we can test both functional
and performance of the application in one tool.

It is better to do a small and quick POC on both the tools and see,
which one is comfortable for your company/ customer or for your
testers while testing the application in all aspect (money and
userfriendly).

Contact HP and iTKO for training and getting an evalution version for
your POC. thanks

Correct me if i am wrong,
K.Srihari


On Aug 25, 5:04 pm, "Rupesh Garg" wrote:
> Hello All:
>
> We have used HP Load Runner for conducting the web services testing. We have
> done fairly well in running tests for functional and load tests through HP
> Load Runner. I want to know that what are the unique features, which are
> being carried over by the HP Service test. How buying this tool will add
> value to the testing of web services exercise?
>
> Also, any comparison with iTKO LISA tool on this front will be appreciated.

Web services protocol

http://blog.testsautomation.com/tag/loadrunner-soap-soa-webservice/

http://www.myloadtest.com/soap-over-jms-with-loadrunner/

http://www.loadtester.com/how-performance-test-net-and-net-web-services-loadrunner-orasi-software

On Sat, Jun 19, 2010 at 4:55 PM, prasenjit dutta wrote:

Hi All,

Did anyone work on web services protocol? can anyone provide me any simple script for that or how the web service protocol generated script is different from http/html protocol generated script?

i am leaving on a jet plane

i am leaving on a jet plane

All my bags are packed I'm ready to go
I'm standin' here outside your door
I hate to wake you up to say goodbye
But the dawn is breakin' it's early morn
The taxi's waitin' he's blowin' his horn
Already I'm so lonesome I could die

So kiss me and smile for me
Tell me that you'll wait for me
Hold me like you'll never let me go
Cause I'm leavin' on a jet plane
Don't know when I'll be back again
Oh babe, I hate to go

There's so many times I've let you down
So many times I've played around
I tell you now, they don't mean a thing
Every place I go, I'll think of you
Every song I sing, I'll sing for you
When I come back, I'll bring your wedding ring

So kiss me and smile for me
Tell me that you'll wait for me
Hold me like you'll never let me go
Cause I'm leavin' on a jet plane
Don't know when I'll be back again
Oh babe, I hate to go

Guitar Solo

Now the time has come to leave you
One more time let me kiss you
Close your eyes I'll be on my way
Dream about the days to come
When I won't have to leave alone
About the times, I won't have to say

So kiss me and smile for me
Tell me that you'll wait for me
Hold me like you'll never let me go
Cause I'm leavin' on a jet plane
Don't know when I'll be back again
Oh baby, I hate to go

Cause I'm leavin' on a jet plane
Don't know when I'll be back again
Oh babe, I hate to go

Software testing market set to boom

http://www.v3.co.uk/v3/news/2268744/software-testing-set-boom

The software testing market is currently worth €79bnSoftware testing market set to boom
Sector could be worth €100bn in four years

The market for IT software testing services and equipment could be worth as much as €100bn in the coming years.

A report from analyst firm Pierre Audoin Consultants (PAC) put software testing spending at €79bn in 2010. The firm expects that figure to climb to €100bn by 2014
"Businesses are increasingly looking to use external skills, in order to leverage suppliers' greater economies of scale, gain access to lower-cost offshore skills and investment in tools and processes, and to support their increasingly complex technology landscapes," said PAC senior analyst Nick Mayes.

The company said that the growth is due in large part to a change in corporate attitudes about IT software and security. Once considered to be an overlooked part of the general development process, testing is increasingly regarded as a vital step in minimising costs and spotting security risks, PAC said.

Going forward, the company sees growing opportunities for testing services providers that specialise in enterprise platforms such as Oracle and SAP along with cloud platforms and security testing services.

Indian government services totally online

All government office related links are available.... save it......Maybe of some help in future...

Obtain:
* Birth Certificate
* Caste Certificate
* Tribe Certificate
* Domicile Certificate
* Driving Licence
* Marriage Certificate
* Death Certificate
* Search More - How do I

Apply for:
* PAN Card
* TAN Card
* Ration Card
* Passport
* Inclusion of name in the Electoral Rolls
* Search More - How do I

Register:
* Land/Property
* Vehicle
* With State Employment Exchange
* As Employer
* Company
* .IN Domain
* GOV.IN Domain
* Search More - How do I

Check/Track:
* Waiting list status for Central Government Housing
* Status of Stolen Vehicles
* Land Records
* Causelist of Indian Courts
* Court Judgements (JUDIS )
* Daily Court Orders/Case Status
* Acts of Indian Parliament
* Exam Results
* Speed Post Status
* Agricultural Market Prices Online
* Search More - How do I

Book/File/Lodge:
* Train Tickets Online
* Air Tickets Online
* Income Tax Returns
* Complaint with Central Vigilance Commission (CVC)
· Search More - How do I

Contribute to:
* Prime Minister's Relief Fund
* Search More - How do I

Others:
* Send Letters Electronically
* Search More - How do I

Recently Added Online Services
* Tamil Nadu: Online application of marriage certificate for persons having registered their marriages
* Tamil Nadu: Online District wise soil Details of Tamil Nadu
* Tamil Nadu: View Water shed Atlas of Tamil Nadu
* Tamil Nadu: E-Pension District Treasury Tirunelveli
* Meghalaya: Search Electoral Roll Online by Name (2008)
* Meghalaya: Search Electoral Roll Online by EPIC number (2008)
* Meghalaya: Search Electoral Roll Online by House number (2008)
* Himachal Pradesh: Revised Pay and Arrears Calculator-Fifth Pay
* Meghalaya: Search Electoral Roll Online by Part number (2008)
* Andhra Pradesh: Online Motor Driving School Information
Global Navigation
* Citizens
* Business (External website that opens in a new window)
* Overseas
* Government
* Know India
* Sectors
* Directories
* Documents
* Forms
* Acts
* Rules
* Schemes
* Tenders
* Home
* About the Portal
* Site Map
* Link to Us
* Suggest to a Friend
* Help
* Terms of Use
* Feedback
* Contact Us
* Accessibility Statement

Indian government services totally online

All government office related links are available.... save it......Maybe of some help in future...

Obtain:
* Birth Certificate
* Caste Certificate
* Tribe Certificate
* Domicile Certificate
* Driving Licence
* Marriage Certificate
* Death Certificate
* Search More - How do I

Apply for:
* PAN Card
* TAN Card
* Ration Card
* Passport
* Inclusion of name in the Electoral Rolls
* Search More - How do I

Register:
* Land/Property
* Vehicle
* With State Employment Exchange
* As Employer
* Company
* .IN Domain
* GOV.IN Domain
* Search More - How do I

Check/Track:
* Waiting list status for Central Government Housing
* Status of Stolen Vehicles
* Land Records
* Causelist of Indian Courts
* Court Judgements (JUDIS )
* Daily Court Orders/Case Status
* Acts of Indian Parliament
* Exam Results
* Speed Post Status
* Agricultural Market Prices Online
* Search More - How do I

Book/File/Lodge:
* Train Tickets Online
* Air Tickets Online
* Income Tax Returns
* Complaint with Central Vigilance Commission (CVC)
· Search More - How do I

Contribute to:
* Prime Minister's Relief Fund
* Search More - How do I

Others:
* Send Letters Electronically
* Search More - How do I

Recently Added Online Services
* Tamil Nadu: Online application of marriage certificate for persons having registered their marriages
* Tamil Nadu: Online District wise soil Details of Tamil Nadu
* Tamil Nadu: View Water shed Atlas of Tamil Nadu
* Tamil Nadu: E-Pension District Treasury Tirunelveli
* Meghalaya: Search Electoral Roll Online by Name (2008)
* Meghalaya: Search Electoral Roll Online by EPIC number (2008)
* Meghalaya: Search Electoral Roll Online by House number (2008)
* Himachal Pradesh: Revised Pay and Arrears Calculator-Fifth Pay
* Meghalaya: Search Electoral Roll Online by Part number (2008)
* Andhra Pradesh: Online Motor Driving School Information
Global Navigation
* Citizens
* Business (External website that opens in a new window)
* Overseas
* Government
* Know India
* Sectors
* Directories
* Documents
* Forms
* Acts
* Rules
* Schemes
* Tenders
* Home
* About the Portal
* Site Map
* Link to Us
* Suggest to a Friend
* Help
* Terms of Use
* Feedback
* Contact Us
* Accessibility Statement

Compare Load Runner and HP Service Test: Features Comparison

Hello All:

We have used HP Load Runner for conducting the web services testing. We have done fairly well in running tests for functional and load tests through HP Load Runner. I want to know that what are the unique features, which are being carried over by the HP Service test. How buying this tool will add value to the testing of web services exercise?

Also, any comparison with iTKO LISA tool on this front will be appreciated.



http://www.infoq.com/news/2009/03/soa-testing-tools



There are quite a few SOA testing tools to choose from now. I am often asked which is the best tool?

The answer of course depends on requirements. Here are the requirement RFI/RFP categories I often used to help with test tool selection:

* Test-aware interfaces: standardized interface and messages for testing
* Message-based test automation: record, replay and management of test scripts
* Virtualization: the ability simulate virtual service providers and consumers
* Simulation: the ability to simulate applications as part of a regression test
* Load Test: the ability to stress test applications
* Validation: pass/fail verification at the component (messaging) and application (data store) levels.
* Components: Java and/or .NET component visibility
* Introspection: WSDL and XML support to generate data and operation tests
* Management: Manage test cases, scripts, data and results
* Security: SSL, WS security federation, digital signatures
* Industry Specific Data Formats: e.g. EDI, HL7
* Continual Test: Automated build, deploy and test



http://www.soatesting.com/

http://www.infoworld.com/d/architecture/three-open-source-web-service-testing-tools-get-high-marks-995

Generate the Custom Graphs using LR Analysis Component

Please validate the below before confirming with the client… an interesting article to try..



__________________________________________________________________________________________________________________

Hi All,

Easy to Generate the Graphs for PerfMon/Nmon (Unix flavor Operating System) counter data: (Silk Performer – CSV to TSD option)

HP LoadRunner Analysis is a free tool right? By using LoadRunner Analysis component, we can use to generate the graph for external data file (CSV/XLS).

Usually, we are monitoring the server’s operating system and server specific counters using other 3rd party tools like PerfMon/Nmon/VMSTAT/Top commands (Due to some security reasons, we are monitoring the servers using 3rd party tools and will generate the measurements in CSV/XLS format). After completion of collecting the data (in CSV/XLS format), we need to write a macro or manually plot the graphs in Excel. Instead of drawing the graphs manually, we can use the LR analysis component effectively. We can certainly install the trial version of LoadRunner 9.x. Simply use the Import Data functionality built into Analysis…

Please find the below example.

1. Collecting performance metrics from remote Linux Operating System to get the raw metrics provided from commands like vmstat, iostat and Top to get memory, disk and cpu utilization respectively.

2. Then quickly parse that data using some custom Perl scripts to help format those results into the csv format that LoadRunner Analysis expects.

For example, vmstat info that comes in its raw format like this:


kthr memory page disk faults cpu
r b w swap free re mf pi po fr de sr m0 m1 m2 m1 in sy cs us sy id
0 0 0 40563488 10311984 4 21 1 0 0 0 0 0 0 0 0 413 280 280 0 0 99
0 0 0 31902256 1908536 1 20 0 0 0 0 0 0 0 0 0 637 793 831 1 0 99

Can be turned into LoadRunner Analysis friendly format like this:
date,time,r,b,w,swap,free,re,mf,pi,po,fr,de,sr,m0,m1,m2,m1,in,sy,cs,us,sy,id
13/4/2008,17:36:22,0,0,0,31792512,2202496,0,2,0,0,0,0,0,0,0,0,0,577,699,706,1,0,99
13/4/2008,17:36:17,0,0,0,31779792,2201592,0,2,0,0,0,0,0,0,0,0,0,568,699,695,0,0,99

Using the Import Data Tool in LR Analysis.

To use the Import Data tool:

1. Choose Tools > External Monitors > Import Data. The Import Data dialog box opens.

2. Browse the CSV file to generate the graph

3. Merge the custom graph with LR client side Running Vuser graph

4. Prepare the Analysis Report.

Visual Studio 2010 - Load Test Tool Details

Scripting(Web test):

- Do we have Initialization section and Termination section for a user.(Ex: A user log in and does some set of action and log out from the web page. when a user enters the login and logout is done only once,the set of actions must be Iterated).
http://msdn.microsoft.com/en-us/library/bb514192.aspx
http://blogs.msdn.com/b/chrispat/archive/2010/01/10/branching-and-looping-in-a-declarative-web-test.aspx

- Error Handling (Ex:If error occurs need to stop the iteration and continue with the next).
http://blogs.msdn.com/b/slumley/archive/2007/04/10/how-to-debug-a-web-test.aspx

- How to include the custom messages to debug the script and display in the log. (Enhanced the code using Console.Writeln() but unable to see in the log).
http://msdn.microsoft.com/en-us/library/bb514192.aspx

- To suppress a particular dependent request instead of all the requests which are not required(Ex: some .gif, blocked contents etc).

A top-level request can appear to have failed because one of its dependent requests could not be found. This might indicate a problem with the Web application's HTML. These errors can be suppressed by disabling the ParseDependentRequests property on the request.
http://msdn.microsoft.com/en-us/library/ms364082(VS.80).aspx


- Log window options such as to enable/disable during the test run.
http://blogs.msdn.com/b/edglas/archive/2007/12/02/web-test-authoring-and-debugging-techniques-for-vs-2008.aspx
http://teamtestplugins.codeplex.com/

- Functions related to build the dynamic form data for a request.
Please share more details on the above point.

- How to extract data when a response page consists of multiple frames.
http://msdn.microsoft.com/en-us/library/microsoft.visualstudio.testtools.webtesting.rules.extracthiddenfields.aspx

- Parameterization: If we select the random username from the data source file, then how to retrieve the corresponding password of the username.
If both username & password are picked up from same datasource then corresponding password will be select with random username automatically.

- If we enhance the code in .cs filethen how to .webtest should get reflected.
It is not supported, since both are different files.

Execution(Load test):
- Can we limit the number of users per Load Agent(Ex: To execute 1000 users, can we distribute 500users from each LA instead of 1000 from a single LA).

You can use the Test Agent property called weighting to distribute the load.

Test Agent Property Description
Weighting Used to distribute load when you use test agents with different performance levels. For example, a test agent with a weighting of 100 receives two times the load as a test agent with a weighting of 50.

Please find below the link for more information on changing the test agent settings:
Changing the Settings for a Test Agent
http://msdn.microsoft.com/en-us/library/dd695837.aspx#ChangeAgent

- Do we have any options to Ramp down the users?
There are no built-in support for this, but one can write custom load test plug-in for ramp down users, please refer below link for more information:
http://blogs.msdn.com/b/yutong/archive/2010/03/15/load-test-plug-in-simulate-multiple-and-repeated-user-load-patterns-step-2-1.aspx
http://blogs.msdn.com/b/slumley/archive/2009/04/10/load-test-plug-ins.aspx

- Can we dynamically increase/decrease the user load during the test run.
http://blogs.msdn.com/b/yutong/archive/2010/03/15/load-test-plug-in-simulate-multiple-and-repeated-user-load-patterns-step-2-1.aspx

Reporting:
- How can we generate the automated report with graphs.
http://blogs.msdn.com/b/slumley/archive/2009/05/22/dev10-feature-load-test-excel-report-integration.aspx

Details of MS VSTS 2010

Hello MSFT Guys:)
Can you please send me some information about the Visual Studio Test Professional 2010? Also, if you know people who are really involved in development/maintainance of this tool, that can be a great help for me also. Below are some of the links found by me:

http://www.radiotfs.com/2008/10/23/RoadToRosarioSpecialVSTS2010Test.aspx

http://blogs.msdn.com/b/james_whittaker/default.aspx?PageIndex=1

http://www.dotnetcurry.com/ShowArticle.aspx?ID=464&AspxAutoDetectCookieSupport=1

Here is the landing page : http://msdn.microsoft.com/en-us/vstudio/default.aspx - start from here to get info on Test Pro and other ALM SKUs

http://blogs.msdn.com/b/anutthara/archive/2010/02/09/resources-for-visual-studio-2010-test-tools.aspx has more resources. For all qs related to Test Pro, write to the MSDN forum listed in the resources list

A very basic description about the Memory Allocation:

http://blogs.msdn.com/b/abhinaba/archive/2009/01/25/back-to-basic-series-on-dynamic-memory-management.aspx

http://blogs.msdn.com/b/abhinaba/

http://blogs.msdn.com/b/amit_chatterjee/archive/2010/02/12/vs-2010-rc-is-ready-for-general-download.aspx