Software Testing Resources
• www.agilistas.org (Agile Testing Wiki - associated w/the Yahoo group)
• Association for Software Testing (New group derived out of FIT affiliations)
• FIT Testing Education (Florida Institute of Technology - Education site)
o http://www.testingeducation.org/BBST/index.html
o http://www.testingeducation.org/BBST/BBSTCombinationTesting.html
• www.methodsandtools.com
o http://www.methodsandtools.com/archive/archive.php?id=23 (TDD article by Lisa Crispin)
• www.missiontesting.com
• www.opensourcetesting.org (Open Source Tools)
• Pacific Northwest Software Quality Conference - Proceedings
• Perl performance test tool - Perl::PDQ and general Perl test tools - http://qa.perl.org/
• QA Forums
o www.qaforums.com Calendar
o www.qatraining.net
o www.qajobs.net
o www.qalinks.com
o www.qadownloads.com
o www.qabooks.com
• Web Testing Tools
o Ruby - http://wtr.rubyforge.org Watir
o Selenium
• "Schools" of testing -
o http://www.jrothman.com/weblog/archive/2003_12_01_mpdarchive.html
o http://www.testingeducation.org/conference/wtst_pettichord_FSofST2.pdf
• Software Testing Institute
• The Software Quality Page
• Software Quality Institute
• StickyMinds
• www.stpmag.com (Software Test & Performance Magazine)
• www.sqatester.com
• http://www.testing.com/agile/ http://www.testing.com/test-patterns/index.html Brian Marick's - Testing.com
• Testing FAQs
o www.testingfaqs.org/t-design.html (Test Design Tools - All Pairs tools!)
• TETworks (Open source test environment toolkit)
• What is Testing
• Yahoo group for Context / Exploratory testing http://groups.yahoo.com/group/software-testing/
• Yahoo group for Agile testing http://groups.yahoo.com/group/agile-testing/
________________________________________
Test Management Links
• American Society for Quality (ASQ)
o Software Division- www.asq-software.org
o RTP Chapter - http://www.rtpnet.org/~asq/
• Performance Tester and WOPR - Workshop on Performance & Reliability
• Bernie Berger - www.testassured.com (Financial Testing & STiFS Workshop)
• International Institute for Software Testing
o www.testinginstitute.com
o www.softdim.com
• Quality Assurance Institute (QAI)
o www.qaiusa.com or www.qaiworldwide.com
o www.qaiindia.com
o Charlotte Chapter - www.citqaa.org
o RTP Chapter - www.tisqa.org
• Software Quality Engineering (SQE)
o www.sqe.com
o www.stickynotes.com
o www.stqemagazine.com
• Testing FAQs - www.testingfaqs.org
• Testing a stapler, example of test case "thinking" - http://www.testingreflections.com/node/view/928
________________________________________
Ruby & Web Based Resources
Ruby is gaining wider acceptance as one of the leading OO, general purpose scripting languages. Check out more information -
• www.ruby-lang.com
• http://rubyinstaller.sourceforge.net
• www.rubygarden.org
• http://www.agilistas.org/agile/TestDataFromExcelToRubyHash
• http://www.rubygarden.org/ruby?ScriptingExcel
• http://atomicobject.com/systir.page (System Testing in Ruby)
• Web Testing Tools
o Ruby - http://wtr.rubyforge.org Watir
o Selenium
• http://rubyinstaller.rubyforge.org/wiki/wiki.pl
• http://www.ruby-lang.org/en/
• http://www.rubycentral.com/
• http://www.rubyonrails.org/
• http://www.ruby-doc.org/
• http://www.projectforum.com/pf/wiki.html (free wiki software)
• http://www.linuxjournal.com/article/8217
• http://www.onlamp.com/pub/a/onlamp/2005/01/20/rails.html
• http://dev.mysql.com/downloads/mysql/4.1.html
• http://www.mysqlfront.de/
• http://ruby-gnome2.sourceforge.jp/
• http://www.rubygarden.org/ruby
• http://www.loudthinking.com/arc/000199.html
• http://www.caliban.org/ruby/ruby-google.shtml
• http://www.caliban.org/ruby/
• Firefox interactions capture tool -
o http://developer.spikesource.com/wiki/index.php/Projects:TestGen4Web
Python / Jython Automation Tools
• PyCon
o Python Org - www.python.org
o Conference - www.python.org/pycon/
o Grig Gheorghiu talk on testing frameworks - http://www.python.org/pycon/2005/papers/10/
• STAF/STAX from IBM for test distribution, execution and reporting -- uses Jython - http://staf.sourceforge.net/index.php
• Marathon from ThoughtWorks for Java GUI testing (I know, agile and GUI testing don't jive, but this tool is supposed to help write acceptance tests in an agile environment) -- uses Jython - http://marathonman.sourceforge.net
o See paper submitted to XP2003:
http://marathonman.sourceforge.net/docs/Successful%20Automation%20of%20GUI%20Driven%20Acceptance%20Testing.pdf
• TestMaker from Frank Cohen's PushToTest.com -- uses Jython agents to check Web applications and Web Services for scalability, performance and functionality - http://pushtotest.com/Downloads/downloadtmdoc.html
• pyGUIUnit -- unit test framework for apps written in Python using QT (I know this is a very specific subset of apps, but the ideas in there could be generalized hopefully to other GUI apps) - http://pyguiunit.sourceforge.net/
• PyFIT, the Python port of FIT that can also be used with FitNesse. I know of no other scripting language that can do
this. FitNesse supports Java and .NET out of the box, but the PyFIT integration is pretty easy to achieve - http://www.xprogramming.com/software.htm
________________________________________
All Pairs Testing - A Few References
• www.pairwise.org
• James Bach at Satisfice has written a small perl script that implements allpairs. Best part - it's free and available from his website. www.satisfice.com and http://www.satisfice.com/tools/pairs.zip. You even get source.
• www.opensourcetesting.org contains quite a few links to open source tools. It has a link to "jenny" which is another free allpairs implementation that is a bit better than James'
• The Air Academy, Six Sigma version is at - www.sigmazone.com/protest.htm
• www.smartwaretechnologies.com
• The general testing FAQ site has quite a few links as well. The site can be referenced by http://www.testingfaqs.org/ and the design tools area by http://testingfaqs.org/t-design.html. There are a few similar tools on that page.
• There is also a testing technique called Category-Partition method that focuses on high degrees of coverage. Some of these tools will not only reduce to an efficient / minimal set of test cases, but also generate test cases (templates) for you. Tcases from www.startingblocktech.com is one of these tools.
• See http://www.developsense.com/testing/PairwiseTesting.html for a description of pairwise testing.
Context Driven Testing School - Wiki
• http://www.context-driven-testing.com/wiki/scribble.cgi?read=ProceduralTestCases
• http://www.context-driven-testing.com/wiki/scribble.cgi?read=BionicTesting
• http://www.context-driven-testing.com/wiki/scribble.cgi?read=ContextDriven
• http://www.context-driven-testing.com/wiki/scribble.cgi?read=NoBestPractices
• http://www.context-driven-testing.com/wiki/scribble.cgi?read=AlternatePrinciples
• Exploratory testing - http://www.satisfice.com/articles/what_is_et.htm
• Session Based Management - http://www.satisfice.com/sbtm/index.shtml
________________________________________
Friday, March 30, 2012
Wednesday, February 29, 2012
World Quality Report by Capgemini
How well is your organization driving software quality and testing compared to other companies today?
-Which areas in Application Lifecycle Management (ALM) pose the greatest challenge to an organization’s success?
-How well do companies follow best practice standards?
-How quickly are companies adopting Agile methods?
-How are virtualized environments changing the way companies test?
-What skills do testers need in increasingly distributed teams?
The 2010-2011 World Quality Report provides insights into these questions and more. This report is based on survey findings from hundreds of testers, business analysts and developers and reveals emerging trends in quality and a forecast of how these trends will shape ALM and associated software in the future.
http://www.capgemini.com/insights-and-resources/by-publication/2010-11-world-quality-report/
-Which areas in Application Lifecycle Management (ALM) pose the greatest challenge to an organization’s success?
-How well do companies follow best practice standards?
-How quickly are companies adopting Agile methods?
-How are virtualized environments changing the way companies test?
-What skills do testers need in increasingly distributed teams?
The 2010-2011 World Quality Report provides insights into these questions and more. This report is based on survey findings from hundreds of testers, business analysts and developers and reveals emerging trends in quality and a forecast of how these trends will shape ALM and associated software in the future.
http://www.capgemini.com/insights-and-resources/by-publication/2010-11-world-quality-report/
Sunday, February 26, 2012
Size of multi-billion dollar testing market

Welcome to multi-billion dollar testing market
Software Testing is one of the emerging areas in IT industry which is rapidly growing. Increased competition and customer demand has made software testing a key operation which demands nowadays top talents and pay packets.
The Global software Testing market is estimated to be $17 billion dollars. The market opportunity for the Indian offshore testing companies is currently $10 billion, estimated to rise to $15 billion in 2012. The software-testing arena would require 25,000-30,000 professional in the next one year as per the IDC report.
Software is integrated into every area of our lives, it's critical to the way we live.
In industry - we no longer have to justify why we need Software testers. Companies are already convinced.
Testing is attracting higher standards of talent.
Decade ago, testing was not recognized at the same level as development. Today, both billing rates and salary levels of testing professionals are comparable, and at cases better than programming professional.
Customers are more exposed to technology and will not accept anything less than perfect software.
Next generation users are more technically advanced. There is low tolerance for poor usability and poor performance.
Friday, February 24, 2012
Higher Business ROI through Cloud Based Testing Environments
Higher Business ROI through Cloud Based Testing Environments
With proliferation of multiple development environments, operating systems, browsers, distributed user base world, testing of an application is becoming increasingly complex. N-Dimensional just seems inadequate when quantifying the testing space formed by new development environments. In the past, we thought we could put our arms around the testing space. We felt like we could understand all the possible states and the resulting effect on our code path traversals. We would use our known black box testing methodologies (like boundary value analysis, equivalence class partitioning etc.) and could load test well beaten paths with our known testing tools. This is true no more. To test with all the possible permutations and combinations, need for the size of test labs are increasing on exponential basis. It is not an unusual thing to hear that various releases of an application have been pushed off as the test lab was not available for the testing teams. Cloud computing environment can surely give a helping hand by providing economy of scale for wide variety of test environments. This paper is making an attempt to explore that how cloud computing can help to bridge this gap in test infrastructures and which all market players are trying to fill this gap.
• What is Cloud?
• Why Cloud?
• Advantages of Cloud
• Typical Cloud Deployments – Examples
• Vendors providing Cloud Services
• Challenges in Cloud Deployments
• Testing using Cloud Based Environments – Benefits and Limitations
With proliferation of multiple development environments, operating systems, browsers, distributed user base world, testing of an application is becoming increasingly complex. N-Dimensional just seems inadequate when quantifying the testing space formed by new development environments. In the past, we thought we could put our arms around the testing space. We felt like we could understand all the possible states and the resulting effect on our code path traversals. We would use our known black box testing methodologies (like boundary value analysis, equivalence class partitioning etc.) and could load test well beaten paths with our known testing tools. This is true no more. To test with all the possible permutations and combinations, need for the size of test labs are increasing on exponential basis. It is not an unusual thing to hear that various releases of an application have been pushed off as the test lab was not available for the testing teams. Cloud computing environment can surely give a helping hand by providing economy of scale for wide variety of test environments. This paper is making an attempt to explore that how cloud computing can help to bridge this gap in test infrastructures and which all market players are trying to fill this gap.
• What is Cloud?
• Why Cloud?
• Advantages of Cloud
• Typical Cloud Deployments – Examples
• Vendors providing Cloud Services
• Challenges in Cloud Deployments
• Testing using Cloud Based Environments – Benefits and Limitations
Sunday, October 24, 2010
Challenges in Testing of mobile applications
Challenges in Testing of mobile applications
http://www.ciol.com/Developer/Testing/Feature/Challenges-in-Testing-of-mobile-applications/142143/0/
According to Gartner, the worldwide mobile applications market is currently estimated to be around $6.2 billion. In 2013, this market is expected to be around $21.6 billion. It is nobody’s guess that this market has huge untapped potential. For the companies that are involved in creating and testing mobile-based applications, this is the tipping point.
http://www.ciol.com/Developer/Testing/Feature/Challenges-in-Testing-of-mobile-applications/142143/0/
According to Gartner, the worldwide mobile applications market is currently estimated to be around $6.2 billion. In 2013, this market is expected to be around $21.6 billion. It is nobody’s guess that this market has huge untapped potential. For the companies that are involved in creating and testing mobile-based applications, this is the tipping point.
Sunday, October 3, 2010
Perfformance Test Plan
Although there is a real company logo on this document, the resource and component names and data have been sufficiently altered to render this test plan as a 0 threat to client security.
This is a mostly complete, enterprise-scale performance test plan for a very large project in a Global 100 company. It is intended only to be a learning tool. If you have questions, you can mail me at brian.wilson@orasi.com or bwilson@techsouth.com.
http://www.cc.gatech.edu/classes/AY2005/cs4803epr_spring/Project/SamplePerformanceTestPlan.pdf
I used this example in my Performance Engineering course at Georgia Tech: http://www.cc.gatech.edu/classes/AY2005/cs4803epr_spring/
Brian Wilson
This is a mostly complete, enterprise-scale performance test plan for a very large project in a Global 100 company. It is intended only to be a learning tool. If you have questions, you can mail me at brian.wilson@orasi.com or bwilson@techsouth.com.
http://www.cc.gatech.edu/classes/AY2005/cs4803epr_spring/Project/SamplePerformanceTestPlan.pdf
I used this example in my Performance Engineering course at Georgia Tech: http://www.cc.gatech.edu/classes/AY2005/cs4803epr_spring/
Brian Wilson
Thursday, September 30, 2010
Jabber Protocol
Hi All,
Below are the highlights of the Jabber Protocol :
• XMPP ( Extensible Messaging and Presence Protocol ) formerly named as Jabber Protocol.
• XMPP is an open, XML-based protocol originally aimed at near-real-time, extensible instant messaging (IM) and presence information, but now expanded into the broader realm of message oriented middleware.
• XMPP-based software is deployed on thousands of servers across the Internet.Popular commercial servers include the Gizmo5, Nimbuzz and Google Talk
• The XMPP network is server-based (i.e. clients do not talk directly to one another) but decentralized: by design there is no central authoritative server.However, anyone may run their own XMPP server on their own domain.The standard TCP port for XMPP is 5222.
Strengths of XMPP :-
• Decentralization: The architecture of the XMPP network is similar to email; anyone can run their own XMPP server and there is no central master server
• Security: XMPP servers may be isolated from the public XMPP network (e.g., on a company intranet), and robust security has been built into the core XMPP specifications
• Flexibility: Custom functionality can be built on top of XMPP; XMPP applications beyond IM include network management, content syndication, collaboration tools, file sharing, gaming, and remote systems monitoring.
XMPP via HTTP transport :-
• Another aspect of XMPP is the HTTP binding for users behind restricted firewalls.As the client uses HTTP, most firewalls allow clients to fetch and post messages without any hindrances. Thus, in scenarios where the TCP port used by XMPP is blocked, a server can listen on the normal HTTP port and the traffic should pass without problems.
• There are various websites which allow people to sign in to XMPP via their browser. Furthermore, there are open public servers, such as www.jabber80.com or 443.jabbear.com that listen on standard http (port 80) and https (port 443) ports and hence allow connections from behind most firewalls.
Further References:-
• http://xmpp.org/tech/overview.shtml
• http://en.wikipedia.org/wiki/XMPP
• http://tedweitz.com/harvard/cscie258/proj/docs/overview-summary.html
Below are the highlights of the Jabber Protocol :
• XMPP ( Extensible Messaging and Presence Protocol ) formerly named as Jabber Protocol.
• XMPP is an open, XML-based protocol originally aimed at near-real-time, extensible instant messaging (IM) and presence information, but now expanded into the broader realm of message oriented middleware.
• XMPP-based software is deployed on thousands of servers across the Internet.Popular commercial servers include the Gizmo5, Nimbuzz and Google Talk
• The XMPP network is server-based (i.e. clients do not talk directly to one another) but decentralized: by design there is no central authoritative server.However, anyone may run their own XMPP server on their own domain.The standard TCP port for XMPP is 5222.
Strengths of XMPP :-
• Decentralization: The architecture of the XMPP network is similar to email; anyone can run their own XMPP server and there is no central master server
• Security: XMPP servers may be isolated from the public XMPP network (e.g., on a company intranet), and robust security has been built into the core XMPP specifications
• Flexibility: Custom functionality can be built on top of XMPP; XMPP applications beyond IM include network management, content syndication, collaboration tools, file sharing, gaming, and remote systems monitoring.
XMPP via HTTP transport :-
• Another aspect of XMPP is the HTTP binding for users behind restricted firewalls.As the client uses HTTP, most firewalls allow clients to fetch and post messages without any hindrances. Thus, in scenarios where the TCP port used by XMPP is blocked, a server can listen on the normal HTTP port and the traffic should pass without problems.
• There are various websites which allow people to sign in to XMPP via their browser. Furthermore, there are open public servers, such as www.jabber80.com or 443.jabbear.com that listen on standard http (port 80) and https (port 443) ports and hence allow connections from behind most firewalls.
Further References:-
• http://xmpp.org/tech/overview.shtml
• http://en.wikipedia.org/wiki/XMPP
• http://tedweitz.com/harvard/cscie258/proj/docs/overview-summary.html
Subscribe to:
Posts (Atom)