Creating a Test Case

From FirebugWiki

(Difference between revisions)
Jump to: navigation, search
m (Fixed little mistake)
m (Fixed links to test case examples)
Line 63: Line 63:
There are already some examples, which can be used as reference:
There are already some examples, which can be used as reference:
-
* [https://getfirebug.com/tests/console/4504/issue4504.html Issue 4504] (Console panel related)
+
* [https://getfirebug.com/tests/manual/console/4504/issue4504.html Issue 4504] (Console panel related)
-
* [https://getfirebug.com/tests/html/issue1318.html Issue 1318] (HTML panel related)
+
* [https://getfirebug.com/tests/manual/html/issue1318.html Issue 1318] (HTML panel related)
-
* [https://getfirebug.com/tests/css/4543/issue4543.html Issue 4543] (CSS panel related)
+
* [https://getfirebug.com/tests/manual/css/4543/issue4543.html Issue 4543] (CSS panel related)
-
* [https://getfirebug.com/tests/script/4248/issue4248.html Issue 4248] (Script panel related)
+
* [https://getfirebug.com/tests/manual/script/4248/issue4248.html Issue 4248] (Script panel related)
-
* [https://getfirebug.com/tests/net/issue3071.html Issue 3071] (Net panel related)
+
* [https://getfirebug.com/tests/manual/net/issue3071.html Issue 3071] (Net panel related)
== Automated tests ==
== Automated tests ==

Revision as of 11:34, 20 July 2012

We need a simple page, that we can open in the browser and use for manual testing to work on an issue

Contents

General info

We can only work on issues, that we can reproduce. Therefore it is very important to have simple test cases for the bug you're seeing or the feature you are missing in Firebug.

A test case MUST include precise step by step instructions how to reproduce it and a description of what you expect to see.

Also, if your steps to reproduce require a file, then please provide that file instead of posting lines of code. This makes it a lot easier for other people to reproduce your test case.

If you provide a test case file, you should also provide the following additional information:

  • The issue number
  • The issue summary
  • Observed results (in case of bugs)
  • Contact information (so we can get back to you in case of questions)

Manual tests

How to create

To create a manual test case you can either provide a publicly accessible URL or create a specific a test case file.

Please note again, that it is essential to give clear steps to reproduce your issue.

You can add additional material like screenshots, videos, links to discussions etc. or offer RDP access to your computer. Though they are not a replacement for a proper test case, since others should also be able to reproduce the problem by their own.

Test cases for enhancements

Also for enhancements we want you to create a simple test case, so we are able to implement a feature/make a change as you imagine it.

So how can you provide a test case for something, that doesn't exist yet? Pretty simple: Like for bug descriptions you can create step by step instructions of how you imagine the changes.

Example

You want a new option inside the Net Panel, that allows you to copy the file name of a request.

1. Open Firebug on this page
2. Enable and switch to the Net panel
3. Reload the page via F5
4. Right-click the request for "Creating_a_Test_Case"
   => The context menu for the request appears.
5. Click the menu item "Copy file name" inside the context menu (not existing yet)
 
=> The file name "Creating_a_Test_Case" should be copied to the clipboard

Templates

To help you with creating test cases we provide some templates. You can use one of the templates below:

To adjust these templates please follow the steps below:

  1. Replace "xxxx" by number of your issue
  2. Replace "Issue summary" by title of your issue
  3. Put inspectable elements, form fields etc. into the "content" section
  4. Add the exact steps to reproduce your issue under "Steps to reproduce"
  5. Describe the currently seen result under "Observed result"
  6. Describe what you would expect to see under "Expected result"
  7. Add your contact information
  8. Remove all template comments

Examples

There are already some examples, which can be used as reference:

Automated tests

For the creation of an automated test, which will be part of the FBTest suite you need at least two parts. An HTML file and a JavaScript file, which executes the test.

How to create

To create the HTML page for the automated test case please follow the steps for the manual tests. The only thing you do not need are observed results.

The automated (JavaScript based) test case should include the exact same steps as when manually executing the test case, i. e. instead of calling an internal Firebug function directly you should call the UI functions, that will call the internal function. So for example instead of calling the editNewAttribute() method for a specific node inside the HTML Panel you should programmatically open the context menu at it and choose the option "New Attribute...". FBTest already provides several APIs, which encapsulates such logic, like in this case the function FBTest.executeContextMenuCommand().

Templates

Two templates are available for automated tests:

You will have to adjust this template using the automated test API.

Examples

There are also some examples for how to create automated tests.

Also see some live examples:

Personal tools