Difference between revisions of "Firebug Test Bot"
|Line 31:||Line 31:|
== Testbot Config ==
== Testbot Config ==
Automated running of tests is configurable using a config file.
Automated running of tests is configurable using a config file. expects file to be available here:
The file follows
The file follows syntax [http://en.wikipedia.org/wiki/INI_file INI Files]. Here is an example:
Revision as of 11:15, 17 January 2011
Firebug test-bot support for scheduled running of Firebug test suite.
Test Results DB
Test results produced by running Firebug test suite are stored into a CouchDB (document-oriented database). The database is available online and all test results (stored as documents) can be accessed using XHR.
Testbot results are stored as documents and there are currently following types of docs.
- header this document represents a test-bot run. You can see list of these documents here.
- result represents a test results. The relation between header and result documents is one-to-many. There is many results from on test-bot run. The relation is made through a headerid filed that is part of each result doc. List of all results is here
The database contains also test-results reported by users who run automated tests manually using Firebug Test Console (FBTest). These results use following doc types.
- user-header represents a user test launch.
- user-results represents a test result from manual running of automated test suite.
Test Results UI
Automated running of tests is configurable using a config file. Testbot currently expects this file to be available here:
The file follows syntax of INI Files. Here is an example:
[Firebug1.6] FIREBUG_XPI=http://getfirebug.com/releases/firebug/1.6/firebug-1.6.1.xpi FBTEST_XPI=http://getfirebug.com/releases/fbtest/1.6/fbTest-1.6b26.xpi SVN_REVISION=8833 FIREFOX_VERSION=3.6 TEST_LIST=http://getfirebug.com/tests/content/testlists/firebug1.6.html [Firebug1.7] FIREBUG_XPI=http://getfirebug.com/releases/firebug/1.7X/firebug-1.7X.0a8.xpi FBTEST_XPI=http://getfirebug.com/releases/fbtest/1.7/fbTest-1.7b7.xpi SVN_REVISION=8923 FIREFOX_VERSION=4.0 TEST_LIST=http://getfirebug.com/tests/content/testlists/firebug1.7.html
Each section (there are two in this example) specifies one configuration. Name of the section should be descriptive, but isn't currently used by testbot.
- FIREBUG_XPI - URL of Firebug XPI file used in this configuration.
- FBTEST_XPI - URL of FBTest XPI (Firebug test harness) file used in this configuration.
- SVN_REVISION - Revision number in Firebug SVN that is used by testbot to pull all test files. Testbot puts these files on its own web server.
- FIREFOX_VERSION - Firefox version used in this configuration
- TEST_LIST - Test suite used by test bot in this configuration.