Firebug Test Bot
Firebug test-bot support for scheduled running of Firebug test suite.
Test Results DB
Test results produced by running Firebug test suite are stored into a CouchDB (document-oriented database). The database is available online and all test results (stored as documents) can be accessed using XHR.
Testbot results are stored as documents and there are currently following types of docs.
- header this document represents a test-bot run. You can see list of these documents here.
- result represents a test results. The relation between header and result documents is one-to-many. There is many results from on test-bot run. The relation is made through a headerid filed that is part of each result doc. List of all results is here
The database contains also test-results reported by users who run automated tests manually using Firebug Test Console (FBTest). These results use following doc types.
- user-header represents a user test launch.
- user-results represents a test result from manual running of automated test suite.
Test Results UI
Automated running of tests is configurable using a config file. Currently test bot expects the file to be available here:
The file follows a syntax that is typical for INI Files. Here is an example:
[Firebug1.6] FIREBUG_XPI=http://getfirebug.com/releases/firebug/1.6/firebug-1.6.1.xpi FBTEST_XPI=http://getfirebug.com/releases/fbtest/1.6/fbTest-1.6b26.xpi SVN_REVISION=8833 FIREFOX_VERSION=3.6 TEST_LIST=http://getfirebug.com/tests/content/testlists/firebug1.6.html [Firebug1.7] FIREBUG_XPI=http://getfirebug.com/releases/firebug/1.7X/firebug-1.7X.0a8.xpi FBTEST_XPI=http://getfirebug.com/releases/fbtest/1.7/fbTest-1.7b7.xpi SVN_REVISION=8923 FIREFOX_VERSION=4.0 TEST_LIST=http://getfirebug.com/tests/content/testlists/firebug1.7.html
Each section (there are two in this example) specifies one configuration. Name of the section should be descriptive, but isn't currently used by testbot.
- FIREBUG_XPI - URL of Firebug XPI file used in this configuration.
- FBTEST_XPI - URL of FBTest XPI (Firebug test harness) file used in this configuration.
- SVN_REVISION - Revision number in Firebug SVN that is used by testbot to pull all test files. Testbot puts these files on its own Web server.
- FIREFOX_VERSION - Firefox version used in this configuration
- TEST_LIST - Test suite used by test bot in this configuration.