Sitemorse benchmarks

Overall Sitemorse™ Mark

The Overall Mark is calculated as follows:

36% weighting to diagnostics rated Compromised
26% weighting to the Performance Mark
20% weighting to the Accessibility Mark
18% weighting to diagnostics rated Impaired

Also, the following additions and subtractions are made:

If the "first page metadata" test is failed, 0.25 is subtracted.
For each of the Modem/ADSL/Corporate "first page timings" tests, 0.1 is subtracted for each "fail".
For UK government sites the eGMS score (which consists of the pages which correctly provide the mandatory eGMS data, as per the "Compliant pages" table below) is included at a weighting of 10%

The minimum score is 0, and the maximum score is 10. Scores exceeding these limits are brought back in range.

Example Overall Sitemorse™ Mark calculation

	Sitemorse™ Test Results	Individual Mark	Weighting
Compromised diagnostics	< 0.040 problems per page	6 / 10	+ 6 x 36% (2.16)
Impaired diagnostics	< 7 problems per page	7 / 10	+ 7 x 18% (1.26)
Performance	< 1,100 ms >= 270kB/sec	7 / 10	+ 7 x 26% (1.82)
Accessibility	>= 60% of pages pass A >= 5% of pages pass AA	4 / 10	+ 4 x 20% (0.80)
Metadata	First page FAIL		- 0.25
56k speed test	First page PASS		0
ADSL speed test	First page FAIL		- 0.1
Corporate speed test	First page FAIL		- 0.1
	Overall Sitemorse™ Mark Total :		6 / 10

Compromised diagnostics

The following diagnostics count as Compromised. The mean number of diagnostics per page is calculated, and converted to ascore out of 10 using the table at the end of this page.

Function: All diagnostics
Email: Compromised diagnostics, and url/mailto link problems.
Metadata: file/html/notitle

Impaired diagnostics

The following diagnostics count as Impaired. The mean number of diagnostics per page is calculated, and converted to a score out of 10 using the table at the end of this page.

Code Quality: All diagnostics
Email: Impaired diagnostics
Metadata: All file/html diagnostics except file/html/notitle

Accessibility Sitemorse™ Mark

The Accessibility Mark is comprised 60% from the percentage of pages with no Priority 1 failures and 40% from the percentage of pages with no Priority 2 failures, as per the "Compliant pages" column below.

Performance Sitemorse™ Mark

The Performance Mark is comprised 50% from the download speed score and 50% from the response time score, as shown in the table below.

Metadata Sitemorse™ Mark

The Metadata Mark is calculated as follows:

For each page:
- Start with a score of 10.
- If the page has no title, subtract 8.
- If the page has no description, subtract 5.
- If the page has any metadata errors ("badmeta", "longmeta", "longtitle", metascheme"), subtract 2.
- If the score is less than 0, set it to 0.
Calculate the average per-page score.
If the eGMS standard applies to the site, the eGMS score (which consists of the pages which correctly provide the mandatory eGMS data, as per the "Compliant pages" table below) is included at a weighting of 30%.
If any "key page" has no description, the maximum score is 6.
If any "key page" has no title, the maximum score is 3.

Spelling Mark

The Spelling Mark is calculated by dividing the total number of mistakes by the total number of words. The Mark is awarded based on the "Failing words" column below.

PDF Sitemorse™ Mark

The PDF Mark is comprised 50% from the number of PDF files which contain no bad links, and 50% from the number of PDF files which use the Tagged PDF format for accessibility (both as per the "Compliant pages" table below).

Individual Marks

Benchmark score (10=Best, 0=Worst)	Compromised (per page)	Impaired (per page)	Response Time (milliseconds)	Download Speed (kilobytes/sec)	Compliant pages	Failing words
10	0	< 0.8	< 100	>= 270	100%	< 2%
9	< 0.010	< 2	< 150	>= 210	>= 94%	< 2.8%
8	< 0.018	< 4.5	< 225	>= 150	>= 80%	< 3.45%
7	< 0.030	< 7	< 350	>= 120	>= 60%	< 3.85%
6	< 0.040	< 10	< 500	>= 96	>= 50%	< 4%
5	< 0.075	< 13	< 700	>= 72	>= 40%	< 4.5%
4	< 0.090	< 20	< 900	>= 48	>= 27%	< 5%
3	< 0.150	< 30	< 1,100	>= 30	>= 15%	< 5.5%
2	< 0.200	< 50	< 1,300	>= 18	>= 10%	< 7%
1	< 0.250	< 100	< 1,500	>= 6	>= 5%	< 10%
0	>= 0.250	>= 100	>= 1,500	< 6	< 5%	>= 10%