Sitemorse benchmarks

Overall Sitemorse™ Mark

The Overall Mark is calculated as follows:

  • 36% weighting to diagnostics rated Compromised
  • 26% weighting to the Performance Mark
  • 20% weighting to the Accessibility Mark
  • 18% weighting to diagnostics rated Impaired

Also, the following additions and subtractions are made:

  • If the "first page metadata" test is failed, 0.25 is subtracted.
  • For each of the ADSL and Corporate "first page timings" tests, 0.1 is subtracted for each "fail".
  • For UK government sites the eGMS score (which consists of the pages which correctly provide the mandatory eGMS data, as per the "Compliant pages" table below) is included at a weighting of 10%

The minimum score is 0, and the maximum score is 10. Scores exceeding these limits are brought back in range.

Example Overall Sitemorse™ Mark calculation

Sitemorse™ Test ResultsIndividual
Mark
Weighting
Compromised diagnostics< 0.040 problems per page6 / 10+ 6 x 36% (2.16)
Impaired diagnostics< 7 problems per page7 / 10+ 7 x 18% (1.26)
Performance< 1,100 ms
>= 270kB/sec
7 / 10+ 7 x 26% (1.82)
Accessibility>= 60% of pages pass A
>= 5% of pages pass AA
4 / 10+ 4 x 20% (0.80)
MetadataFirst page FAIL- 0.25
ADSL speed testFirst page FAIL- 0.1
Corporate speed testFirst page FAIL- 0.1
Overall Sitemorse™ Mark Total :6 / 10

Compromised diagnostics

The following diagnostics count as Compromised. The mean number of diagnostics per page is calculated, and converted to ascore out of 10 using the table at the end of this page.

  • Function: All diagnostics
  • Email: Compromised diagnostics, and url/mailto link problems.
  • Metadata: file/html/notitle

Impaired diagnostics

The following diagnostics count as Impaired. The mean number of diagnostics per page is calculated, and converted to a score out of 10 using the table at the end of this page.

  • Code Quality: All diagnostics
  • Email: Impaired diagnostics
  • Metadata: All file/html diagnostics except file/html/notitle

Accessibility Sitemorse™ Mark

The Accessibility Mark is comprised 60% from the percentage of pages with no Priority 1 failures and 40% from the percentage of pages with no Priority 2 failures, as per the "Compliant pages" column below.

Performance Sitemorse™ Mark

The Performance Mark is comprised 50% from the download speed score and 50% from the response time score, as shown in the table below.

Metadata Sitemorse™ Mark

The Metadata Mark is calculated as follows:

  • For each page:
    • Start with a score of 10.
    • If the page has no title, subtract 8.
    • If the page has no description, subtract 5.
    • If the page has any metadata errors ("badmeta", "longmeta", "longtitle", metascheme"), subtract 2.
    • If the score is less than 0, set it to 0.
  • Calculate the average per-page score.
  • If the eGMS standard applies to the site, the eGMS score (which consists of the pages which correctly provide the mandatory eGMS data, as per the "Compliant pages" table below) is included at a weighting of 30%.
  • If any "key page" has no description, the maximum score is 6.
  • If any "key page" has no title, the maximum score is 3.

Spelling Mark

The Spelling Mark is calculated by dividing the total number of mistakes by the total number of words. The Mark is awarded based on the "Failing words" column below.

PDF Sitemorse™ Mark

The PDF Mark is comprised 50% from the number of PDF files which contain no bad links, and 50% from the number of PDF files which use the Tagged PDF format for accessibility (both as per the "Compliant pages" table below).

Individual Marks

Benchmark score
(10=Best, 0=Worst)
Compromised
(per page)
Impaired
(per page)
Response Time
(milliseconds)
Download Speed
(kilobytes/sec)
Compliant pagesFailing words
100< 0.8< 100>= 270100%< 2%
9< 0.010< 2< 150>= 210>= 94%< 2.8%
8< 0.018< 4.5< 225>= 150>= 80%< 3.45%
7< 0.030< 7< 350>= 120>= 60%< 3.85%
6< 0.040< 10< 500>= 96>= 50%< 4%
5< 0.075< 13< 700>= 72>= 40%< 4.5%
4< 0.090< 20< 900>= 48>= 27%< 5%
3< 0.150< 30< 1,100>= 30>= 15%< 5.5%
2< 0.200< 50< 1,300>= 18>= 10%< 7%
1< 0.250< 100< 1,500>= 6>= 5%< 10%
0>= 0.250>= 100>= 1,500< 6< 5%>= 10%