Smarter, Faster, Better eGovernment

Capgemini has released its 8th eGovernment Benchmark Measurement called Smarted, Faster, Better eGovernment.

International eGoverment surveys are always interesting. This is especially true when surveys include an aim at measuring user experience, as the Capgemini survey does.

In this survey, user experience is divided into six sub categories:

1. Usability
2. Accessibility – Manual
3. User Satisfaction
4. One-Stop-Shop
5. User Focus
6. Accessibility – Automatic

From the above user experience categories, there are some interesting points to take note from. The manual evaluations were limited to checking if the national portals could be viewed with various font sizes. It turns out that this was possible for almost every portal and the metric was finally dropped.

Another interesting point is that Capgemini has chosen to measure web accessibility automatically using the technology from the European Internet Accessibility Observatory (EIAO). Capgemini states that technology conducts a series of automated tests following the  Unified Web Evaluation Methodology. From each national portal, 6000 pages were downloaded and about 300 pages examined. (It should be noted that EIAO is no longer being developed. The project measuring Web accessibility automatically, building on the EIAO application, is eGovMon.)

According to Capgemini, the top five countries in Europe when it comes to Web accessibility is:

1. Austria,
2. Netherlands,
3. Denmark,
4. Norway and
5. Germany

This ranking list is further supported by Capgemini stating that Austria regularly proceeds with self assessment of government Web sites. Furthermore, that the Netherlands have a strict Web accessibility policy; all Web sites launched after September 1st 2006 in the Netherlands must conform to strict accessibility guidelines within the end of 2010.

2009 Transparency Internetional Global Corruption Index

Transparency International has annually since 1996 released a global corruption index aim at representing the level of public-sector corruption. The results from the 2009 Global Corruption Index has recently been released.

New Zealand, Denmark, and Singepore received the highest score (least corrupt), while Somalia, Afghanistan, and Myanmar have most improvement potential.

Good scores reflect political stability, long-established conflict of interest regulations and solid, functioning public institutions. Furthermore, the results  show that countries which are perceived to have the highest levels of public-sector corruption are also those plagued by long-standing conflicts, which have torn apart their governance infrastructure. (What is new in the 2009 Corruption Perceptions Index)

The corruption index is calculated based on results from survey questions posed to business leaders around the world (Transparency International Frequently Asked Questions)

Government At Glance

A new and very interesting survey from OECD has recently been launched called Government at Glance. This survey focuses on public administration and is intended to be a bi-annual survey of the OECD members.

The survey is categorized into indicators. Each indicator is composed of results from multiple questions. These are individually weighted discretized into a single score per grouping of indicator. The indicators are grouped as following:

• Delegation: Composed of among others checking if there is a agency for human resources on national level.
• Recruiting system: Composed of among others how a person becomes a public servant (direct application or competitive examination).
• Performance-related pay: Composed of among others who gets performance related pay.
• Performance assessment: Composed of among others how important performance assessment is related to career advancement.
• Mid-term perspective: This is divided into; Estimates such as how often are multi-year estimated updated and Targets/Ceilings such as how many years does a target cover.
• Performance Budget: Composed of among others if the ministries are required to report on performance against targets.
• Executive flexibility: Composed of among others if the ministries have the authority to cancel spending once the budget has been approved.
• Regulatory Impact Analysis (RIA)-process: Composed of among others if RIA carried out before new regulations are adopted.
• Programmes for reduction of administrative burdens: Composed of among others if there is an explicit programme to reduce the administrative burdens.

The survey also includes how core values within government has changed from 2000 to 2009, shown in the following figure:

Some of the other key findings includes that governments are increasingly using private and non-profit entities to provide goods and services. Furthermore, that only between 10% and 60% of the population use eGovernment services.

Online Tools for Analyzing your Web Site

It is unfortunately not possible to get a complete overview of how well a web site is working for the users by only using automatic analysis tools. However, there exists many tools which give valuable indications.

Web Accessibility

It should be clearly noted that in order to make a web site successfully working for all users, including users with disabilities, automatic accessibility measurements is not sufficient. In fact, only 20% of the tests defined in the Unified Web Evaluation Methodology can be measured automatically. However, many tools of automatic accessibility evaluation exists. Following are some of these;

• The eAccessibility Checker detects web accessibility barriers using tests from the Unified Web Evaluation Methodology.
• Walidator is another online tool based on the Unified Web Evaluation Methodology. In addition to automatic evaluation, the Walidator also assists in manual evaluation.
• WAVE is interesting tool for web accessibility analysis which, in contrast to most other tools, does not a report or list of all the detected barriers. It presented the evaluated web page visually as well as clearly marking the detected barriers.
• TAW is a tool which, in addition to WCAG1.0 and WCAG2.0 could present accessibility according to the W3C mobileOK Basic Tests.

Code Validation

(x)HTML and CSS are the most used technologies on web pages. There are many reasons to have valid (x)HTML and CSS. To mention a few; valid code is important to make sure the web pages are rendered similarly in different browsers, to help faster loading in web browsers and to reduce maintenance. The World Wide Web consortium (W3C) has also gathered opinions from the web community validation of web pages.

I would be surprised if many disagree with me when I say that hard to take a professional web site seriously if there has not even valid HTML. Thankfully, making sure web pages are implemented with valid (x)HTML and CSS is both easy and fool proof.

• The classic and de facto standard of (x)HTML validation is the W3C Markup Valid Service.
• Similarly, the de facto standard for CSS validation is the W3C Jigsaw.
• Additionally, the CSE HTML Validator Lite does similar work as the W3C Markup Validator, but it has a little more detailed interface.

Broken Links

Another issue which can easily be checked automatically is detecting links which are no longer working (broken links). When you create a web site you typically link to the relevant resources – both internal and external. As the web site grows, chances are that the number of links to external resources also grows. Naturally, it would be a tedious process to manually verify that your links are still working, which is why we have automatic tools for doing exactly this:

• One such tool is the SiteReportCard. In addition to broken links, it also checks for spelling errors, search engine hits and more. This is definitely worth a try.
• Another similar tool to check for broken links, HTML syntax, etc. is Dr Watson.

Performance

Web Site performance can also be carried out automatically.

• Websiteoptimization.com has a web page speed test.  This tool provides information on the web page size and download duration with various connection rates. In addition, it provides suggestions on improve the performance of the evaluated web site such as adding HTTP compression, reducing the size of scripts etc.

• Load Impact is a more  thorough performance analysis tool. Among the useful features, it sends multiple requests to the evaluated web site in order to get an overview of how many simultaneous requests (users) the web site can handle.

Open Source in French eGovernment

Recently, a very interesting survey on open source in the French government has been presented. Following is a short summary of this survey, which I thought could be a nice follow up on my recent blog post on open source in eGovernment.

This French survey shows that 96% of the French public sector use open source.

According to the report, 77% use open source for the maturity of the software, which is the most common reason. This is of course not a property of open source itself but a consequence of well carried out open source development in these projects.

Furthermore, very much related to government transparency, 67% say they use open source software to be independent from their vendor. 48% say they use open source for interoperability, while 43% say they use it because of public policies.

Open Source in eGovernment

I have recently had the fortunate opportunity to listen to several talks from the open source evangelist Bruce Perens. This inspired me to do a short survey on the use of open source in eGovernment.

There is no question that open data and open source are key elements to ensure transparency in government. Any scientific survey on these topics will tell you this, such as: Government Transparency via Open Data and Open Source, Open Source Government Transparency Projects, etc. Furthermore, not surprisingly, the European Commission reported that open source software as well as the use of open standards are necessary for successful interoperability.

Despite of this, a recent paper by Robert Deller and Veronique Guillox,

Determining relevance of “best practice” based on interoperability in European eGovernment initiatives, identified that open source and open systems are unfortunately significantly under utilized when efficiency is measured in government services. In fact, Deller and Guillox’ data indicates that open source is the most under-represented characteristic when benchmarking interoperable systems. The study shows that only 6% of the best practice initiatives from the ePractice portal had explicit requirements for an open systems. Similarly, as much as 84% of the initiatives had absolutely no indication that open source were part of the initiative.

In contrast, an excellent project which won the ePractice good practice label 2007 is PloneGov. The project is still innovating and is again a finalist for the good practice label in 2009 (and has won several other impressive awards). The project has realized that government agencies world wide often have similar requirements and face similar challenges. Thus, PloneGov attempts to unite efforts and focus on creating portals for local governments and cities. There is no question that they do this very well; the PloneGov reference list is impressive and speaks for itself.

Joomla is another open source portal which has been used for local governments web sites. We are for example starting to see this used by several Norwegian municipality web sites. I work with Norwegian municipalities myself and have often been surprised that we have not seen more open source projects such as Joomla used for the web sites. Norway has 430 municipalities, most of which have very similar requirements, this is specially true for their web sites. This should be the ideal situation for use of open source software. It will be interesting to see how Joomla will compete with the well established proprietary vendors in the Norwegian marked.

Another eGovernment tool based on open source and open standards recognized by ePractice is openFWPA. Even though it is currently only deployed used in Asturia, Spain, it is a large application which has the potential to make collaboration between public entities more transparent and much easier – both in Spain and globally. This project has a huge potential and it will be exiting to see if other government agencies will start to utilize this in the future.

Let us hope that we see many more excellent open source government projects in the future as well as more transparent eGovernment.

unfortunately

ITU promotes implementation of UN convention on Rights of Persons with Disabilities

The International Telecommunication Union (ITU) promotes an implementation of United Nations Convention on the Rights of Persons with Disabilities. A forum, hosted by the Ministry of Information and Communication Technology of Thailand, addressed policy and regulatory measures to promote accessibility in ICT. According to the press release, this is the first effort to promote implementation of ICT provisions in UN on the rights for persons with disabilities.

For more details, see the press release from ITU.

European eGovernment Award

The list of finalists and good practices for the European eGovernment Award has been made available.

Among the most interesting finalists are:

• Jämför service (Sweden) – Comparing services in Stockholm.
• NemHandel (Denmark) – Open Shared e-business infrastructure.
• PloneGov (Belgium) – Open Source Collaboration for Public Sector.

Among the most interesting good practices are the

• MyGuide (United Kingdom) -  eGovermnent courses.
• e-VEM (Slovenia) – One-stop-shop for companies. e-VEM was also among the winner of the United Nations public service day award.

Accessibility of Evaluation Tools

A very interesting blog has been posted by Peter Krantz addressing the Pitfalls of Accessibility Evaluation Tools.

This post shows that web accessibility evaluation tools are not consistent when it comes to presenting accessibility barriers. Furthermore, most of the evaluation tools find a significant amount of barriers on the remaining tools as well as on their own tool.

The post is available at Standards Schmandards.

Correlation Between Manual and Automatic Accessibility Testing

In this post we provide a short introduction to two methodologies for measuring accessibility of public web sites; (1) Norge.no – an annual survey carried out by the Norwegian Agency for Public Management and eGovernment (DIFI) on quality of Norwegian public web sites and (2) eGovMon – a fully automatic tool based on the Unified Web Evaluation Methodology. Finally we present, despite methodological differences, a strong correlation between the results of these two surveys.

Norge.no

The survey is carried out by the Norwegian Agency for Public Management and eGovernment (DIFI) on quality of public web sites. The results are presented annually and are receive a lot of attention by web site owners, policy makers as well as in the popular media.

The survey consists of 34 indicators in the area of accessibility, usability and relevance. Twelve of the indicators are on accessibility from which seven are directly related Web Content Accessibility Guidelines 1.0 level 1,2 and 3. The survey is carried out manually by experts and the results are presented as stars on web site level; 6 stars are awarded to the best web sites while the web sites with most potential for improvement receive only 1 star.

eGovMon

The eGovMon tool is based on Unified Web Evaluation Methodology using the Web Content Accessibility Guidelines 1.0 level 1 and 2.  The
eGovMon system is an implementation of the fully automated monitoring application scenario. In total the system consists of  23 web accessibility tests both on (x)HTML and CSS. On web site level, the results are presented as number of barriers found over number of tests applied (UWEM score). The most accessible web sites will receive 0%, while those with most improvement potential will receive 100%.

Correlation between results.

We evaluated automatically 414 of the Norwegian municipalities using the eGovMon tool and compared these to the results presented by Norge.no. In the figure below we plot the results from both Norge.no and eGovMon. From this figure, we can see that the average eGovMon web site score improves the more stares appointed by Norge.no. From this we can conclude that there is a strong correlation.

This is true for all groups except the web sites which received six stars, which indicates that good accessibility (six stars by Norge.no) can not be identified by automatic evaluation alone but needs to be supported by manual assessments.

This is based on a scientific publication Benchmarking and improving the quality of
Norwegian municipality web sites for 5th International Workshop on Automated Specification and Verification of Web Systems 2009 by Morten Goodwin Olsen, Annika Nietzio, Mikael Snaprud and Frank Fardal.