Summarising from the experience of social indicators application in the United States, Cobb and Rixford listed 12 lessons for the current development of social indicators that will make an impact to the society:

q Obtaining a figure does not equate to establishing a good indicator. This is because quantities should reveal qualities, but qualities are “ always ambiguous and that any statements about them are provisional rather than final.”

q Effective indicators require a clear conceptual basis. Ideally, concepts should be defined before data is collected, but in practice that is not easy. On the other hand, “although measurement can help clarify a concept, the concept itself will not simply emerge from data.”

q No indicators are free from values, because “ all serious indicators work is political”. Value judgements prevail from selecting indicators to the formulation of survey questions.

q Comprehensiveness may tamper with effectiveness, because historically the most effective indicators tended to focus on one single issue, by guiding people to consider deeper questions. In additions, interpreting indicators is more important than simply describing them. Indicators covering a small area for specific audiences tend to be more effective.

q The symbolic value of an indicator may outweigh its value as a literal measure, especially the fact that indicators serve as metaphors, not statistics.

q Indicators must not be confused with reality, because “even the best indicator is only a fractional measurement of the underlying reality”. Multiple indicators measuring the same social phenomenon may overcome this problem.

q Democratic establishment of indicators requires more than good public participation processes, the result of emphasis on procedural justice. This practice will effectively suffocate changes to status quo, and perhaps substantive justice, such as equal opportunities, should be emphasised instead.

q Measurement does not necessary include appropriate action.

q Better information lead to better decisions and improved outcomes, but this is not easy. This is because indicators only have indirect effects to policy making, and behaviour plays a larger part.

q Innovative thinking on causes of a particular social problem is often required to resolve this problem, because indicators have a function of enlightenment, which are supposed to lead people to reconsider the common understanding of the problem.

q Indicators that reveal causes, not symptoms, of a particular social problem should be searched in order to take action. Mere description of indicators without providing insight to trends is more unlikely to lead to remedial action.

q Indicators provide the basis for setting outcomes as long as one has control over resources, that is if developers of indicators “ have a connection to those with the power to make substantive changes.” This brings us to determine who actually has the power to take action.

The application of social indicators also brings forth the issues of public management and governance, such as the management structure required to manage programmes that are jointly implemented across government departments, the capacity building of the members of the public in reading and interpreting the published indicators so that correct conclusions can be drawn. Indicators contain “a normative element” meaning that they cannot be used as the only basis for resource allocation. Other political constraints must be taken into account. The values of policy makers decide the criteria for success and values of delivery of government programmes, and they are subjective by every means. It is possible to resolve this constraint by employing the same technique used in the selection of social indicators, known as “values inquiry” but in turn this is constrained by the need to determine the priorities between different types of needs in the society, which is again a subjective exercise.

For more information on indicators see BEN WARNER’S BLOG.