Section 5 – Performance Discussion – NRTEE – DPR – 2003-2004
2003-2004 - NRTEE Departmental Performance Report Previous - Contents - NextSection 5: Performance Discussion
Figure 5.1 illustrates the linkages between the NRTEE’s outcomes, priority and resources. An in-depth discussion of performance follows. Please note that this reporting structure differs significantly from the Report on Plans and Priorities 2003–04. An explanation for these changes and a crosswalk can be found in Annex 4.
Figure 5.1: High-level logic model
|
STRATEGIC OUTCOME: Federal policy development on environment and economy issues, as well as decisions in other key sectors, are influenced by NRTEE advice |
|
When decisions affecting both the environment and the economy are based on careful analysis and advice, such as that provided by the NRTEE, all Canadians benefit. Personal health and well-being, which rely on clean air, soil and water, are of central importance to Canadians, who also want the prosperity that a healthy economy provides. The NRTEE helps decision makers to integrate these vital considerations. Planned spending: $5.0 million Actual spending: $4.9 million FTEs: 27 |
|
INDIRECT OUTCOME: New working partnerships are formed between industry, government, non-governmental organizations and other major societal actors |
|
The NRTEE’s multistakeholder programs prepare the ground for further debate on contentious issues. They do this by facilitating the development of partnerships across sectors and regions of the country—partnerships that are crucial to breaking down the barriers to sustainable development in Canada. As this outcome is a by-product of spending on the strategic outcome, there are no specific funds allocated at this level. |
|
IMMEDIATE OUTCOME: Federal clients and national stakeholders are aware of and understand the problems, opportunities and practical solutions identified and examined by the NRTEE |
|
In order to make balanced decisions, decision makers require a clear understanding of the views of key stakeholders, main areas of convergence and debate, and the range of potential solutions. By involving decision makers in NRTEE task forces and consultations, and by extensive promotion of the resulting information, the agency expects to see an increase in understanding. This outcome is a direct precursor to achieving the strategic outcome. As such, spending and FTEs are reflected only at the strategic outcome level. |
|
PLANS AND PRIORITY at the ACTIVITY LEVEL |
|
The NRTEE has one activity, providing advice on the environment and economy. This activity is therefore our priority. Much of the NRTEE’s planning takes place at the level of two sub-activities:
Spending on this single activity equals spending on the strategic outcome and, as such, is reflected only at that level. (Beginning with DPR 2004–05, the agency will be able to report spending in the two sub-activity areas.) |
This reporting year, the NRTEE has a stronger basis for describing its performance than in previous years. The implementation of its new performance measurement system provides quantitative and qualitative insights into activities, outputs and the extent to which the agency has increased awareness and understanding—its immediate outcome. The agencyapplied this new system to its cross-countryurban tour and used it to guide the planning ofnew programs. As a result, performance information willbe available as new programs go forward.
Thisyear, the NRTEE also introduced an evaluation function,using a case study approach to evaluate recently concludedprograms. For example, it commissioned four independentevaluation pilots that focused on higher-level results,including its influence on policy development and decisionsin other sectors. The agency plans to evaluate one ormore programs each year. It is anticipated that, througha five-year synthesis process, the combination of thesedistinct evaluations, together with ongoing performance measurement, will provide a relatively complete picture of the NRTEE’s performance story. More information about the NRTEE’s approach to performance measurement and evaluation are available in its Results-based Management and Accountability Framework.
A discussion of the agency’s performance follows, including a description of progress toward achieving its outcomes and priority, as well as its status with regard to government-wide initiatives.
Influencing federal policy development on environment and economy issues, as well as decisions in other key sectors:
Our strategic outcome
When decisions affecting both the environment and the economy are based on careful analysis and advice, such as that provided by the NRTEE, all Canadians benefit. Personal health and well-being, which rely on clean air, soil and water, are of central importance to Canadians, who also want the prosperity that a healthy economy provides.
The NRTEE helps decision makers to integrate these vital considerations.
Four recent evaluations of our work have shed light on this contribution, confirming that our work is relevant and highly regarded by federal officials, leaders of civil society and the private sector. Despite this, our influence on federal policy has been moderate. We learned that federal executives expect us to provide a broader context for sustainable development advice and that we could improve our overall effectiveness in several ways.
The NRTEE’s work is consistently viewed as an important source of policy advice by executive- and program-level federal officials. The majority of those interviewed felt that the NRTEE has the potential to add “very significant” or “significant” value on issues of national importance. Federal officials identified no other single organization as being better placed to address national-level issues such as environment and sustainable development indicators, redevelopment and sustainability.
Literature reviews confirm that the agency’s work in areas such as brownfields, nature conservation, sustainability, fiscal reform and indicators is widely cited by key departments. A six-month analysis of the NRTEE’s website during the last year showed that federal officials are the largest single group of visitors to the website, making frequent and repeated visits to browse or download documents including the popular State of the Debate reports.
A final indicator that the federal government values the NRTEE’s advice is the extent to which it asks the agency to conduct additional work in specific policy areas. In past years, the agency has responded to requests to broaden the awareness and understanding of domestic emissions trading among Canada’s opinion leaders and to develop a set of national indicators relating to the environment and sustainable development. In August 2003, the Prime Minister asked the NRTEE to “study and inform Canadians on the potential for future emissions reductions.” The NRTEE is now responding to this most recent request.
Some specific examples of influence on federal policy this year are set out below:
- The Environmental Quality in Canadian Cities report was released less than a year ago, yet federal officials stated that it had already provided important input to federal policy and at least one recommendation has been announced for adoption.
- With respect to the development of a national set of indicators,officials reported that the NRTEE’s Environment and Sustainable Development Indicators Initiative had accelerated consideration of the use of indicators in the definition of national accounts.
-
The NRTEE’s indicators are starting to be integrated into government reporting, such as Canada’s Performance 2003, the President of the TreasuryBoard’s annual report to Parliament.
Performance indicator: Decision makers in other levels of government and the private sector regard the NRTEE as an important source of advice
Because much of the NRTEE’s advice focuses on the federal government’s policy role, its influence on other levels of government and sectors is smaller. Although three evaluations included representatives of non-federal sectors, there is not sufficient evidence from which to draw broad conclusions at this time. However, a small set of findings suggest that the agency is having an impact outside the federal government:
- Significant attention is being paid to the Environmental Quality in Canadian Cities report (the “urban” report) at the municipal level, with some municipal councils officially endorsing the report (City of Toronto and the Greater Vancouver Regional District)and disseminating it to a wider network of contacts to increase awareness.
- Think tanks and other non-governmental organizations (NGOs) are using the urban report to advocate to government policy makers at several levels. At least one think tank is also using the report to inform provincial decision makers on recommended policy directions in Ontario.
- Although influence at the provincial level has been varied, one province indicated that it was already using the urban report to guide its decision making. Provincial jurisdictions can be sensitive to national-level studies or policy recommendations pertaining to urban issues. However, the evaluation revealed that this concern did not arise with respect to the NRTEE report. This is an important positive finding.
- The NRTEE’s Domestic Emissions Trading Initiative is generally recognized as making an important contribution to understanding about the subject among non-expert opinion leaders and decision makers
- National stakeholders reported that the Environment and Sustainable Development Indicators Initiative had made a contribution to the development of indicators at all levels of government.
More information on the value of the NRTEE’s advice is presented in the discussion of our priority, below.
NRTEE’s influence: What can we do better?
Senior federal officials who were interviewed confirmed that the NRTEE’s advice is widely respected for its credibility, neutrality and relevance to important national issues. However, these officials also suggested that the NRTEE’s influence on federal policy should be greater, concluding that it should seek to integrate itself as a key, if not leading, player in sustainable development within the federal system. This enhanced role would likely include the provision of high-level, strategic advice to the government on sustainable development.
Reaching this objective would require significant changes to the way the NRTEE currently approaches its work. The agency is considering the implications of such a move as part of its current strategic planning efforts.New working partnerships are formed between industry, government, NGOs and other major societal actors:
A valuable indirect outcome
New partnerships that form to continue dialogue and maintain momentum on sustainable development issues are an important side benefit of NRTEE processes.
The NRTEE’s multistakeholder programs prepare the ground for further debate on contentious issues. They do this by facilitating the development of partnerships across sectors and regions of the country—partnerships that are crucial to breaking down the barriers to sustainable development in Canada.
Stakeholders and officials involved in the NRTEE’s Environment and Sustainable Development Indicators Initiative reported that its contribution to work in other levels of government owes much to the agency’s ability to work with multiple levels of government, regions and sectors in developing the indicators. The program provided an opportunity for participants to meet face to face, many for the first time, and to identify opportunities for further collaboration.
In a similar vein, the agency’s work on brownfield redevelopment resulted in the creation of the Canadian Brownfields Network to assist in implementing the NRTEE’s recommendations and act as a continuing liaison between government, stakeholders and practitioners (see sidebar).
|
The Canadian Brownfields Network (CBN) tries to accelerate brownfield redevelopment and promote effective urban revitalization. Building on the work of the NRTEE, the CBN provides its members, both brownfield practitioners and stakeholders, with a continuing opportunity to interact, exchange successful case studies and actively identify new mechanisms that will improve a community's environmental and economic performance. |
Our immediate outcome
To make balanced decisions, decision makers require a goodunderstanding of stakeholder views, areas of convergence and debate, and the range of potential solutions in specific policy areas. By involving these decision makers in NRTEE task forces, workshops and consultations, the agency helps them gain this understanding, which is an essential precursor to achieving the agency’s strategic outcome. Extensive promotion of the resulting information to targeted audiences and opinion leaders across the country builds even broader understanding among key sectors and constituencies, as well as a foundation of support for key policy themes and directions. This support, in turn, provides an additional source of confidence for decision makers.
Performance indicator: Greater awareness and understanding on the part of affected federal officials and national stakeholders
As an advisory body, the NRTEE has little ultimate control over policy decisions. Instead, it devotes considerable effort to building the prerequisite understanding. The agency has become highly skilled in achieving this outcome, a conclusion that is strongly supported by performance measurement and evaluation. Participants in NRTEE stakeholder processes and information sessions expressed familiarity with our work. They commonly agreed that they now had better awareness and understanding of the issues, even though most were already well informed before they took part in NRTEE processes and events. Surveys and evaluations demonstrated the link between raising awareness and understanding, on one hand, and building the momentum and support necessary for change, on the other:- The NRTEE conducted a major cross-country tour to promote the recommendations of its sustainable cities and brownfield redevelopment work, targeting middle- and senior-level municipal and provincial officials, other key stakeholders and opinion leaders in the media. The majority of participants reported that they had increased awareness and understanding as a result of attending the information sessions (93 percent said “yes” or “somewhat”).
- On the same tour, 71 percent of participants said theyagreed with the NRTEE’s recommendations, and over half said they were likely to act on the information they gained at the sessions. Three-quarters said the information would assist them in their decision making and in generating more discussion within their work communities.
- All federal officials interviewed were aware of the contents of the Environment and Sustainable Development Indicators Initiative report, and 80 percent indicated that their understanding of the issues had increased as a result of the initiative. Two-thirds of non-federal stakeholders indicated that their understanding of the issues had increased, although many were already experts in this area.
- Stakeholders generally believed that the Domestic Emissions Trading Initiative had made an important contribution to awareness and understanding of the subject among non-expert opinion leaders and decision makers. This initiative prepared the ground for further work by the federal government.
- No significant areas for improvement were suggested bythe evaluations or other performance measurement findings.
| 2004 Arthur Kroeger College Award for Policy Leadership Presented to the NRTEE in the spring of 2004, this prestigious award is given to an individual or organization that serves as a model to others on how to define an issue and successfully advance the policy process through the use of innovative leadership. In the NRTEE's case, the awards jury noted excellence in “pursuing policy consensus in the midst of contending economic and environmental perspectives and interests.” |
| Program area |
Status |
| Conservation of Natural Heritage | Concluded - State of the Debate report |
| Urban Sustainability | Concluded - State of the Debate report |
| Environment and Sustainable Development Indicators Initiative | Concluded - State of the Debate report |
| Ecological Fiscal Reform |
Ongoing |
| Greening of the Budget | Report issued annually |
| Conserving Canada’s Natural Capital: the Boreal Forest | Scoping concluded |
| Capital Markets and Sustainability | Scoping concluded |
| Energy and Climate Change | Scoping underway |
|
Governance |
Scoping concluded |
- The issue of domestic emissions trading has continued relevance with federal government priorities and objectives relating to climate change, particularly with respect to the most economically efficient means of achieving greenhouse gas emission reduction targets.
- Interviews confirm that environment and sustainable development indicators remain an important priority for federal, provincial and municipal governments, non-governmental organizations/not-for-profit organizations and organizations in the private sector. In addition, the ESDI Initiative is mentioned in key federal agenda documents such as the 2004 Speech from the Throne Speech and the 2004 budget plan.
- The subject of urban sustainability, including urban infrastructure, is a consistently stated key national priority and is identified in the objectives of federal government agenda documents, such as the budgets, the 2004 Speech from the Throne and departmental sustainable development strategies. The issue received heightened focus as a national priority in 2004.
- The NRTEE is able to add “very significant”or “significant” value on the topic of urban sustainability. Moreover, no other single organization was consistently identified as being better placed to address national-level urban issues. No comparable initiatives were undertaken by other organizations, including federal government agencies or task forces and public policy think tanks. The types of activities carried out by the NRTEE have high potential to be useful for urban sustainability issues on a national scale, as well as on regional and local scales. The development of specific recommendations for the federal role in urban sustainability was regarded as particularly useful.
The NRTEE looks forward to surveying non-federal stakeholders in 2004–05 to gain a fuller picture of the usefulness, relevance and credibility of its advice.
Sub-activity two: Promoting advice to federal clients and other targeted sectors In 2003–04, the NRTEE continued its efforts to ensure that federal decision makers, stakeholders in key sectors, the media and the public recognize it as a leader in providing objective views and analysis relating to the “state of the debate” on the environment and the economy in Canada. The NRTEE was extremely active this year, releasing three State of the Debate reports: Environment and Sustainable Development Indicators for Canada, Environmental Quality in Canadian Cities: The Federal Role, and Securing Canada’s Natural Capital: A Vision for Nature Conservation in the 21st Century. These reports were the basis for a variety of efforts to promote advice related to the environment and the economy.Performance indicator: A diversity of strategies are employed to reach target audiences in the federal system, opinion leaders and decision makers in Canadian society, and the Canadian public
Urban sprawl, rapid growth, gridlock, noise, smog and site contamination were among the issues addressed by a series of cross-Canada information sessions organized by the NRTEE in Vancouver, Calgary, Winnipeg, Toronto, Ottawa and Halifax this year, building on NRTEE recommendations and key findings from the agency’s reports on urban sustainability and brownfield redevlopment. Sessions stimulated discussion among local municipal leaders, including the mayor or appointed deputy in each city, regional experts, leading urban specialists and interested citizens. Designed to generate momentum for the development of a coherent response to Canada’s urban issues, the NRTEE engaged more than 1,600 people in the “cities” debate and garnered extensive media coverage at both the local and national levels. The NRTEE also organized briefings with key federal officials, industry groups and NGOs to discuss the findings from its programs as well as work in progress. These briefings often took the form of one-on-one sessions, interdepartmental briefings, or speaking engagements at major industry or NGO association conferences. The agency received extensive national media coverage throughout the year on a variety of issues including brownfield redevelopment, urban sustainability, conservation of natural heritage and environment and sustainable development indicators. The NRTEE website remained an important tool for disseminating key information to stakeholders and members of the public. In 2003–04, the number of unique visitors to the site continued to grow, increasing by 50 percent over the 2002–03 figure. The Virtual Library feature enabled people to easily access over 300 NRTEE documents on sustainable development, while the agency’s signature series, the State of the Debate reports, continued to have strong brand recognition and are among the most popular for downloads. Providing valueThe NRTEE is widely respected as a non-partisan and highly credible source of information on sustainable development issues. In a typical 18–24 month cycle, it generates in-depth analysis and recommendations in four to five areas of relevance to government priorities. At the same time, it works to build awareness and receptivity to new approaches among the nation’s most influential opinion leaders. The NRTEE does this work with an annual budget of just over $5 million, representing less than 0.003 percent of the government’s total spending.
Where we could do better The NRTEE learned through its evaluation efforts that it must redesign its approach to its Greening of the Budget submissions to ensure they are timelier, focused on fewer priorities, better costed and more clearly targeted to the current priorities of federal decision makers. The agency is currently assessing options in response to this significant finding. Although the agency has built a reputation for providing useful analysis and recommendations in discrete policy areas, federal decision makers have told us that they would also like to receive advice that is more strategic. In response, the agency is considering ways to provide a balance of strategic and issue-oriented advice in the future. Finally, the NRTEE would like to strengthen and regularize its contact with senior federal officials, working more closely with them at the beginning of NRTEE processes to identify mutual concerns and opportunities. Although federal decision makers are already included in all NRTEE processes, reaching the most senior officials could lead to better alignment of advice and policy development. This would involve finding ways to brief federal ministers or participating in the agendas of relevant federal–provincial discussions. The agency is exploring how it could achieve these communications objectives. Progress on government-wide initiatives This final section describes the NRTEE’s efforts with regard to several key government-wide initiatives. Figure 5.3 summarizes the level of maturity reached in each case. Figure 5.3: NRTEE status on government-wide initiatives|
Initiative |
Status: Foundation / Transition / Mature |
| Management Accountability Framework | Foundation established |
| Modern Comptrollership: | |
|
Approaching maturity |
|
Approaching maturity |
|
Transition stage |
|
Foundation established |
| Government on Line | Approaching maturity |
| Sustainable Development Strategies |
N/A |
| Security and Business Continuity Planning | Foundation established |
| Management of Government Information | Foundation established |
Information management system
In March 2003, in response to the Treasury Board policy on the Management of Government Information, the NRTEE initiated a major records and information management project, which is taking place from June 2003 to March 2005. This project will develop the tools, policies and procedures, and electronic systems necessary to manage information in all media. In 2003–04, the NRTEE put in place the human resources needed to support the project, developed a file plan for operational records and developed the strategy for a Record Document Information Management System (RDIMS) implementation project that will run from May 2004 to March 2005.



















