ExpectMore.gov


Detailed Information on the
Federal Motor Carrier Safety Administration - Operations and Programs Assessment

Program Code 10002250
Program Title Federal Motor Carrier Safety Administration - Operations and Programs
Department Name Department of Transportation
Agency/Bureau Name Federal Motor Carrier Safety Administration
Program Type(s) Direct Federal Program
Assessment Year 2004
Assessment Rating Moderately Effective
Assessment Section Scores
Section Score
Program Purpose & Design 100%
Strategic Planning 100%
Program Management 100%
Program Results/Accountability 60%
Program Funding Level
(in millions)
FY2007 $464
FY2008 $211
FY2009 $228

Ongoing Program Improvement Plans

Year Began Improvement Plan Status Comments
2005

Analyze and implement the Comprehensive Safety Analysis 2010 (CSA 2010). Key Features of CSA 2010 are to: Increase the opportunity to have contact with more carriers and drivers; Use more and better data to improve performance measurements for identifying high risk carrier and driver behaviors; and Apply a wide range of interventions to correct these high risk behaviors before they become chronic and habitual.

Action taken, but not completed Major research and development milestones were completed in FY 2007, with operational model tests to begin in January 2008 in selected States.

Completed Program Improvement Plans

Year Began Improvement Plan Status Comments
2005

Develop and implement a comprehensive and recurring Regulatory Evaluation program. This program will provide a comprehensive review of Agency regulations to evaluate their timeliness and effectiveness in improving Agency performance. Incorporate results from these reviews into the rulemaking process.

Completed Regulatory evaluation has become a standard management practice in FMCSA. The program has reviewed Parts 366, 374 and 387 of the Federal Motor Carrier Safety Regulations (FMCSRs) regulations, is reviewing Part 382, and will review Part 385. Results from previous evaluations have contributed to responses to petitions for rulemakings and towards development of current rulemaking activities concerning insurance and financial responsibilities of truck and bus companies.
2005

Develop and implement a comprehensive Quality Assurance Program to ensure Agency programs and practices are consistent, standardized and applied in a timely manner.

Completed Quality assurance reviews have become a standard management practice in FMCSA. FMCSA intends to conduct QA reviews in FY 2007 on enforcement case processing and personal property management procedures.

Program Performance Measures

Term Type  
Long-term Outcome

Measure: Highway fatality rate per 100 million vehicle miles traveled (VMT) (CY).


Explanation:

The 2006 fatality rate of 1.41 equates to 42,642 lives lost from motor vehicle crashes. USDOT's original fatality goal began as a 1998 NHTSA and FHWA goal to reduce the number of transportation deaths by 20 percent, which equated to achieving an absolute number of 33,500 annual motor vehicle fatalities by 2008. The number was changed to an equivalent rate in 2002. The original goal was based on overly optimistic behavioral assumptions??a 90% seat belt usage rate and alcohol-related fatalities falling to 11,000 annually. Current figures indicate that the national seat belt usage rate is at 82% and that there are over 17,000 alcohol-related highway fatalities annually. Additionally, an unpredictable, and sustained spike in motorcycle rider fatalities began when the original goals were set??from a historic low of 2,116 in 1997 to 4,810 in 2006 (a 127% increase).

The Administration remains committed to reducing highway fatalities and fully supports the goal of reducing fatalities to a rate of 1.0 per 100 million VMT. DOT realizes it will not reach this goal by 2008 as originally planned, and has revised the target date from 2008 to 2011, to account for the dramatically changing nature of highway safety challenges. The Department has established four fatality sub-measures??passenger vehicles, nonoccupants, motorcycle riders, and large-truck- and bus-related fatalities??which represent the breadth of all highway users. This enables DOT to more closely examine the fatality rates of these different segments of highway users, in order to develop new strategies to combat sub-measure trends that are impeding progress to the overall 1.0 goal. These four fatality sub-measures have been raised from agency specific goals to Departmental metrics to highlight the overall commitment by the Department and the three respective surface transportation modes (NHTSA, FHWA, and FMCSA) that directly support the overall 1.0 fatality rate goal and the four supporting sub-measures.

Year Target Actual
2011 1.0
Long-term/Annual Outcome

Measure: Large Truck and Bus Fatalities per 100 million total Vehicles Miles Traveled (VMT)


Explanation:The goal is no more than 0.16 large truck and bus fatalities per 100 million VMT for all vehicles by the end of 2010. The revision to this measure accounts for the fact that seventy five percent of large truck and bus crashes involve passenger vehicles as both types share a common operating environment. Secondly, the measure now correlates statistically to the DOT 1.0 goal of less than 1.0 highway-related vehicle fatalities per 100 million VMT. This measure allows management at the DOT level to see the extent to which FMCSA programs impact the attainment of the overall goal.

Year Target Actual
2006 0.179 .0178
2007 .0175 Pending
2008 .0171
2009 .0167
2010 .0160
Long-term/Annual Outcome

Measure: Large Truck Fatalities per 100 million per Truck Vehicle Miles Traveled (TVMT)


Explanation:Reduce the rate of large truck-related fatalities per 100 million truck vehicle miles traveled (TVMT) 41% from 1996 to 2008, resulting in a rate of 1.65.

Year Target Actual
1996 NA 2.81
1997 NA 2.82
1998 NA 2.75
1999 NA 2.65
2000 NA 2.57
2001 2.45 2.45
2002 2.32 2.30
2003 2.19 2.31
2004 2.07 2.37
2005 1.96 2.37
2006 1.85 2.24
2007 1.75 TBD - January 2009
2008 1.65
2009 1.65
2010 1.65
2011 1.65
2012 1.65
Annual Output

Measure: Number of Federal Compliance Reviews conducted annually.


Explanation:Number of Federal Compliance Reviews conducted annually.

Year Target Actual
2002 NA 7,577
2003 NA 9,068
2004 7,000 7,637
2005 8,000 12,449
2006 10,000 11,126
2007 10,000 10,243
2008 10,000
2009 10,000
2010 10,000
2011 10,000
2012 10,000
Annual Output

Measure: Number of Roadside Inspections conducted annually (Truck and Bus - in thousands)


Explanation:Roadside inspections (RI) represent the most visible safety-promoting instrument at FMCSA's disposal. With over 3 million actions annually, they act as a constant reminder for commercial motor carriers to comply with highway safety guidelines. Failure to pass a RI could result in a vehicle and or driver being placed out of service.

Year Target Actual
2002 NA 2,944
2003 NA 3,034
2004 2,400 2,989
2005 2,700 2,941
2006 3,000 3,032
2007 3,000 3,279
2008 3,000
2009 3,000
2010 3,000
Long-term/Annual Outcome

Measure: Number of serious reportable HAZMAT Incidents involving commercial motor vehicles


Explanation:FMCSA's goal is to reduce serious reportable truck-related hazardous incidents 20 percent by 2010 using 2000 actual results as a baseline.

Year Target Actual
2000 NA 574
2001 562 602
2002 551 477
2003 540 488
2004 529 461
2005 519 375
2006 508 400
2007 498 371
2008 Changing in 2008
Annual Outcome

Measure: States satisfying "green" data quality criteria as reflected on the State Safety Data Quality (SSDQ) Map.


Explanation:Much of FMCSA safety data is collected by States and funded through various FMCSA grant instruments. This data must be accurate and timely as it informs Agency decisions on which large truck and bus companies it should review or inspect. The data also provides a quantitative basis for analysis of potential safety, environmental, or economic impacts associated with future changes to Federal Motor Carrier regulations. States must report data in a timely, accurate and complete manner in order to achieve a "green" designation on the SSDQ map. * Criteria changed in 2007, will affecting results in 2008 and beyond.

Year Target Actual
2006 32 36
2007 38 21
2008 24
2009 28
2010 32

Questions/Answers (Detailed Assessment)

Section 1 - Program Purpose & Design
Number Question Answer Score
1.1

Is the program purpose clear?

Explanation: The Federal Motor Carrier Safety Administration (FMCSA) is charged with reducing the number and severity of crashes involving large trucks as stated in its authorizing legislation, and has safety as its highest priority. The Motor Carrier Safety Improvement Act of 1999 (MCSIA) authorized and established FMCSA to reduce commercial motor vehicle (CMV) involved crashes, fatalities, and injuries. The Agency's mission closely aligns with the Department of Transportation (DOT) Highway Safety performance goal and the Department's Safety strategic objective.

Evidence: The Motor Carrier Safety Improvement Act of 1999 (MCSIA) authorized and established FMCSA to reduce commercial motor vehicle (CMV) crashes, fatalities, and injuries. The Agency's mission closely aligns with the Department of Transportation (DOT) Highway Safety performance goal and the Department's Safety strategic objectives as explained and reported on in: DOT Strategic Plan 2003-2008 (Pg 6,), found at www.dot.gov/stratplan2008/strategic_plan.htm - _Toc52257027, the DOT Performance and Accountability Report (PAR), found at www.dot.gov/perfacc2003/safety.htm and pages 1 to 4 of FMCSA's FY 2005 Integrated Performance Budget, submitted February, 2004. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 20%
1.2

Does the program address a specific and existing problem, interest or need?

Explanation: Approximately 5,000 people die and more than 100,000 are injured on our nation's highways each year in crashes involving large trucks. In MCSIA, Congress stated that the current rate, number and severity of crashes involving large trucks were unacceptable. Additionally, the DOT Office of Inspector General (OIG) stated in 1999 that the motor carrier program (then the Office of Motor Carriers, FHWA) would be unlikely to be able to reverse the then-upward trend in large truck fatalities, and identified aspects of Large Truck Safety as management challenges. DOT OIG recommendations (TR-1999-01) are specifically addressed in sections 206, 208, 217, and 222 of MCSIA.

Evidence: In MCSIA, Congress stated that the current rate, number and severity of crashes involving large trucks were unacceptable. Additionally, FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 1-4) outlines the FMCSA's focus and objectives. Additionally, the DOT IG identified aspects of Large Truck Safety as management challenges (DOT IG TR-1999-091) and GAO/T-RCED-99-89 stated that FMCSA's activities to reduce fatalities are likely to have little short-term impact. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 20%
1.3

Is the program designed so that it is not redundant or duplicative of any other Federal, state, local or private effort?

Explanation: FMCSA's authorization includes safety regulation of interstate (and foreign/border) commercial motor vehicle transportation. FMCSA is the only federal agency that addresses the causes of commercial motor vehicle crashes and resulting injuries and fatalities. FMCSA's central strategy for reducing fatalities, injuries and crashes involving large trucks is to ensure that commercial carriers, vehicles and drivers meet the highest possible safety standards. In executing this strategy, FMCSA regulates and carries out safety enforcement operations and partners with states by enlisting the efforts of State agencies. State involvement cascades enforcement to intrastate commerce. FHWA and NHTSA share aspects of highway safety with FMCSA, but are not duplicative. FHWA addresses highway safety through roadway design and operations; and, NHTSA's programs focus on educational traffic safety efforts directed to private passenger vehicles and on vehicle manufacturing standards (including large truck). FMCSA and NHTSA coordinate on large truck safety to avoid potential overlap and build upon agency synergy. MCSAP grants provide for direct state motor carrier enforcement activities; furthermore, regulation (see 49 CFR Part 350.301) ensures these federal funds do not supplant State funds for commercial vehicle safety efforts.

Evidence: FMCSA's authorization, as defined in MCSIA, includes safety regulation of interstate (and foreign/border) commercial motor vehicle transportation. FMCSA regulates and carries out safety enforcement operations and partners with states by enlisting the efforts of State agencies in maintaining a delicate balance between federal and state regulatory authority as addressed in GAO-02-495, found at www.gao.gov/new.items/d02495.pdf (Pgs. 1-4). State involvement within the limits of CFR Part 350.301 cascades enforcement to intrastate commerce. FHWA and NHTSA share aspects of highway safety with FMCSA, but are not duplicative as outlined in FMCSA's Integrated Performance Budget, submitted February 2004 (Pgs. 1-4). (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 20%
1.4

Is the program design free of major flaws that would limit the program's effectiveness or efficiency?

Explanation: While the FMCSA did not reach their annual/long term goal in FY2003 to decrease the large truck fatality rate from 2.32 to 2.19, the design of Motor Carrier Operations and Programs is free of major flaws. FMCSA restructured its budget accounts as part of the FY 2004 budget development process (consistent with surface transportation reauthorization and OST/OMB guidance) to better consolidate safety operational programs. FMCSA has harmonized its commercial motor vehicle (CMV) safety goal in a consolidated (DOT) highway safety performance goal with NHTSA and FHWA. Program initiatives aimed at improving the focus and effectiveness of FMCSA's programs are being considered in the context of surface transportation reauthorization.

Evidence: FMCSA restructured its budget accounts as part of the FY 2004 budget development process (consistent with surface transportation reauthorization and OST/OMB guidance) to better consolidate safety operational programs as reflected in FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 1-4) and in the DOT Performance and Accountability Report and in the SAFETEA Surface Transportation Reauthorization found at www.dot.gov/perfacc2003/safety.htm and www.fhwa.dot.gov/reauthorization/ (Pgs. 9-10). (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 20%
1.5

Is the program effectively targeted, so that resources will reach intended beneficiaries and/or otherwise address the program's purpose directly?

Explanation: : FMCSA coordinates a number of complementary and supporting strategies to reduce fatalities in crashes involving large trucks. Federal programs complement and support state-conducted motor carrier safety activities to ensure compliance with Federal Motor Carrier Safety Regulations (FMCSRs). Motor carrier operations and programs coalesce into an integrated safety strategy of partnership, outreach, information and research, education, rulemaking, compliance, and enforcement. FMCSA's balanced program of enforcement and compliance programs, together with State grants, has been a key contributor in significantly reversing the trend in CMV fatalities. Without this full compliment of strategies, it could be expected that fatalities would increase along with the increases in traffic and exposure. The program's impact is evidenced in the difference between potentially increasing fatalities and the actual reductions realized, the delta representing lives saved. At the operational level, program managers actively use the Safety Status Measurement System (SafeStat) to prioritize the deployment of enforcement and compliance resources to carriers posing the greatest safety risk.

Evidence: FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 1-4, 10-14) demonstrates how the Agency critically targets its resources to attain its stated performance goal. In addition, the Agency prioritizes its activities through SafeStat, found at http://ai.volpe.dot.gov/SafeStat/SafeStatMain.asp (Select: Summary Report). (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 20%
Section 1 - Program Purpose & Design Score 100%
Section 2 - Strategic Planning
Number Question Answer Score
2.1

Does the program have a limited number of specific long-term performance measures that focus on outcomes and meaningfully reflect the purpose of the program?

Explanation: The program's long-term goal is to reduce the rate of fatalities in crashes involving large trucks. This long-term goal has been translated into specific annual performance targets and is directly tied to DOT's Safety strategic objective and Highway Safety performance goal. The program's ambitious long-term goal is to reduce the rate of large truck fatalities to 1.65 fatalities per 100 million Truck Vehicle Miles Traveled (TVMT) by 2008 and is commensurate with other DOT highway safety aims. Related to this overarching goal, the agency also tracks as indicators the number of fatalities and persons injured in crashes involving large trucks, and the rate of persons injured in crashes involving large trucks.

Evidence: FMCSA's long-term goal has been translated into specific annual performance targets as outlined in FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 10-15; 43-45; 64-65) and is directly linked to the DOT Strategic Plan 2003-2008, found at www.dot.gov/stratplan2008/strategic_plan.htm#Toc52257027 and the DOT Performance and Accountability Report (PAR), found at www.dot.gov/perfacc2003/safety.htm

YES 12%
2.2

Does the program have ambitious targets and timeframes for its long-term measures?

Explanation: FMCSA's long-term safety objective is to reduce the rate of truck-related fatalities to 1.65 per TVMT by the year 2008. This is a highly ambitious goal, equating to a 41% reduction in rate of fatalities from those experienced in 1996. FMCSA sets annual performance targets for achieving this reduction and is on track towards achieving the 1.65 long-term goal, because we have reduced the number and rate of truck-related fatalities every year for the past five years. The agency tracks and reports its progress in the annual DOT PAR and FMSCA integrated performance budget. Annual targets for reduction of the CMV fatality rate are referenced in question 4.1.

Evidence: FMCSA's outcome measures are included in the Agency's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 10-15; 43-45; 64-65) and results are reported in the DOT Performance and Accountability Report, found at www.dot.gov/perfacc2003/index.html. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
2.3

Does the program have a limited number of specific annual performance measures that can demonstrate progress toward achieving the program's long-term goals?

Explanation: FMCSA's integrated performance budget documents agency outcome and efficiency measures for Federal programs. The agency measures and tracks key operational outputs and targets, utilizing a number of leading indicators and strategic measures to determine the program's progress in meeting its long-term goals. Progress on key outputs is tracked quarterly.

Evidence: FMCSA's outcome measures can be found in: FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004: (Pgs. 10-15; 43-45; 64-65, 74-76), 'Measuring the FMCSA's Safety Objectives from Year 2000 to 2002' found at ai.volpe.dot.gov/CarrierResearchResults/HTML/SafetyMeasures/saf_meas0002.htm (Pgs. ii-ix), the Motor Carrier Safety Progress Report and Administrator's FY 2003 Accomplishments Report, found at knowzone.fmcsa.dot.gov/news/freshinfo/MC-A_Accomplish_2003.htm and quarterly progress reports are available at www.fmcsa.dot.gov/factsfigs/mcspr/MCSPR-03-31-04.html. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
2.4

Does the program have baselines and ambitious targets for its annual measures?

Explanation: FMCSA has both baseline data and targets for its annual outcome and output measures. Annual baselines and targets for output measures are documented in the Agency's annual budget submission, as is the Agency's annual outcome target. The performance outcome target and results are reflected in questions 4.1 and 4.2.

Evidence: Baseline data and targets for the Agency's outcome and output measures can be found in FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004, (Pgs. 10-15; 43-45; 64-65), and in DOT Performance and Accountability Report located at www.dot.gov/perfacc2003/safety.htm. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
2.5

Do all partners (including grantees, sub-grantees, contractors, cost-sharing partners, and other government partners) commit to and work toward the annual and/or long-term goals of the program?

Explanation: FMCSA partners at both the national and State level. At the national level, FMCSA, FHWA, and NHTSA work collaboratively and extensively with key safety partners. During 2003, the three operating administrations: 1) collaborated in the development of the safety elements of the proposed SAFETEA; 2) issued a special communiqu?? to new chief executive officers in 22 States, urging the use of strategic highway safety planning and providing State-specific highway safety data; and 3) coordinated and sponsored the 'National Highway Safety Leadership Forum' in June 2003. As a result of these and other collaborative efforts, the American Association of State Highway and Transportation Officials (AASHTO), and the Governor's Highway Safety Association (GHSA) adopted the DOT Highway Safety goal as their own in 2003, thus joining FMCSA, FHWA, and NHTSA in working toward achievement of this important Departmental goal. In addition, the goals of the Commercial Vehicle Safety Alliance (CVSA) to reduce fatalities and injuries align to the long term goals of FMCSA.At the program delivery level, States address five safety performance elements in their Commercial Vehicle Safety Plans (CVSPs), mandatory as part of their grant applications. In addition, in order to qualify for incentive funding, States agree to specific safety performance objectives that link to agency goals. FMCSA conducts reviews for compliance with program requirements and tracks the performance of each State with regard to its progress in achieving the outcome goal of reducing truck-related fatalities and crashes. In 2003, for the first time FMCSA Division Administrators (located in each State) developed and submitted annual division safety plans that include partnering with NHTSA, FHWA, and the applicable State on cross-modal safety initiatives at the State level. These annual plans strengthen the linkage between State CVSPs, FMCSA plans and national goals, and focus on achievement of specific truck safety initiatives unique to each State. The initiatives planned meld national goals with specific State truck safety issues. Plan priorities include concerted safety partnering efforts with FHWA field division and NHTSA regional partners.

Evidence: DOT's Strategic Plan 2003-2008 located at www.dot.gov/stratplan2008/strategic_plan.htm - _Toc52257027 and DOT's Performance and Accountability Report located at www.dot.gov/perfacc2003/safety.htm, together with a Secretarial Initiative to Reduce Highway Fatalities, AASHTO Policy Resolution PR 17-03, GHSA Press Release, located at www.naghsr.org/html/media/press_releases/041304.html, aMCSAP Planning memorandum, dated April 2004, State CVSPs and Division Safety Plans attest that all of the Agency's partners commit to and work toward the programs annual and long term goals. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
2.6

Are independent evaluations of sufficient scope and quality conducted on a regular basis or as needed to support program improvements and evaluate effectiveness and relevance to the problem, interest, or need?

Explanation: FMCSA's Strategic Planning and Program Evaluation Division conducts scheduled evaluations of key agency programs to determine safety impact. Additionally, the Volpe National Transportation Systems Center annually evaluates and issues reports on the effectiveness of safety mitigation strategies (FMCSA Safety Program Performance Measures - Compliance Review Impact Assessment Model, May 2003; FMCSA Safety Performance Program Performance Measures - Intervention Model: Roadside Inspection and Traffic Enforcement Effectiveness Assessment, September 2002). FMCSA programs are also the subjects of ad hoc evaluations. FMCSA is seeking to expand evaluative capabilities in FY 06 to include post-issuance regulatory evaluations and formal quality assurance reviews of key agency business processes.

Evidence: FMCSA's conducts Program Evaluations on a regular basis as listed in DOT's Strategic Plan 2003-2008 (Section 12; Program Evaluation), located www.dot.gov/stratplan2008/strategic_plan.htm. Additionally, the Agency just recently completed a CVISN Program Review in 2003 and contracts with Volpe Center in evaluating the Agency's Compliance Review and Roadside Inspection programs, located at ai.volpe.dot.gov/ProgramMeasures/PM/PerfMeas.asp. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
2.7

Are Budget requests explicitly tied to accomplishment of the annual and long-term performance goals, and are the resource needs presented in a complete and transparent manner in the program's budget?

Explanation: DOT/OST rates FMCSA 'Green' for Budget Performance and Integration plans and status; and FMCSA's integrated performance budget was highlighted in the Department's FY 2005 Budget in Brief. The FMCSA has developed a set of logic models, included in its annual integrated performance budget that details the alignment between funding for all programs and performance on agency strategic goals, including full program support costs. In the logic models contained in the agency's annual integrated performance budget, funding aligns with each of the agency's safety program objectives: enforcement, outreach, driver identification, technology deployment, and safety information capabilities. These then link to the performance goal "Save lives and reduce injuries by preventing truck and bus crashes," which links, in turn, to the DOT Highway Safety performance goal and ultimately to the Safety strategic goal. The impacts of funding, policy and legislative changes are reflected in the budget submission.

Evidence: FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004, (Pgs. 9, 45, 57, 65 and 75), DOT Budget in Brief: Policy, Performance and Program Outlook, April 9, 2002 and DOT's PMA Scorecard and PMA Success Stories located atwww.whitehouse.gov/omb/budintegration/scorecards/agency_scorecards.html clearly distinguishes the Agency's linking of annual and long term goals to accomplishments in a clear and transparent manner. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
2.8

Has the program taken meaningful steps to correct its strategic planning deficiencies?

Explanation: The agency has integrated its performance planning and reporting with its budget process and has a strong strategic planning process. Effectiveness assessments of compliance and enforcement activities are conducted annually to inform the strategic planning process and to facilitate resource allocation for performance based budgeting. The agency tasks and receives from each FMCSA Division Administrator specific, performance-based annual plans for his/her Division. In 2003, FMCSA developed and delivered data and evaluation training for field Divisions to enhance goal setting, programming and evaluation. In 2004, this training will be extended to State personnel.FMCSA has also harmonized its CMV safety goal in a consolidated DOT highway safety performance goal with NHTSA and FHWA. Program initiatives aimed at improving the focus and effectiveness of FMCSA's programs are being considered in the context of surface transportation reauthorization.

Evidence: FMCSA's FY 2005 Performance Plan is included in the Agency's 2005 Integrated Performance Budget, submitted February 2004: (Pgs. 20, 21 and 25 for example). Program Evaluations are planned well in advance to inform the budgeting process as scheduled in DOT's Strategic Plan 2003-2008, (Section 12: Program Evaluation), located at www.dot.gov/stratplan2008/strategic_plan.htm. To further enhance and advance the Agency's efforts, Division Safety Plans, as in the case of North Carolina, are required to be submitted yearly with specific performance based goals aligned with the new safety provision of SEC 1402 of the TEA-21 Reauthorization. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 12%
Section 2 - Strategic Planning Score 100%
Section 3 - Program Management
Number Question Answer Score
3.1

Does the agency regularly collect timely and credible performance information, including information from key program partners, and use it to manage the program and improve performance?

Explanation: The Motor Carrier Management Information System (MCMIS) provides a central repository of information on commercial vehicle safety data, as well as a national inventory of motor carriers and shippers. MCMIS is built to increase system reliability and customer satisfaction, improve data quality, reduce repetitive manual data entry, and provide a data warehouse of information needed by FMCSA employees and other safety professionals who strive to meet CMV safety goals. Algorithms such as the Safety Status Measurement System and the Inspection Selection System use MCMIS safety data to assess a motor carrier and to target carriers, vehicles, and/or drivers at the most risk of unsafe practices and to prioritize the deployment of enforcement resources. MCMIS data are used by: 1) FMCSA and State agencies for targeting safety enforcement and for developing safety programs; and, 2) FMCSA, States, and other safety organizations to evaluate safety trends, promote safety programs, and evaluate the effectiveness of existing and proposed safety guidelines, enforcement standards, and rules. FMCSA also draws on NHTSA's FARS data and FHWA's HPMS data on vehicle miles traveled in order to track the program's annual and long-term performance goals. The accuracy, timeliness and completeness of data entered by States continue to be a challenge. The agency has a broad spectrum of strategies to improve data quality including, incentive grants, Federal and State training, data systems improvements and targeted State initiatives.

Evidence: FMCSA regularly collects a broad array of timely and credible data, including data and Program Measures from key program partners. Management Information System (MCMIS) is the agency's decision-making backbone. MCMIS data are used by: 1) FMCSA and State agencies for targeting safety enforcement and for developing safety programs; and, 2) FMCSA, States, and other safety organizations to evaluate safety trends, promote safety programs, and evaluate the effectiveness of existing and proposed safety guidelines, enforcement standards, and rules. This information is available on the web located at www.fmcsa.dot.gov/related.htm Program Measures,Introduction,About Program Measures,About Program Measures and SAFER Web.

YES 14%
3.2

Are Federal managers and program partners (including grantees, sub-grantees, contractors, cost-sharing partners, and other government partners) held accountable for cost, schedule and performance results?

Explanation: The FMCSA Administrator enters into an annual performance agreement with the Secretary in support of Departmental strategic and performance goals. Progress is reported annually in the Administrator's Accomplishment Report. Key performance aspects are then subsequently cascaded through a network of performance agreements to FMCSA SES members and their subordinate managerial and program staff. Performance is tracked and updated quarterly.The performance of program partners i.e., grantee States, is also tracked. The grant programs have been strategically designed to incorporate incentive grants for those grantees that demonstrate improvement in identified safety and program performance factors.When outside contractors are engaged for work supporting the program, the contracts include explicit performance requirements.

Evidence: FMCSA's managers together with program partners and contractors are held accountable for their performance through as evidenced by: the Administrator's FY 2003 Accomplishment Report, located at knowzone.fmcsa.dot.gov/pma.asp?PMAItem=Budget, FMCSA SES and managerial performance agreements,GAO-02-495: www.gao.gov/new.items/d02495.pdf A&I Online Program Measures,Introduction,About Program Measures,About Program Measures, Division Safety Plans (North Carolina), CVSPs (Previously provided) and Contract: DTFHY61-00-00069. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 14%
3.3

Are funds (Federal and partners') obligated in a timely manner and spent for the intended purpose?

Explanation: Program managers and field units must provide quarterly budget plans. Procurements are checked for alignment with legislative mandates and receive budget element approval (Block 2) and are reconciled to maintain anti-deficiency status with monthly reports (SF-133) to provide information for resource reallocation. These SF-133s are submitted weekly during the fourth quarter to provide needed timely information. With respect to grant programs, funds are obligated by FMCSA State Division Administrators upon receipt of the allocation memo and an acceptable CVSP. Grant program managers monitor the obligation activity for timeliness on a regular basis, and State Division Administrators review all reimbursement vouchers to ensure that claimed expenses are in conformance with the approved CVSP. Any questionable expenditures are immediately resolved with State partners.

Evidence: Both Federal and partners funds are obligated and tracked in a timely manner as evidenced by, Quarterly Budget Plans, Procurement Request Policy Memo dated April 5, 2004 and CVSP reimbursement and compliance documentation. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 14%
3.4

Does the program have procedures (e.g. competitive sourcing/cost comparisons, IT improvements, appropriate incentives) to measure and achieve efficiencies and cost effectiveness in program execution?

Explanation: Because of the importance of timely, quality safety data to the Agency, FMCSA has developed an efficiency measure for the timeliness of the data upload. In addition, FMCSA has high-level efficiency annual index which serves as the focus for organizational excellence. A competitive sourcing coordinator has been appointed; and, two functions are currently being evaluated for competitive sourcing. Plans are underway to implement Managerial Cost Accounting for a large share of agency resources. In addition, the agency looks to increasingly capitalize on information technology (e-Gov) initiatives to streamline internal processes and to increase public accessibility to programs and information. Our e-Gov initiatives include advances in processing operating authority, greater accessibility to safety data, and biennial carrier census. FMCSA is a leader within DOT for Do-It-Yourself initiatives.

Evidence: FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 82-83, TBD) establishes two efficiency measures to gauge and measure the effectiveness of the Agency's operations. To improve efficiency of agency operations, FMCSA aims to work with States to improve timeliness of crash and inspection data, reducing the number of days to upload State data to MCMIS. Additionally, a high-level efficiency measure, lives saved, serves as the Agency's focus for organizational excellence. FMCSA's Competitive Sourcing policy and strategies are located at http://knowzone.fmcsa.dot.gov/pma.asp?PMAItem=Competitive. These initiatives have significantly contributed to the Agency's recent achievements as outlined in PMA Benefits and Success Stories. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 14%
3.5

Does the program collaborate and coordinate effectively with related programs?

Explanation: FMCSA collaborates with the highway and transportation safety programs of DOT, FHWA, NHTSA, RSPA, and State partners. In addition, FMCSA coordinates its border safety inspection operations with the activities of DHS and border agencies, border State enforcement authorities, and Canadian and Mexican counterparts.

Evidence: The Agency's recent collaborations include, initiatives outlined in an Information Memorandum to the Deputy Secretary, dated March 31, 2003 and at AASHTO Subcommittee on Highway Transport ANNUAL MEETING JUNE 9-10, 2003 Holiday Inn, Riverwalk San Antonio, Texas. Additionally, DOT's Strategic Plan 2003-2008 located at www.dot.gov/stratplan2008/strategic_plan.htm - _Toc52257027 and FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004 (Pgs. 21-26), provide additional information on collaborative and coordinated initiatives. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 14%
3.6

Does the program use strong financial management practices?

Explanation: FMCSA exhibits strong financial management practices in administering program funds. As of FY 2004, FMCSA has contracted with a third party accounting service provider, Federal Aviation Administration (FAA) Office of Financial Operations, who in conjunction with agency program offices ensure the proper use of funds, along with prompt, accurate payments and accurate financial reporting. FMCSA and FAA's management systems and the DELPHI accounting systems meet all statutory requirements. The agency is currently standing up an integrated financial and performance-based cost accounting system which will support daily operations. This cost accounting system will be operational by summer 2004. FMCSA received a clean audit opinion for its FY 2003 Highway Trust Fund Audit performed by Independent Auditors Clifton Gunderson. As a result of this audit, FMCSA's Corrective Action Plan addresses identified reportable practices, and details the agency's plans to resolve reported weaknesses.

Evidence: FMCSA's programs are reviewed each year and is 'Green' on the DOT PMA Scorecard for Financial Performance, located at www.whitehouse.gov/omb/budintegration/scorecards/exec_branch02.pdf. and has identified measure to address audit recommendations in FMCSA's Corrective Action Plan. Additionally, FMSCA is standing up an integrated financial and performance-based cost accounting system as demonstrated in the Agency's Managerial Cost Accounting documentation. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 14%
3.7

Has the program taken meaningful steps to address its management deficiencies?

Explanation: FMCSA conducts program evaluations and process reviews to identify program and management deficiencies. Several process reviews of key business programs are currently underway. FMCSA has developed and begun implementation of a Human Capital Plan and a companion Workforce Plan. These Plans address succession planning, competencies and skill gaps, competitive sourcing and other important Human Capital issues and trends. In May 2004, key FMCSA managers received FMFIA training to ensure compliance with fiscal controls.FMCSA is also increasingly integrating findings and recommendations of General Accounting Office (GAO), DOT Office of Inspector General (OIG), and National Transportation Safety Board (NTSB) as integral components of the agency's safety strategy and operational guidance. In 2003, FMCSA successfully addressed all aspects of the GAO's large truck safety management challenge. FMCSA also successfully closed 7 open safety recommendations issued by the NTSB, as well as 20 audit recommendations issued by the DOT/OIG.

Evidence: FMSCA continually reviews and evaluates its programs to improve their effectiveness as evidenced by the Agency's Human Capital Plan, its Workforce Plan, the Enforcement Process Review memo, the Driver, Vehicle and Roadside Strategies Program and its 'Concept of Operations for R&T Project Exit Strategies.' FMCSA's conducts Program Evaluations on a regular basis as listed in DOT's Strategic Plan 2003-2008 (Section 12; Program Evaluation), located at: www.dot.gov/stratplan2008/strategic_plan.htm. Additionally, the Agency has made significant progress in implementing DOT-OIG/NTSB and GAO recommendations as referenced in FMCSA's input to the DOT 2003 Performance and Accountability Report (MEMO: Performance Input to DOT 2003 Performance and Accountability Report, dated October 23, 2003).(To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

YES 14%
Section 3 - Program Management Score 100%
Section 4 - Program Results/Accountability
Number Question Answer Score
4.1

Has the program demonstrated adequate progress in achieving its long-term performance goals?

Explanation: As stated in the responses to 2.1 and 2.2, the program's long-term performance goal is to reduce the large truck fatality rate 41% from 1996 to 2008, to a rate of 1.65 large truck fatalities per 100 million truck vehicle miles traveled. The program has achieved reductions in the large truck fatality rate in each of the past five years and is on track to achieve this ambitious long-term goal. Although the 2003 target was missed, it was not missed by a large margin and the program has maintained a downward trend in the large truck fatality rate. The number of large truck injuries and the large truck injury rate ' two leading indicators tracked by the program ' have also shown improvement over the past three years. If the crash rate had remained at the 1996 fatality rate level of 2.81 per 100 million TVMT, there would have been an estimated 6,035 lives lost in 2002 in crashes involving large trucks. FMCSA interventions, then, have contributed to 1,138 lives saved in 2002.

Evidence: FMCSA's progress in achieving long-term goals is documented in DOT Performance and Accountability Report, located at www.dot.gov/perfacc2003/index.html, the Administrator's FY 2003 Accomplishments Report, located at knowzone.fmcsa.dot.gov/pma.asp?PMAItem=Budget and in FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004: (Pgs. 10-15). (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

LARGE EXTENT 13%
4.2

Does the program (including program partners) achieve its annual performance goals?

Explanation: In addition to making progress toward its long-term performance goal of reducing CMV fatality rate, the program is progressing in its annual performance goals. The program has met or exceeded its annual targets for its large truck fatality rate measure in each year except 2003. In addition, the program exceeded its 2003 target for number of roadside inspections conducted annually and nearly achieved its 2003 target for number of Federal compliance reviews conducted annually.

Evidence: FMCSA's annual Program Performance Goals, including partners, are documented in DOT's Performance and Accountability Report located at http://www.dot.gov/perfacc2003/index.html, the Administrator's FY 2003 Accomplishments Report, located at http://knowzone.fmcsa.dot.gov/pma.asp?PMAItem=Budget and in FMCSA's FY 2005 Integrated Performance Budget, submitted February 2004, (Pgs. 10-15). ?? DOT Performance and Accountability Report: http://www.dot.gov/perfacc2003/index.html ?? FMCSA's FY 2005 Integrated Performance Budget: (Pgs. 10-15) ?? Administrator's FY 2003 Accomplishments Report http://knowzone.fmcsa.dot.gov/pma.asp?PMAItem=Budget. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

LARGE EXTENT 13%
4.3

Does the program demonstrate improved efficiencies or cost effectiveness in achieving program goals each year?

Explanation: Even though the program did not achieve its annual performance target in 2003 to improve efficiency of agency operations, FMCSA aims to work with States to improve timeliness of crash and inspection data, reducing the number of days to upload State data to MCMIS. As recently as 2002, it took nearly 50 days, on average, for inspection data to be uploaded, and more than 150 days for the upload of crash data. Since 2002, FMCSA has worked with State partners to emphasize the importance of improved upload efficiency, reducing the cycle times for inspection data 53% and crash data 34%, respectively. The agency has established outyear targets for improving the efficiency of State data processing. In addition, efficiency of agency operations at saving lives is a high-level index of agency efficiency and organizational excellence. The agency's efficiency measure compares annual lives saved in large truck-related crashes on the nation's highways with the FMCSA overall budget. Overall, the trend since 1997 is positive, with the agency's efficiency improving each year except 2001, when increased agency resources slightly lagged improvements in highway safety. Otherwise, resource increases have yielded compounded safety benefits. Agency efficiency improved more than 20% in 2002, owing to a 57% increase in lives saved as compared with a 29% budget increase.

Evidence: ?? FMCSA FY 2006 Integrate Performance Budget

LARGE EXTENT 13%
4.4

Does the performance of this program compare favorably to other programs, including government, private, etc., with similar purpose and goals?

Explanation: FMCSA's program compares favorably to programs with similar purposes and goals, such as NHTSA. FMCSA's performance has exceeded that of similar programs, an achievement considering a backdrop of a static highway fatality rate and increasing passenger and commercial vehicle miles traveled. FMCSA works in concert with NHTSA, FHWA, and other DOT operating administrations to achieve the DOT highway safety goal. Safety organizations such as GHSA, AASHTO, and others have adopted the DOT highway safety goal and contribute to FMCSA's efforts to decrease the large truck fatality rate.

Evidence: Support for and adoption of FMCSA's safety goal can be viewed at DOT's Strategic Plan 2003-2008, located at www.dot.gov/stratplan2008/strategic_plan.htm, DOT's Performance and Accountability Report, located at www.dot.gov/perfacc2003/index.html, www.naghsr.org/html/media/press_releases/041304.html, in a memo; Secretarial Initiative to Reduce Highway Fatalities, dated 3/31/03, and in AASHTO Policy Resolution PR-17-03. (To obtain copies of FMSCA's budget related material please contact either the House Appropriations Committee at (202) 225-2771 or the Senate Appropriations Committee at (202) 224-7363. To obtain copies of material not available on the web please contact Tom Lawler at 202-366-0072 or tom.lawler@fmcsa.dot.gov.)

LARGE EXTENT 13%
4.5

Do independent evaluations of sufficient scope and quality indicate that the program is effective and achieving results?

Explanation: While rigorous program effectiveness evaluations of the program's major operational compliance and enforcement activities are conducted annually by the Volpe National Transportation Systems Center, evaluations do not show that FMCSA can achieve its goals and results through these safety interventions alone. These evaluations focus on the program's impact and effectiveness of the efforts that FMCSA gives toward truck safety. Specifically, the effectiveness of compliance reviews, roadside inspections, and traffic enforcement in reducing crashes, fatalities, and injuries is evaluated using the (1) Intervention Model and (2) Compliance Review Impact Assessment Model. These evaluation models yield annual estimates of crashes avoided, injuries avoided, and lives saved attributable to these interventions. FMCSA is seeking to expand evaluative capabilities in FY 2006 to include post-issuance regulatory evaluations and formal quality assurance reviews of key agency business processes.

Evidence: FMCSA's Program Effectiveness can be viewed at http://ai.volpe.dot.gov/ProgramMeasures/PM/PM.asp

SMALL EXTENT 7%
Section 4 - Program Results/Accountability Score 60%


Last updated: 09062008.2004SPR