2022 Project Director Orientation - 1:00PM - 2:30 PM Pacific Time - May 5, 2022 Western Extension Risk Management Education Center - Wsu
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Western Extension Risk Management Education Center
2022 Project Director Orientation
1:00PM – 2:30 PM Pacific Time – May 5, 2022
2022 Project Orientation Tools for Measuring & Reporting Farmer/Rancher Success Shannon Neibergs, Director Jo Ann Warner, Associate Director Heather Schriver, Grants & Communications Coordinator
Webinar Instructions
• Please MUTE participant microphones to
minimize background noise.
• Use the Chat function to type in your questions.
(Scroll to bottom of Zoom window to click on
the Chat icon)
• Feel free to ask questions at any time; and we’ll
also stop for questions at the end of each
section.
Thank you!
Introductions
Underserved by Crop Insurance Projects
1. Dave Elliot & Logan Motas – Oahu Resource
Conservation & Development Council
2. Tip Hudson – Washington State University
3. Staci Emm & Lindsay Chichester – University of
Nevada Cooperative Extension
4. Melelani Oshiro & Dillon Feuz – University of
Hawaii-Manoa, CTAHR
5. Sonya DeLuca – Napa Valley Grapegrowers
(Education and Underserved)
Introductions
Education & Exploratory Projects
1. Cindy Garretson-Weibel – Wyoming Leadership Council
2. Jan Tusick – Lake County Community Development
3. Lindsay McLaggan – CA Cattlemen’s Foundation
4. Erin Austin & Sam Blomquist – Alternative Energy Resources
Association (AERO)
5. Sonya DeLuca – Napa Valley Grapegrowers (Education and
Underserved)
6. Addie Candib – American Farmland Trust
7. Kirk Hansen – Northwest Natural Resource Group (NNRG)
8. Dana Hoag – Colorado State University
9. Andrew Perleberg and Kevin Zobrist – Washington State University
10. Daniela Perez & Alejandro Tecum – Adelante Mujeres
11. Christina Stucker-Gassi – Northwest Center for Alternatives to Pesticides
(NCAP)
12. Lucy Diekmann – University of California Cooperative Extension - EXP
13. Laurie Zuckerman – Environmental Sustainability Rotary Action Group –
EXP
What We Are Going to Cover
• ERME Overview
• Measuring Outcomes Using
a Retrospective Design
• Measuring Change in Online
Learning Environments
• Invoicing Process
• RVS Online Reporting
System
• Final Report – How to
Communicate Success
Western Extension Risk Management Education Center
(Western Center)
• One of four regional Extension
risk management education
centers in the U. S.
• Administer a competitive grants
program in the 13 western states
and U.S. affiliated Pacific Islands
• Supported by funding from the
USDA National Institute of Food
and Agriculture (NIFA)
• http://westrme.wsu.edu/ERME Program
Grounded in USDA/NIFA Strategic
Goals
Requires planning and
accountability measures
Alignment of your Project Goals
with ERME Aspirational GoalsUSE OF BASELINE/BENCHMARKING DATA: COMPARE/CONTRAST.
Extension • Mission:
Risk • Educating America’s farmers and
ranchers to manage the unique risks of
Management producing food for the world’s table.
Education • Overarching Goal:
(ERME) • Helping farm and ranch families
improve their economic viability
through targeted risk management
education.Extension Risk Management Education
Legislative Authority: To educate
agricultural producers with training
that improves their economic
viability
Economic Economic viability: Refers to the farm’s
or ranch’s ability to increase
Viability: opportunities for equity growth over
time.
Outstanding projects
provide evidence of
economic gains for
producers.Measuring Outcomes/Results
Using Retrospective Evaluation
and Surveys –
When/What/How to MeasureEffective Verification of Outcomes… • Leads to improved economic viability for farmers and ranchers • Results in effective programs and policies • Provides rigorous and meaningful evidence as a routine part of program delivery. • Imparts additional value to those who do not directly benefit from a program. • End Result: Ability to contribute effectively to a shared knowledge base
What Will You Verify? Measuring participant change across the life of the project (short-medium- long term) Short Term – KASA: Knowledge, Awareness, Skills, Attitude Medium Term – Actions/Practices (behavior changes; what are they doing differently? Long Term – Conditions (Economic, environmental, community Project monitoring – Is the Project Team following the Project Steps (Plan of Work)? Is what you are doing increasing the chances of success for producers?
How Will You Verify? Methods and Timeline for Measurement Retrospective Evaluation (immediately after a training or workshop series) Follow-up Surveys (within 3-18 months after workshops or training series)
Why is this Important? Fills in knowledge gaps in risk management Achievement of outcomes that are significant to food and ag (improved profitability for producers rural prosperity community vitality…) Long Term Economic/Societal and Environmental Impacts (Public Value)
End Goal for Producer Actions is
Improved Economic Viability
(Profitability)
Five levels of producer actions:
1. Understand Short Term – KASA:
Knowledge, Awareness,
2. Analyze Skills, Attitude
3. Develop Medium Term –
Actions/Practices (behavior
4. Decide changes; what are they
5. Implement doing differently?
Long Term – Conditions
(Economic, Environmental,
Community)• ERME Benchmark Metric for
“Understanding”
• Assess changes in
understanding using a
retrospective design.
• A retrospective evaluation
Reporting measures participants’
previous versus current
Requirement knowledge on a risk topic
area(s) at the end of a
workshop or training series.
**All ERME projects are asked to
conduct this retrospective evaluation
at the end of each workshop or
training seriesERME • Use a 5 point numbered
Retrospective (Likert) scale
Evaluation • 1 will indicate No
Understanding to
Across the • 5 indicating Complete
Project Understanding
Portfolio
• Administer to
participating producers
at the end of each
workshop or training
series.Likert Scale Categories
Retrospective Evaluation for Measuring
“Understanding” or Short-Term Change
For each of the topics listed below, please check the box under the
number that indicates your level of understanding/knowledge both
before and after completing this training.
How do you rate your understanding about the following topics related to
Financial Risk:
Q1. Business Plans
Q2. Enterprise Budgets
Q3. Livestock Decision AidsRetrospective Evaluation for Measuring Medium
Term Change (Analyze/Develop/Decide)
For each of the topics listed below, please check the box under the
number that indicates your commitment to developing these tools both
before and after completing this training.
To what degree did developing the following tools help you to improve your
financial risk management :
Q1. Business Plans
Q2. Enterprise Budgets
Q3. Livestock Decision Aids
Not at all Somewhat Very much Extremely soFollow-up Surveys with a Retrospective Design Result: “x” number of producers will enterprise budgets Questions: 1.a: Did you develop an enterprise budget(Yes/No) 1.b: To what degree did developing this budget help you to improve your decision making in the area of financial risk? Not at all, Somewhat, Very much, Extremely so (Likert-Type Scale) 1.c: How much were you able to improve your profitability through utilization of an enterprise budget? Less than $99, $100 – 499, $500 – 999, More than $1000. 1.d: What is the benefit you estimate will accrue to your operation as a result of using your enterprise budgets? Less than $99, $100 – 499, $500 – 999, More than $1000. (answers the expectation of improved profitability)
Follow-up Surveys with a Retrospective Design Result: “x” number of producers will (insert result) Questions: 1.a: Did you develop (insert action verb) (insert risk mgt strategy or practice) (Yes/No) 1.b: To what degree did developing (insert action verb) (insert risk mgt strategy or practice) help you to improve your decision making process on (insert risk topic)? Not at all, Somewhat, Very much, Extremely so (Likert-Type Scale) 1.c: How much did you reduce the overall cost of production as a result of developing (insert action verb) (insert risk strategy or practice) ? Less than $99, $100 – 499, $500 – 999, More than $1000. 1.d: What is the benefit you estimate will accrue to your operation as a result of developing (insert action verb) (insert risk strategy or practice) ? Less than $99, $100 – 499, $500 – 999, More than $1000. (answers the expectation of improved profitability)
RVS Online Reporting System
Retrospective Tutorials ERME Retrospective Evaluation Presentation: http://extensionrme.org/pubs/ERME-Retrospective- Training.pdf Reporting Tutorial: Outcome Analysis – Page 19 http://extensionrme.org/pubs/ReportingTutorial.PDF
Retrospective and Other Survey Methods:
1. Online Quizzes: a quick way to measure
knowledge gain across a wide audience
2. Online Polls/Surveys: Captures direct
feedback on participants’ learning experience.
Measuring
Change in 3. Brief Online Interviews – A method for
Online participants to demonstrate proficiency in the
different risk areas.
Learning
Environments 4. Open-Ended Essay Questions: Qualitative
Assessment method for evaluating medium to
longer term learning goals {higher level learning}
5. Dialogue or Video Testimonials: Gives
participants an opportunity to reflect on their
knowledge.OPEN SOURCE ACCESS: REGISTRATION
Measuring
Change in
Online
Learning PARTICIPANT SUBSETS –
STRUCTURED
EVALUATION OR SURVEY
FOCUS GROUPS
Environments
VIDEO TESTIMONIALSQuestions/ Discussion?
Award Management &
Tools for Project
Directors• http://westrme.wsu.edu/award-
management/tools-for-project-directors/
Award • http://westrme.wsu.edu/award-
management/reporting/education-projects/
Management
**Bookmark these pages!• Evaluation Resources
Award • Funding
Management Acknowledgement
and Logo
(Tools for Project Requirements
Directors Tab) • Invoicing
• University
• Non-University
• Sample Invoice• Acknowledgement of
Support:
• This material is based
upon work supported
by USDA/NIFA under
Award Number 2012-
49200-20031.
Award
• Logos – USDA/NIFA and
Management Western ERME• Acknowledgment of Support
• Proper Naming Convention
Award • Western Extension Risk
Management Education
Management Center
• Or
• Western ERME Center• Invoicing – General
• Submit invoices monthly or no
less than quarterly
• Email to SPS@WSU.EDU
• Copy kdwhite@wsu.edu &
hschriver@wsu.edu
• Invoice Certification Statement
Invoicing Include on your invoice
• Sample Subcontract Invoice:
https://s3.wp.wsu.edu/uploads/
sites/2162/2021/05/2021-1.-
Attach-6-Sample-Invoice-1.pdf• Invoicing – General
• Can submit One Final Invoice at
the end of project or Quarterly.
• Email to SPS@WSU.EDU
Invoicing – • Copy kdwhite@wsu.edu &
Exploratory hschriver@wsu.edu
• Invoice Certification Statement
Projects Include on your invoice
• Sample Subcontract Invoice:
https://s3.wp.wsu.edu/uploads/
sites/2162/2021/05/2021-1.-
Attach-6-Sample-Invoice-1.pdfInvoicing
Invoicing Certification Statement – Include on
your statement:• Invoicing Procedures
Cost Reimbursable Subcontract
Supporting documentation
Accounting of salaries and
wages
Copies of receipts etc. from
Invoicing vendors
Travel detail
• **ERME 2022 Subaward
Attachment 4 – Non-University
or University• Invoice payment based upon current
and satisfactory reporting.
• Progress Notes Section of
Online Report
• No Program Delivery in a
quarter? Write a short
Reporting & note in the Progress Notes
Section of report.
Invoicing • Submitting invoices in the
first 3 months of your
Policy project?
• Check off the project
steps that have been
completed or;
• Write a brief description
of the program delivery
that has occurred to date
in the Progress Notes
Section of the report.• Online quarterly reports
(2022/2023 Timeline)
• July 1, 2022
• October 3, 2022
• January 3, 2023
Reporting Dates • April 3, 2023
• July 3, 2023
and Timeline – • Final Report is due October
17, 2023.
(18 Month Period • No Time Extensions
of Performance)
• Proposed Results, Project Steps,
Project Overview
• Auto populated in the online
report system
• Additional progress reports may be
submitted or report info entered at
any time.• Final Report is due 2 weeks past
end date of project
• Final Report:
• Project Overview – Highlight Results!
Final • Upload of Materials
Report & • Retrospective Evaluation results
uploaded
Invoice • Final Comments/Stories
• Actual Results/Outcomes entered
Final Invoice is due within 60 days of
final budget period end date (9/30/23).
FINAL PAYMENT contingent upon
meeting all Final Report obligations.Attachment 4 – University/Non- University/Exploratory University: https://s3.wp.wsu.edu/uploads/sites/2162/2021/05/20 21-Attachment-4-University.pdf Non-University: https://s3.wp.wsu.edu/uploads/sites/2162/2022/05/20 22-Attachment-4-Non-University.pdf Exploratory: https://s3.wp.wsu.edu/uploads/sites/2162/2022/05/20 22-Attachment-4-EXP.pdf
Questions/ Discussion?
• http://westrme.wsu.edu/award-
management/reporting/education-
projects/
Online
• https://westrme.wsu.edu/award-
Reporting management/reporting/underserv
Links for the ed-projects/
RVS System
• http://westrme.wsu.edu/award-
management/reporting/explorator
y-grants/
• http://extensionrme.org/Resource
s.aspx#RVS• http://extensionrme.org/pubs/ReportingTutorial.PDF Reporting Tutorial
Entering Your Report
Important Information
Reporting Portal
Instructions Window
Submitting A Progress Report
Reporting Status
Final Report
Your Final Report – How to
Communicate Success
Demonstrates:
Achievement of participant outcomes and program success in a public reporting system available to all
stakeholder partners
USDA
Governmental
Congressional
Public/Private Sector Stakeholders
Communities
Funding Agencies
Upper Administration at Universities• Actual Results/Outcomes
entered
Impact • Project Overview – Highlight
Reporting – Results!
Communicating
• Retrospective Evaluation
your Success in
results uploaded
the Results
Verification • Upload of Materials
System (RVS) • Final Comments
• Project Success Stories
Evidence that indicates
improved economic resilience
and viabilityAt the end of 18 months:
Impact • Enter retrospective evaluation
results into the online reporting
Reporting – system for Understanding.
Communicating • What other strategies did
your Success in producers put into practice that
resulted in measurable
the Results reductions of risk?
Verification • How many producers were able
to reduce input costs/increase
System (RVS) sales/ensure profitability by
growing business equity?
Impact:
• Describe how your project led to
improved economic resilience
and viability for your producer
participants. Write at least one story about an
individual producer in the
Reporting following format:
Successes and Describe the situation
Include outcomes
Impacts – accomplished by that
Contributing producer
to a Shared Describe any overarching
Knowledge impacts; i.e. to the
family/community/environme
Base nt etc.
• Include evidence or
indicators of improved
profitability or economic
gain
Include a testimonial from
this individual producer or
family memberStory Format Example
Situation: A father and daughter operate a small farm business on 3.75 acres
in ALBA’s Organic Farm Incubator in California. After increasing their
acreage and diversifying their crops with the goal of generating more income,
they ended up not having the demand that they expected.
Outcomes:
1. Gained new wholesale relationships for succession plantings of
celery, romaine lettuce, and green beans.
2. Acquired training in food safety and assistance in renewing their food
safety certificate.
3. Adapted to new requirements.
4. Learned how to write invoices and updated certifications to reflect the new
crop mix.
Impacts: With the increase in sales, the father has dedicated himself full-time
to the farm business and they were able to hire an additional farm worker.
Producer Quote: “The consultations on crop mix and marketing strategy were
very useful. I also have a much better understanding of how to choose crops
based on production costs, marketability and revenue.”
Link to Producer Story: https://s3.wp.wsu.edu/uploads/sites/2162/2021/03/WCRME-Outstanding-
Project-Success-Story-2021-Family-Farm-1.pdfERME Outstanding Project Awards – Made on an annual basis in each ERME region Opportunity to be recognized and present at ERME national conference Eligible to compete approximately 15 months post final report Project Directors will receive notification when the application period opens. Choose “Yes” to use the producer success story submitted as part of the final report. Story can be re-written at time of Outstanding Project Award (OPA) application.
Jo Ann Warner 509-477-2168
warnerj@wsu.edu
Shannon Neibergs 509-335-6360
sneibergs@wsu.edu
Thank you! Heather Schriver 541-891-9190
hschriver@wsu.eduYou can also read
