Wednesday, January 26, 2011

Sales Manager - Case analysis - Training ROI

How to calculate ROI training.
A sales manager underwent a training workshop and came back with the following monthly performance.
Sales before and after :   120,000 and 140,000
Profit before and after:  12,000 and 16,800
Use return on sales as the Key performance indicator.
a)  What is the total improvement?  b)  What is the improvement contributed by improved competency or due to efficiency?  c)  What is the improvement caused by the volume change?  d)  What is the ROI on training if the cost of training is 10,000?

Answers
a) 4,800 total improvement
b) 2,800 efficiency improvement
c) 2,000 volume improvement
d) 2800/10,000 = 28% say per month. or 336% per year.

Note:  Efficiency and volume improvement has been separated.
For ROI just take the efficiency improvement in the calculation.

Arriffin Mansor 012-2786282









Friday, January 21, 2011

What they quoted me in UK training journal


JAY CROSS - What Andrew would do
I can’t muster the energy to respond to the opening statement by Jim Cass. But I would like to reply to Phil Pryce’s comment: “The ROI (£) in training is notoriously difficult (nigh impossible) to prove but what about the other benefits in doing a job better for example.”
I agree that other alternative data to financial impacts of training might be preferred by some clients but it is straightforward enough to determine financial impacts provided an effective TNA is undertaken, clear metrics are agreed up front and the process is not as an after thought.
And the issue of correlation; cause and effect is addressed perfectly by Jay Cross in his recent book called ‘What Would Andrew Do’. He looks closely at the process of evaluation and proving the alignment of development and learning in organisation. He comes to pretty much the same conclusion as me on this issue. Here’s a quote. Great minds think alike or all fools think the same depending on your position.
'“Proof is a figment” Otherwise brilliant people assure me that it’s impossible to isolate the impact of training. You can never tell whether some concurrent event has contaminated the results and negated their value as scientific evidence of training’s impact. To which I reply, “Baloney!” (Not an exact quote.) All quests for certainty in our uncertain world are futile. Business decisions are made with less-than-perfect information; it comes with the territory. Management is not conducting a science class – it’s looking for results.
So the question is not: How do we prove beyond a shadow of a doubt that a given training program produced a given result? The question is: What will our sponsor accept as persuasive evidence that the program produced the result? Working with strong probabilities, we proceed to make our case logically – linking learning to business results. Establish a causal link between a particular skill deficiency and a particular business outcome. If the owner of the problem buys into this logic and the way you will measure it after training, that’s all the proof you need.'
And to finish, one final quote from Arriffin Mansor:
'Training is a social science, it is obviously impossible to evaluate the effects of training with laboratory and test tube precision. Just like any other business decision, we have to live with assumptions and informed analysis, not absolute examination and medical scientific rigour. If we accept ROI in general business terms, how could we not accept ROI in training?'
Just a different view.

Hedda Bird's picture

The Value of Training - well value to whom?

The training profession spends huge amounts of time and energy looking in minute detail at the training event ( classroom, online - whatever), and minimal amounts of time trying to understand what the training is actually for. That is, what will be different in the organisation once the training is complete. IF ( and its a big if) TNA actually analyses the organisational need for which training may be part or all of the solution, then its worth its weight in gold, and will help the whole organisation understand better what it needs to do to achieve a result. Mostly TNA picks up a set of 'skill requirements' that may have been generated by a competency list produced by an unknown person some time ago, or the perceived skill needs dictated by a line manager without close analysis of the problem. (You know the sort - any possible hint that their team isn't performing, and it must be due to lack of training).
The same applies to evaluation - IF it actually evaluates the difference between before and after ( even allowing for some other non-training effects to have an impact) then it is a valuable, and value adding activity. If it helps you IMPROVE the difference between before and after, thats even better. If it only looks at the training event, then once you have reached a minimum quality standard, it adds little value.
To sum up: For training to be valuable to an organisation we have to have SOME idea of what difference the training has made. Jim is right, that much of what passes for TNA and evaluation is really inward looking to the L&D profession and meaningless to the rest of the organisation. Simply getting people to tell us they had a good experience ( hopefully true) and that they learnt a lot ( infact, unlikely to be true - most evidence shows that people consistently over estimate how much they have learned) is indeed poor science.
But its not all doom and gloom! Just starting to think about what difference the training might make ( creating a LIne of Sight between training and organisational goals for instance) can start to make a real difference both to the content and the impact of a training programme.


Problems in measuring training results


  1. The net impact of training is difficult to recognize.  Since profits has always been the business objective the additional net gain as the result of training should be measured.
  2. The influence of other factors need to be eliminated as it is not done in a tube.
  3. The cost of training intervention should include opportunity costs too.  For example, the participant salaries or loss of earnings for the corporation due to their training activities. 
  4. As in all measurement, training too requires realistic assumptions.
  5. Use input output to measure results of training.
  6. Measure expected change results minus before training performance.
  7. The change in competency causes the KPI line to shift to the left indicating improvement in performance after training.
  8. The solutions are suggested in my other posts.

Arriffin Mansor 012-2786282

Wednesday, January 19, 2011

Performance Objectives

Objectives could be defined at 4 levels valid probably for the next 6  or 12 months using accepted KPIs.
  • Corporate objectives
  • Departmental objectives
  • Sectional objectives
  • Individual objective
Next, a set of key result areas are identified for each objective or goal.

Generally, we use financial ratios for performance measurement.  They are creditable, consistent and objective for comparison purposes.

The best measure of efficiency is dividing output by input.

Return is a better measure of performance.i.e outcome divided by input.

Arriffin Mansor 012-2786282

Tuesday, January 18, 2011

Building performance Leadership

How to build an effective team leader.
  1. Clear Goals setting and definition - quantitative metrics
  2. Key result areas as discussed and identified
  3. Team's KPI as discussed and chosen
  4. Measuring and evaluating Team performance 
  5. Team  problems and solutions discussed and adopted
  6. Team Initiatives or programs discussed
  7. Leadership development
  8. Performance improvement
  9. Strategic mapping
  10. Performance analysis and evaluation.
  11. Group dynamics and synergy
  12. communication improvement among team members.
  13. Problem solving and decision making
Arriffin Mansor 012-2786282


Training Need Analysis

It is unfortunate I could not upload a graphic presentation in this column.


  1. Identifying past  Performance Gaps  - using financial statements
      • Gaps    - Performance Gap Analysis -  Critical Performance Gaps - Persons/Groups ----CGA
      • (Input Output Analysis)    (Use Du Pont ROE Chart)
  2. Future Gaps - Global       Expected        LT competency reqmt.
      • Industry        ROE growth   ST competency reqmt    
      • Scenario
      • (the above two steps identify sets of critical competency gaps for critical staff.) (key performance Areas)(within the organisation)
  3. Competency gaps Analysis
      • competency profile of key workers
  4. Delivery Training Alternatives
      • Costs
  5. Justify Training  ---Expected Performance Improvement (before and after)  - Input output Analysis
      • to be delivered----Exp Training Costs (Actual + Opportunity)   Expected ROI --Cash flows --Expected IRR/NPV
      • Evaluate
      • Training      ---(Same as above) (except that they are all actual figures) Actual Return on Investment etc
  6. Annual Training and budgeting based on expected ROI and prioritisation. 

                            


Arriffin Mansor 012-2786282

Sunday, January 16, 2011

After ROI it is IRR

If you can calculate the ROI of training, you might as well proceed to calculate the internal rate of return of the training project.
The additional steps are as follows
Use excel or lotus spreadsheet for the purpose of analysis
1.  Extend the training benefits to the economic life of the training.
2.  Project the cash inflows and outflows of the training.
3.  Calculate IRR/NPV

IRR and NPV has better meaning than ROI.  It takes into account time value of money.


Arriffin Mansor 012-2786282

Training Management: Development Training Need Analysis

Saturday, January 15, 2011

Development Training Need Analysis

Being futuristic, development training is more difficult to identify than the normal training.
The future may include industry and global trend.  In addition, the planner may have his own reasons to forecast growth in certain areas.

The steps to conduct development TNA are as follows:-
  1. Project ROE/ROA of the company say in the next 5 years
    • based on market analysis
    • based on market positioning
    • based on market size and growth rate
  2. Design projected business model with profit plans
  3. Cascade in accordance to Du Pont Chart based on improved strategies.
  4. Critical Performance Gaps
  5. Locate best practices through benchmarking
  6. Chart the BSC perspectives at corporate level
  7. Identify the Critical Success Factors of the company.
  8. Use BSC perspectives to identify individual's training needs - competency gaps
  9. Justify training through expected ROI.
Based on the above, a new set of competencies are recognized to bring the company to the next level.

Arriffin Mansor 012-2786282

Friday, January 14, 2011

Individual training needs - the micro unit

  1. The workload of a worker is drawn from the workload of his boss.
  2. Ascertain the performance gaps by contrasting with the industry standards
  3. Use the BSC perspectives to get the competency needs of a worker.
  4. Alternatively, use the competency profile of an equivalent standard worker tracked by benchmarking.
  5. Best Practices become competency requirement.
  6. Competency gaps are the training needs


Arriffin Mansor 012-2786282

Identifying Developmental Training Needs

Developmental needs refers to the future needs of an organisation as oppose to the normal training needs which attempt to solve the current performance gaps.

How to project the growth of an organisation?  The best indicator of performance growth is the return on equity and the return on assets.  For example if last year you achieve 15% ROE,  projected 20% ROE would probably mean a new set of strategies are required.

The concept of cause effect linking up of all the strategies with lines towards the ROE is called the strategic map.

What variables within the ROE format you need to improve to result in higher ROE?

The change must be in line with accepted or best practice strategy.

To identify the learning needs the BSC perspectives could be applied.

At the bottom of the strategic map is the HR inputs.

We work downward to get the training needs.


Arriffin Mansor 012-2786282

Thursday, January 13, 2011

IMPROVEMENT AND DEVELOPMENT TRAINING - 8 KEY STEPS

4 plus 4 steps

PERFORMANCE PHASE
1.  Performance Gaps - (ROE format)
2.  Critical Gaps (pareto and sensitivity analysis)
3  Eliminate non-training variables - (input output analysis)
4.  Calculate actual KPI of identified persons - (financial ratios)

COMPETENCY PHASE
5.  Competency profile of the benchmarked competent worker - (best practices and a defined set of KSA)
6.  Competency Gaps identified by comparing standards with actuals. - (a set of net KSA)
7.  Categorise and combine the gap competencies (core, soft and hard)
8.  Adopt delivery strategies on best practice basis.

Apply these steps to get the micro and the macro needs

Arriffin Mansor 012-2786282
arriffin@gmail.com

Monday, January 10, 2011

Training Need Analysis - 5 key steps

  1. Identify critical performance gaps of an organisation -  by ROE format.
    • variance analysis between actual against standards
    • use pareto principle to identify the most critical
  2. Analyse and select performance gaps caused by lack of competency - use input output analysis
  3. Bench mark to get the best practices and standard competency profile - use KPI
  4. Compare competency of relevant job holders with that of standard - competency gaps
    • competency and depth
    • Eliminate factors other than competency
  5. Category and cluster competencies for appropriate training strategy and delivery 

Arriffin Mansor 012-2786282

Thursday, January 6, 2011

From Performance Gap to Needs Analysis - Video

Arriffin Mansor 012-2786282
Please read my comments below on the above talks.