Operations assessment

by Alex Roan on Jul 1, 2024

Introduction

Business transformation is a process where an organisation changes from an existing to a target operational state. Organisations spend a significant amount of effort identifying these improved target states. Corporate strategy drives this at macro level while team, department, function and business area managers are responsible for the execution at a lower level.

Whether identifying, assessing, initiating or executing transformation it's critical to have a good understanding of the current operational state. This is the baseline against which everything else flows; feasibility, benefits, effort, time, cost, risk and more.

The current operational state can be investigated, documented and discussed by carrying out an operational assessment. This is an activity which is relevant to all forms of business transformation. An operational assessment can take many forms in terms of scope, approach and level of detail. This depends upon the nature of the transformation in question.

This article is a discussion of operational assessments and how they apply to different organisations and transformation programs. I've put this together based on personal experience as an analyst, consultant and project manager, however every organisation and every project is different. Some viewpoints may not be relevant in some situations, but hopefully still provide a useful basis for consideration.

To plan and execute an operational assessment in a quality way we need to be clear on the purpose of assessment, the structure or organisations, the way assessments vary for different transformation types and different operational areas. The discussion is organised in the following way:

An illustration of the article contents

For clarity, examples of business transformation programs are:

And examples of affected operational areas are:

We will define these in more detail later.

Operational assessments can occur at different levels of detail. Small scale assessments may occur as part of daily operations. Events such as encountering issues, reviewing results or holding team meetings may lead to the documentation of an idea for transformation in the form of a simple document, e-mail or support request. This could be considered as an initial assessment of a business situation. Usually detail is minimal at this stage; only what is required to consider if further investigation is merited.

Small scale assessments can lead to more formalised assessments with the objective to validate the opportunity or problem in detail and capture baseline factors such as feasibility, benefit level and effort estimates. As more detail becomes available a decision may be taken to transform the idea into a formalised change request, project or program. This progression into an executional phase often starts with another form of assessment such as 'requirements gathering' or 'as is' analysis.

So, assessments can happen at different levels of details throughout the transformation process. Consider a generalised flow from idea to execution:

  1. A need for change is identified with a 'mini assessment', for example:
    • During daily operations; an issue is encountered or opportunity discovered
    • As part of the strategy or planning process
    • As part of the execution of an existing transformation program
  2. A more formalised and detailed assessment is initiated to assess feasibility, benefit and cost
    • This can help create a baseline for change
    • And a business case for change
  3. If approved, a transformation program may be initiated, which may have in depth assessments such as:
    • 'as is' analysis, requirements gathering
    • Design, build, deploy etc.

There tends to be more formalisation around step 3; the execution of business transformation programs, than steps 1 and 2; the idea generation through to approval.

There are benefits to put more formality around the `idea to transformation project initiation process. I'd recommend tracking this in a centralised way:

This should improve the quality of ideas that progress to transformation programs and the likelihood of success of those.

The scale of assessment

At the simpler end of transformation the scale of an assessment can take the form of a detailed description of a business issue. This forms the basis of a case for change. Consider the following examples:

At the more complex end of the scale an assessment may need to analyse a comprehensive range of factors in depth. This could include external factors such as the economic forecast, market forecast and competitor analysis as well as a internal factors such as a detailed operational analysis. Consider the following examples:

The need for assessment

Learning from past transformation projects

Looking back at the issues and problems I've experienced while working on transformation programs, many were at least in part caused by an incorrect understanding of the current state. This can be traced back to either a lack of assessment or a poor quality assessment.

When encountering an issue during a change program there is a tendency to blame factors such as the methodology, the team capability, and the resource availability. However, while these are often contributing factors, the root cause is often a mistake or underestimation of scope including the work required to deal with that scope. This is a fundamental error in defining the benefits of transformation without due diligence on identifying the true 'volume' of transformation required to achieve those.

The project management institute defines key project management dimensions of cost, time, scope, quality, benefits and risk. Experienced project managers are well versed in the challenges of balancing these. However, projects are often in trouble from day one. The errors made in scoping prior to project initiation lead to unrealistic timelines, incorrect effort estimates and in the worst case project objectives which are not feasible. These issues also mean the project teams are not correctly sized or lack required capabilities. Often it's not only the case that cost, time, scope, quality, benefit and risk are mismanaged, it's the case that they are not correctly sized at the outset.

When it comes to a lack of assessment or a poor quality assessment some situations I commonly see include:

It's useful to consider why assessments are often incomplete and develop strategies to mitigate these. Some of the factors I've observed are:

Challenges maintaining depth of knowledge

Managers have to balance time between managing strategy and people as well overseeing their operational areas. As managers take on more responsibilities it becomes difficult to retain a depth of operational knowledge.

Consider that operations are divided into business units and functions. These then break down into departments and teams which run processes. Each process may involve human actions, data, systems, reports and controls. They may also be affected by issues, problems, risks and other transformations. The level of detail to consider when analysing an operation is extensive.

The more responsibility a manager takes the harder it is for them to maintain depth of knowledge on the current operations. Managers risk using out of date knowledge or making incorrect assumptions when they are involved in the identification and planning of business transformations. I've observed that managers have a tendency to underestimate the effort to analyse, design and build solutions in complex areas. A formalised assessment process with the structured involvement of experts can help to mitigate this risk.

Poor knowledge management

A common issue organisations face is a lack of documentation or poor quality documentation. Creating and maintaining documentation can be challenging. Often this work is avoided. Even when good quality documentation is created it may not be kept up to date.

A lack of documentation compounds the difficulties that managers face staying up to date on detail. It also makes it hard to onboard new employees or utilise consultants or contractors. Furthermore it represents a control and audit risk. As time passes a lack of documentation usually leads to poor or inconsistent knowledge transfer. This is a major source of generating process variation.

An organisational issue that arises due to poor knowledge management is the creation of the 'lone wolf' expert. Teams may end up with individuals who keep knowledge to themselves. This can lead to process bottlenecks and business continuity risks. These individuals can also become major barriers to transformation. This can be difficult for managers to deal with.

A lack of knowledge management and documentation should be considered as a high risk for transformation. If the current operational situation is not well understood then the volume of change to achieve a transformations objectives cannot be well defined. During transformation programs it's very common for scope increases to occur due to discovering new processes, new issues or hidden data and systems complexities.

Misleading reports

Leaders and managers review and discuss a range of reports as part of the decision making process. These reports contain financial and operational metrics. While they are useful, they can only convey part of what is happening in operations. For example a report showing manufacturing variances per cost center may give a good overview of manufacturing performance, but it will rarely explain why performance varies. It's no replacement for observing the process in the factory.

One mechanism which helps is the preparation of accompanying commentary by experts. However it's not feasible to prepare commentary covering everything, neither is it possible to involve deep level experts in all decision making processes.

Bias

Managers have a tendency to make decisions with bias towards their previous experiences. For example a manager who has experienced successful outsourcing may have a tendency to suggest outsourcing as a solution when they move to a new organisation. Another manager who had a great experience with a certain brand of IT system may suggest that as a solution.

Managers vary in how they focus on key operational attributes such as strategy, people, process, data and systems. This is one reason why having a diverse management team helps maintain a balanced view.

The business book genre contains books which explain a range of different approaches as the key to success. This is in part due to a tendency to try to rationalise success after the fact from a biased or individual viewpoint.

Triggers for assessment

In order to identify and plan for operations assessment it's useful to consider the different triggers for business transformation.

Daily business monitoring may uncover an acute business issue or opportunity. Within the technology space there are formalised processes that help to manage this. Frameworks such as the IT infrastructure library (ITIL) describe how issues may be linked to more fundamental underlying problems which can lead to change requests and transformation projects. Within the process space approaches such as 'Lean' promote the idea of actively looking for inefficiencies at every level in an organisation. Lean organisations will often have a form of improvement request log which may lead to transformation programs. Effective teams often have a form of daily or weekly review which can act as a source to identify transformation opportunities.

Periodic performance reviews also lead to the identification of transformation opportunities. I'd consider these reviews to occur in three broad categories:

Reviews usually occur on a weekly, monthly, quarterly and annual basis. The aforementioned change and opportunity logs and other 'idea' trackers may form a part of the standard agenda. Reviews are a key part of the decision making process on whether to investigate opportunities further. Given that it's important that any small-scale or basic assessment work that forms the basis for discussion is of an appropriate level of detail and quality.

If an organisation decides to centrally track ideas as part of transformation management it may be useful to identify the source of those ideas i.e which review process, meeting or activity they originated in as well as which team, individual etc.

Annual planning

The annual planning process is a major trigger for transformation programs. This is where the executive committee come together to discuss and make decisions about the future of the business. Ideas are translated into targets, which are then used to create detailed plans and budgets. Achieving the plans may mean identifying and initiating business transformation.

The approach to strategy and planning varies by organisation, usually there are detailed targets for a year ahead, higher level targets for a longer time-frame, say 3-5 years, and at the minimum directional statements for the longer term.

The annual planning process relies on three main inputs:

Gathering and processing these inputs is in itself a form of assessment. The quality of this assessment is critical as it provides the information executive members will base their decisions on.

Assessing the current situation is a complicated process. Individual teams, departments, functions and business areas must create management summaries which are combined and consolidated for the executive review. The following information is used:

Consider for example that a sales team manager may need to summarise sales performance for a regional manager who summarises for a national manager who then summarises for the head of sales. The head of sales is then responsible for representing sales within the executive committee discussions. They must present sales data including considerations for supporting areas such as IT, HR etc. as they relate to sales. This process will happen for all operational areas.

Within the annual planning process there is usually a cycle of assessment, discussion and feedback. In some organisations annual planning can take as long as six months, and involve multiple rounds of draft targets and plans. This is in part due to the interconnected nature of an organisation and how a change to a budget or transformation in one area may affect other areas.

In addition to the performance discussion there may be special topics such as:

When special topics relate to external areas or new business activities organisations often engage contractors, consultants or research agencies to help.

As targets become firm, each operational area must consider and plan how they will achieve the targets. This may result in the need to carry out a deeper assessment of the current operation. This is usually a step down into the next level of detail. The assessment will vary depending on the target:

Employees and managers should keep in mind that whenever they report information they are taking part in the 'assessment' process that forms part of the strategy and planning process.

Types of assessment

Illustration of article contents

Moving beyond the planning process the scope and approach for assessments will vary by factors such as:

These and other factors inform the type of assessment needed. Assessments will vary by factors such as:

I would propose to classify assessments into two broad categories; those that investigate ideas prior to the initiation of formalised transformation projects are and those that form part of formalised transformation projects.

Prior to project initiation

After a potential transformation is identified the first assessment captures information needed to build a case for change and a project proposal.

It's this first assessment that can lack formality and depth which may leads to issues further down the line when trying to execute business transformation.

A case for change centres around financial investment required, benefits and the payback period. To build this financial case we need to assess key factors such as scope and approach which help to build a picture of the resources and time required. It's also important to clearly identify assumptions made and the main risks and opportunities. In addition to informing the financial case these are important feasibility considerations.

A project proposal accompanies a case for change and adds further detail on how the change can be executed. The information required in a proposal varies by the magnitude and type of change, but typically would include factors such as project plan, scope, team roles and other factors that are important from a project management perspective. Together with the financial case this allows stakeholders to consider everything that is needed to initiate a transformation project.

After project initiation

Transformation projects will usually start with a detailed assessment immediately after the project initiation. These assessment phases often have other names such as requirements gathering or 'as is' analysis. In the case of agile projects this may be done in parallel with design and build.

This assessment is at a lower level of detail and is aimed at uncovering the information needed to design, build and implement the transformation. The focus will vary with the type of transformation, some examples:

Let's discuss a few of these in more detail.

New or upgraded business systems

Business systems enable processes by providing a level of automation of information capture and activity execution while also providing measures as a function of reporting. For example:

Projects to implement new or upgraded business systems are difficult. They rely on a good understanding of business processes, business decisions making, organisation roles, data and technology. These projects often encounter problems due to failures of assessment, two common cases are:

In both of these cases the requirements are based on the current process, without taking the step to fully assess the value or suitability of it. Projects often identify incremental improvements to the current state based on existing pain-points, but less commonly challenge the value of existing processes and their outputs with a view to a more complete re-design.

This is understandable for a few reasons including:

Not every business systems project should aim for a complete re-design. However, each project should have a formalised assessment to consider the state of the current situation and question carefully the extent to which they want to replicate existing ways of workings or create something new. It's good practice to run a cost / benefit analysis on scope elements or design points of a transformation project. This helps to focus work towards value.

For business systems, the main categories to consider during assessment are:

  1. Value and suitability of the current solution:
    • Estimated level of replication vs. re-design required for future solution. This can be considered at a summary level and for each of the individual factors below
  2. Data:
    • Input data volume, quality
    • Details of automated or manual data conversions prior to load to the systems
    • Manipulations to the data in system
  3. End to end process flows and task level instructions with details including:
    • Level of automation or manual work
    • Process performance metrics
    • Task effort vs. elapsed times
    • Complexity measures
    • Risk measures
    • Issues and workarounds
  4. Structure, content and format of outputs:
    • Reports
    • Interfaces
  5. User experience, roles and security:
  6. Internal controls

When assessing the above it's useful to work through a checklist or questionnaire. The content of these will vary by transformation type and business are. The type of questions to consider include:

  1. Process
    • Why does this process exist?
    • Is this process manual or automated
    • Is this process standardised or are there variations?
  2. Information - why does this data element exist?
  3. Are there any issues, problems or workarounds?
  4. Have there been any control exceptions - are suitable controls in place for this activity, data element etc.

Outsourcing and shared services

With outsourcing and shared services the focus is on work migration across organisations. Consider this as shifting work from a sending organisation to a receiving organisation. The assessment here should focus on scope, and state of the work to be migrated. This could also be applied to a shift of work between teams or across locations within the same organisation.

It's critical to assess the process performance and the issues present in the current operation including issues, exceptions, variations, deviations and workarounds. These should be documented as a performance baseline which will be useful in quantifying post migration success. Success should be consistency with or improvement above this baseline.

One common issue with outsourcing and shared service space is unrealistic expectations of immediately improved performance. In some cases organisations considered a move to shared services or outsourcing a failure, where in reality the issue was a shift of broken processes and systems to a new organisation with an expectation of the performance to be improved at reduced cost.

Cost savings may be possible due to labour arbitrage by shifting existing processes to a new organisation. In this case a short term dip in performance should be expected due to challenges with knowledge transfer, and other transition related issues. If there is a desire to improve processes some investment is usually required. Note this is often more cost-efficient in the receiving organisation.

In addition to the baseline analysis, details of the current process are needed to manage the migration of work from the sending to receiving organisation. These details should include:

The assessment of these factors can be used to design and build the receiving organisation and how it interacts with the receiving organisation.

Acquisition integration

When a company is considering an acquisition it starts by identifying targets. If potential targets are found the next step is to assess them in more detail. This may be followed by an offer, a period of transacting and contracting and a post acquisition integration.

The assessment for potential acquisition targets is usually focussed on validating the following:

One of the main challenges with this kind of initiative is a lack of access to data. While assessing an acquisition there may be limited access to data and limited communication channels. Sources of information to target include:

New product or service launch

In the case of a new product or service assessment will focus on:

Assessments for new products and services are usually highly tailored to the product or service in question.

Scoping an assessment

Illustration of article contents

When planning an assessment it's useful to think carefully about the desired result of the transformation being considered. This can help inform what to assess. Consider a few examples:

If the objective is to grow revenue or improve profitability focus areas would include:

If the objective is to reduce cost focus areas may include:

If the objective is to increase innovation and launch new products focus areas may include:

If the objective is to increase controls after an incident such as fraud, a data leak or incorrect statutory declaration, focus areas may include:

In each case consideration of the desired transformation helps to identify the focus areas for assessment.

Interpreting results

Illustration of article contents

It can be difficult to interpret the results of an assessment. Consider an assessment identifies how many manual journals an accounting department posts in a month, how do they gauge whether this is efficient or inefficient? Making comparisons can be useful. A few ways to do this include:

Benchmark data is often used by consultants. I've found both freely available and paid data to be useful in previous projects. Benchmarking can give an idea of the level of potential improvement that may exist without doing a deep analysis of roles, process, data and systems.

For example when assessing the efficiency of the finance function calculated metrics may include:

These can be benchmarked both internally and externally.

Internal benchmarking works well with multi category multinational organisations. Results may be compared by industry, business areas and locations.

In addition to commonly reviewed process metrics other factors such as process design, use of technology, organisation structure and data volumes can also be benchmarked on a similar basis. I have found it useful to look at factors such as number of employees per manager or number of business systems per business area or function, comparing these to what I've seen in organisations that perform well can give me a rough idea of how organisations differ and provide clues on where to assess in more detail.

When it comes to benchmarking it's important to adjust expectations based on the overall business situation. An organisation with a history of business issues, old systems and no process standardisation will rarely be able to transform isolated processes to reach a level in-line with a top performing organisation. This would require a broader transformation of culture, policy, processes and systems.

A business framework for assessment

Illustration of article contents

Based on the discussion so far we can see there are a lot of factors to consider when it comes to operational assessment, this makes it useful to work from a framework. This helps ensure all possible areas are considered. It also promotes the use of a common language which helps to avoid misunderstandings and incorrect assumptions.

Terminology relating to organisations varies across professional bodies and organisations so it can be useful to clearly define terms. For the purpose of this discussion I will use 'business area' to describe the breakdown of the organisation into different areas. I'll use the term 'attribute' to define factors that enable business areas to operate. These attributes include process, people and systems.

One standardised way of looking at organisations is through Michael Porter's value chain.

Value Chain

I like the value orientated viewpoint. I'll discuss this later as part of process management. However I believe Michael Porter's layout has a few downsides:

I approach my own work with a framework that shows business areas vs. attributes as a matrix.

The business areas that make up an organisation should be adapted to fit specific organisations, I normally start from the following:

Business Areas

In this view:

The next step in building the framework is to identify the attributes that enable the business areas to operate. Consider the following:

Business areas and attributes

This is an example of a slightly adjusted list of business areas against a list of attributes:

The extent to which an assessment should look at each attribute will vary depending on transformation type. For example a major finance systems project may need to look at all attributes in detail while a data cleansing program may focus 80% of effort on data and 20% of effort on people, process and systems.

To illustrate how attributes may relate to individual business areas consider some example points for the finance function:

A diagram showing attributes of the finance function

Let's discuss each business area in detail.

Business areas

The way an organisation is structured depends on the organisation type; public vs. private and the industry, product or service. Regardless of this we can still start from the three major areas; corporate, line of business and business services and adjust these as necessary.

As opposed to business area some organisations use terms including business unit, division and function. In certain business systems terms such as 'business area' or 'functional area' may have a specific meaning. In this discussion I use business area in the general sense.

Corporate functions

The corporate area can be considered primarily as housing headquarter activities. The most important part of this is the executive committee. In addition it may house other specialities. These specialities often differ from those housed in business services in that their role is more orientated to advise or govern rather than provide a service. Or they may simply contain activities that are best positioned in close proximity to the executive committe. Common activities in corporate include:

  1. Office of the executive
  2. External communications including investor relations
  3. Legal
  4. Governance, risk and compliance including internal controls.

There may be other areas such as global branding, and portfolio management.

Line of business

Line of business includes the product, service, customer or market focussed areas. Common line of business units include:

When it comes to individual organisation there are many permutations of how these areas may be structured. In multi-product or service category organisations there may be:

By multi-product or multi-service I refer to organisations which may have products or services across different categories. For those familiar with financial reporting you can consider these as IFRS segments. For example:

The structure of the line of business area will have an impact on the assessment approach. The structure itself is often the focus of an assessment. This is particularly true when the assessment is related to corporate targets such as revenue growth and profitability.

Assessing and transforming an organisations line of business operations is a major focus of restructuring initiatives.

Business Services

Business services exist to ensure that both corporate and line of business operations can function. These usually include:

Historically line of business operations may have included their own finance, HR, IT etc. however from around the late 90s there was a shift to centralise business services into one business area servicing multiple line of business operations.

Business services are value drivers in themselves and can significantly influence an organisation. I'd recommend against them considering them as support functions.

Business attributes

Earlier I introduced ten business attributes:

  1. Strategy
  2. Financials
  3. Policy
  4. Process
  5. People
  6. Organisation
  7. Technology
  8. Data
  9. Locations
  10. Governance, risk and controls.

This list is flexible. Identifying ten is probably towards the more detailed end of the scale.

Sometimes these are simplified by grouping areas such as policy & process, people & organisation, data & technology. This is useful from a communications perspective, but care should be taken to cover the nuances of each topic.

A simplified grouping:

  1. Strategy
  2. Organisation & people
  3. Policy, process and controls
  4. Technology and data.

I haven't included change management as an attribute for a couple of reasons:

I'd recommend to consider change management alongside project management. I would build this into my plans as a stream of project activities rather than a part of the business area x attribute framework.

In certain organisations there may be other attributes that should be called out, an example of this could be locations.

Let's discuss each attribute in detail:

Strategy

Part of the corporate process is deploying strategy down through an organisation. This includes objectives and quantifiable targets. Each business area develops it's own strategy describing how it will deliver the corporate objectives and targets.

When carrying out an assessment of a potential business transformation we should consider strategy at the corporate level and the level of other affected business areas.

Questions to consider include:

Assessments may uncover conflicts. For example a line of business may have an idea for a new reporting system which helps improve sales forecast accuracy. This may align well with corporate strategy, however the desired reporting system may have conflicts with data and systems strategies.

Often these conflicts come to light after transformation projects are initiated and experts start to discuss the requirements and design across different business areas.

Financials

As opposed to the finance function business area this attribute refers to financial data which can be relevant to any business area. The finance function are important transformation partners as they can contribute to assessments with the analysis of financial data.

The usefulness of the financials will depend on how well structured the organisations data is. Noteworthy focus areas are listed below.

Cost analysis

When assessing operations we look at individual business areas. The cost of these business areas be seen in the cost centre hierarchy. Generally costs incurred in an organisation are posted to a cost centre. At it's lowest level a cost centre should represent an individual team or department. The design logic of a cost centre is to create one for each cost responsible manager, which normally aligns to a team or department. Cost centres can be grouped which then shows the cost of the business at a variety of levels (team, department, business area, office, country).

Because cost centres are defined by responsible managers they tend to mirror an organisations structure. They let us see costs by major buckets of organisational activities:

When costs are captured by cost centre they are also captured by general ledger account. Accounts are defined according to accounting standards, however for the cost relevant accounts we can consider them as being organised closely related to 'nature of activity'. This lets us see whether they are related to items such as research agencies, consultants, systems, utilities or outsourcing service providers.

Using this combination of account and cost centre is a great starting point to build a picture of how much each area of the operations spends. This data answers questions such as:

In a company with a good data model and well designed account and cost centre structures we can often dig one or more levels deeper where we see unusual patterns. If a business area has unusually high expenditure on consultants we can see which team within that department is using the consultants. This helps to identify items to investigate further during assessment. This leads to targeted questionnaires, interviews and workshops.

Profitability analysis

Product related industries in particular have advanced cost and profitability reporting capabilities. These can provide very detailed analysis of

Analysing this data is a key part of assessments focussed on revenue growth, profitability and cost management.

Other financials

The above examples relate to the profit and loss statement which is often focussed on as part of business transformation. Finance may also help with balance sheet or cash flow reporting, for example:

Combining financials with other data

Magic starts to happen when combining financial data with other data. A good example is HR data. Care should be taken in this area as HR data can be very sensitive. Normally accessing data with named individuals is not advisable from an ethical, statutory and regulatory perspective. However, usually it is possible to access de-personalised data such as number of employees by level, by team, by function etc.

With the number of employees in a business area and the costs by nature of that business area we can look at cost per employee. For example:

With data on locations, such as floor space per location we can look at cost with respect to location. For example:

These results can be compared with benchmark data as discussed earlier to give an indication of whether inefficiencies are present or the performance is in line with good practice.

Easily accessible benchmark data includes high level metrics such as the cost of finance function as a percentage of revenue. It's more difficult to find the cost of a sales management team in the beauty industry. The more detailed we get, the closer we get to confidential information. However, some of this detailed benchmark data can be obtained from research agencies.

Even if external benchmark data is not available it can be useful to compare costs internally:

In certain situations where access to operational teams or data is limited this may be the only source of information and should be explored in detail to draw as many conclusions as possible.

Policy

Each business area should have a clear and up to date policy. A good policy contains rules and guiding principles on the application of the other attributes, especially process, people (roles), data, systems and controls. Let's illustrate with a few examples:

The finance policy includes:

A poorly defined accounting policy can lead to operational inefficiencies and issues. At one end of the scale this means capturing more information than needed or doing more processing than needed. At the other end of the scale it leads to posting inconsistencies which make reports hard to interpret or at the worst incorrect.

The human resources policy will document important factors concerning the management of people such as the performance management process:

Without a clear HR policy there may be a number of issues caused by inconsistent management of people.

A good policy can provide a good sense of how an organisation operates. When carrying out an assessment this is a good place to start. Initial questions include:

For a high level assessment checking if policy exists, how accurate it is and whether it is used is a good starting point. This can be done through document review, questionnaires and interviews. For an assessment of limited scope only a number of policies may be relevant and within those only limited number of sections.

For detailed assessment such as the implementation of new systems a line by line review of policy should be done as as early as possible, preferably prior to transformation project initiation. Policies often have useful and easily accessible information which can inform a projects scope, issues and risks.

Process

At it's simplest process is the conversion of an input to an output through one or more actions. These actions can be manual or automated. Manual processes may or may not be assisted by business systems. Where people are involved processes may be run by a single individual or may involve individuals across multiple business areas.

Processes can be defined at different levels of detail. For example a sales person adding commentary to a sales report may be considered as a process. This may then form a part of the sales performance management process, which in turn forms part of the order to cash process. Processes done by a single person at a single point in time may also be referred to as activities, tasks or process steps.

Transformation initiatives start by identifying scope at higher levels of process detail. During assessment, design and build projects move into lower levels of process detail. Project scope often changes as new information comes to light when assessing details.

All processes have a cost and a benefit. When assessing processes we should always maintain focus on these factors.

For example process costs may include:

Benefits can be defined in terms of the value of the process outputs.

Ideally an organisation will have a clear understanding of all it's processes and each will be optimised in terms of cost and benefit. However assessing processes is challenging:

When assessing process focus should be placed on:

The lean mindset is useful when it comes to process assessment. A big part of lean is looking at the current process in detail and continually trying to identify defects and inefficiencies.

I view process as the foundation of an organisation. If strategy defines the objective, process is the way to reach it. People, data, technology and other attributes are key enablers, but tend to be more transient.

Process knowledge in an organisation is often spread out and inconsistent. In large organisations experts tend to work in silo's. This means it can be difficult and time consuming to understand the operation. Many leading multi-national organisations have invested in multi-year projects to understand and document processes. They do this for several reasons:

Process frameworks

Given that processes are challenging to work with it's useful to work from a framework or taxonomy. This can help ensure an assessment is comprehensive. A framework can show the breakdown of processes across different levels of detail. Take for example the finance function, one way to break down its processes:

Each of these can be be further broken down into more detailed processes eventually leading to individual tasks.

A similar framework can be put together for any business area. Once we have this framework we can use it to better structure assessments.

This initial step of documenting processes in a framework can improve management and collaboration by building a consistent understanding of what is done in each business area. It also promotes the use of a common language. I've observed that terms such as 'financial accounting' and 'management accounting' are interpreted differently by different people. The framework removes any vagueness about this and at a glance shows exactly what is included in each. At this stage frameworks may highlight:

Observations at this stage can help generate a list of focus areas to investigate in more detail during an assessment.

Moving into further levels of details can be time consuming, this will often require:

From the finance taxonomy above take the example of 'Fixed Assets Accounting'. To understand how that breaks down into sub processes an expert may be able to guess that it will be something like:

But to understand what kind of assets are relevant and validate/update this list it will likely require discussions with fixed assets accountants. Detailed assessment and discussions can not only help define the detailed processes it can capture process attributes such as

The challenge is it takes a lot of time and effort to reach this level of detail. This is one of the biggest challenges transformation experts and consultants face. Especially as business experts are often assigned to assist transformation projects in addition to their full time daily work.

In the case of limited time or access to experts I'd recommend starting with:

This can be quick and can provide a way to partially validate an initial process taxonomy as well as identify key attributes of each process, for example:

Process modelling

If there is time and access to experts to go into more detail a structured way to do this is through process modelling. There are various approaches and standards to process modelling. One that I've used extensively before is BPMN. An older, but excellent book on BPMN is BPMN Method & Style.

Process modelling provides a standardised format to document and visualise processes while clearly calling out inputs, activities and outputs.

Building process modelling capability with methods such as BPMN can be time consuming. If there is limited time to invest then simple block diagrams or bullet points lists can provide a starting point. However I'd recommend even in a simplified approach to create a style guide with modelling rules, it's important to make sure that processes are modelled in a consistent way, otherwise we lose the benefit of creating transparency.

Assessing operations through process

Let's summarise key factors to assess when looking at process.

Outputs

Outputs are key. Process models should always clearly define the output state:

Activities

The next step is to assess the state of the activities used to generate the output:

Inputs

When mapping a process we also need to capture the trigger and inputs. Often the state of the inputs have a big effect on the steps involved in a process.

For example:

This way of looking at process drives us towards horizontal process management and value chains. Rather than improving individual areas in isolation and risking a negative impact on upstream or downstream processes it's better to consider the end to end process.

Process considerations for different transformations

As a starting point here are sample process considerations for a range of common transformation types.

Acquisition and divestitures

Business systems implementation

Cost reduction

Work transfer to shared services or outsourcing

Organisation re-design

People and organisation model

Special care should be taken when it comes to assessing people. There may be statutory, regulatory, union, works council and ethical considerations when it comes to using employee data, discussing or making decisions concerning employees.

I'd recommend working with human resources and legal when it comes to accessing and using human resources data or when a transformation has the potential to impact employees.

Organisation model

The structure of an organisation in terms of people and their roles is usually summarised in an organogram with accompanying detail in human resources systems, spreadsheets and other documents. Useful information from these documents to consider for assessment includes:

I've found that organisation structures are prone to inconsistent evolution based on the preferences of individual managers.

Organisations often periodically assess and adjust their structure. This can include assessing the number of roles and the reporting lines. These initiatives often aim to reduce cost, improve controls, and improve overall effectiveness. However, after an organisation update it may not take long for the organisation to start deviating from the design based on the preferences and decisions of individual managers. This may lead to inconsistencies across business areas when it comes to factors such as responsibilities, skills and capabilities at different levels. A good policy and effective human resource function can help to maintain organisational consistency.

When considering business transformation we should assume there may be such inconsistencies within the organisation. Reviewing the organisation chart, human resources policy and holding an initial discussion with human resources is a good way to start an assessment.

Detailed employee data

Detailed employee data that can be useful includes:

As some of this is sensitive data it may not be possible to access by named individual, but may be possible to access in a de-personalised form with names and employee id's removed.

This information helps to analyse how consistent employee costs are by role, team, business area and location. The roles can be benchmarked with internal data including other locations or business areas and with external data including data by industry, competitor and professional bodies.

Culture and behaviours

It's important to consider an assessment of an organisations culture and any patterns related to employee behaviours. Transformation programs often focus on tangible factors such as financials, project plans, roles, process, data and systems. These can be assessed in a methodical way. On the other hand culture and behaviours are harder to assess. Consider:

I started my career at Procter & Gamble. P&G have a strong corporate culture, I re-call we even had the term 'Proctoid' to describe us. However even in P&G there were significant cultural differences:

Moving beyond broader cultural factors and into individual business areas we see differences across individuals:

Some of these factors have a bigger impact on the ability for an organisation to transform in a positive way than more obvious things such as budget or skills.

For example it's easy to observe that in some cases a new employee who is optimistic and hard working can achieve more than an experienced employee who is unhappy and resistant to change. This isn't intended to point blame at individual employees, but rather to uncover the reasons for such behaviour and it's importance as something to assess.

Approaches which may help with assessing cultural and behavioural aspects include:

A people orientated change management method I have had success with is prosci ADKAR which stands for awareness, desire, knowledge, ability, reinforcement.

This is an approach that helps work through change with people. I've used this to facilitate information gathering and discussion with stakeholders and employees before. It's very effective at uncovering fears and other concerns. This can be invaluable to identify potential issues early and make adjustments.

ADKAR is one of many approaches available. The key is not the method, but the intention to address the topic in a direct way.

As mentioned this kind of assessment often uncovers fears. Some of the common ones I've encountered include:

When assessing operations if you encounter resistance to change it may in itself be an operational performance issue. Effective organisations should be flexible, adaptable and be able to affect change without the creation of undue stresses.

It may be useful to assess in more detail the history of transformation within the organisation. Have previous programs frequently failed? If so, why?

Change fatigue

A history of failure links to change fatigue. Many organisations run a constant stream of transformations. Often employees, managers and stakeholders have transformation project responsibilities in addition to their day-to-day full time roles.

When assessing change effort and putting together a business case and project proposal it's important to consider the resource requirements. Watch out for managers assigning employees transformation roles on top of their daily work. It's not uncommon to see people already working full time assigned additional project roles. In some cases individuals have workloads exceeding 100% of a normal full-time level.

This leads to change fatigue. This can be made worse if there is a history of transformations that fail. This includes transformations that did not achieve their targeted benefits or transformations that were more complex than initially estimated.

Bad actors

I'm hesitant to write about individuals as there are often complex reasons for the way people behave, but I think a good quality assessment has to consider this.

Many of the transformation programs I've worked on have encountered issues due to the behaviour of one or more individuals. This includes:

These may be issues with the employee or managers. The impact of these behaviours often go beyond the individual.

As part of an assessment it's important to proactively look for bad actors either within the project team, the stakeholders or other employees the team interacts with. This assessment can help as a basis to plan to either help people or neutralise any negative influences.

I am sure that I myself haven't always behaved perfectly at work, especially during stressful transformations and I would have benefited from mechanisms being put in place to help.

Technology

There are two main aspects to consider when it comes to technology, there is 1) 'functional' technology utilised by non-technology functions and 2) the technology functions own technology which will typically includes things like telecoms, internet, data centres, IT service providers etc.

The biggest challenge in the technology space is perhaps the complexity to execute change.

Areas to consider as part of assessment include:

IT service providers:

Business systems:

Desktop:

If it's not already done, it's worthwhile considering benchmarking all technology costs. Within the technology industry there's rarely a fixed price for software and maintenance and an assessment of costs could lead to contract re-negotiation or a change of suppliers.

Data

As with technology, data is an area that can be expensive and time consuming when it comes to transformation.

Factors to considering in an assessment include:

The problem of multiple reporting tools can be a large problem particularly in multinationals. These companies normally have complex systems architectures comprised of numerous business systems. In recent years tools for data manipulation and reporting have become cheaper and easier to use. This can lead to different functions and teams putting the same data into different tools. Manipulation of the same source data in different analytics and reporting tools can create comparability issues. This is a real challenge for technology functions as it has become easier for other business areas to buy software as a service without the involvement of the technology function.

Within finance this is often an issue between statutory reporting and management reporting tools at the consolidated level. One set of reporting tools is configured orientated towards statutory consolidation, the other to the towards management consolidation. This can create a stream of dual work. And can result in inconsistent management reports which require further effort to reconcile.

To make this worse, other teams such as sales may be using yet another set of reporting systems.

In some companies there are teams of people in different departments doing the same thing, but with different tools in different ways.

I've seen cases where executive committees have to deal with several different calculations of gross sales or gross margin.

Locations

Assessing locations includes considering office space utilised as well as the potential usage of work from home policies.

In some industries locations may include facilities such as manufacturing sites, distribution centres, data centers, hospitals, hotels etc.

Factors to consider are:

An analysis of this can lead to location moves and/or consolidations. When taking these decisions it's important to consider all impacted factors:

Governance, risk and compliance

Business transformation is often focused on revenue growth, cost and profitability. Whenever considering and designing a change to an organisation it's important to consider governance, risk and controls.

Some transformations may be specifically focussed on this topic. This may be the case following fraud, financial reporting errors etc.

Governance, risk and compliance applies to other process attributes. For example controls should be embedded as part of roles, process, data and systems design.

During an assessment, key questions to consider include:

Assessment approach

Illustration of article contents

When executing business transformation organisations usually follow a project management methodology. These can be a useful starting point when considering how to approach an assessment. Commonly followed standards and methods include:

We can consider project management methods to broadly focus on two areas:

Assessments are usually carried out as part of different phases. For example a scope assessment during initiation or a detailed 'as is' assessment during execution. The challenge with many project methodologies is they give only general guidance. This allows methods to be applied to many project types, but makes them less useful when it comes to telling you exactly what to do at what level of detail.

IT vendor or consulting firm methods may provide more guidance on exactly what to assess as they are customised to specific transformations. However they tend to have their own weaknesses. Software implementation methodologies tend to be poor at covering business value and people-steps. Consulting methods may focus well on value, but lack technical detail on exactly how to achieve it.

Part of project planning and initiation is to design the detailed approach to any assessment that needs to be undertaken. The starting point for this is to identify all relevant assessments. Usually transformations require more than one as successive levels of detail are explored:

  1. Assessments at the organisation wide level
    • Business overview & strategy
    • Financial and management reports
  2. Business area overviews
    • Strategy
    • Financial and management reports
    • Organisation charts
  3. Business area details
    • Policy
    • Process
    • Reports
    • People / org model:
      • Headcount
      • Roles
      • Training, skills, capabilities
    • Technology:
      • Infrastructure
      • Business applications architecture
      • Design specifications
    • Data:
      • Data model
      • Data library

Tools and templates

After identifying the necessary assessments and the desired level of detail the next step is to define the assessment activities and the tools and templates that will help facilitate them.

I recommend to approach assessment in three main steps:

  1. Gather and review available information
  2. Identify and request additional needs
  3. Hold discussions as required.

There may be multiple iterations within these steps.

Available information

The following can provide useful sources of information:

What's available will vary by organisation. Experienced employees will be able to suggest other sources of information. The quality will also vary by organisation and will be a factor in determining how much effort is required for discussion and whether new documents need to be created.

Gathering additional information

Often additional information is required, useful ways to approach capturing this include:

Discussions

Discussions can take the form of meetings, interviews and workshops. These can be structured in several ways:

Lean

In addition to project methodologies there are other 'tools' that can be useful in facilitating assessment. Lean is one of these. Lean which famously originated from the Toyota Production Method is both a cultural approach to business and a set of tools. It represents a shift towards proactively looking for deficiencies and inefficiencies in daily work. This creates an excellent environment for assessment as there is a high level of focus and awareness on the attributes of existing operations; policy, process, systems, data, issues etc.

Lean also has a number of tools which can be useful in helping structure assessments. For example the 'the seven wastes'. Lean classifies waste into seven categories. These were originally identified for manufacturing, but can translate well into service industries too.

The seven wastes within services:

This may look more like a design consideration than an assessment consideration, but these categories help to define what we need to look for during an assessment.

Other useful tools from lean include value stream mapping and right first time.

Six Sigma

Six sigma is another noteworthy technique worth mentioning in relation to assessment. In contrast with Lean six sigma is a statistical approach to assessment. Six sigma works well in processes which can be measured. The focus is on identifying variances and defects and eliminating these. Originating in Motorola this was traditionally popular in manufacturing where production lines could generate high quality statistical data.

This can also be used in service processes where IT systems can provide process data.

Assessing business areas in detail

Illustration of article contents

Corporate function

Starting from the top the corporate function is an area that houses the executive committee members. It may also house areas such as strategy, legal and external communications.

Office of the executive

Executive committees provide the top level of management that is responsible to ensure organisations meet stakeholder needs. We can consider stakeholders in two groupings:

Primary stakeholders:

Other stakeholders:

There's a fairly broad list of other stakeholders. These include statutory authorities, regulatory bodies, employees, unions, customers, suppliers, the local community and environmental groups. Which of these are relevant and how much focus is put on them will vary by organisation. The nature of responsibility of the executive committee will also vary depending on the stakeholder, for example:

In my experience executives manage these objectives through two different operational views:

  1. Management of the current operation (daily / short term view)
  2. Making decisions and plans for the future of the organisation (mid / long term view).

These two focuses break down into individual process areas.

Management of the operation

Making decisions and plans for the future:

In addition to these there is a significant amount of effort in managing collaboration across an executive team. This means committee meetings need strong processes in terms of agenda preparation, chairing, minute taking and follow up action tracking.

Within corporate it's common for organisations to engage strategy consultants, economic/market/product advisors and research agencies. It's less common to engage operations experts. This may be due to the infrequency or variability of corporate processes. This may increase the chance of finding improvements via operational assessment.

I'd consider key assessment topics according to a few categories

Executive committee structure and work systems

Daily work systems can be underrated. A good case study of this is the UK government 'Whatsapp' scandal. Ministers 'Whatsapp' chat histories were leaked. The data showed a few things:

Future planning (annual, long term)

In the book Superforecasting: The Art and Science of Prediction by Philip Tetlock (Author) and Dan Gardner (Author) the authors bring to light the many of the challenges with forecasting. However, one of the common factors they find with 'good forecasters' is a data-based approach, and an ability to see past 'bias' and red-herring 'big ideas'.

Monthly/quarterly business review on actuals vs. plan vs. historic
External communications (annual reports, press statements, investor updates)
Investigation into opportunities and challenges

Legal

Outside of the legal industry the legal area in an organisation may be small. Organisations may have in-house lawyers, or managers that engage and co-ordinate external lawyers as needed. Legal is often not a major focus of an operational reviews.

Key processes:

Questions to consider during an assessment:

Costs to analyse:

Governance, risk & compliance

This is an area where responsibilities are built into employee and manager roles throughout the organisation.

For example:

In order to oversee how well business areas manage this an organisation may have a dedicated governance, risk and compliance team with several responsibilities:

Within certain industries there may be large teams of GRC experts that form a larger business area. For example in banking and insurance there are often separate risk and compliance teams. These industries have a large number of complex disclosures to prepare and a large number of high impact risks which creates significant operational work.

Questions to consider:

As with legal a good place to start is a brief investigation into historical performance in this area:

The effectiveness of a GRC organisation can be assessed by how well their objectives are executed throughout the organisation by looking at:

Another point to consider is the frequency of and results of GRC assessments:

One form of assessment I enjoy reading about is penetration testing. This can apply to physical locations as well as IT systems. Experts use social engineering and IT tools to test an organisations process and access controls. It's surprising how far experts can penetrate into an organisations process, data and systems, highlighting how important GRC assessments are.

Costs to analyse:

Line of business operations

Marketing

There can be a lack of clarity around the role of marketing in an organisation. At Procter & Gamble. AG Lafley famously talked about the core of the business as consumer market knowledge (CMK). In this sense marketing is identifying the wants and needs of potential consumers. The management of advertising campaigns also often sit within marketing. In some cases marketing includes leads generation and sales conversion, but I include these in sales. In other cases marketing includes branding, but I include this in product management.

Key processes:

Key metrics and reports:

While there are many marketing metrics, an important metric is the connection between marketing campaigns, advertising campaigns and sales. In many cases this may not be well tracked due to the challenges to connect sales to specific campaigns.

Digital businesses may have quite unique approaches where marketing and sales are highly interconnected. For example when marketing and advertising campaigns are online and drive clicks from social media to online stores. In this case many metrics can be tracked across the end to end process.

Questions to consider:

Key costs to analyse:

Product development

Key processes:

Key metrics and reports:

Questions to consider:

Key costs to analyse:

Sales

Key processes:

Metrics and reports:

Key questions to consider:

Key costs to analyse:

Outbound logistics

Key processes:

Metrics and reports:

Key questions to consider:

Key costs to analyse:

In the case of outbound logistics high costs are likely to be centred around warehouse locations and transportation.

Supply chain

Procurement

Within manufacturing procurement is a major part of inbound logistics which focusses on raw materials and packing materials. However, procurement has a broader scope including items such as fixed assets, office supplies and external business services. Therefore I've separated it out from inbound logistics.

Key processes:

High level process areas include:

  1. Procurement management and policy
  2. Sourcing
  3. Contracting
  4. Ordering
  5. Vendor management.

Within procurement management and policy important areas include:

Within the raw and pack space important areas include:

From a broader procurement perspective important areas include:

Metrics and reports:

Questions to consider:

Key costs to analyse:

Inbound logistics

Key processes:

Metrics and reports:

Key questions to consider:

Key costs to analyse:

Manufacturing

Key processes:

Questions to consider:

Key costs to analyse:

Business services

The finance function

As finance is an area I focus on I will discuss in a little more detail. It's useful to start by considering the purpose of the finance function. The main objectives are:

This can be summarised as the correct recording and processing of financially relevant business activities and reporting and communicating results in as efficient a way as possible.

Questions to consider at different stages of the process:

Inputs: the recording of financially relevant activities:

Processing: correcting, adjusting, aggregating and summarising:

Outputs: reports summarising financially relevant business activities:

When assessing the finance function there are a range of documents that can be reviewed. These include:

Assessing finance metrics

The best place to start is the cost of the finance function. As with other service functions the main cost will either be staff costs or external service providers.

In the case of the internal finance function the sizing and suitability can be examined by looking at the organisation model and role descriptions alongside the scale of transactions and complexity of the overall operation. This is a point that can be benchmarked internally or externally.

In addition to staffing costs, other costs to look at include:

In addition to costs finance processes can be analysed through process and data metrics:

Assessing the accounting policy

A poor quality accounting policy can lead to processing issues:

Questions to consider:

Assessing finance process

Accounting specifics:

Assessing people & organisation
Assessing data & information

Topics to consider include:

Assessing finance systems
Finance costs to analyse

Human resources

Human resources manage the hire to retire cycle. A primary focus of this is the recruitment and retention of talented individuals.

Key processes:

Assessing HR metrics
Assessing HR policy
Assessing HR processes
Assessing HR people and organisation
Assessing HR data & information
Assessing HR systems
HR costs to analyse

Information technology

Key processes areas within IT include:

Metrics and reports:

Questions to consider:

People and organisation:

IT systems:

Costs to consider:

Facilities and workplace

Key processes:

Questions to consider:

Key costs to analyse:

External assessments

Illustration of article contents

Another assessment area to consider as part of business transformation is the external environment. These are outside of the scope of this discussion, but the following could be considered:

Conclusions

Illustration of article contents

I hoped to cover a few things in this article:

  1. Business transformation can suffer from an incorrect understanding of the current state. Usually due to a lack of assessment or a poor quality assessment.
  2. Assessments take place at different levels of detail from issue, idea or opportunity identification through to transformation project completion.
  3. Frameworks, approaches and business area checklists can help us plan and execute good quality assessments.

Every situation is unique:

And I'd recommend to always think carefully about transformation and assessments and customise them to the situation.

Finally, I'd re-cap key watch-outs and barriers related to assessment and transformation: