{"text_format":"1","workbook":"xlsx","n_sheets":7,"sheets":["IMA","Notes","Inputs","Calcs","Record","Report","Checklist"],"not_rendered":{"charts":2,"images":3,"macros":1,"external_links":0,"defined_names":21,"comments":0,"pivot_tables":0},"unopened":[{"sheet":"IMA","index":0,"reason":"not_a_worksheet"}],"bounds":{"document_bytes":16777216,"sheet_cells":100000,"rows_first":2000,"rows_last":500,"rows_between":2000,"halvings":0,"cell_chars":16384,"cell_head_chars":4096},"cells_cut":0,"cells_raw":0,"read":"whole","date_system":"1900"}

{"sheet":"Notes","index":1,"n_rows":62,"n_cols":21,"rows_kept":62,"cut":false,"hidden":false,"merged":[[5,4,5,17],[40,4,40,17],[44,4,44,17]]}
[]
[]
[]
[null,null,null,"What Is the Initial Model Assessment for?",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"The requirement to produce a Should Cost Model (SCM) when making sourcing decisions and contracting outside suppliers for the delivery of public services is set out within the Sourcing Playbook and for public works projects or programmes within the Construction Playbook. The Playbooks set out when contracting authorities should produce an SCM, which functions are responsible for them, and how SCMs fit within the procurement lifecycle. The accompanying SCM Guidance Note provides high-level guidance on SCMs, including commissioning them and the requirement to undertake an Initial Model Assessment (IMA). \n[Sourcing Playbook & SCM Guidance Note ~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[Construction Playbook~https://www.gov.uk/government/publications/the-construction-playbook]"]
[]
[null,null,null,null,"This Initial Model Assessment Tool (IMA Tool) provides an understanding of how to approach the development of a Should Cost Model (SCM) based on an assessment of its requirements and available information and resources. The IMA should be undertaken at the start of the SCM Planning phase, and prior to commissioning development of an SCM.\n\nThis IMA Tool is used to produce a report and a checklist to assist in building a model that delivers appropriate insight, with proportionate levels of Quality Assurance (QA) and testing. It is designed to help manage development risks. Notably, the suggested QA and testing on the Checklist sheet is a guideline and it should be considered on a case-by-case basis, as part of QA planning, whether more stringent QA and testing is appropriate.\n\nOnce completed, the IMA should be re-visited periodically, including after any changes impacting the SCM's use or risk profile (e.g. following any changes to the SCM Scope), to confirm that the IMA remains representative and the QA Plan appropriate. The QA Plan should be updated to reflect any required changes. See SCM Development Guidance for more information on preparing a QA Plan."]
[]
[]
[null,null,null,"How do I use the Initial Model Assessment?",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Following completion, a copy of the completed IMA Tool together with a PDF of the outputs (see Record, Report and Checklist sheets), which evidences the completion date, should be saved. These should be stored with other SCM documents, such as the SCM Quality Assurance (QA) Plan, to provide an audit trail (see SCM Development Guidance for more details on SCM document storage). \n\nThe SCM QA Plan, which should be prepared during the Planning phase / stage, should be informed by the IMA Score and the suggested tests (see Checklist sheet).\n[SCM Development Guidance~Hyperlink-TBD-SCM Development Guidance]"]
[]
[null,null,null,null,"Using this IMA Tool is simple:"]
[null,null,null,null,null,"1)","Navigate to the 'Inputs' tab in this IMA Tool;"]
[null,null,null,null,null,"2)","Enter project information into the yellow cells;"]
[null,null,null,null,null,"3)","Select appropriate answers to each of the questions; and"]
[null,null,null,null,null,"4)","Print and save the outputs from this IMA Tool."]
[]
[null,null,null,null,null,"Note: The project information entered on the 'Inputs' tab (see Step 2 above) is pulled through to the top of the 'Record', 'Report' and 'Checklist' sheets and does not need to be re-entered. "]
[]
[]
[null,null,null,"What are all of the outputs for?",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"IMA outputs on the Record, Report and Checklist sheets can be saved via the in-built Macros (Print PDF button) or manually by printing them to PDF using MS Excel's print PDF feature:\nTo save using the in-built macros click the 'Save PDF' button on the corresponding output sheet. This will save a PDF of the sheet in the same folder that this IMA Tool is saved.\nTo save manually select the 'File' menu; Select the 'Print' menu; Select 'Save as PDF' from the 'PDF' selection box; Enter the storage details (e.g. location); Select the 'Save' button."]
[]
[null,null,null,null,"There are 3 outputs produced by this IMA Tool:"]
[null,null,null,null,null,"1)","'Record' - this is a record of the responses provided to the assessment questions - it is used to document the completion of this IMA Tool."]
[null,null,null,null,null,"2)","'Report' - this is a written report that provides good practice recommendations for producing the SCM. It is tailored based on responses."]
[null,null,null,null,null,"3)","'Checklist' - Suggested tests to perform as part of formal QA and testing. It is based on answers provided and should be tailored as appropriate."]
[]
[]
[null,null,null,"What does everything mean?",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"For support in relation to the IMA, or on Should Cost Modelling more generally, contact the Sourcing Programme via: sourcing.programme@cabinetoffice.gov.uk\n[sourcing.programme@cabinetoffice.gov.uk~]"]
[]
[null,null,null,null,"The \"?\" shows where this IMA Tool has inbuilt help or hyperlinks to resources. Click on it in each section to find out more.","  Help",null,null,null,"The \"?\" shows where this IMA Tool has inbuilt help or hyperlinks to resources. Click on it in each section to find out more."]
[]
[null,null,null,null,null,"  Details",null,null,null,"Cells coloured in yellow denote areas where inputs are required in order to complete this IMA Tool."]
[]
[null,null,null,null,null,"  Buttons",null,null,null,"Buttons should be used to select responses to questions by clicking the button corresponding to the required response."]
[]
[null,null,null,null,"Low","  Score",null,null,null,"The 'Score' box shows the categorisation of the model - this will shape the suggestions that this IMA Tool provides."]
[]
[]
[null,null,null,"How is the IMA rating calculated?",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"The SCM's criticality score should be informed by the Cabinet Office Tiering Tool. For more information on the IMA scoring approach contact the Sourcing Programme via: sourcing.programme@cabinetoffice.gov.uk\n[Cabinet Office Tiering Tool~https://khub.net/group/gcf-community/group-library/-/document_library/Sz8Ah1O1ukgg/view_file/70330206?_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_redirect=https%3A%2F%2Fkhub.net%3A443%2Fgroup%2Fgcf-community%2Fgroup-library%2F-%2Fdocument_library%2FSz8Ah1O1ukgg%2Fview%2F70329062%3F_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_navigation%3Dhome%26_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_orderByCol%3DmodifiedDate%26_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_orderByType%3Ddesc%26_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_fileEntryTypeId%3D-1]\n[sourcing.programme@cabinetoffice.gov.uk~]"]
[]
[null,null,null,null,"This IMA Tool rates an SCM as either Low, Medium or High risk based on user supplied answers to seven multiple choice questions (see Inputs tab). The first question relates to the SCM's 'Criticality' and the remaining six questions to the SCM's 'Sophistication':"]
[null,null,null,null,null,"1)","'Criticality' (Question 1) - the importance of the decision supported by the SCM and/or the potential impact that the SCM may have (informed by the Cabinet Office Tiering Tool)"]
[null,null,null,null,null,"2)","'Sophistication' (Questions 2-7) - the risks associated with delivering an SCM that is fit for purpose and available at the point of need"]
[]
[null,null,null,null,"Each question has four possible answers, which are scored on a progressive basis to reflect increasing risk. The combined score for Criticality and Sophistication is used to drive an overall rating for the SCM of either Low, Medium, or High risk."]
[]
[]
[]
[null,null,null,"References & Hyperlinks",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"If any of the links are broken please contact the Sourcing Programme via: sourcing.programme@cabinetoffice.gov.uk\n[sourcing.programme@cabinetoffice.gov.uk~]"]
[]
[null,null,null,null,"Included References"]
[null,null,null,null,null,"Sourcing Playbook"]
[null,null,null,null,null,"Construction Playbook"]
[null,null,null,null,null,"SCM Guidance Note"]
[null,null,null,null,null,"SCM Development Guidance"]
[null,null,null,null,null,"SCM Technical Build Guidance"]
[null,null,null,null,null,"SCM Scoping Template"]
[null,null,null,null,null,"HMT Aqua Book"]
[null,null,null,null,null,"Cabinet Office Tiering Tool "]
[]
[null,null,null,null,"Contact the Sourcing Programme for Further Information:"]
[null,null,null,null,null,"sourcing.programme@cabinetoffice.gov.uk"]

{"sheet":"Inputs","index":2,"n_rows":73,"n_cols":14,"rows_kept":73,"cut":false,"hidden":false,"merged":[]}
[]
[]
[null,null,null,null,"S1","S1","S1","S1","S1","S1","S1"]
[null,null,null,null,"Initial Model Assessment ('IMA')",null,null,null,null,null,null,null,null,"Enter the project name and IMA completion details into the yellow cells below."]
[]
[null,null,null,null,null,"Project Name:",null,null,null,null,"Enter the name of the project that this IMA relates to",null,"Enter the name of the project that this IMA relates to"]
[]
[null,null,null,null,null,"Prepared By:",null,null,null,null,"Enter the full name of the person undertaking this IMA",null,"Enter the full name of the person undertaking this IMA"]
[]
[null,null,null,null,null,"Prepared On:",null,null,null,null,"Enter today's date in dd-mm-yy format (e.g. 17/02/21)",null,"Enter today's date in dd-mm-yy format (e.g. 17/02/21)"]
[]
[null,null,null,null,null,"Protective Marking:",null,null,null,null,"OFFICIAL",null,"Enter the protective marking"]
[]
[null,null,null,null,null,"IMA Score:",null,null,null,null,{"$f":"Calcs!$N$46","v":"TBC"},null,"The IMA Score will be updated on completion of the questions below."]
[]
[]
[]
[]
[null,null,null,"SCM Criticality"]
[]
[null,null,null,null,{"$f":"Calcs!$D$18","v":1},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E23))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E23))","v":"Impact - How important is the decision that the SCM supports?"},null,null,null,null,null,null,"This question looks to understand the potential impact of the SCM. For example, if production of the SCM was substantially delayed, if it contained a significant error or if it was shared publicly what would the impact be?\n\nInvariably the level of impact will correspond to contract value and the Cabinet Office Tiering Tool can be used to inform Bronze/ Silver/ Gold classifications. However, additional factors such as reputational impact or SCM data sensitivity should be considered and the criticality level set accordingly.\n\n[Tiering Tool~https://khub.net/group/gcf-community/group-library/-/document_library/Sz8Ah1O1ukgg/view_file/70330206?_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_redirect=https%3A%2F%2Fkhub.net%3A443%2Fgroup%2Fgcf-community%2Fgroup-library%2F-%2Fdocument_library%2FSz8Ah1O1ukgg%2Fview%2F70329062%3F_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_navigation%3Dhome%26_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_orderByCol%3DmodifiedDate%26_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_orderByType%3Ddesc%26_com_liferay_document_library_web_portlet_DLPortlet_INSTANCE_Sz8Ah1O1ukgg_fileEntryTypeId%3D-1]"]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E23),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E23),$E$21:$E23,0))","v":"The SCM will support a decision that will not result in a 'tiered' contract award"},null,null,"The SCM is being used to support a decision of fairly insignificant value or the outputs of the SCM are for information purposes only and do not impact the decision itself. It is expected that any reputational or other forms of damage to the department that could arise from an erroneous SCM-led decision will be fairly insignificant."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E24),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E24),$E$21:$E24,0))","v":"The SCM will support a Bronze contract or a decision with a low business impact"},null,null,"The SCM is being used to support a decision of relatively low value. It is expected that any reputational or other forms of damage to the department that could arise from an erroneous SCM-led decision are relatively low."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E25),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E25),$E$21:$E25,0))","v":"The SCM will support a Silver contract or decision with a marked business impact"},null,null,"The SCM is being used to support a decision of reasonably significant value. It is expected that any reputational or other forms of damage to the department that could arise from an erroneous SCM-led decision are marked but not elevated above typical levels."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E26),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E26),$E$21:$E26,0))","v":"The SCM will support a Gold contract or decision with a major business impact"},null,null,"The SCM is being used to support a significant or business critical decision. This also includes decisions with a lower financial value but where the reputational impact of making an incorrect decision based on the SCM is significant."]
[]
[]
[]
[]
[null,null,null,"SCM Sophistication"]
[]
[null,null,null,null,{"$f":"Calcs!$D$19","v":2},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E35))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E35))","v":"Detail - How detailed does the analysis need to be and how complex are the assets/goods/services being sourced?"},null,null,null,null,null,null,"This question looks to understand the nature of the decisions that the SCM is designed to inform and the complexity of the assets/goods/services being sourced and, by reference, the potential complexity of the resultant model."]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E35),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E35),$E$21:$E35,0))","v":"High level cost estimates are required for something that is relatively simple"},null,null,"A high level of analysis is appropriate because additional detail will not change the decision (e.g. cost is one of a number of factors informing the Delivery Model Assessment and 'Rough Order of Magnitude' costs will be sufficient). The assets/goods/services being sourced also have a small number of components that are relatively straightforward in nature."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E36),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E36),$E$21:$E36,0))","v":"High level cost estimates are required for something that is relatively complex"},null,null,"A high level of analysis is appropriate because additional detail will not change the decision (e.g. cost is one of a number of factors informing the Delivery Model Assessment and 'Rough Order of Magnitude' costs will be sufficient). However, the assets/goods/services being sourced have many components and/or components that are fairly complex in nature. "]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E37),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E37),$E$21:$E37,0))","v":"Detailed cost estimates are required for something that is relatively simple"},null,null,"More detailed analysis is required because the output of the model will be used to support more operational decision making (e.g. providing insight into supplier returns). However, the assets/goods/services being sourced have a small number of components that are relatively straightforward in nature."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E38),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E38),$E$21:$E38,0))","v":"Detailed cost estimates are required for something that is relatively complex"},null,null,"More detailed analysis is required because the output of the model will be used to support more operational decision making (e.g. providing insight into supplier returns). The assets/goods/services being sourced also have many components and/or components that are fairly complex in nature. "]
[]
[null,null,null,null,{"$f":"Calcs!$D$20","v":3},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E42))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E42))","v":"Level of Understanding - How well defined are the assets/goods/services being sourced?"},null,null,null,null,null,null,"This question looks to understand if the assets/goods/services being sourced and the potential delivery options (e.g. the operating model) are well known."]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E42),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E42),$E$21:$E42,0))","v":"All components of the assets/goods/services being sourced are well defined and have been delivered elsewhere"},null,null,"The assets/goods/services being sourced can easily be broken down into components. Something similar in nature has been delivered elsewhere in government and there is visibility of how it has been delivered. The way it will be delivered is well established (e.g. the operating model is known)."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E43),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E43),$E$21:$E43,0))","v":"All components of the assets/goods/services being sourced are well defined but some are new or novel in nature"},null,null,"The assets/goods/services being sourced can easily be broken down into components. Most components have been delivered elsewhere in government and there is visibility of how they have been delivered. However, some components, whilst well defined, are new/novel or the way that they will be delivered is new/novel."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E44),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E44),$E$21:$E44,0))","v":"Most components of the assets/goods/services being sourced are well defined with some elements yet to be agreed"},null,null,"The assets/goods/services being sourced can be broken down into components but it is not clear how some of them may be delivered."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E45),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E45),$E$21:$E45,0))","v":"The components of the assets/goods/services being sourced are unclear"},null,null,"The assets/goods/services being sourced cannot currently be divided into components and delivery scenarios have yet to be identified."]
[]
[null,null,null,null,{"$f":"Calcs!$D$21","v":4},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E49))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E49))","v":"Resources - Are appropriate resources available to plan & design, develop, test and use the SCM?"},null,null,null,null,null,null,"This question looks to understand whether resources will be available to perform key tasks in producing the model."]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E49),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E49),$E$21:$E49,0))","v":"Appropriately skilled people have been identified to plan & design, develop, test and use the model"},null,null,"Consider if appropriately skilled people can be identified to plan & design, develop, test and use the model. It is important to ensure that the person who builds the model must not be the person who undertakes formal QA and testing on it. Only use this response if separate people can be identified and all people are appropriately skilled and experienced."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E50),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E50),$E$21:$E50,0))","v":"People cannot be identified to perform one of the activities listed above"},null,null,"People cannot be identified to undertake one of the activities (e.g. there is no separate person available to perform testing). All identified people are appropriately skilled and experienced."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E51),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E51),$E$21:$E51,0))","v":"People cannot be identified to perform more than one of the activities listed above"},null,null,"People cannot be identified to undertake more than one of the activities (e.g. only a model user can be found). All identified people are appropriately skilled and experienced."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E52),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E52),$E$21:$E52,0))","v":"Appropriately skilled people cannot be identified to undertake one or more of the activities"},null,null,"There are no appropriately skilled resources available to perform any of the activities listed above."]
[]
[null,null,null,null,{"$f":"Calcs!$D$22","v":5},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E56))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E56))","v":"Data Availability - Are all data sources needed to produce the SCM known and understood? "},null,null,null,null,null,null,"This question looks to understand the data that the model will use and its availability.\n\nIf data is not available or not in the right format it may require changes to the SCM Scope or Specification (inc. Design). This can result in a sub-optimal model design, may increase the risk of error and may delay production of the SCM."]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E56),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E56),$E$21:$E56,0))","v":"All data requirements are known and confidence in data availability is high"},null,null,"What data the model will need is known and the process for gaining access to that data is well understood. The data has been obtained previously to support decisions of a similar type. There are no issues with the data and no gaps in data requirements."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E57),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E57),$E$21:$E57,0))","v":"Most data requirements are known and where known confidence in its availability is high"},null,null,"Most data that the model will need is known and the process for gaining access to it is well understood. This data has been obtained previously to support decisions of a similar type. There are no issues with this data and there are minimal gaps in data requirements."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E58),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E58),$E$21:$E58,0))","v":"Data requirements are not completely clear or confidence in availability of some data is low"},null,null,"The data that the model needs cannot be defined clearly or confidence in the availability of some data is unclear. For example data sources may be unfamiliar or issues have previously been encountered obtaining similar data. "]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E59),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E59),$E$21:$E59,0))","v":"Data requirements and/or data sources are unclear"},null,null,"The data that the model needs cannot be defined clearly or confidence in the availability of data is low."]
[]
[null,null,null,null,{"$f":"Calcs!$D$23","v":6},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E63))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E63))","v":"Data Robustness - Where data is available, where is it coming from?"},null,null,null,null,null,null,"This question looks to understand the maturity or reliability of the data that is used to power the model.\n\nData with a lower level of maturity is invariably less certain and subject to greater variability. SCMs that provide insufficient confidence and/or cannot appropriately articulate the level of confidence in outputs to decision makers may be unfit for purpose. Further information on risk and uncertainty can be found within the Aqua Book.\n\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]"]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E63),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E63),$E$21:$E63,0))","v":"All key cost drivers originate from historical actuals or robust supplier estimates"},null,null,"There is a high degree of confidence in all of the key data that will power the SCM. It is mature data that will be sourced from historical actuals and robust supplier quotes."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E64),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E64),$E$21:$E64,0))","v":"All key cost drivers are from actuals and non-binding bottom up supplier estimates "},null,null,"There is a reasonably high level of confidence in all of the key data that will power the SCM. It will be sourced from historical actuals and recent bid estimates or more robust but dated firm supplier quotes. "]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E65),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E65),$E$21:$E65,0))","v":"Some key cost drivers are based on parametric or relationship-based estimates"},null,null,"Some data may be based on parametric or other relationship based estimation approaches and/or data provided informally (e.g. by suppliers)."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E66),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E66),$E$21:$E66,0))","v":"Some key cost drivers are based on consensus or subject matter expert opinions "},null,null,"There is a low level of confidence in some of the key data that will power the SCM. Some data may be based on consensuses opinion or input from subject matter experts."]
[]
[null,null,null,null,{"$f":"Calcs!$D$24","v":7},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($E$21:$E70))&INDEX(Calcs!$H$18:$H$29,MAX($E$21:$E70))","v":"Model Development - Is a new model required?"},null,null,null,null,null,null,"This question looks to understand the extent of model development activity required. This includes formula and structural development activity."]
[]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E70),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E70),$E$21:$E70,0))","v":"A tested, generic model requiring no changes is available for use"},null,null,"A pre-existing model that meets the current modelling requirements is available for use. It has been tested to an appropriate level and no further development activity will be required to configure it for use on this project. The data that powers it will need to be tested."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E71),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E71),$E$21:$E71,0))","v":"A tested, generic model can be used after limited adaptation"},null,null,"A pre-existing model that meets the current modelling requirements is available for use. It has been tested to an appropriate level and only limited adaptation will be required to configure it for use on this project. Following adaptation it will need to be retested, as will the data that powers it."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E72),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E72),$E$21:$E72,0))","v":"One or more existing models are available to help structure model development"},null,null,"One or more pre-existing models exist that can be adapted to form the basis of a new model. The model along with the data that powers it will need to be tested."]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$I$18:$N$29,MAX($E$21:$E73),ROW()-ROW($E$21)-MATCH(MAX($E$21:$E73),$E$21:$E73,0))","v":"A new model will need to be built from scratch"},null,null,"Whilst there may be some supporting templates and guidance materials that can be used to structure development, a new model needs to be built. The model along with the data that powers it will need to be tested."]

{"sheet":"Calcs","index":3,"n_rows":72,"n_cols":44,"rows_kept":72,"cut":false,"hidden":true,"merged":[]}
[]
[null,"S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1"]
[null,null,"IMA Version Control"]
[]
[null,null,null,{"$f":"MAX($G$7:$G$10)","v":1},null,null,"Version","Worksheets Changed",null,"Description of Change",null,"Change Type","Date","Made By"]
[]
[null,null,null,null,null,null,1,"All worksheets",null,"IMA Created",null,"Data+Calcs","2021-03-31","Sourcing Programme (sourcing.programme@cabinetoffice.gov.uk)"," "]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null," "]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null," "]
[null,null,">>","  Insertion Row >>>>>"]
[]
[]
[]
[null,null,"IMA Questions & Scoring"]
[]
[null,null,null,"Group No.","Group",null,"Headline","Strapline","Q1","Q2","Q3","Q4","Q5","Q6",null,"A1","A2","A3","A4","A5","A6",null,"W",null,"Q",null,"S",null,"Criticality","Sophistication",null,"G1","G2","G3","G4","G5","G6",null,"Chosen",null,"Guidance",null,"References"]
[]
[null,null,null,{"$f":"ROW()-ROW(D$16)-1","v":1},"Criticality",null,"Impact - ","How important is the decision that the SCM supports?","The SCM will support a decision that will not result in a 'tiered' contract award","The SCM will support a Bronze contract or a decision with a low business impact","The SCM will support a Silver contract or decision with a marked business impact","The SCM will support a Gold contract or decision with a major business impact",0,0,null,1,2,4,8,null,null,null,100,null,0,null,{"$f":"IF(OR($Y18=0,SUM($P18:$U18)=0),0,INDEX($P18:$U18,$Y18))","v":0},null,{"$f":"IF($E18=AC$16,($W18/SUMIF($E$18:$E$29,AC$16,$W$18:$W$29))*$AA18,0)","v":0},{"$f":"IF($E18=AD$16,($W18/SUMIF($E$18:$E$29,AD$16,$W$18:$W$29))*$AA18,0)","v":0},null,"Approaching the development of a model requires considerations of proportionality. The guidance below and the suggested tests to perform on the model, set out on the Checklist sheet, are based on this. It is important to invest more time in developing models that have a higher business impact and try to reduce the risk of mistakes or errors. The tests in the Checklist sheet are suggestions and additional tests can be applied if considered appropriate. See Aqua Book for more details on QA and proportionality.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]","Approaching the development of a model requires considerations of proportionality. The guidance below and the suggested tests to perform on the model, set out on the Checklist sheet, are based on this. It is important to invest more time in developing models that have a higher business impact and try to reduce the risk of mistakes or errors. The tests in the Checklist sheet are suggestions and additional tests can be applied if considered appropriate. See Aqua Book for more details on QA and proportionality.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]","Approaching the development of a model requires considerations of proportionality. The guidance below and the suggested tests to perform on the model, set out on the Checklist sheet, are based on this. It is important to invest more time in developing models that have a higher business impact and try to reduce the risk of mistakes or errors. The tests in the Checklist sheet are suggestions and additional tests can be applied if considered appropriate. See Aqua Book for more details on QA and proportionality.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]","Approaching the development of a model requires considerations of proportionality. The guidance below and the suggested tests to perform on the model, set out on the Checklist sheet, are based on this. It is important to invest more time in developing models that have a higher business impact and try to reduce the risk of mistakes or errors. The tests in the Checklist sheet are suggestions and additional tests can be applied if considered appropriate. See Aqua Book for more details on QA and proportionality.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]",0,0,null,{"$f":"IF($Y18=0,0,INDEX($AF18:$AK18,$Y18))","v":0}," ",{"$f":"IF(AM18=0,0,LEFT($AM18,IF(ISERR(FIND(\"[\",$AM18,1)),LEN($AM18),FIND(\"[\",$AM18,1)-1)))","v":0}," ",{"$f":"IF(AM18=0,0,RIGHT($AM18,LEN($AM18)-IF(ISERR(FIND(\"[\",$AM18,1)),LEN($AM18),FIND(\"[\",$AM18,1)-1)))","v":0}," "]
[null,null,null,{"$f":"ROW()-ROW(D$16)-1","v":2},"Sophistication",null,"Detail - ","How detailed does the analysis need to be and how complex are the assets/goods/services being sourced?","High level cost estimates are required for something that is relatively simple","High level cost estimates are required for something that is relatively complex","Detailed cost estimates are required for something that is relatively simple","Detailed cost estimates are required for something that is relatively complex",0,0,null,1,2,4,8,null,null,null,100,null,0,null,{"$f":"IF(OR($Y19=0,SUM($P19:$U19)=0),0,INDEX($P19:$U19,$Y19))","v":0},null,{"$f":"IF($E19=AC$16,($W19/SUMIF($E$18:$E$29,AC$16,$W$18:$W$29))*$AA19,0)","v":0},0,null,"It is important to consider the decision that the model is designed to support. Higher level cost estimates might provide information that is suited for more strategic decisions, such as informing a Delivery Model Assessment. These types of estimates are generally quicker to prepare but do not provide the insight that can be generated from more detailed models and may limit the ability to perform more detailed investigation and analysis. \n\nConsider whether decision makers may need additional detail in the future. As what is being sourced is relatively simple, decision makers might require a model that goes into more detail. Consider if it may be better to design a model that caters for these scenarios now rather than having to build a new, more detailed, model in the future. Further guidance on preparing a model Scope is available in the SCM Guidance Note.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]","It is important to consider the decision that the model is designed to support. Higher level cost estimates might provide information that is suited for more strategic decisions, such as informing a Delivery Model Assessment. These types of estimates are generally quicker to prepare but do not provide the insight that can be generated from more detailed models and may limit the ability to perform more detailed investigation and analysis. \n\nAs what is being sourced is relatively complex, consider which aspects of the model could be simplified. If a detailed model is only required in the future, consider if it may be better to design a model that can be readily expanded rather than building complexity in now. Further guidance on preparing a model Scope is available in the SCM Guidance Note.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]","It is important to consider the decision that the model is designed to support. If the decision is more operational or evaluative in nature, it might be appropriate to build a more detailed model. In general, more detailed models can provide greater insight but will take longer to prepare.\n\nIt is important to agree the level of detail with decision makers before starting to develop the model as this will help to manage the risk that detail is developed within the model which is not used to support the decision or that it is insufficient to meet their needs. Further guidance on preparing a model Scope is available in the SCM Guidance Note.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]","It is important to consider the decision that the model is designed to support. If the decision is more operational or evaluative in nature, it might be appropriate to build a more detailed model. In general, more detailed models can provide greater insight but will take longer to prepare.\n\nAs what is being sourced is relatively complex, consider which aspects of the model could be simplified. If a detailed model is only required in the future, consider if it may be better to design a model that can be readily expanded rather than building complexity in now. It is important to agree the level of detail with decision makers before starting to develop the model as this will help to manage the risk that detail is developed within the model which is not used to support the decision or that it is insufficient to meet their needs. Further guidance on preparing a model Scope is available in the SCM Guidance Note.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]",0,0,null,0," ",{"$f":"IF(AM19=0,0,LEFT($AM19,IF(ISERR(FIND(\"[\",$AM19,1)),LEN($AM19),FIND(\"[\",$AM19,1)-1)))","v":0}," ",{"$f":"IF(AM19=0,0,RIGHT($AM19,LEN($AM19)-IF(ISERR(FIND(\"[\",$AM19,1)),LEN($AM19),FIND(\"[\",$AM19,1)-1)))","v":0}," "]
[null,null,null,3,"Sophistication",null,"Level of Understanding - ","How well defined are the assets/goods/services being sourced?","All components of the assets/goods/services being sourced are well defined and have been delivered elsewhere","All components of the assets/goods/services being sourced are well defined but some are new or novel in nature","Most components of the assets/goods/services being sourced are well defined with some elements yet to be agreed","The components of the assets/goods/services being sourced are unclear",0,0,null,1,2,4,8,null,null,null,20,null,0,null,0,null,0,0,null,"The level of understanding of what is being sourced will influence the design of the model. Something that is well-defined and clearly understood will inform decisions around the costs that should be included in the model and inform model scoping activities. A more detailed understanding of the various components of what is being sourced should be gained to inform the model Scope.\n\nFurther guidance on preparing a model Scope is available in the SCM Guidance Note and an SCM Scoping Template is also available.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[SCM Scoping Template~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","The level of understanding of what is being sourced will influence the design of the model. Something that is well-defined and clearly understood will inform decisions around the costs that should be included in the model and inform model scoping activities. A more detailed understanding of the various components of what is being sourced should be gained to inform the model Scope.\n\nFor new or novel aspects, these should be understood in more detail. This may include consulting with Subject Matter Experts. It may be helpful to include scenarios within the model to cater for the potential variability in model inputs for the new or novel components.\n\nConsider factoring in additional model development time to allow for data capture in relation to the new or novel service components.\n\nFurther guidance on preparing a model Scope is available in the SCM Guidance Note and an SCM Scoping Template is also available.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[SCM Scoping Template~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]\n","The level of understanding of what is being sourced will influence the design of the model. Something that is well-defined and clearly understood will inform decisions around the costs that should be included in the model and inform model scoping activities. Whilst model scoping activities can commence for the well-defined components, efforts should focus on defining the other components to a similar level of detail.\n\nConsider factoring in additional model development time to allow for understanding of all components.\n\nThis activity should be included in the model Delivery Plan and is a key dependency in model development. Commencing the model build without fully understanding all components may increase the build iterations and may result in a sub-optimal model.\n\nFurther guidance on preparing a model Scope is available in the SCM Guidance Note and an SCM Scoping Template is also available.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[SCM Scoping Template~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","The level of understanding of what is being sourced will influence the design of the model. Something that is well-defined and clearly understood will inform decisions around the costs that should be included in the model and inform model scoping activities. Efforts should focus on defining the various components. Consider pausing model scoping activities until components have been defined.\n\nCommencing the model build without fully understanding all components may increase the build iterations and may result in a sub-optimal model.\n\nDefining the components should be included in the model Delivery Plan and is fundamental to being able to develop a model. \n\nFurther guidance on preparing a model Scope is available in the SCM Guidance Note and an SCM Scoping Template is also available.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[SCM Scoping Template~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]",0,0,null,0," ",{"$f":"IF(AM20=0,0,LEFT($AM20,IF(ISERR(FIND(\"[\",$AM20,1)),LEN($AM20),FIND(\"[\",$AM20,1)-1)))","v":0}," ",{"$f":"IF(AM20=0,0,RIGHT($AM20,LEN($AM20)-IF(ISERR(FIND(\"[\",$AM20,1)),LEN($AM20),FIND(\"[\",$AM20,1)-1)))","v":0}," "]
[null,null,null,4,"Sophistication",null,"Resources - ","Are appropriate resources available to plan & design, develop, test and use the SCM?","Appropriately skilled people have been identified to plan & design, develop, test and use the model","People cannot be identified to perform one of the activities listed above","People cannot be identified to perform more than one of the activities listed above","Appropriately skilled people cannot be identified to undertake one or more of the activities",0,0,null,1,2,4,8,null,null,null,20,null,0,null,0,null,0,0,null,"Appropriately skilled people have been identified to plan & design, develop, test and use the model. It is important to confirm their availability and secure their time during the model planning phase.\n\nFurther information on the importance of using suitably qualified and experienced resource in the development, QA and testing of models can be found within the Aqua Book.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]","Appropriately skilled people have been identified to perform all but one of the plan & design, develop, test and use activities. It is important to confirm the available resources and secure their time during the model planning phase.\n\nFor the activity where appropriately skilled resource is not available, it is important to note the following:\n1) Modelling activity should not be performed by unskilled resource as this may impinge on the model's fitness for purpose. Consider contacting the Sourcing Programme to discuss available support; and\n2) If appropriately skilled resources cannot be secured internally then consider seeking external support. Further details on resourcing are available in the SCM Guidance Note.\n\nFurther information on the importance of using suitably qualified and experienced resource in the development, QA and testing of models can be found within the Aqua Book.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]","Appropriately skilled people are not available to perform a number of the plan & design, develop, test and use activities. Without appropriately skilled resources available, there is a risk that the model will be substandard or delayed. Consider pausing model scoping activities until appropriately skilled resources have been identified and secured. Note that:\n1) Modelling activity should not be performed by unskilled resource as this may impinge on the model's fitness for purpose. Consider contacting the Sourcing Programme to discuss available support; and\n2) If appropriately skilled resources cannot be secured internally then consider seeking external support. Further details on resourcing are available in the SCM Guidance Note.\n\nFurther information on the importance of using suitably qualified and experienced resource in the development, QA and testing of models can be found within the Aqua Book.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]","Appropriately skilled people are not available to perform any of the plan & design, develop, test and use activities. Without appropriately skilled resources available, there is a risk that the model will be substandard or delayed. Model scoping activities should be paused until appropriately skilled resources have been identified and secured. Note that:\n1) Modelling activity should not be performed by unskilled resource as this may impinge on the model's fitness for purpose. Consider contacting the Sourcing Programme to discuss available support; and\n2) If appropriately skilled resources cannot be secured internally then consider seeking external support. Further details on resourcing are available in the SCM Guidance Note.\n\nFurther information on the importance of using suitably qualified and experienced resource in the development, QA and testing of models can be found within the Aqua Book.\n[SCM Guidance Note~https://www.gov.uk/government/publications/the-outsourcing-playbook]\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]",0,0,null,0," ",0," ",0," "]
[null,null,null,5,"Sophistication",null,"Data Availability - ","Are all data sources needed to produce the SCM known and understood? ","All data requirements are known and confidence in data availability is high","Most data requirements are known and where known confidence in its availability is high","Data requirements are not completely clear or confidence in availability of some data is low","Data requirements and/or data sources are unclear",0,0,null,1,2,4,8,null,null,null,20,null,0,null,0,null,0,0,null,"All data requirements are known and confidence in data availability is high. It is important to prepare a Data Plan as part of model planning and refresh it as requirements are confirmed during model design.\n\nNote that as the model Specification (inc. Design) evolves, data requirements may also evolve. It is important to continue to monitor the data availability throughout the model development lifecycle.\n\nData collection should be initiated as early as possible in the model development process to help manage the potential risks of delay.\n\nFurther considerations in relation to data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","Most data requirements are known and confidence in this data availability is high. It is important to prepare a Data Plan as part of model planning and refresh it as requirements are confirmed during model design.\n\nFilling the gaps in data requirements should be prioritised. Where data is unavailable it may necessitate changes to the model Specification (inc. Design) and can cause delay.\n\nNote that as the model Specification (inc. Design) evolves, data requirements may also evolve. It is important to continue to monitor the data availability throughout the model development lifecycle.\n\nData collection should be initiated as early as possible in the model development process to help manage the potential risks of delay.\n\nFurther considerations in relation to data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","It is important to recognise that a model needs data to operate. If a model is designed around data that cannot be obtained, it may necessitate redesign and could cause substantial delay.\n\nWhere data requirements cannot be defined clearly, efforts during model planning should focus on understanding what data may be available through consultation with a broad range of stakeholders. This should be considered in conjunction with the likely drivers of the model. A combination of what data is available and the key drivers supporting the model will inform the model Specification (inc. Design). Once a good understanding of the model data requirements have been gained, this should be captured in a Data Plan.\n\nWhere confidence in the availability of some data is low efforts during model planning should focus on:\n1) Confirming the availability of data;\n2) Identifying alternative data sources; and\n3) Scoping a model that is supported by available data.\n\nData collection should be initiated as early as possible in the model development process to help manage the potential risks of delay.\n\nFurther considerations in relation to data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","Model development should not be progressed beyond the planning phase until a better understanding of data requirements and data availability has been gained.\n\nEfforts during model planning should focus on defining data requirements, which will be informed by available data. It may be necessary to consult with a broad range of stakeholders to identify what data is available, either internal or external to the contracting authority. Data requirements should be considered in conjunction with the likely drivers of the model. A combination of what data is available and the key drivers supporting the model will inform the model design. Once a good understanding of the model data requirements has been gained, these should be captured in a Data Plan.\n\nIt is important to recognise that a model needs data to operate. If a model is designed around data that cannot be obtained, it may necessitate redesign and could cause substantial delay. If there is a high risk of data not being available then alterative modelling approaches should be considered from the outset. For example, top down or parametric approaches.\n\nFurther considerations in relation to data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]",0,0,null,0," ",0," ",0," "]
[null,null,null,6,"Sophistication",null,"Data Robustness - ","Where data is available, where is it coming from?","All key cost drivers originate from historical actuals or robust supplier estimates","All key cost drivers are from actuals and non-binding bottom up supplier estimates ","Some key cost drivers are based on parametric or relationship-based estimates","Some key cost drivers are based on consensus or subject matter expert opinions ",0,0,null,1,2,4,8,null,null,null,100,null,0,null,0,null,0,0,null,"As part of model planning a Data Plan to support the collection of data should be prepared. As model development progresses this will form the basis of a Book of Assumptions / Data Log. A Book of Assumptions / Data Log documents the data sources that the model will be using and enables, with reference to the model Specification, challenge and/or confirmation of its appropriateness. It is a necessary document for the performance of effective QA and testing (e.g. Validation).\n\nWhilst all key cost drivers originate from historical actuals or robust supplier estimates it is still important to undertake validation as part of formal QA and testing. This, along with other forms of QA and testing, should be factored into the QA Plan.\n\nFurther considerations in relation to QA and data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","As part of model planning a Data Plan to support the collection of data should be prepared. As model development progresses this will form the basis of a Book of Assumptions / Data Log. A Book of Assumptions / Data Log documents the data sources that the model will be using and enables, with reference to the model Specification, challenge and/or confirmation of its appropriateness. It is a necessary document for the performance of effective QA and testing (e.g. Validation).\n\nWhilst there is a reasonably high level of confidence in key data some may be subject to a greater level of uncertainty. It is important to understand and communicate the impact that this has on model outputs to fully inform decision makers.\n\nIt is important to undertake validation as part of formal QA and testing and this, along with other forms of QA and testing, should be factored into the QA Plan.\n\nFurther considerations in relation to QA and data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","As part of model planning a Data Plan to support the collection of data should be prepared. As model development progresses this will form the basis of a Book of Assumptions / Data Log. A Book of Assumptions / Data Log documents the data sources that the model will be using and enables, with reference to the model Specification, challenge and/or confirmation of its appropriateness. It is a necessary document for the performance of effective QA and testing (e.g. Validation).\n\nIt is important to ensure decision makers are aware of and in agreement with the estimating methodology used to generate the data used by the model. Whilst a well-constructed parametric model can generate reasonably robust cost estimates there will be a degree of uncertainty. It is also important to understand and communicate the impact that this has on model outputs to fully inform decision makers. \n\nIt is important to undertake validation as part of formal QA and testing and this, along with other forms of QA and testing, should be factored into the QA Plan.\n\nFurther considerations in relation to QA and data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","As part of model planning a Data Plan to support the collection of data should be prepared. As model development progresses this will form the basis of a Book of Assumptions / Data Log. A Book of Assumptions / Data Log documents the data sources that the model will be using and enables, with reference to the model Specification, challenge and/or confirmation of its appropriateness. It is a necessary document for the performance of effective QA and testing (e.g. Validation).\n\nAs some key data sources are opinion based, it might be appropriate to model some discrete scenarios/sensitivities or use additional techniques to understand and communicate the data's inherent uncertainty.\n\nIt is important that stakeholders are made aware of the uncertainty regarding some data in the model and that its impact is presented alongside model outputs.\n\nEfforts should focus on improving the quality of the data in the model that is least mature and has the biggest impact on model outputs. \n\nIt is important to undertake validation as part of formal QA and testing and this, along with other forms of QA and testing, should be factored into the QA Plan.\n\nFurther considerations in relation to QA and data planning can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]",0,0,null,0," ",0," ",0," "]
[null,null,null,7,"Sophistication",null,"Model Development - ","Is a new model required?","A tested, generic model requiring no changes is available for use","A tested, generic model can be used after limited adaptation","One or more existing models are available to help structure model development","A new model will need to be built from scratch",0,0,null,1,2,4,8,null,null,null,100,null,0,null,0,null,0,0,null,"A pre-existing model is available for use. Whilst this may save on development effort, undertaking aspects of model planning is recommended. It is also important to confirm that the model is appropriate for use in this case. The model development process still needs to be planned and managed.\n\nUse of a pre-existing model may reduce but does not negate the need to undertake appropriate QA and testing. This includes confirming that the QA and testing previously performed on the model is appropriate for its indented re-use and performing tests that focus on the data that powers the model.\n\nAny feeder models or data manipulation that may be required to generate the data or transform it into the right format to load into the model should also be subject to appropriate QA and testing.\n\nGuidance on the reuse of models can be found in the SCM Development Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","A pre-existing model requiring limited adaptation is available for use. Whilst this may save on development effort, undertaking model planning is recommended. It is also important to confirm that the model is appropriate for use in this case. The model development process still needs to be planned and managed, and the amount of time required to recalibrate and retest the model should not be underestimated.\n\nUse of a pre-existing model may reduce but does not negate the need to undertake appropriate QA and testing. This includes confirming that the QA and testing previously performed on the model is appropriate for its indented re-use and performing tests that focus on the data that powers the model.\n\nAny feeder models or data manipulation that may be required to generate the data or transform it into the right format to load into the model should also be subject to appropriate QA and testing.\n\nGuidance on the reuse of models can be found in the SCM Development Guidance and guidance on the development of models can be found in the SCM Technical Build Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]\n[SCM Technical Build Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","One or more pre-existing models requiring adaptation are available for use. Whilst they may inform and help to reduce development effort, it is still important to plan and design the model as if it is a new build. \n\nThe model along with the data that powers it will need to be tested in line with the QA Plan that should be prepared as part of model planning.\n\nGuidance on the reuse of models can be found in the SCM Development Guidance and guidance on the development of models can be found in the SCM Technical Build Guidance.\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]\n[SCM Technical Build Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]","Use the available good practice guidance, tools and templates available to support the model development lifecycle.\n\nGuidance on building models can be found in the SCM Technical Build Guidance and on designing and managing the development of models in the SCM Development Guidance.\n[SCM Technical Build Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]\n[SCM Development Guidance~https://www.gov.uk/government/publications/should-cost-modelling-tools-and-templates]",0,0,null,0," ",0," ",0," "]
[null,null,null,8,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,0,null,0,null,0,0,null,0,0,0,0,0,0,null,0," ",0," ",0," "]
[null,null,null,9,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,0,null,0,null,0,0,null,0,0,0,0,0,0,null,0," ",0," ",0," "]
[null,null,null,10,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,0,null,0,null,0,0,null,0,0,0,0,0,0,null,0," ",0," ",0," "]
[null,null,null,11,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,0,null,0,null,0,0,null,0,0,0,0,0,0,null,0," ",0," ",0," "]
[null,null,">>","  Insertion Row >>>>>"]
[]
[null,null,null,"Weighted Score > > > > >",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,{"$f":"COUNTIFS(W18:W29,\">0\",Y18:Y29,\"=0\")","v":7},null,null,null,{"$f":"SUM(AC$18:AC$29)","v":0},{"$f":"SUM(AD$18:AD$29)","v":0}]
[]
[]
[]
[null,null,"Score Thresholds by Tier"]
[]
[null,null,null,"Threshold","Group",null,null,null,null,null,null,null,null,null,null,"T1","T2","T3","T4","T5","T6",null,null,null,null,null,null,null,"Criticality","Sophistication"]
[]
[null,null,null,{"$f":"ROW()-ROW(D$37)-1","v":1},{"$f":"INDEX($AC$37:$AD$37,$D39)","v":"Criticality"},null,null,null,null,null,null,null,null,null,null,0,1.5,2,3,4,6,null,null,null,null,null,null,null,{"$f":"MATCH(AC$31,$P39:$U39,1)","v":1}]
[null,null,null,{"$f":"ROW()-ROW(D$37)-1","v":2},{"$f":"INDEX($AC$37:$AD$37,$D40)","v":"Sophistication"},null,null,null,null,null,null,null,null,null,null,0,1.5,2,3,4,6,null,null,null,null,null,null,null,null,{"$f":"MATCH(AD$31,$P40:$U40,1)","v":1}]
[]
[]
[]
[null,null,"IMA Output Table"]
[]
[null,null,null,"IMA Output > > > > >",null,null,null,null,null,null,null,null,null,{"$f":"IF($Y$31>0,\"TBC\",INDEX($P$48:$U$53,COUNTA($N$48:$N$53)+1-$AD$40,$AC$39))","v":"TBC"},null,"C1","C2","C3","C4","C5","C6"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"v","v","v","v","v","v"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,"S6",">","Med","Med","Med","High","High","High"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,"S5",">","Low","Low","Med","High","High","High"]
[null,"S1","S1",null,null,null,null,null,null,null,null,null,null,"S5",">","Low","Low","Med","Med","High","High"]
[null,"S1","S1",null,null,null,null,null,null,null,null,null,null,"S3",">","Low","Low","Low","Med","High","High"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,"S2",">","Low","Low","Low","Med","Med","High"]
[null,"S1","S1",null,null,null,null,null,null,null,null,null,null,"S1",">","Low","Low","Low","Med","Med","Med"]
[null,"S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1","S1"]
[]
[]
[null,null,"Suggested QA and Testing Activities"]
[]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Suggested Quality Assurance Activities",null,null,null,null,null,null,"Low",null,"Med",null,"High",null,{"$f":"$N$46","v":"TBC"},"Rank"]
[]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Verification",null,null,null,null," ",0,null,-1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W61:$AA61,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC61=0,0,MAX(AD$60:AD60)+1)","v":1}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Validation",null,null,null,null," ",0,null,-1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W62:$AA62,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC62=0,0,MAX(AD$60:AD61)+1)","v":2}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Structural Review (model maps)",null,null,null,null," ",-1,null,1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W63:$AA63,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC63=0,0,MAX(AD$60:AD62)+1)","v":3}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Good Practice Critique",null,null,null,null," ",-1,null,1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W64:$AA64,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC64=0,0,MAX(AD$60:AD63)+1)","v":4}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Analytical Review",null,null,null,null," ",-1,null,1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W65:$AA65,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC65=0,0,MAX(AD$60:AD64)+1)","v":5}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit SCM for Partial Verification (agreed upon procedures)",null,null,null,null," ",-1,null,1,null,0,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W66:$AA66,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC66=0,0,MAX(AD$60:AD65)+1)","v":6}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Partial Validation (agreed upon procedures)",null,null,null,null," ",-1,null,1,null,0,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W67:$AA67,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC67=0,0,MAX(AD$60:AD66)+1)","v":7}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit SCM for Peer Review (agreed upon procedures)",null,null,null,null," ",1,null,-1,null,-1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W68:$AA68,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC68=0,0,MAX(AD$60:AD67)+1)","v":8}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit the SCM for Commercial Review",null,null,null,null," ",1,null,1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W69:$AA69,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC69=0,0,MAX(AD$60:AD68)+1)","v":9}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Undertake Parallel Build of SCM (Verification alternative)",null,null,null,null," ",0,null,-1,null,-1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W70:$AA70,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC70=0,0,MAX(AD$60:AD69)+1)","v":10}]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Test","Submit QA Report for sign-off",null,null,null,null," ",1,null,1,null,1,null,{"$f":"IF($N$46=\"TBC\",\"TBC\",INDEX(Calcs!$W71:$AA71,MATCH(Calcs!$N$46,Calcs!$W$59:$AA$59,0)))","v":"TBC"},{"$f":"IF(AC71=0,0,MAX(AD$60:AD70)+1)","v":11}]
[null,null,">>","  Insertion Row >>>>>"]

{"sheet":"Record","index":4,"n_rows":45,"n_cols":13,"rows_kept":45,"cut":false,"hidden":false,"merged":[]}
[]
[]
[null,null,null,"S1","S1","S1","S1","S1","S1","S1",null,null,"S1"]
[null,null,null,"IMA Record",null,null,null,null,null,null,null,null,"The IMA score together with a record of responses to questions on the Inputs sheet are shown below. This should be saved as part of model QA documentation. \nClicking the 'Save PDF' button will save a PDF of this sheet in the same folder that this IMA Tool is stored. It can also be saved manually by exporting it as a PDF:\nSelect the 'File' menu; Select the 'Print' menu; Select 'Save as PDF' from the 'PDF' selection box; Enter the print details (e.g. location); Select the 'Save' button."]
[]
[null,null,null,null,"Project Name:",null,null,null,null,{"$f":"Inputs!$K$6","v":"Enter the name of the project that this IMA relates to"},null,"The name of the project that this IMA relates to can be updated on the Inputs sheet.\nNote: If a project name has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Prepared By:",null,null,null,null,{"$f":"Inputs!$K$8","v":"Enter the full name of the person undertaking this IMA"},null,"The name of the person who prepared this IMA can be updated on the Inputs sheet.\nNote: If a name has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Prepared On:",null,null,null,null,{"$f":"Inputs!$K$10","v":"Enter today's date in dd-mm-yy format (e.g. 17/02/21)"},null,"The date this IMA was prepared on can be updated on the Inputs sheet.\nNote: If a date has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Protective Marking:",null,null,null,null,{"$f":"Inputs!$K$12","v":"OFFICIAL"},null,"The protective marking can be updated on the Inputs sheet.\nNote: If the protective marking has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"IMA Score:",null,null,null,null,{"$f":"Calcs!$N$46","v":"TBC"},null,"See the Report sheet for suggested approaches to model development and the Checklist sheet for suggested QA and testing activities based on the IMA Score. \nNote: The IMA Score will be shown as \"TBC\" unless ALL questions on the Inputs sheet have been answered."]
[]
[]
[]
[]
[null,null,null,{"$f":"Calcs!$D$18","v":1},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D21))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D21))","v":"Impact - How important is the decision that the SCM supports?"}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D21))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D21),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D21))))","v":"TBC"}]
[]
[null,null,null,{"$f":"Calcs!$D$19","v":2},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D25))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D25))","v":"Detail - How detailed does the analysis need to be and how complex are the assets/goods/services being sourced?"}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D25))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D25),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D25))))","v":"TBC"}]
[]
[null,null,null,{"$f":"Calcs!$D$20","v":3},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D29))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D29))","v":"Level of Understanding - How well defined are the assets/goods/services being sourced?"}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D29))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D29),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D29))))","v":"TBC"}]
[]
[null,null,null,{"$f":"Calcs!$D$21","v":4},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D33))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D33))","v":"Resources - Are appropriate resources available to plan & design, develop, test and use the SCM?"}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D33))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D33),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D33))))","v":"TBC"}]
[]
[null,null,null,{"$f":"Calcs!$D$22","v":5},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D37))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D37))","v":"Data Availability - Are all data sources needed to produce the SCM known and understood? "}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D37))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D37),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D37))))","v":"TBC"}]
[]
[null,null,null,{"$f":"Calcs!$D$23","v":6},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D41))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D41))","v":"Data Robustness - Where data is available, where is it coming from?"}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D41))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D41),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D41))))","v":"TBC"}]
[]
[null,null,null,{"$f":"Calcs!$D$24","v":7},null,{"$f":"INDEX(Calcs!$G$18:$G$29,MAX($D$19:$D45))&INDEX(Calcs!$H$18:$H$29,MAX($D$19:$D45))","v":"Model Development - Is a new model required?"}]
[]
[null,null,null,null,null,null,null,null,{"$f":"IF(INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D45))=0,\"TBC\",INDEX(Calcs!$I$18:$N$29,MAX($D$19:$D45),INDEX(Calcs!$Y$18:$Y$29,MAX($D$19:$D45))))","v":"TBC"}]

{"sheet":"Report","index":5,"n_rows":40,"n_cols":13,"rows_kept":40,"cut":false,"hidden":false,"merged":[]}
[]
[]
[]
[null,null,null,"IMA Tailored Report",null,null,null,null,null,null,null,null,"The guidance below is based on answers provided to questions on the Inputs sheet. This can be saved and stored with model documentation as required. \nClicking the 'Save PDF' button will save a PDF of this sheet in the same folder that this IMA Tool is stored. It can also be saved manually by exporting it as a PDF:\nSelect the 'File' menu; Select the 'Print' menu; Select 'Save as PDF' from the 'PDF' selection box; Enter the print details (e.g. location); Select the 'Save' button."]
[]
[null,null,null,null,"Project Name:",null,null,null,null,{"$f":"Inputs!$K$6","v":"Enter the name of the project that this IMA relates to"},null,"The name of the project that this IMA relates to can be updated on the Inputs sheet.\nNote: If a project name has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Prepared By:",null,null,null,null,{"$f":"Inputs!$K$8","v":"Enter the full name of the person undertaking this IMA"},null,"The name of the person who prepared this IMA can be updated on the Inputs sheet.\nNote: If a name has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Prepared On:",null,null,null,null,{"$f":"Inputs!$K$10","v":"Enter today's date in dd-mm-yy format (e.g. 17/02/21)"},null,"The date this IMA was prepared on can be updated on the Inputs sheet.\nNote: If a date has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Protective Marking:",null,null,null,null,{"$f":"Inputs!$K$12","v":"OFFICIAL"},null,"The protective marking can be updated on the Inputs sheet.\nNote: If the protective marking has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"IMA Score:",null,null,null,null,{"$f":"Calcs!$N$46","v":"TBC"},null,"See the Report sheet for suggested approaches to model development and the Checklist sheet for suggested QA and testing activities based on the IMA Score. \nNote: The IMA Score will be shown as \"TBC\" unless ALL questions on the Inputs sheet have been answered."]
[]
[]
[]
[]
[null,null,null,"Guidance Based on IMA Responses",null,null,null,null,null,null,null,null,"Tailored model development guidance based on provided answers to IMA questions."]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$18","v":1},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H21)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H21)","v":0}]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$19","v":2},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H24)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H24)","v":0}]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$20","v":3},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H27)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H27)","v":0}]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$21","v":4},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H30)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H30)","v":0}]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$22","v":5},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H33)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H33)","v":0}]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$23","v":6},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H36)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H36)","v":0}]
[]
[null,null,null,null,null,null,null,{"$f":"Calcs!$D$24","v":7},null,null,null,{"$f":"INDEX(Calcs!$AQ$18:$AQ$29,$H39)","v":0}]
[null,null,null,null,null,null,null,null,null,{"$f":"INDEX(Calcs!$AO$18:$AO$29,$H39)","v":0}]

{"sheet":"Checklist","index":6,"n_rows":39,"n_cols":13,"rows_kept":39,"cut":false,"hidden":false,"merged":[]}
[]
[]
[null,null,null,"S1","S1","S1","S1","S1","S1",null,null,null,"S1"]
[null,null,null,"IMA Checklist",null,null,null,null,null,null,null,null,"The checklist of suggested QA and testing activities below is based on the IMA score. This should be used to inform the QA plan and be saved as part of model QA documentation. \nClicking the 'Save PDF' button will save a PDF of this sheet in the same folder that this IMA file is stored. It can also be saved manually by exporting it as a PDF:\nSelect the 'File' menu; Select the 'Print' menu; Select 'Save as PDF' from the 'PDF' selection box; Enter the print details (e.g. location); Select the 'Save' button."]
[]
[null,null,null,null,"Project Name:",null,null,null,{"$f":"Inputs!$K$6","v":"Enter the name of the project that this IMA relates to"},null,null,"The name of the project that this IMA relates to can be updated on the Inputs sheet.\nNote: If a project name has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Prepared By:",null,null,null,{"$f":"Inputs!$K$8","v":"Enter the full name of the person undertaking this IMA"},null,null,"The name of the person who prepared this IMA can be updated on the Inputs sheet.\nNote: If a name has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Prepared On:",null,null,null,{"$f":"Inputs!$K$10","v":"Enter today's date in dd-mm-yy format (e.g. 17/02/21)"},null,null,"The date this IMA was prepared on can be updated on the Inputs sheet.\nNote: If a date has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"Protective Marking:",null,null,null,{"$f":"Inputs!$K$12","v":"OFFICIAL"},null,null,"The protective marking can be updated on the Inputs sheet.\nNote: If the protective marking has not been entered the adjacent text will be shown in red."]
[]
[null,null,null,null,"IMA Score:",null,null,null,{"$f":"Calcs!N46","v":"TBC"},null,null,"See the Report sheet for suggested approaches to model development and the Checklist sheet for suggested QA and testing activities based on the IMA Score. \nNote: The IMA Score will be shown as \"TBC\" unless ALL questions on the Inputs sheet have been answered."]
[]
[]
[]
[]
[null,null,null,"QA and Testing Activity Checklist Based on IMA Score",null,null,null,null,null,null,null,null,"Further details on the suggested activities can be found in the SCM Development Guidance. See Aqua Book for a definition of Verification and Validation and the importance of undertaking both activities as part of formal QA and testing of SCMs.\n[SCM Development Guidance~https://gff.civilservice.gov.uk/networks-and-discussions/commercial-finance-knowledge-network/]\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]"]
[]
[null,null,null,null,"#",null,null,"SCM Phase","Suggested Activities","Notes"]
[]
[null,null,null,null,{"$f":"ROW()-ROW($E$23)+1","v":1},null,null,{"$f":"Calcs!$P61","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q61)","v":"TBC"},null,null,"It is important to check the analysis for errors and alignment with the model Specification (Verification). \n\nPerforming a Verification requires specialist skills and software tools and can be labour intensive. Whilst it will not provide a guarantee that all errors will be identified, it can provide a reasonably high degree of comfort in a model’s logical integrity and should be considered as part of QA planning. It is recommended for sophisticated and/or high-risk models and may also be appropriate for lower risk models. For a higher degree of comfort over a model’s logical integrity it may also be appropriate to consider a Parallel Build.\n\nVerification is the process of checking the model for errors and alignment with its stated objectives, as set out in model documentation (e.g. the model Specification including Design). It involves the independent application of a broad range of analytical techniques that include the review of:\n•\tall unique formulas on a cell-by-cell basis;\n•\ta Structural Review (model maps);\n•\tall VBA code on a line-by-line basis;\n•\tall formulas for inconsistencies;\n•\tall named ranges for errors;\n•\tall external links for appropriateness;\n•\tall inter and intra-sheet data flows;\n•\ta Good Practice Critique; and\n•\tthe overall model logic and design. \n\nThe quality assurer does not necessarily need to be from a 3rd party provider but should be unaffiliated with the development team and suitably qualified and experienced to undertake the review. The output of Verification is a documented list of tests performed and results against them. Notably, Verification in-itself is unlikely to be sufficient to confirm, or otherwise, the fitness for purpose of a model and additional tests may also be required (e.g. Validation).\n\nFurther details on Verification can be found in the Aqua Book and the SCM Development Guidance.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]\n[SCM Development Guidance~]"]
[null,null,null,null,2,null,null,{"$f":"Calcs!$P62","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q62)","v":"TBC"},null,null,"It is important to check that the analysis is appropriate, i.e. fit for the purpose for which it is being used (Validation).\n\nThis is the process of checking the extent to which the model is reflective of the real-world situation and is appropriate to support its intended purpose, as set out in model documentation (e.g. the model Specification including Design). It is a test performed on the data and assumptions that feed into the model, the way that they are manipulated and the outputs produced. It focusses on assessing the viability of the data and assumptions, the way they are manipulated by the model (in the context of its intended purpose), and the authenticity of model outputs. It will include Commercial Review and Analytical Review as well as a more granular review of model input data and assumptions and model methodology.\n\nNotably, depending on data volumes, a statistically significant data sample may be employed over full sampling. The output of Validation includes a report providing an assessment of the completeness of the Book of Assumptions / Data Log, an assessment of the maturity and appropriate use of data, an assessment of the model’s overall logic against its intended purpose together with the results of both the Commercial and Analytical Review. Notably, Validation in-itself is unlikely to be sufficient to confirm, or otherwise, the fitness for purpose of a model and additional tests may also be required (e.g. Verification).\n\nFurther details on Validation can be found in the Aqua Book and the SCM Development Guidance.\n[Aqua Book~https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government]\n[SCM Development Guidance~]"]
[null,null,null,null,3,null,null,{"$f":"Calcs!$P63","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q63)","v":"TBC"},null,null,"A Structural Review is an independent test of the model's structure, typically using specialist software. \n\nThe quality assurer will examine the model's design and structure for potential errors and alignment with good practice principles. This can be performed as a standalone activity although should be included as part of a Verification. \n\nFurther details on Structural Review can be found in the SCM Development Guidance.\n[SCM Development Guidance~]"]
[null,null,null,null,4,null,null,{"$f":"Calcs!$P64","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q64)","v":"TBC"},null,null,"A Good Practice Critique is an independent test that the model has been developed in accordance with good practice principles. This can be performed as a standalone activity although should be included as part of a Verification. \n\nFurther details on good practice are available in the SCM Technical Build Guidance and a Good Practice Toolkit to help structure the critique is also available.\n[SCM Technical Build Guidance~]\n[Good Practice Toolkit~]\n"]
[null,null,null,null,5,null,null,{"$f":"Calcs!$P65","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q65)","v":"TBC"},null,null,"An Analytical Review is an independent examination of model outputs or behaviour under different input conditions.\n\nThe model developer should work with key stakeholders and those responsible for performing the Analytical Review to define and agree a set of tests that the model will be subjected to. This can be performed as a standalone activity although should be included as part of a Validation. \n\nFurther details on Analytical Review can be found in the SCM Development Guidance. An example Test Memo is also available.\n[SCM Development Guidance~]\n[Test Memo~]"]
[null,null,null,null,6,null,null,{"$f":"Calcs!$P66","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q66)","v":"TBC"},null,null,"A Partial Verification will include a reduced breadth and/or depth of testing compared to Verification and correspondingly require less effort (see Verification overview above). It requires clear up-front agreement on what will and will not be performed, which should be documented as a set of agreed upon procedures. It will not provide the same degree of comfort as Verification and the limitations should be well understood.\n\nQA Reports should clearly state that a Partial Verification has been undertaken and highlight key limitations. When agreeing the scope of the Partial Verification, the trade-offs between time to undertake versus benefits should be carefully considered. For example, Structural Review (model maps) and Good Practice Critique generally take less time than other aspects of Verification. Oftentimes, it is the scope of the formulaic review that is reduced owing to the time intensive nature. In these cases, the focus of formulaic review may be limited to specific sheets, or sections of sheets containing complex formula, or those that drive the highest proportion of overall costs. Notably, Verification (including Verification) is unlikely to be sufficient to confirm, or otherwise, the fitness for purpose of a model and additional tests may also be required (e.g. Validation).\n\nFurther details on Verification can be found in the SCM Development Guidance and an example Test Memo is also available.\n[SCM Development Guidance~]\n[Test Memo~]"]
[null,null,null,null,7,null,null,{"$f":"Calcs!$P67","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q67)","v":"TBC"},null,null,"A Partial Validation will include a reduced breadth and/or depth of testing compared to a Validation and correspondingly require less effort (see Validation overview above). It requires clear up-front agreement on what will and will not be performed, which should be documented as a set of agreed upon procedures. It will not provide the same degree of comfort as Validation and the limitations should be well understood. QA Reports should clearly state that a Partial Validation has been undertaken and highlight key limitations.\n\nWhen agreeing the scope of the Partial Validation, the trade-offs between time to undertake and versus benefits should be carefully considered. For example, Commercial and Analytical Review generally take less time than other aspects of Validation. Oftentimes, the volume of data tested is reduced owing to the time intensive nature of validating inputs. In these cases, the focus may be on cost drivers with the greatest impact on overall costs and/or sampling approaches used to reduce the volume of data tested. Notably, Validation (including Validation), is unlikely to be sufficient to confirm, or otherwise, the fitness for purpose of a model and additional tests may also be required (e.g. Verification).\n\nFurther details on Partial Validation can be found in the SCM Development Guidance and an example Test Memo is also available.\n[SCM Development Guidance~]\n[Test Memo~]"]
[null,null,null,null,8,null,null,{"$f":"Calcs!$P68","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q68)","v":"TBC"},null,null,"Peer Review is the independent performance of an agreed and documented set of tests on the model and checks to various elements. \n\nThe model developer should work with key stakeholders and the quality assurer to define the set of tests and checks, giving due consideration to their scope and what will and will not be covered. \n\nFurther details on Peer Review can be found in the SCM Development Guidance and an example Test Memo is also available.\n[SCM Development Guidance~]\n[Test Memo~]"]
[null,null,null,null,9,null,null,{"$f":"Calcs!$P69","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q69)","v":"TBC"},null,null,"Commercial Review is the independent examination of the model from a commercial, sense-check, perspective. \n\nThe model developer should work with the quality assurer and other stakeholders to agree and document areas of focus for Commercial Review. This can be performed as a standalone activity although should be included as part of a Validation.\n\nFurther details on Commercial Review can be found in the SCM Development Guidance and an example Test Memo is available.\n[SCM Development Guidance~]\n[Test Memo~]"]
[null,null,null,null,10,null,null,{"$f":"Calcs!$P70","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q70)","v":"TBC"},null,null,"In some instances, it may be appropriate to have a duplicate model independently built as an alternative to, or in addition to, Verification. Through comparison this will help to identify deviations and potential errors. \n\nParallel Build alone is unlikely to be sufficient to confirm that the model is fit for purpose and other forms of testing (e.g. Validation) will likely be required. \n\nFurther details on Parallel Build can be found in the SCM Development Guidance.\n[SCM Development Guidance~]"]
[null,null,null,null,11,null,null,{"$f":"Calcs!$P71","v":"Test"},{"$f":"IF(rngIMAScore=\"TBC\",\"TBC\",Calcs!$Q71)","v":"TBC"},null,null,"The performance of QA and testing needs to be documented in a QA Report and communicated to decision makers for approval. This sign-off formalises the fact that an appropriate level of QA and testing has been performed and that the model is ready for use. \n\nAn example QA Report Template is available.\n[QA Report Template~]"]
[]
[null,null,null,null,"Colour Coding Key for Suggested QA and Testing Activities Based on IMA Score"]
[]
[null,null,null,null,null,null,null,null,"Suggested Activity"]
[null,null,null,null,null,null,null,null,"Also Consider"]
[null,null,null,null,null,null,null,null,"Not Suggested"]