Taking Part: England’s Survey of Leisure, Culture and Sport
2011/12 Questionnaire Development
Angela Charlton, Michael Potter, Samuel Sullivan and Sabrina Qureshi, TNS-BMRB  
August 2011

        

Our aim is to improve the quality of life for all      through cultural and sporting activities, support the pursuit of excellence, and champion the tourism, creative and leisure industries.

Contents

1.	Introduction and background	5
2.	Questionnaire development workshop	6
3.	Cognitive Testing	10
4.	Quantitative CAPI Pilot	22
5.	Next Steps	33
Appendices	34

1.	Introduction and background
In preparation for the 2011/12 survey, the content of the Taking Part adult and child questionnaires was reviewed to ensure the survey continued to collect relevant information for the Department for Culture, Media and Sport (DCMS) and other stakeholders.  As a result of the review, a number of new questions were developed and tested.

This report outlines the different stages of the review and development process conducted jointly between DCMS and TNS-BMRB, highlighting the findings and recommendations from each stage.  

The three stages of development were:

1.	A questionnaire development workshop held jointly by DCMS and TNS-BMRB
2.	Cognitive testing of new questions to be included in the adult survey
3.	A face-to-face quantitative pilot conducted in-home to test the final draft of the 2011-2012 questionnaire using Computer Assisted Personal Interviewing (CAPI)

Chapter 2 covers the questionnaire development workshop, held in March 2011 to discuss the future of the Taking Part survey.  Key survey users and stakeholders were invited to offer their opinions and put forward suggestions for new questions and topic areas.

Chapter 3 outlines the findings of the cognitive interviews.  This stage was conducted in April 2011 by the research team at TNS-BMRB. It tested new questions covering the following areas:

•	Involvement in heritage related groups and activities
•	Involvement in local planning decisions
•	National identity and pride
•	Involvement in the 2012 Olympic and Paralympic Games
•	The influence of the 2012 Olympic and Paralympic Games on involvement in sport, cultural activities and volunteering. 

Chapter 4 outlines the findings from the face-to-face pilot.  This tested the full CAPI questionnaire with an emphasis on the following areas:

•	Overall questionnaire length and the timing of each section after the inclusion of the new questions
•	Placement of new questions in the context of the current Taking Part 2010/11 questionnaire 
•	Respondents’ basic understanding of questions
•	Gaining interviewer feedback on questionnaire design and practical aspects of conducting the interview (e.g. use of prompt materials and the engagement of respondents).
2.	Questionnaire development workshop
A questionnaire workshop was held at DCMS on Monday 28th March 2011. The aim was to discuss the future of the Taking Part survey and to put forward potential new question topics that could be tested in the subsequent piloting phase for the 2011/12 survey or considered for future editions of the survey.  

Representatives from DCMS (the Taking Part team, Arts team and Olympics team), TNS-BMRB, Sport England, Arts Council England, English Heritage and the Cabinet Office were all present.  The Taking Part team from DCMS also presented feedback and comments submitted by Taking Part users as part of a wider questionnaire consultation, which took place prior to the workshop.

After the team from TNS-BMRB had introduced the survey, its history and current status, the workshop was split into two group discussions, with the focus on suggesting new priorities and subject areas that could be included in the survey.  Following the discussions, the small groups provided feedback to the rest of the workshop, and points for further action were identified.

This chapter summarises the main talking points from the discussions, and brings together the suggestions for new subject areas that were considered for the piloting stage.
2.1.	Current uses of Taking Part data

Attendees were first asked to outline how they currently use Taking Part data.  This varied considerably between participants.

•	Arts Council England are particularly interested in understanding the motivations for participation and attendance among young people. In particular, the Taking Part data informs their policies for encouraging youth participation.  The broadcasting and media questions are not used by Arts Council England as they get this information from alternative data sources.  

•	The DCMS arts sector team gave specific examples of how they have used Taking Part data: 
o	Information on barriers to engagement in the arts among young people suggested that cost might be a factor. This led to the ‘A Night Less Ordinary’ campaign, which offered free and reduced-price theatre tickets to under-25s. 
o	When ministers asked for initiatives to promote arts engagement in rural areas, DCMS were able to use Taking Part data to demonstrate that arts engagement is already high in rural areas, and that new initiatives were therefore unnecessary.

•	Sport England currently use the survey for insight purposes, rather than for the general prevalence measurements, as the Active People Survey, their own survey on sports participation, provides this kind of information for them.  The data has also been used for segmentation purposes, to compare sports participation with participation in other sectors, something that Active People can’t offer.

•	The Cabinet Office had not used Taking Part data at this stage, but were exploring the possibility of using data to measure a range of measures (e.g. volunteering, charitable giving, community engagement) related to big society.  
2.2.	New areas of interest

Several new topic areas were suggested in the group discussions. A number of revisions to existing questions were also suggested. These provided a useful starting point for developing new questions to be tested in the subsequent cognitive testing stage.  The new topic areas were as follows:

•	Motivations and barriers - Sport England suggested that Taking Part could move away from focusing its priorities on prevalence measurement (i.e. the extent to which people participate in particular sports), and towards creating a stronger understanding of motivations and barriers to participation more generally.  While specifically mentioned with regards to the sports content of the questionnaire, this could also be applied to the other sectors, and potentially other areas of interest such as big society.  

Arts Council England also raised an interest in capturing more data regarding motivation.  While it is generally accepted that Taking Part does a good job of understanding the reasons why people attend events (e.g. ‘a family trip’, ‘a school outing’), it was felt that more could be done to find out what actually motivates people to attend. There is some overlap here with barriers, and it was suggested that, particularly for young people, it might be beneficial to explore respondents’ social circle. For example, people are often influenced by the interests of their friends - if friends are not interested in arts, heritage etc., they may be less likely to participate or attend themselves. 

•	2012 Olympic and Paralympic Games - Taking Part was seen as the perfect place for questions to capture engagement with the 2012 Olympic and Paralympic Games.  Questions would be needed before and during the 2012 Olympic and Paralympic Games (asking whether the respondent plans to attend an Olympic event), and during and after the 2012 Olympic and Paralympic Games (asking whether they have actually attended an event). 

It was also agreed that there is a need to find out whether people have attended an event that is connected to or inspired by the 2012 Olympic and Paralympic Games. Respondents may have been to such an event without realising that it was connected to the 2012 Olympic and Paralympic Games, so this question would need a pre-coded list. 

National pride was identified an area of interest, but not necessarily a priority.  The Olympics Legacy team at DCMS would be interested in measuring any change in national pride around the 2012 Olympic and Paralympic Games, but there is an awareness that this may be influenced by the performance of Team GB at the 2012 Olympic and Paralympic Games. 

Satisfaction with the 2012 Olympic and Paralympic Games investment and legacy was mentioned as an area for testing, with DCMS wanting to know whether people have noticed investment in their local facilities as a result of the 2012 Olympic and Paralympic Games, and if they’re satisfied with this. 

The impact of the 2012 Olympic and Paralympic Games on social cohesion (i.e. the extent to which people from different backgrounds get on with each other) was also mentioned as an area of interest along with the need to develop an understanding of the ways in which people are mixing more (street parties, 2012 Olympic and Paralympic Games themed events etc.).
 
•	Big society - From a big society perspective, it was felt that more general questions in the public participation, charitable giving and volunteering sections of the questionnaire would be of benefit, focusing more on general participation than culture and sport sector-specific activity.

•	Frequency of participation in the arts - The DCMS arts sector team expressed a concern that attendance in arts events is becoming more niche – i.e. more people are attending arts events but the number of events people attend in a year is low. It would be useful to find some way to capture this. 

•	Location of activity - There was interest in finding out where people are attending or participating in activities in relation to where they live. Are people only going to local events or are they travelling to other areas? English Heritage expressed a particular need to find out whether attendance is in England or elsewhere. 

•	Local facilities - It was suggested that the survey could focus more on local facilities (in particular accessibility) – the expansion of the existing levers section could accommodate questions of this nature.

•	Digital engagement – Library sector representatives identified a need for questions that more accurately capture digital engagement with library resources.  English Heritage also mentioned a need to more fully measure digital engagement in heritage, e.g. accessing websites of heritage attractions. 

•	Wellbeing - It was suggested that a question on general wellbeing could be included, perhaps depending on the outcome of the ONS consultation on measuring national wellbeing.

•	Disability - Barriers for people with disabilities were identified as an area of interest. Barriers to participation were important, but also access to information (e.g. websites). Are people with disabilities being catered for? 

•	Child surveys - Extra detail on competitive sport would be desirable, especially a focus on the impact extra competitive sport at school level might have on participation after leaving full-time education.

2.3.	Potential survey partners

It was felt that there was a strong case for opening up modules of the survey to other government departments and subjects, providing funding could be secured.  DCLG and the Cabinet Office were identified as potential candidates, following the cancellation of the Citizenship Survey.
2.4.	Possible questions to be removed from the questionnaire

It was suggested that generally, any section where there are not significant changes observed over time could be considered for removal from the questionnaire.  At the very least, such sections could be removed and run on a modular basis every other year, or even up to once every five years, depending on the need and the expected levels of change.

The socialisation questions (i.e. the questions covering what adults did as children) were seen as a prime candidate for this approach, with little or no change to the activities and participation respondents reported when they were younger, since the survey began.  These questions, along with others could be run on a year-on/year-off basis to free up questionnaire space.  

Other sections or questions that were suggested for removal or review:

•	Participation questions – it was suggested that the current participation questions may provide a level of detail that is not required anymore, particularly with reference to the sports section.
•	Happiness question – at this stage it was suggested that a general section on happiness/wellbeing would be useful, in which case this question could be removed.
•	Media usage and broadcasting questions – some attendees felt that these questions were not really used for anything, and as such could be surplus to requirements.
2.5.	Post-workshop actions

Following the workshop, DCMS asked representatives from the various survey stakeholders to put forward questions that they would like to include in the 2011/12 survey, along with any they would be happy to remove.  DCMS and TNS-BMRB used this feedback and the information gathered at the workshop to develop a short questionnaire for cognitive testing.  

3.	Cognitive testing
This chapter outlines the findings and recommendations from the cognitive testing stage of question testing.

The advantage of cognitive interviewing over conventional piloting is that it pays explicit attention to the mental processes respondents use to answer survey questions.  These mental processes include:

Comprehension 	e.g. do respondents understand the same thing as we intended when we designed our questions?	
Judgements	e.g. what do they take into account when responding to the questions?	
Responses	e.g. will the survey instrument allow them to express their responses correctly?	

In some respects techniques used in understanding these mental processes are similar to those used in qualitative interviewing, but the objective is different: in qualitative work we try to explore actual attitudes and behaviour, whereas in cognitive interviewing we try to understand respondent thought processes when answering a survey question.  

This stage included questions developed in light of the questionnaire workshop, and suggestions put forward by DCMS and the Taking Part survey partners (Arts Council England, Sport England and English Heritage).  The questions tested covered the following areas:

•	Involvement in heritage related groups and activities
•	Involvement in local planning decisions
•	National identity and pride
•	Involvement in the 2012 Olympic and Paralympic Games
•	The influence of the 2012 Olympic and Paralympic Games on involvement in sport, cultural activities and volunteering. 
3.1.	Methodology

TNS-BMRB conducted 23 cognitive interviews from a central London venue on the 28th April 2011.  The profile of respondents that were interviewed is shown in Table 3.1.

Table 3.1 Profile of respondents

	Interviews completed	
Sex	Male	13	
	Female	10	
Age	16-29 years	6	
	30-44 years	5	
	45-64 years	8	
	65+	4	
Working status	Working	8	
	Not working	3	
	Unemployed	1	
	Retired	3	
	Not working	6	
	Student	2	

Respondents were recruited for the interview by recruiters working in the street.  They briefly introduced the survey, DCMS, and how long the interview was likely to take, before bringing them in to the central venue to be interviewed face-to-face by one of four TNS-BMRB researchers. There was a guide quota set out, in order to get an even spread of demographics among respondents. Each respondent received a £5 high-street voucher for taking part in the interview.

The interviews lasted between 30 minutes and 90 minutes, depending on the answers provided.  This time included extensive probing of the answers provided by the respondent to ensure as much detail as possible was collected, as well as standard cognitive follow-up questions designed to extract aspects of the respondent’s comprehension and understanding of the questions asked.  The final questionnaire used for the pilot is included in Appendix 1.
3.2.	Heritage/local engagement: question review

This section outlines the questions that were asked for the pilot on the subject of heritage and local engagement. Findings from these questions are detailed below, including issues that need to be addressed before inclusion on the main survey and any additional observations that were gleaned from the interviewing process by the research team.
3.2.1.	Involvement with groups

Respondents were initially asked a screening question that already appears on the survey (GRPINT) asking whether they are involved in groups, clubs, or organisations. Any respondents who said that they had been involved in groups in the last 12 months were then asked whether this involvement had involved any of the following:  

1.	Involvement in planning issues affecting your local environment (e.g. discussing planning applications)
2.	Learning about local heritage/the historic environment through talks (e.g. guest speakers)
3.	Learning about local heritage/the historic environment by visiting historic places
4.	Helping to directly conserve understand local heritage/the historic environment
5.	None of these (SINGLE-CODED)

Around half of respondents reported that they had been involved in groups and answered the follow-up question. 

These questions generally worked well. The introductory text defining group involvement was quite broad and could potentially encompass groups of people coming together for any reason – for example, one respondent answered ‘yes’ on the basis that he watches sport on television with his friends.  However, given that this is an existing question the current definition should remain the same.  The broad definition also ensures that the follow-up question is answered by all respondents to whom it applies. 

A number of minor issues emerged that needed to be addressed. 

Some respondents answered the follow-up question in relation to things that they have done individually rather than as part of a group. It was immediately obvious that they were talking about individual as opposed to group activities, so it was easy to clarify and code the question correctly. In order to minimise confusion, it was proposed to either amend the response codes to reiterate group involvement (e.g. ‘Learning about local heritage/the historic environment through group visits to historic places’) or include an onscreen prompt for interviewers (e.g. ‘IF YES: Can I just check, was this as part of a group?’). 

Another issue surrounded the time frame for the question. We asked whether respondents had been involved in any of these things in the last 12 months. This could present a problem if a respondent belongs to a group on a continuous basis (i.e. their involvement in the group itself is ongoing) but the group has not done any of these things within the last 12 months – for example, the group may visit historic places but have not done so within the last 12 months. Clarification was required about whether respondents needed to have actually done the activity within the last 12 months, or if belonging to a group within the last 12 months was sufficient. 
3.2.2.	Local planning decisions

Some questions on the local planning process were included which were aimed at understanding the interest and potential role the individual currently takes in the local planning process. There was an additional focus on planning decisions that affect heritage sites or buildings. These questions were designed to find out whether respondents would be any more or less likely to get involved in planning decisions that affect heritage sites or buildings. 

After being provided with a definition of ‘local planning decisions’, respondents were asked to indicate whether they had been involved in any such decisions by selecting from the following statements: 

1.	I have been involved in planning decisions that affected me directly, but not the wider local community
2.	I have been involved in planning decisions that affected my local community as a whole (i.e. may or may not have affected me directly, but affected the community)
3.	I have not been involved in any planning decisions

Respondents selecting statement 1 or 2 were then asked whether they had ever been involved in a decision that affected a heritage site or building, while those selecting statement 3 were asked whether they would ever get involved in planning decisions (of any kind). The final question in this section was asked of all respondents who said that they had never been involved in a planning decision that affected a heritage site or building, and asked whether they would ever consider getting involved in this kind of decision.

There were no major issues with these questions so they would be suitable for inclusion with only minor adjustments. 

It was recommended that showcards should be used for these questions. The statements, while easy to understand, are slightly involved and there is a lot for the respondent to absorb.  Some respondents did not initially pick up on the fact that statements 1 and 2 were mutually exclusive. Allowing respondents to read the statements again while considering their response would help to ensure that the questions are properly understood.  

Clarification was required from DCMS and English Heritage about some of the terms used in this question.  Firstly, ‘involvement’ in local planning decisions.  One respondent was unsure about this, saying that he had demonstrated an interest in a planning decision by looking at some plans in a local church, but had taken no further action. Would this type of passive interest be classed as involvement?  Secondly, there was also potential for confusion surrounding the term ‘planning decisions’. Some respondents asked whether the closure of public buildings (e.g. libraries) constituted a planning decision.  Would this type of action be included?  If not, a definition would need to be added along the lines of ‘This does not include occasions when a public building or service has been closed.’

Respondents were probed for their understanding of the terms ‘local area’ and ‘local community’. Most had a clear idea of what they considered as their local area, and this was synonymous with their local community. Generally speaking, respondents regarded their local area as the place where they live (their street and the surrounding streets) and their local community as the people who live in that area. In order to ensure consistency when respondents are answering these questions, it was recommended that one of the ‘local area’ definitions used in the current questionnaire, is included with this question.
3.2.3.	Involvement in issues affecting the local environment

Some questions were piloted that aim to identify what may be preventing people from getting involved in issues that affect their local environment (e.g. planning decisions) and assess their likely involvement in these issues.  

These questions proved to be extremely problematic. The testing demonstrated that the questions could not be used in their current format, and would need to be altered significantly if they were to be included on the main survey. 
Barriers to involvement in planning decisions 

The first question in this section asked respondents whether they would be more likely to get involved in local planning decisions if they knew more about the following: 

How the overall planning process works 
How to access information on specific planning cases
Your local area and its history, e.g. what buildings are of historic or architectural importance
Which community groups are involved in planning issues 

Respondents were given three response options: ‘A lot’, ‘A little’, or ‘Not at all’. 

Two main issues emerged in relation to this question: 

•	Most respondents had difficulty following the question and lost track of what they were being asked. Some simply responded to each statement by saying something along the lines of ‘Yes, I would like to know more about this’, and needed to be prompted to say whether they would be any more likely to get involved. 
•	It was difficult to ensure that this question was answered in the same way by all respondents without knowing a respondent’s existing level of knowledge. For example, some respondents answered ‘Not at all’ because they have no interest in getting involved in planning decisions.  Others however gave the same response, but because they already know as much about these things as they need to, more information would not make them any more likely to get involved. 

Aside from the issues outlined above, with the question in its current form there would be a danger that respondents may over-emphasise the impact that more information would have on their likelihood to get involved. If a respondent is at all likely to get involved in planning decisions, then they would generally consider information in all of four areas to be useful and therefore likely to increase their chances of involvement. 

One possible solution would be to ask whether respondents know how to access more information in each of these areas. Rather than ask for a simple ‘Yes/No’ response (which would lead likely lead to over-reporting), it was proposed that an open question is asked.  For example:

What would you do if you wanted to find out more about…

a)	How the overall planning process works? 
b)	How to access information on specific planning cases? 
c)	Your local area and its history, e.g. what buildings are of historic or architectural importance?
d)	Which community groups are involved in planning issues?

This would be asked as an unprompted question, but interviewers would be provided with a pre-coded list of responses to code to.  

The rationale behind this question was that it should capture how familiar respondents are with sources of information on these four aspects of planning decisions. We felt that knowing how to access this kind of information was more relevant here, as many people would only seek out this kind of information if a particular planning issue arose that they are interested in. As such, not knowing how to access information is more likely to prevent people from getting involved than a lack of knowledge itself. 

If respondents report that they do know how to access information on planning decisions, it could be reasonably assumed that lack of information is not a barrier to involvement. 

A follow-up question could be asked to provide more detail on barriers to involvement. This question would be asked of all respondents who have already told us that they either have not been involved in, or would never want to be involved in planning decisions (assuming of course that these questions are added to the questionnaire). This would take the form of the question INUN that was also tested in this round of piloting (feedback on this question can be found below): 

Earlier you said you [had never been involved in planning decisions/would never want to get involved in planning decisions]. Why is this? 
Issues affecting the local environment

The second part of this section asked about general issues affecting the local environment and potential involvement in some of these areas.
 
Respondents were asked a pair of questions about a list of things that can affect the quality of their local environment:

		Clean streets
		Green spaces (e.g. parks)
		Libraries, theatres, museums or galleries
		Leisure centres or sports facilities
		Historic places, areas or buildings
		Traffic management
		Access to public transport
		Shopping facilities 
		Education facilities (e.g. schools, colleges)
		Low levels of crime

The first question asked respondents to tell us how important they feel it is to have each of these things in their local area. For anything that they considered to be ‘very’ or ‘quite’ important, they were asked how likely they would be to get involved in activities relating to these things in their local area. 

The items on the list were well understood by respondents, with the possible exception of ‘Low levels of crime’. As this is more abstract, some respondents commented that it seemed out of place, given that all of the other items are more tangible ‘things’ that can be found in an area. 

There was also a potential issue around ‘traffic management’. Most respondents had a clear idea of what this meant to them, but there was some variety in the examples that they provided when probed. Some examples were: 

‘Keeping the roads clear…car parks, anti-congestion measures.’

‘Street management (e.g. access to bike lanes). Safe pavements for pedestrians. Traffic lights.’

‘Good signs, traffic lights, zebra crossings.’

‘Parking, pedestrianisation, bus lanes, speed bumps.’

Clarification was required on what should be included under the term ‘traffic management’ and a further definition could be developed if required. 

These questions proved to be particularly problematic for two main reasons: 

•	Social desirability seemed to have a strong impact on the answers provided. Most respondents answered ‘Very/quite important’ and ‘Very/quite likely’ for everything on the list. As all items on the list are nominally ‘positive’ things, it seemed unlikely that many respondents would regard them as unimportant. 

•	Respondents struggled with the concept of ‘involvement’. Although examples were included in the question text (‘for example, by volunteering, contacting the council, or attending a public meeting’), for many of items on the list respondents were not clear what was meant by ‘involvement’. Several respondents instinctively said that they would be likely to get involved, but then were unable to think of what this would entail. This was a particular issue for ‘clean streets’, ‘traffic management’, ‘access to public transport’, and ‘shopping facilities’. It seemed therefore that respondents were not making a distinction between importance and likelihood to get involved.

The testing demonstrated that it would be difficult to capture potential involvement with these questions. As indicated above, respondents quite often claimed that they were likely to get involved in something, but this seemed to be driven more by their identification of an issue as important rather than by any actual intention to get involved.

It may be considered more effective to ask respondents whether they have been involved in activities relating to any of the things on the list. For any items that respondents have not been involved with, they could be asked the follow-up question INUN which asks why they have not been involved. 

An alternative solution would be to address these questions after LIVBET, which currently appears in the Social Capital section:

What one thing would most improve the quality of your local area? 

1.	Cleaner streets
2.	More green spaces
3.	Less traffic 
4.	Less crime
5.	More/better shops
6.	Better schools/colleges etc. 
7.	More/better libraries, museums, galleries, cinemas, theatres etc. 
8.	More leisure centres or sports facilities
9.	Better transport links
10.	More parking spaces
11.	Better designed buildings
12.	More money for the renovation of old buildings
13.	Other (specify)

This response list is slightly different to the questions that were tested in the pilot, but largely covers the same things. A question could be added after LIVBET along the lines of: 

And still looking at this list, which, if any, would you be most likely to get involved with in your local area (for example by volunteering, contacting the council, or attending a public meeting)? You can choose up to three. 

Given that respondents are likely to consider all of these items to be important, it may be more valuable to identify which items are most likely to encourage involvement.
3.2.4.	Heritage participation

Some questions were tested that asked whether respondents had visited any heritage or historic sites in the last 12 months. Follow-up questions asked about any visits to sites outside of England and any involvement in historic re-enactment. 

There were no major issues with these questions. Respondents were able to answer the first question (SCHER) easily and understood the response codes well. 

When probed, respondents’ definitions of ‘a city or town with historic character’ were largely consistent, with most referring to places with old or historic buildings, or places where something of historical significance has happened. Some respondents queried whether they should include occasions when they had been somewhere with historic character by chance (i.e. they did not visit because the place had historic character).  These instances were included as this is currently the instruction on the main survey.  

Only three respondents had visited somewhere outside of England in the last 12 months – one to Scotland and two to Europe. 

None of the respondents had been to an event involving historic re-enactment/recreation in the last 12 months however most were familiar with what this is. Examples of definitions provided by respondents were as follows: 

‘Groups of people re-enacting a scene as they thought it happened.’

	‘Retelling or acting out something that happened in the past.’

	‘If an event happened somewhere, a group of enthusiasts re-enact what happened.’

The word ‘recreation’ caused confusion for a couple of respondents. One was thinking about restoration, and gave the definition ‘Preserving or adding to historic buildings’. Clarification was required from English Heritage about whether there is a distinction between re-enactment and recreation in this context. Given that the term ‘historic re-enactment’ is well understood, it was suggested that ‘recreation’ should be dropped from the question text. However, if ‘historic recreation’ is something distinct from re-enactment, a definition would need to be provided.
3.3.	2012 Olympic and Paralympic Games and pride: question review

The following section outlines the findings from the testing of questions based around the 2012 Olympic and Paralympic Games. At the time of piloting awareness and intentions seemed to be quite low, however the questions will have more relevance to respondents as the 2012 Olympic and Paralympic Games get closer. 

3.3.1.	Involvement in the 2012 Olympic and Paralympic Games

“In what ways do you intend to follow, or get involved in the London 2012 Olympic or Paralympic Games?”

This question was asked open-ended, allowing respondents to suggest any activity. Respondents struggled to come up with many answers to this question but this was not surprising as at the time of piloting, the 2012 Olympic and Paralympic Games was still 15 months away.  The most popular answers at the time of piloting were around watching on the TV, or buying tickets for events. 

After asking the question open-ended, respondents were taken through the following response list:

1.	Through watching or listening to live events on TV, internet, the radio or watching live events on a public big screen.
2.	Through attending a ticketed Olympic or Paralympic event.
3.	Through taking part in a Games related sports or physical activity (e.g. AdiZone, Gold Challenge, Cadbury’s Spots V Stripes)
4.	Through using a new or improved sports facility linked to the 2012 Games (e.g. Inspire-marked)
5.	Through Games related employment or training
6.	Through taking part in a Games related cultural event or activity (e.g. Cultural Olympiad, London 2012 Festival)
7.	Through volunteering during the Games (e.g. as a Gamesmaker, London Ambassador or for Cadbury’s Spots V Stripes)
8.	Through taking part in a Games related community event or activity (e.g. street party or local Inspire Mark project)
9.	None of the above

When prompted, respondents mentioned that they expected to get involved or follow the 2012 Olympic and Paralympic Games in many of the ways on the list, in particular by volunteering or through 2012 Olympic and Paralympic Games related employment.  This should be noted with caution as using the list may have led respondents to over-state their likely involvement, particularly as most respondents had indicated that they had not considered any of the options before but could potentially participate when prompted. 

As respondents were taken through the various options, there was low recognition for some of the specific 2012 Olympic and Paralympic Games related activities and terms. This included: AdiZone, Gold Challenge, Cadbury’s Spots V Stripes, Inspire-Marked, and Cultural Olympiad. When the activity was recognised, for example Cadbury’s Spots and Stripes, the respondent did not link this with the 2012 Olympic and Paralympic Games.  

Respondent’s intentions seemed to fit reasonably well with the coded options; however it was recommended that the following code should be altered:

1.	Through watching or listening to live events on TV, internet, the radio or watching live events on a public big screen.

In most cases this option was coded although when probed about the specific activities included, many respondents only expected to watch on television. As watching live events on a public screen requires rather different behaviour it was recommended that the option should be split into activities done at home and those done outside the home. In addition, splitting TV and radio would allow people to specify the form of their coverage. The internet could then be split by both options to identify whether people are watching online or just listening. 

1.	Through watching on TV or the internet at home. 
2.	Through listening to the radio or internet at home.
3.	Through reading the newspaper online or offline.
4.	Through watching live events on a public big screen. 

Attendance at ‘free events’ was also mentioned by some respondents so this would be a useful addition to the response list to capture this type of involvement.   

Respondents were asked about their understanding of the phrase used in the question to describe the 2012 Olympic and Paralympic Games. The provided phrase ‘London 2012 Olympic and Paralympic Games’ was understood by all, and no alternatives were suggested. 

3.3.2.	The influence of the 2012 Olympic and Paralympic Games on involvement in sport
These questions asked whether the respondent had taken part in any sport in the last 12 months and whether the 2012 Olympic and Paralympic Games had motivated them to do more sport, and if so, how.    

Most respondents noted their current participation in sport was not influenced by the 2012 Olympic and Paralympic Games.  It is worthwhile noting that this question (and the similar questions regarding cultural activity and volunteering) cannot generate a causal connection between the 2012 Olympic and Paralympic Games and an increase in non-2012 Olympic and Paralympic Games based activity (as there is an absence of data to show what would have happened if the 2012 Olympic and Paralympic Games were not being held in London) but it does provide a guide to whether the respondent perceives a link.

The follow-up questions (SPNWHY and NOSPWHY) asked respondents in what ways they had become more motivated or interested in sport. However, as most respondents said that 2012 Olympic and Paralympic Games had no impact, there was limited opportunity to test these questions. The response lists to these questions were fairly comprehensive, particularly as code 1 in both cases (‘I’m more interested in sport in general’) can encompass most responses.  Therefore despite having not fully tested these questions, it was recommended that the ‘Other (specify)’ option is removed.  

Those who had not done any sport in the last 12 months were asked a follow-up question that asked whether 2012 Olympic and Paralympic Games had increased their interest in sport. It worked in the same way as the motivation question above, and would also benefit from ‘Other (specify)’ being removed. 

Respondents understanding of the terms ‘motivated’ and ‘interested’ were generally consistent. There was however some discrepancy regarding what this might entail; for example, ‘more interested in sport in general’ could include watching more sport on TV. Assuming that DCMS would be content for respondents to interpret ‘more interested’ for themselves, this should not be a problem.

3.3.3.	The influence of the 2012 Olympic and Paralympic Games on involvement in culture
 
In addition to a sporting influence, the influence of the 2012 Olympic and Paralympic Games on involvement in cultural activities was also tested. The positioning of the question did cause some confusion as it came directly after the sports questions.  As a record of cultural activities by respondents is already collected from earlier questions in the survey, it was recommended that that these are noted in the question text. This would serve to remind the respondent of their answers and also define what is meant by ‘cultural activities’ in the context of the survey. 

“Earlier you said you took part in the following cultural activities.... xxxx

Do you think that the UK hosting the 2012 Olympics and Paralympic Games has motivated you to do more cultural activities?”

Again, within the options of ways they are more motivated, “Other (specify)” should be removed. 
 
The question itself had the same weakness as the sport question (in terms of causality) but it would capture people’s perception of whether the 2012 Olympic and Paralympic Games has motivated them to do more cultural activities, and how. 

Some respondents were confused by how the 2012 Olympic and Paralympic Games could motivate participation in cultural activity and questioned the relevance of this.  Again this is not surprising and as the 2012 Olympic and Paralympic Games get closer and the recognition of the cultural aspects of the 2012 Olympic and Paralympic Games increases, confusion should decrease.  

It also needs to be made clear in the question text that ‘cultural activities’ refers to any kind of cultural activities and these do not necessarily need to be connected to the 2012 Olympic and Paralympic Games 

3.3.4.	The influence of the 2012 Olympic and Paralympic Games on volunteering

These questions worked in a similar way to the sport and culture questions. 

The aim of this section was to understand the influence of the 2012 Olympic and Paralympic Games on respondents volunteering activities.  The objective is to find out if the 2012 Olympic and Paralympic Games will result in communities becoming more active and cohesive by inspiring more people to volunteer their time and set-up their own 2012 Olympic and Paralympic Games related activities. With such a small sample, the questions did not get fully tested.  Generally respondents could provide a definition of volunteering such as ‘working without payment’, ‘giving up time’ or ‘providing help or knowledge’. Respondents had a reasonable understanding of different types of volunteering activities. However if there are specific 2012 Olympic and Paralympic Games related activities DCMS are interested in, it would be useful to mention these in the question to ensure the activities are prompted and considered by the respondent.  For example, one respondent mentioned that he would not include a 2012 Olympic and Paralympic Games street party as a volunteering activity as he would see this as an informal fun activity with everyone in the community contributing in some way.  This respondent only defined volunteering activities as formal unpaid work or help.

3.3.5.	Pride and the 2012 Olympic and Paralympic Games

This section of the questionnaire aimed to assess the influence of Britain’s sporting achievements on national pride.  Firstly, a question was asked to gauge what respondents regard as their ‘national identity’, followed by a question about what makes them proud of Britain.  This was to try and understand where previous sporting achievement stands alongside other aspects of British life.  The question and the response list was adapted from one used in the British Election Panel Study 1992-1997.  

Two different versions of this question were tested:

1.	 “What, if anything makes you most proud of Britain?” This was asked as an open-ended question.
2.	 “And which, if any, of the following makes you most proud of Britain?”  

Those who heard the latter option were provided with a list of possible options. The testing demonstrated that those who were not prompted were able to list one or two possible options that made them proud and they were also able to explain the reasoning of this when probed. 

While this question did seem to work in an open-ended format, it was recommended that it be administered as a prompted list. This was favoured over an open-ended question as there was a specific interest in finding out about respondents’ pride in sporting achievements. Allowing respondents to see this on a response list would ensure that it is not overlooked. Given that a number of options are presented, and the question limits the respondent to three choices, we were satisfied that pride in sporting achievement would not be artificially overstated. The list would be rotated so that it appears in a different order for each respondent. This would help to ensure that certain responses are not selected disproportionately due to being at the top of the list. 

It was recommended, based on respondents’ answers, that the following options should be added:

1.	The Health Service
2.	British Multiculturalism 
3.	The Monarchy
3.4.	Recommendations and changes

The Taking Part team at DCMS communicated the above findings from the cognitive interviewing to the relevant survey stakeholders to ensure that potential changes did not affect the original meaning of the questions. Following feedback to TNS-BMRB, the questions were revised accordingly, added to the questionnaire and tested in the quantitative CAPI pilot. 

4.	Quantitative CAPI pilot
This chapter outlines the findings and recommendations from the quantitative CAPI pilot stage of question testing,
4.1.	Methodology

The quantitative pilot was conducted by TNS-BMRB between the 25th and 30th of May 2011. The pilot had two aims: to test new questions in the context of a current questionnaire; and to obtain timings for the new questionnaire. It also provided the opportunity to gain interviewer feedback on the questionnaire and the practical aspects of conducting the interview.

The pilot study was carried out in 11 areas across England: 

•	Sedgefield, Durham
•	Manchester
•	Leeds
•	Nottingham
•	Sandwell, West Midlands
•	Bedford
•	Barnet
•	Ealing
•	Goring, Oxfordshire
•	Medway, Kent
•	Bristol

Prior to fieldwork commencing, all interviewers attended an interviewer briefing, conducted by the TNS-BMRB research team (on the 24th May 2011). Two interviewer debrief sessions were held once fieldwork was completed (on the 31st May 2011).

Addresses were selected using a random location sampling method. Interviewers were issued with a list of streets clustered within one of the 11 survey areas and instructed to conduct interviews at any addresses on those streets. Respondents were recruited on the doorstep, without any advance materials or notification. Each interviewer was given a target of 6 adult interviews and 3 child interviews, with the aim of achieving 99 interviews across all 11 areas. In addition, there was a guide quota set out, in order to get an even spread of demographics among respondents. Each household that participated in the survey received a £5 high-street voucher. 

In order to gain an accurate indicator of interview length, interviewers did not carry out any cognitive probing during the interview. However, interviewers were instructed to pay close attention when respondents were answering and note down any issues experienced with particular questions. Interviewers were also encouraged to ask some brief follow-up questions once the interview was completed, to find out whether respondents had any comments on the questionnaire. Some interviews were observed by members of the research team at TNS-BMRB and DCMS.

4.1.1.	Interview length 

One of the key purposes of the pilot study was to assess the impact of new questions on the overall interview length. The average interview lengths were as follows:

•	Adult – 47 minutes (set at 40-42 minutes)
•	Child 5-10 – 12 minutes (set at 10 minutes)
•	Child 11-15 – 24 minutes (set at 20 minutes)

Average timings for individual sections in the adult interview are shown below:

Section	Average length	
Introduction and Household Grid                                                              - Start to SCHOOLYR	2:06	
NATID and PRIDE                                                                                - Sample A	1:12	
Social Capital                                                                                            - TIMAREA to GRPINF	2:36	
Socialisation                                                                                               - GROWA to GROWCW	1:16	
Free Time Activities                                                                           - FRETIM	1:11	
Arts Participation/Attendance Screener (Section A)                                                        -SCARTP21 to ARTAVN2	3:50	
Libraries Screener (Section A)                                                                                - SCLIBN to LIBNON	0:16	
Archives Screener (Section A)                                                                             - SCARC to ARCNON	0:12	
Heritage Screener (Section A)                                                                              - SCHER to REENACT	1:08	
Museums and Galleries Screener (Section A)                                                      - SCMUSN to MUSNON	0:32	
Walking and Cycling (Section B)                                                                            - SCWALK to CYCLREC	1:04	
Sports Participation (Section B)                                                                             -SCSPMON to SCSPY	2:59	
Swimming/Cycling Ability (Section B)                                                                      - FIT to CYCLCOM	1:05	
EVENTS to SPOCLOSE (Section B)
	0:33	
Detail of Participation (Arts)                                                                         - ARTPENJ to B4OP1A	0:44	
Detail of Participation (Libraries)                                                        - LIBSAT to LIBREC	0:10	
Detail of Participation (Archives)                                                        - ARCSAT to ARCREC	0:01	
Detail of Participation (Museums, Galleries, Heritage sites)                                    - MUSNAM to HERAREA	0:43	
Participating in Sports or Recreational Activities                               - SPOENJN to SPORECN	0:16	
Barriers to Participation (Arts)                                                              - NOAPANY1 to C4OP1A	1:02	
Barriers to Participation (Libraries)                                                         - NOLIB to LAPSFREQ3	0:08	
Barriers to Participation (Archives)                                                          - NOARC to LAPSFREQ4	0:11	
Barriers to Participation (Museums or Galleries)                                       - NOMUS to LAPSFREQ5	0:09	
Barriers to Participation (Heritage)                                                       - NOHER to HERAREA	0:32	
Barriers to Participation (Sport)                                                       - NOSP to LAPSFREQ7	0:21	
Internet use                                                                                      - INTSEC to EMAIL	1:19	
Volunteering                                                                                            - VOLWORK to VOLCHK	0:23	
Group involvement                                                                                - GRPINT to GRINV	0:18	
Charitable Giving                                                                                 - GIVETY to GIVEENC	5:33	
Community Cohesion                                                                          - FEBRIT to SEBEGB	1:06	
Public Participation                                                                                         - INFLU1 to ACTION2	1:31	
Planning Decisions                                                                              - PLDC to INQY	1:08	
PRIDE                                                                                                 - Sample B	0:25	
Olympics                                                                                                   - OLYMPCN to VOLWHY	2:56	
Broadcasting                                                                                           - MAINTV to NEWPAP2	1:02	
Demographics                                                                                 - EDUC1 to End	8.05	

The pilot found that the adult questionnaire was too long.  It was recommended that the length could be reduced by removing questions completely and/or only including certain questions or sections to a proportion of respondents.  

The child questionnaires were also slightly longer than specified. While the timings were only based on a small number of interviews, TNS-BMRB recommended that DCMS review the content of both the 5-10 and 11-15 questionnaires to identify whether any questions could be removed.
4.2.	Respondent profile

In total, 115 interviews were conducted, comprising 83 adult interviews, 18 5-10 interviews and 14 11-15 interviews. The profile of respondents for each group is shown below:

Table 4.1 Profile of respondents – Adult interview 

	Interviews completed	%	
Sex	Male	37	45	
	Female	46	55	
Age	16-29 years	17	20	
	30-44 years	27	33	
	45-64 years	22	27	
	65+	17	20	
Working status	Working	42	51	
	Not working	41	49	

Table 4.2 Profile of respondents – 5-10 interview

	Interviews completed	%	
Sex	Male	8	44	
	Female	10	56	
Age	5-7	6	33	
	8-10	12	66	

Table 4.3 Profile of respondents – 11-15 interview

	Interviews completed	%	
Sex	Male	5	36	
	Female	9	64	
Age	11-12	8	57	
	13-15	6	43	

4.3.	General Findings

In general the pilot study went well and yielded useful feedback that would be helpful in refining the questionnaire. Interviewers reported that respondents were relatively easy to recruit, as evidenced by the fact that the target number of interviews was exceeded. 

The pilot uncovered some minor issues with existing questions. These issues are not covered in this report, but have been addressed separately by the research team at TNS-BMRB, in consultation with DCMS. 

Several of the new questions used showcard response lists. Feedback was sought from interviewers in order to assess how well these showcards worked and how easily respondents were able to use them. Opinion was fairly mixed, with some interviewers reporting that the showcards worked well and others favouring a ‘show screen’ approach. The latter group felt that switching between showcard and ‘show screen’ questions was confusing for the respondent and in some cases redundant, as a respondent could often see the response list on screen even when they were supposed to be using a showcard. 

The main issue appeared to be in using showcards and then show screen in subsequent questions (or vice versa). In order to make the process of using showcards easier for interviewers and respondents, it was proposed that their use throughout the questionnaire would be reviewed, and an attempt would be made to ensure that blocks of questions use just one approach– this would reduce the need to switch between the two methods.

Another general issue to emerge from the pilot related to questions that ask respondents about their ‘local area’. Several questions contained this reference without a definition of what is meant by ‘local area’. In isolation, respondents could be allowed to define the area for themselves. However, given that other questions ask about the ‘immediate neighbourhood’, it would be beneficial to include a brief definition of ‘local area’ in order to clarify the distinction between these two types of question. 
4.4.	New questions – adult questionnaire

The following section provides feedback and recommendations on the new questions that were added to the questionnaire for the pilot. Not all new questions are commented on below – some have been tested at previous stages and were included primarily for timing purposes. 

4.4.1.	National identity and pride

The questions relating to national identity (NATID) and pride (PRIDE) were tested in two different places for the pilot. Sample A respondents were asked these questions together in the Social Capital section, near the beginning of the interview. For Sample B respondents, PRIDE was asked at the start of the 2012 Olympic and Paralympic Games section, and NATID in the Demographics section (after SXCLASS in the main questionnaire). 

The reason for testing the positioning of PRIDE was to find out whether respondents would be any more or less likely to say that they are proud of British sport or culture after being asked questions on these subjects – in other words, whether the preceding questions would prime respondents to give these responses.  

The testing demonstrated that the positioning of the PRIDE question made no noticeable difference in this regard. Similar proportions of Sample A and Sample B respondents selected ‘British sporting achievements’ (18% and 14% respectively) or ‘British arts and culture’ (10% and 9% respectively). As such, asking this question midway through the interview did not seem to adversely affect the responses given. 

Based on interviewer feedback and observations of the research team, it was recommended that these questions are asked midway through the interview (the Sample B approach). Whilst no specific issues were reported for Sample A respondents, it was noted that Sample B respondents found these questions slightly easier to answer. These questions, particularly PRIDE, could seem somewhat abrupt when asked near the beginning of the interview, appearing as they do with minimal introductory text and bearing little relation to the other questions in this section. 

Respondents appeared to be more comfortable answering PRIDE midway through the interview, when they had developed a rapport with the interviewer and had already spent some time thinking about responses to other questions (essentially, after they had ‘warmed up’). In addition, the testing demonstrated that the demographics section was a more natural place to ask NATID. 

In terms of the questions themselves, no issues were experienced with NATID. This is a fairly standard identity question that has been used on other surveys, and it worked well in its current form. 

PRIDE also worked well during the pilot. Respondents understood the response list and did not query any of the codes. No additional codes were suggested by respondents. Most respondents selected three responses (the maximum allowed) with some commenting that they would like to choose more than three. Interviewers observed that these respondents narrowed their responses down to three by deciding which things made them most proud of Britain – while this may be slightly difficult for some, there was no indication that respondents in the pilot selected three arbitrarily from a longer list. 

One change was recommended to PRIDE. This question was asked using a showcard for the pilot. It is important to ensure that respondents are not influenced by the order of the responses, as this can sometimes result in responses that appear at the top of the list being over selected.  It was recommended, if all responses fit onto one screen, that the list should be shown on screen so the response list could be rotated in each interview.  However if this is not possible, it was recommended that two showcards are used, A and B.  Showcard A would display the response list in the existing order, while showcard B would display the list in reverse order. Half of respondents would use showcard A and half would use showcard B. 

4.4.2.	Social capital 

One new question was added to the Social Capital section. STOGETH asked about the extent to which people from different backgrounds get on well together in the respondent’s local area.

No changes were recommended for this question. Respondents were able to answer it easily. This was not surprising given that it is an established question that was previously asked in the Citizenship Survey. One initial concern was that respondents would not necessarily be thinking about people from different backgrounds, but instead think about people in general. Based on interviewer feedback, respondents picked up on the ‘different backgrounds’ aspect and answered this question in the way that we would expect. 

Prior to the pilot study, concerns were expressed regarding the positioning of STOGETH, and whether answers to this question would be noticeably affected by respondent’s answers to the previous question, LIVBET (a current question in the Taking Part adult questionnaire).  From the pilot study, there was no evidence to suggest that respondents were influenced by LIVBET in the answers they gave to STOGETH, and as such there was no issue with the placement of this question at this point in the questionnaire.

4.4.3.	Heritage/historic re-enactment

For the pilot, respondents who had visited an historic or heritage site in the last 12 months were asked where these visits took place (e.g. England, Scotland). This question worked well, without any issues. 

A question was added to the heritage screener section, asking whether respondents had attended an event involving historic re-enactment (REENACT). 

This question generally worked well. As anticipated, very few respondents answered ‘yes’ to this question (6%). Most understood the term ‘historic re-enactment’, but a couple of respondents were not familiar with the term and could not initially answer the question. 

It was recommended that a brief definition of ‘historic re-enactment’ is added for interviewers to use if necessary. 

4.4.4.	Community cohesion and belonging

A group of questions taken from the Citizenship Survey were added for the pilot that related to community cohesion and belonging (FEBRIT, SBENEIGH, SBELOC, SBEGB). A couple of minor issues emerged in relation to these questions.

Some respondents seemed a little surprised by FEBRIT (‘To what extent do you agree or disagree that you personally feel a part of British society?’), commenting that this seemed like a strange question to ask. It seemed that this reaction was shared exclusively by respondents who answered ‘Strongly agree’ – a common response was ‘Of course I’m a part of British society’. Respondents who disagreed did not react in the same way. 

This was not problematic as although some respondents seemed taken aback by this question, they had no problems producing a response. As such, no changes were recommended to this question. 

As a general point, it was felt that FEBRIT and SBEGB were very similar questions – this observation was also made by several respondents. It may be worth considering the value of including both questions in the questionnaire. Given the issues outlined above, SEBGB was favoured over FEBRIT. 

At SBELOC, some respondents expressed uncertainty over what constituted their local area. Previously respondents have been allowed to use self-definition for this term. However, the questionnaire now asked about ‘immediate neighbourhood’ and ‘local area’ in succession (SBENEIGH and SBELOC). In order to reduce overlap between these two terms, it was recommend that a brief definition for ‘local area’ should be added. A typical definition that has been used on other surveys is ‘within a 15 to 20 minute walk from where you live’. 

4.4.5.	Planning decisions

These questions related to local planning decisions (PLDC, PLIN) and respondents’ views on what is important to their local area (INQY). 

PLDC asked respondents whether they had been involved in any local planning decisions, and PLIN asked respondents who had been involved, whether any of these decisions affected a heritage site or building. 

Just 18% of respondents reported at PLDC that they had been involved in a local planning decision, with 2% reporting at PLIN that they had been involved in a decision that affected a heritage site or building. 

The key aspects to test for these questions were respondents’ understanding of ‘local planning decisions’ and ‘involvement’.

Some introductory text preceding PLDC provided an explanation of planning decisions. For the pilot, interviewers were instructed to read out the introductory text ‘if necessary’ – in other words, only if the respondent was unsure or required further clarification. No respondents asked for a definition. However, interviewers fed back that they read out the introductory paragraph in most cases anyway. It was observed that that this did aid understanding for respondents who were unsure, and for those who were already familiar with this concept, the text helped to confirm what was meant by it. 

The testing demonstrated that the text served to give context to the question and ensured that respondents answered in a consistent way. It was therefore recommended that the ‘if necessary’ instruction was removed so the instructions should be read out in all interviews. 

Further explanatory text was included after the question text, providing some examples of ‘involvement in planning decisions’. Again, interviewers were instructed to read these out ‘if necessary’. 

These examples were less widely used by interviewers compared to the introductory text. While no respondents queried what was meant by ‘involvement’ or asked for a definition, some interviewers reported that respondents paused after hearing the question and required some time to think about their answer. In these cases, interviewers read out the definitions. It was felt that these definitions helped respondents to produce an answer. In most cases, respondents who heard the definitions answered that they had not been involved in planning decisions. 

Given that these definitions were not used in all cases, it was recommended that it was appropriate to retain the ‘if necessary’ instruction, and advise interviewers to use the definitions as needed.    

PLIN was answered by just 15 respondents. Most were able to answer without any problems, but one respondent said that they were not sure what was meant by the term ‘heritage site’. They commented that an old factory near their house had been demolished, but were uncertain whether this could be classed as a heritage site. While this term would be understood by most respondents, it would be useful to provide a brief definition.  Specifically, if certain sites or buildings are technically designated as ‘heritage sites’, it would be useful to include this definition. This would be included in the script with an ‘if necessary; instruction.

INQY asked respondents to look at a list of things that can affect how they feel about their local area, and select up to three that they considered to be most important. 

Almost all respondents selected three responses at this question. Some commented that they would like to select more than three but, as with PRIDE, interviewer feedback suggested that respondents were able to prioritise their choices and limit their selection to three. 

Further clarification was needed for this question as some respondents asked questions before producing an answer. Two common queries were, ‘does it matter if I haven’t used this?’ and ‘do I need to have this in my area?’  As the respondents’ opinions were of interest here, rather their actual experience, the response to both of these queries should be ‘no’.  As such, it was recommended that the following instruction should be added: 

INTERVIEWER ADD IF NECESSARY: You can select any of the things on this list, even if you haven’t used it or don’t have it in your area.  

4.4.6.	Wellbeing 

A question on life-satisfaction (SATIS) was added to the demographics section.  It was placed in the adult questionnaire after the current question on happiness. This also provided the opportunity to compare the responses of both questions to assess how closely they were linked, and whether respondents thought differently about their answers to both questions.

At first glance, the responses to both the happiness and satisfaction question were very similar.  The mean score out of 10 for both questions was 7.4.  Interviewers reported that respondents tended to think about happiness and satisfaction in the same way when answering these questions, and that these questions were closely linked.  Therefore, the merits of asking both HAPPY (the current Taking Part happiness question), and SATIS was questionable as both seem to be similar. If it was necessary to ask both questions, an alternative approach would be to split the sample in half so that respondents are asked either HAPPY or SATIS.  

4.4.7.	2012 Olympic and Paralympic Games

A series of questions were asked to explore the ways in which respondents plan to follow the 2012 Olympic and Paralympic Games, and whether the UK hosting the 2012 Olympic and Paralympic Games has had any impact on their involvement with sport, culture and volunteering. 

One general finding on these questions was that most respondents appear to have given little thought at this stage to how, if at all, they will follow the 2012 Olympic and Paralympic Games. Interviewers reported a generally low level of engagement with these questions, observing that respondents seemed to answer quickly without looking at the response lists in detail. This was likely to be due, at least in part, to the timing of the pilot, given that the 2012 Olympic and Paralympic Games will not take place until the summer of 2012. Engagement with these questions should increase over time, as respondents become more familiar with 2012 Olympic and Paralympic Games related events and make firmer plans in connection with the 2012 Olympic and Paralympic Games. 

OLYMPICSV2A asked respondents to select from a short list the ways in which they plan to follow the 2012 Olympic and Paralympic Games. This first list contained some of the more basic ways in which the 2012 Olympic and Paralympic Games can be followed (e.g. ‘Watching on TV’). This was followed by OLYMPICSV2B, which asked respondents to select from a more detailed list the ways in which they plan to follow the 2012 Olympic and Paralympic Games. This list contained more specific activities, including branded events such as AdiZone, and volunteering during the 2012 Olympic and Paralympic Games. 

Respondents were able to answer the first question (OLYMPICS2VA) quite easily. Some respondents were slightly confused by the reference to the internet at the first two codes: 

1.	Watching on TV or the internet at home
2.	Listening to the radio or internet at home

These respondents initially thought that they should only select these codes if they planned to follow the 2012 Olympic and Paralympic Games on the internet. To make this clearer, it was recommended the references to the internet should be moved into a separate code: 

1.	‘Watching or listening on the internet at home’

The second question in this pair (OLYMPICS2VB) proved to be slightly more problematic. The majority of respondents (71%) answered ‘None of the above’ at this question. This was not in itself an issue, as the purpose of the question was to assess awareness of and intention to participate in these activities – if most respondents did not intend to follow the 2012 Olympic and Paralympic Games in these ways this would still be a legitimate finding. However, the issue that emerged from the pilot was that most respondents did not look at the response list in detail. Many commented that they had not made any plans for following the 2012 Olympic and Paralympic Games. As a result, a response of ‘None of the above’ was not necessarily an indication of their likelihood to get involved, but may simply indicate that respondents had not considered the ways in which they will follow the 2012 Olympic and Paralympic Games at this early stage. 

The current questionnaire contains questions asking whether respondents are motivated to do more sport or volunteering as a result of the UK hosting the 2012 Olympic and Paralympic Games. For the pilot, a similar question was tested that asked whether respondents are motivated to do more cultural activities (OLYMPCULT). In response to a finding from the cognitive interviews, the following text was included to explain why this question is being asked: 

INTERVIEWER ADD IF RESPONDENT ASKS WHY WE ARE ASKING ABOUT CULTURAL ACTVITIES AND 2012 OLYMPICS AND PARALYMPICS: There are a number of cultural events taking place around the UK as a result of UK hosting the 2012 Olympic and Paralympic Games. 

Only one respondent was reported as having queried this question. However, interviewers observed that several respondents seemed slightly surprised to be asked about cultural activities in relation to the 2012 Olympic and Paralympic Games. The additional text seemed to work well to explain why the question is being asked, but did not appear to have had any impact on responses given – only 2% of respondents answered ‘Yes’ at this question. Given that queries may arise here, it was recommended that the additional text should be retained. 

After the questions asking whether respondents were motivated to do more sport or volunteering, follow-up questions were added asking in what ways they were more motivated.  It was difficult to draw any firm conclusions from these questions as although they seemed to work well, only a few respondents were asked them.
4.5.	New Questions – child

Questions relating to the 2012 Olympic and Paralympic Games were added to both children’s questionnaires for the pilot. The same issues around low respondent engagement that were observed on the adult questionnaire apply to these questions also. The comments below outline issues that were specific to the children’s questionnaires. 

4.5.1.	5-10 questionnaire

Parents of 5-10 year-olds had a good idea of the more general ways in which their child intends to follow the Olympics (OLYMPICSV2ACH). These kinds of things (e.g. ‘Attending a ticketed event’, ‘Watching on TV’) are likely to be done at home or with the parent, so respondents were able to answer this question relatively easily. 

Parents had more difficulty answering the follow-up question (OLYMINVCH510), which was about any 2012 Olympic and Paralympic Games related events that their child had taken part in. Respondents who were disinterested in the 2012 Olympic and Paralympic Games themselves had particular difficulty, as they appeared to be less interested in anything their child may do/have done in relation to this. 

There was some confusion over the term ‘Games related sports or physical activity’. The examples given in the response codes suggest that there is only an interest in activities that have an official link to the 2012 Olympic and Paralympic Games. However, some respondents raised the fact that their child had taken part in events that also appear in the Olympics (e.g. athletics). Whilst these activities are unlikely to have any official link to the 2012 Olympic and Paralympic Games, they could be considered to be ‘related’ to the 2012 Olympic and Paralympic Games in a broader sense. If these sorts of activities should not be included, it was recommended that a clarification would need to be added to the question text or response code. 

Parents of older children (9-10) were generally less certain than parents of younger children about what activities they had taken part in. The majority of respondents (12 out of 18) answered ‘None of these’ at this question, suggesting that this question is not particularly relevant at present, but should become more so as the 2012 Olympic and Paralympic Games approach.

4.5.2.	11-15 questionnaire

As with the adult and 5-10 proxy interviews, 11-15 year-olds had no difficulty answering the question about ways in which they intend to follow the 2012 Olympic and Paralympic Games (OLYMPICSV2ACH). 

Once again, the follow-up asking about activities they had actually done proved to be slightly more problematic. Of the 12 respondents who answered this question, eight answered ‘None of these’, with many remarking to interviewers that, while they had participated in sport at school, they were unaware of any link to the 2012 Olympic and Paralympic Games. In order to simplify the response codes for the 11-15 questionnaire, examples of these activities were removed (e.g. School Games, National School Sport Week). In light of the issue outlined above, we recommended reinstating these examples. 

5.	Next steps
The findings from the cognitive interviewing and the quantitative pilot were presented to the Taking Part Steering Group on the 9th of June 2011. The Steering Group agreed that the following amendments be made to the 2011/12 to questionnaires from the 1st of July 2011:

•	The questions that were piloted on heritage and historic re-enactment were added to the heritage screeners and frequency section of the adult questionnaire, in the locations that they were tested.
•	The questions on group involvement that were tested in Sample B of the CAPI pilot (GRPINT and GRPINF) were included in the adult questionnaire in the same location (in the volunteering section).
•	A new section on “community cohesion/belonging” was added to the adult questionnaire, after the charitable giving section.  This section contained the questions SBELOC, SBEGB and STOGETH that were tested in the CAPI pilot, though SBENEIGH was not included, following concerns about the overlap between this question and SBELOC.
•	The questions that were tested regarding planning decisions (PLDC, PLIN and INQY) were included in the adult questionnaire, as part of the public participation section.  These questions are asked of 50% of respondents.
•	The question on national pride (PRIDE) was added to the start of the 2012 Olympic and Paralympic Games section in the adult questionnaire.  The battery of questions regarding the 2012 Olympic and Paralympic Games, that were tested in the pilot study, were also added to this section, with the exception of CULTWHY.
•	The question on national identity (NATID) was added to the demographics section of the questionnaire, as tested in Sample B of the CAPI pilot.
•	The 2012 Olympic and Paralympic Games questions were added to the 5-10 and 11-15 child questionnaires, following amendments based on discussions between TNS-BMRB and DCMS.

All interviewers working on the 2011/12 Taking Part survey were briefed about the changes and additions to the questionnaires via a video briefing, featuring input from DCMS on the new policy priorities of the department, and an overview of all of the new questions by a researcher from TNS-BMRB.

The new questions will be closely monitored by TNS-BMRB and DCMS, and amendments will be made, if necessary for the next quarter of fieldwork, commencing October 2011.

Appendices
Appendix 1 – Questionnaire for Cognitive Testing

Taking Part Piloting (April 2011) Y7-Q2

Heritage/Local Engagement Questions

Local Engagement

[ASK ALL] 
GRPINT (Basic Screening Question)
This question is about involvement in groups, clubs and organisations. These could be formally organised groups or just groups of people who get together to do an activity or talk about things. Please exclude just paying a subscription, giving money and anything that was a requirement of your job. 

In the last 12 months, have you been involved with any groups of people who get together to do an activity or to talk about things? These could include evening classes, support groups, slimming clubs, keep-fit classes, pub teams and so on. 

1.	Yes
2.	No
3.	Don’t know

[IF GRPINT = 1]
GRINV	
Thinking about the group or groups that you have been involved with in the last 12 months has your participation in these groups involved any of the following? 

	CODE ALL THAT APPLY
	
1.	Involvement in planning issues affecting your local environment (e.g. discussing planning applications)
2.	Learning about local heritage/the historic environment through talks (e.g. guest speakers)
3.	Learning about local heritage/the historic environment by visiting historic places
4.	Helping to directly conserve/understand local heritage/the historic environment
5.	None of these (SINGLE-CODED)
PROBES

Check respondents’ understanding of response codes. In particular, what do respondents understand by: 

-	‘Planning issues’

-	‘Conserve’

-	‘Historic environment’

	

Local Planning Decisions

The following questions are about local planning decisions.  By this we mean a planning decision that is made by your local council or local authority.  It can refer to a decision made by neighbouring council or local authority if you live on the border of an authority.

[ASK ALL]
PLDC	
Thinking about planning decisions in your local area, which of the following statements best applies to you? 

1.	I have been involved in planning decisions that affected me directly, but not the wider local community
2.	I have been involved in planning decisions that affected my local community as a whole (i.e. may or may not have affected me directly, but affected the community)
3.	I have not been involved in any planning decisions

[IF PLDC = 1 OR 2]
PLIN
Have you ever been involved in local planning decisions that affected a heritage site or building (e.g. an historic building, monument, park or garden)? 

1.	Yes
2.	No
3.	Don’t know

[IF PLDC = 3]
PLDIRC	
Which of the following statements best applies to you? 

1.	I would get involved in planning decisions if they affected my local community as a whole (i.e. may or may not affect me directly)
2.	I would get involved in planning decisions, but only if they affected me directly
3.	I would never want to get involved in planning decisions

[IF PLDC = 3 OR (PLIN = 2 OR 3)]
PLHRT
Now thinking about planning decisions that would affect a heritage site or building (e.g. an historic building, monument, park or garden), which of the following statements best applies to you? 

1.	I would get involved in planning decisions if they affected my local community as a whole (i.e. may or may not affect me directly)
2.	I would get involved in planning decisions, but only if they affected me directly
3.	I would never want to get involved in planning decisions affecting a heritage site or building

PROBES

Check respondents’ understanding of response codes. In particular, what do respondents think of:

-	As their local area or community? Is there a difference? 

-	By the term ‘affecting me directly’?

-	Do respondents make a distinction between ‘local planning decisions’ and ‘heritage planning decisions’? 

-	The statements used? Is it clear they are mutually exclusive (i.e. distinction between decisions that affect respondent directly and affect the local community as a whole)? 

[ASK ALL]
PLENV	
We are interested in finding out how we can involve people more effectively in planning decisions affecting their local environment. How much more likely would you be to get involved in local planning decisions if you knew more about: 

	A lot	A little	Not at all	Don’t know	
How the overall planning process works 
					
How to access information on specific planning cases
					
Your local area and its history, e.g. what buildings are of historic or architectural importance
					
Which community groups are involved in planning issues 

[ASK ALL]
INQY
There are a number of different things that can affect the quality of your local environment. How important do you feel it is to have the following things in your local area? 

	Very important
	Quite important
	Not very important
	Not at all important
	Don’t know
	
Clean streets
						
Green spaces (e.g. parks)						
Libraries, theatres, museums or galleries						
Leisure centres or sports facilities						
Historic places, areas or buildings						
Traffic management 						
Access to public transport						
Shopping facilities						
Education facilities (e.g. schools, colleges)						
Low levels of crime						

PROBES

How do respondents answer this question? Are they thinking about things that are actually in their local area, or are they thinking more generally (i.e. hypothetically)? 

Are they thinking only about what is important to them personally (i.e. things they use) or what is important for the community as a whole? 

Check that response are understood, in particular: 

-	‘Traffic management’

[IF INQY = 1 OR 2]
INACT	
You said that having [RESPONSES = 1 ‘IMPORTANT’ or 2 ‘QUITE IMPORTANT’ FROM INQY] in your local area is important to you. How likely would you be to get involved in activities relating to these things in your local area (for example by volunteering, contacting the council, or attending a public meeting)?  

LIST FILTERED ON RESPONSES TO INQY

	Very likely
	Quite likely
	Not very likely
	Not at all likely
	Don’t know
	
Clean streets
						
Green spaces (e.g. parks)						
Libraries, theatres, museums or galleries						
Leisure centres or sports facilities						
Historic places, areas or buildings						
Traffic management 						
Access to public transport						
Shopping facilities						
Education facilities (e.g. schools, colleges)						
Low levels of crime						

PROBES

What do respondents understand by the term ‘getting involved’? What sorts of things are they thinking about here? 

Are answers affected by existing involvement? 

	

[IF INACT = 3 OR 4]
INUN	
You said that you would be unlikely to get involved in activities relating to [RESPONSES = 3 or 4 FROM INQY] in your local area. Why would you be unlikely to get involved in this issue/these issues? 
	
UNPROMPTED. CODE ALL THAT APPLY.

IF RESPONDENT SAYS ‘I’M TOO BUSY’, PROBE FOR REASON.

1.	Issue(s) is/are not important enough
2.	I have work commitments
3.	I have to look after children/the home
4.	I have to look after someone who is elderly or ill
5.	I have to study
6.	I’m too old
7.	I’m too young
8.	I don’t have any of these things in my local area
9.	I haven’t heard about any opportunities to get involved
10.	I know other people who will get involved
11.	I’m new to the area
12.	I have an illness or disability that I feel prevents me from getting involved 

PROBES

Do respondents mention any other reasons for not getting involved?

Heritage Participation

[ASK ALL]
SCHER
In the last 12 months, have you visited any of these places? 

CODE ALL THAT APPLY

1.	A city or town with historic character
2.	 A historic building open to the public (non-religious)
3.	A historic park or garden open to the public
4.	A place connected with industrial history (e.g. an old factory, dockyard or mine) or historic transport system (e.g. an old ship or railway)
5.	A historic place of worship attended as a visitor (not to worship)
6.	 A monument such as a castle, fort or ruin
7.	 A site of archaeological interest (i.e. Roman villa, ancient burial site)
8.	 A site connected with sports heritage (e.g. Wimbledon) (not visited for the purposes of watching sport)
9.	 None of these

PROBES

What does ‘a city or town with historic character’ mean to you?

Can you provide any examples?

 

[IF SCHER <> 9]
HERINT	
Thinking about these visits over the last 12 months, did any of these take place outside of  England? 

IF ‘YES’, PROBE: ‘Whereabouts did these visits take place?’

CODE ALL THAT APPLY

1.	Scotland
2.	Wales
3.	Northern Ireland
4.	Republic of Ireland
5.	Europe
6.	Outside Europe
7.	No – all visits in England (SINGLE-CODED)

[ASK ALL]
REENACT
In the last 12 months, have you been to an event involving historic re-enactment/recreation?

1.	Yes
2.	No
3.	Don’t know

[IF REENACT = 1]
REENACT2
What did this involve?  (TESTING PURPOSES ONLY)

PROBES

What does an ‘historic re-enactment/recreation’ mean to you?

Pride

[ASK ALL]
NATID (QUESTION FROM CITIZENSHIP SURVEY) (Basic Screening Question)
What do you consider your national identity to be? (code all that apply)

1.	English 
2.	Scottish 
3.	Welsh 
4.	Irish 
5.	British 
6.	Other (specify)
PROBES

-  What does the term “national identity” mean to you? 

[ASK ALL]
PRIDE 
And which, if any of the following, makes you most proud of Britain? (code all that apply)

ASK OPEN ENDED QUESTION – CODE TO LIST

1.	The British countryside and scenery
2.	The British people
3.	British history
4.	British sporting achievements
5.	British arts and culture (music, film, literature, art etc.)
6.	British architecture and historic buildings
7.	British education and science
8.	British industry and exports
9.	The British legal system
10.	Britain’s democratic tradition
11.	Other (specify)

PROBES

-  In what ways do these things make you proud of Britain?

-  What other things make you proud of Britain?

-  If answered 4, in the past, which sporting achievements have made you proud of Britain?

Olympics 

[ASK ALL]
OLYMPICSV2 
In what ways do you intend to follow, or get involved in the London 2012 Olympic or Paralympic Games? (code all that apply)

ASK AS AN OPEN QUESTION FIRST

Check whether intend to follow, get involved in any of the following ways:

1.	Through watching or listening to live events on TV, internet, the radio or watching live events on a public big screen.
2.	Through attending a ticketed Olympic or Paralympic event.
3.	Through taking part in a Games related sports or physical activity (e.g. AdiZone, Gold Challenge, Cadbury’s Spots V Stripes)
4.	Through using a new or improved sports facility linked to the 2012 Games (e.g. Inspire-marked)
5.	Through Games related employment or training
6.	Through taking part in a Games related cultural event or activity (e.g. Cultural Olympiad, London 2012 Festival)
7.	Through volunteering during the Games (e.g. as a Gamesmaker, London Ambassador or for Cadbury’s Spots V Stripes)
8.	Through taking part in a Games related community event or activity (e.g. street party or local Inspire Mark project)
9.	None of the above

PROBES

-  Probe for definitions of “Inspire Mark”, “Cultural Olympiad”

-  If answered 3, 5, 6, 7, 8 or 9, probe whether this was officially linked to the Games

- Understanding of “London 2012 Olympic or Paralympic Games” or is there an alternative phrase to use eg. London 2012, 2012 Games or Olympics etc

-Would watching ‘free events’ be mentioned here? Maybe add to response list

	

[ASK ALL]
SPORT (Basic Screening Question)
In the last 12 months have you taken part in any sport or physical recreational activity?  Do not include activities you did as part of your paid work or for academic study.

1.	Yes
2.	No

[IF SPORT = 1]
OLYMSPN  (CURRENT TAKING PART QUESTION)
Do you think that the UK hosting the 2012 Olympic and Paralympic Games has motivated you to do more sport or recreational physical activity?

1.	Yes
2.	No
3.	Don’t know

[IF OLYMSPN = 1]
SPNWHY 
In what ways has the UK hosting the 2012 Olympic and Paralympic Games motivated you to do more sport or physical recreational activity? (Code all that apply)

1.	I’m more interested in sport in general
2.	It introduced me to new sports
3.	It encouraged me to take part in sport more often
4.	It encouraged me to take up a new sport
5.	I intend to take part in sport more often
6.	I intend to take up a new sport
7.	Other (specify)
8.	None of these

[IF SPORT = 2]
NOSPORT
Do you think that the UK hosting the 2012 Olympic and Paralympic Games has made you more interested in sport or recreational physical activity?

1.	Yes
2.	No

[If NOSPORT = 1]
NOSPWHY
In what ways has the UK hosting the 2012 Olympic and Paralympic Games made you more interested sport or physical recreational activity? 

CODE ALL THAT APPLY

1.	I’m more interested in sport in general
2.	It introduced me to new sports
3.	I intend to take part in sport more often
4.	I intend to take up a new sport
5.	Other (specify)
6.	None of these

PROBES

-  What does the term “motivated to do more sport” /“more interested in sport” (depending which question asked) mean to you?

-  If answered 1, 2, 3 or 4 at SPNWHY – which sport(s) have you become interested in?

-  If answered 3 or 4 at SPNWHY – are you actually doing more sport now?  If so, which sports?

-  If answered 5 or 6 at SPNWHY or 3 or 4 at NOSPWHY – how likely are you to start doing more sport?

	

[ASK ALL]
CULTURE (Basic Screening Question)
In the last 12 months have you done any of the following?  Do not include activities you did as part of your paid work or for academic study.

1.	Attended a creative, artistic, theatrical or musical event
2.	Spent time doing any creative, artistic, theatrical or musical activities
3.	Attended a museum or art gallery  
4.	Visited a place of historical interest
5.	Been to an archive centre or record office
6.	Used a public library service
7.	None of these things

[ASK IF CULTURE = 1-6]
OLYMPCULT (CURRENT TAKING PART QUESTION)
Do you think that the UK hosting the 2012 Olympic and Paralympic Games has motivated you to do more cultural activities?  

1.	 Yes
2.	 No
3.	 Don’t know

[ASK IF OLYMPCULT = 1]
CULTWHY 
In what ways has the UK hosting the 2012 Olympic and Paralympic Games motivated you to do more cultural activities?
1.	I’m more interested in cultural activities in general
2.	It introduced me to new cultural activities
3.	It encouraged me to participate in cultural activities more often
4.	It encouraged me to participate in new cultural activities
5.	I intend to participate in cultural activities more often
6.	I intend to take up a new cultural activity
7.	Other (specify)
8.	None of these

PROBES

-  What does the term “motivated to do more cultural activities” mean to you?

-  If answered 1, 2, 3 or 4 – which cultural activities have you become interested in?

-  If answered 5 or 6 – how likely are you to start doing more cultural activities?

	

[ASK ALL]
VOLUNT (Basic Screening Question)
During the last 12 months, have you done any voluntary work?

1.	Yes
2.	No

[ASK IF VOLUNT = 1]
OLYMPVOL (CURRENT TAKING PART QUESTION)
Do you think that the UK hosting the 2012 Olympic and Paralympic Games has motivated you to do more voluntary work? 

1.	Yes
2.	 No
3.	Don’t know

[ASK IF OLYMPVOL = 1]
VOLWHY
In what ways has the UK hosting the 2012 Olympic and Paralympic Games motivated you to do more volunteering? (code all that apply)
1.	I am now more interested in volunteering 
2.	I am now more aware of volunteering opportunities 
3.	I was motivated to volunteer for the first time
4.	I now volunteer more often 
5.	I intend to volunteer more often in the future
6.	Other (specify)
7.	None of these

PROBES

-  What kinds of things do you think of when I mention the word “volunteering” or “voluntary work”?

-  Probe whether the following are considered “volunteering” (who involved, types of activities):

Member of a committee

Providing transport or driving

Organising community events 

Coaching or tuition

Officiating or refereeing

-  If answered 1, 2, 3 or 4 – which type of volunteering have you become interested in?

-  If answered 5 or 6 – how likely are you to start doing more volunteering?

	

INTERVIEWER: Now I’d just like to ask you a couple of questions about you before we finish.

[ASK ALL]
AGE
What was your age last birthday?

OPEN

Don’t know
Refused

[If AGE = DK or Ref, ask AGEBAND]
AGEBAND
Looking at this list, can you please tell me which age group you fall into?

1.	16-29
2.	30-44
3.	45-64
4.	65+
Don’t know
Refused

[ASK ALL]
WORKING
What is your current working status?

DO NOT READ OUT BUT PROMPT FROM THE LIST AS REQUIRED. SINGLE CODE MAIN STATUS

1.	Working full-time (30+ hours per week)
2.	Working part-time (9 to 29 hours per week)
3.	Unemployed – less than 12 months
4.	Unemployed (long term) – more than 12 months
5.	Not working – retired
6.	Not working – looking after house/children
7.	Not working – long term sick or disabled
8.	Student – in full-time education studying for a recognised qualification
9.	Student – in part-time education studying for a recognised qualification
10.	Other
11.	Refused

GENDER
DO NOT READ OUT

1.	Male
2.	Female

THANK AND CLOSE.

Appendix 2 – Adult Questions for CAPI Pilot

PLEASE NOTE – SOME QUESTIONS FOR TESTING SHOULD BE ALLOCATED BASED ON SAMPLE A OR B:

GRPINT – now asked of both Sample A and B, but at different points in the questionnaire

•	GRPINF – follows Sample A rotation of GRPINT (and only asked of Sample A)

•	GRINV – follows Sample B rotation of GRPINT (and only asked of Sample B)

NATID & PRIDE – asked in two separate positions – first position – Sample A, second position – Sample B

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL IN SAMPLE A]

Linking text:
The next couple of questions are about how you think of yourself and your views on Britain as a country…

NATID
What do you consider your national identity to be?
Please choose your answer from this card. Please choose as many or as few as apply. 
SHOWCARD A
CODE ALL THAT APPLY 

1.	English 
2.	Scottish 
3.	Welsh 
4.	Irish 
5.	British 
6.	Other (specify)
7.	Don’t know
8.	Refused

----------------------------------------------------------------------------------------------------------------------------
[ASK ALL IN SAMPLE A]
PRIDE
SHOWCARD B
Looking at this, what, if anything makes you most proud of Britain? You can choose up to three. 
CODE UP TO THREE

1.	The British countryside and scenery
2.	The British people
3.	British history
4.	British sporting achievements
5.	British arts and culture (music, film, literature, art etc.)
6.	British architecture and historic buildings
7.	British education and science
8.	The British legal system
9.	Britain’s democratic tradition
10.	British health service
11.	British multiculturalism
12.	The British Monarchy
13.	None of these things
14.	Don’t know
15.	Refused 
----------------------------------------------------------------------------------------------------------------------------

[All in SAMPLE A]
STOGETH 

To what extent do you agree or disagree that this local area is a place where people from different backgrounds get on well together? Please choose your answer from this card.
SHOWCARD C

1.	Definitely agree 
2.	Tend to agree 
3.	Tend to disagree 
4.	Definitely disagree 
5.	SPONTANEOUS ONLY- Too few people in the local area 
6.	SPONTANEOUS ONLY- All same backgrounds
7.	SPONTANEOUS ONLY- Don't know 
----------------------------------------------------------------------------------------------------------------------------

{IF SCHER <> 9 AND (HERWKAC = 1 OR HERWKAC = 3 OR HERWKAC = 4)]

HERINT

Thinking about these visits over the last 12 months, where did they take place? Please choose your answer from this list, and choose as many as apply.

SHOWCARD D

CODE ALL THAT APPLY

1.	England
2.	Scotland
3.	Wales
4.	Northern Ireland
5.	Republic of Ireland
6.	Europe
7.	Outside Europe
8.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL]
REENACT
In the last 12 months, have you attended or taken part in an event involving historic re-enactment?

1.	Yes
2.	No
-1. Don’t know

----------------------------------------------------------------------------------------------------------------------------
[ASK ALL]
SPOCLOSE
Can I just check, do you have a sports facility that you can get to within 20 minutes (either by walking or by some other form of transport)?  
INTERVIEWER: Sports facility could be an indoor or outdoor facility such as a sports club, sport or leisure centre, health and fitness facility or school open for community use

1.	Yes 
2.	No 
-1. Don’t know 

----------------------------------------------------------------------------------------------------------------------------

[All in SAMPLE B (Same as Growing up)]
GRPINT		
The next question is about involvement in groups, clubs and organisations. These could be formally organised groups or just groups of people who get together to do an activity or talk about things. Please exclude just paying a subscription, giving money and anything that was a requirement of your job. 

In the last 12 months, have you been involved with any groups of people who get together to do an activity or to talk about things? These could include evening classes, support groups, slimming clubs, keep-fit classes, pub teams and so on.

1.	Yes
2.	No
-1. Don’t know

Added back into questionnaire in Y6 Q1 (April 2010) but as half sample 

----------------------------------------------------------------------------------------------------------------------------

[GRPINT = 1] [SAMPLE B]
GRINV 
Thinking about the group or groups that you have been involved with in the last 12 months, has your participation in these groups involved any of the following? 
IF YES: Can I just check, was this as part of a group? 
	
READ OUT AND CODE ALL THAT APPLY

1.	Involvement in planning issues affecting your local environment, for example discussing planning applications
2.	Learning about local heritage or the historic environment through talks, for example guest speakers
3.	Learning about local heritage or the historic environment by visiting historic places
4.	Helping to directly conserve or understand local heritage or the historic environment
5.	None of these (SINGLE-CODED)
6.	Don’t know (SINGLE-CODED)

----------------------------------------------------------------------------------------------------------------------------
COMMUNITY COHESION/BELONGING

Linking text:
I'm now going to ask you a few questions about how you see yourself. 

[ASK ALL]
FEBRIT
SHOWCARD K
To what extent do you agree or disagree that you personally feel a part of British society? Please choose your answer from this card. 

1.	Strongly agree
2.	Tend to agree
3.	Tend to disagree
4.	Strongly disagree
5.	(SPONTANEOUS) Don’t know
----------------------------------------------------------------------------------------------

[ASK ALL]
SBENEIGH
I now want to ask you about a number of different places. Using the answers on this card, please tell me how strongly you feel you belong to each place. 
SHOWCARD L
First, your immediate neighbourhood, by which I mean your street or block, within a five minute walk from your home. 
PROMPT IF NECESSARY: How strongly do you feel you belong? 

1.	Very strongly
2.	Fairly strongly
3.	Not very strongly
4.	Not at all strongly
5.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL]
SBELOC
SHOWCARD L
And now your local area? 
PROMPT IF NECESSARY: How strongly do you feel you belong? 

1.	Very strongly
2.	Fairly strongly
3.	Not very strongly
4.	Not at all strongly
5.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL]
SBEGB
SHOWCARD L
Britain?
PROMPT IF NECESSARY: How strongly do you feel you belong? 

1.	Very strongly
2.	Fairly strongly
3.	Not very strongly
4.	Not at all strongly
5.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

The following questions are about local planning decisions. 

INTERVIEWER ADD IF NECESSARY:  By this we mean any decision that is made by your local council or local authority that involves a building being built, demolished, or changed in any way. It can refer to a decision made by a neighbouring council or local authority if you live on the border of an authority. 

[ASK ALL]
PLDC	
SHOWCARD M
Thinking about planning decisions in your local area, which of the following statements on this card best applies to you? 
INTERVIEWER ADD IF NECESSARY:  By involvement in planning decisions we mean things such as:
•	Writing to (or meeting with): planning officers, local councillors, mps about planning decisions
•	Organising or attending meetings about local planning decisions
•	Giving time (or money) to groups engaging in local planning decisions
1.	I have been involved in planning decisions that affected my local community as a whole (i.e. may or may not have affected me directly, but affected the community)
2.	I have been involved in planning decisions that affected me directly, but not the wider local community
3.	I have not been involved in any planning decisions
4.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[IF PLDC = 1 OR 2]
PLIN
And did this involve local planning decisions that affected a heritage site or building, for example an historic building, monument, park or garden? 

1.	Yes
2.	No
3.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL]
INQY
SHOWCARD N
There are a number of different things that can affect how you feel about your local area. Looking at this list, please tell me which of these things you feel are most important to your local area.  You can choose up to three.
CODE UP TO THREE 

1.	Clean streets
2.	Green spaces (e.g. parks)
3.	Libraries, theatres, museums or galleries
4.	Leisure centres or sports facilities
5.	Historic places, areas or buildings
6.	Traffic management
7.	Access to public transport
8.	Shopping facilities
9.	Education facilities (e.g. schools, colleges)
10.	None of these 
11.	Don’t know

----------------------------------------------------------------------------------------------------------------------------
OLYMPICS

[ASK ALL IN SAMPLE B]
PRIDE
SHOWCARD O
Looking at this, what, if anything makes you most proud of Britain? You can choose up to three. 
CODE UP TO THREE

1.	The British countryside and scenery
2.	The British people
3.	British history
4.	British sporting achievements
5.	British arts and culture (music, film, literature, art etc.)
6.	British architecture and historic buildings
7.	British education and science
8.	The British legal system
9.	Britain’s democratic tradition
10.	British health service
11.	British multiculturalism
12.	The British Monarchy
13.	None of these things
14.	Don’t know
15.	Refused 

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL]
OLYMPICSV2A
Do you intend to follow the London 2012 Olympic or Paralympic Games in any of the following ways?
READ OUT

1.	Watching on TV or the internet at home 
2.	Listening to the radio or internet at home
3.	Reading the newspaper online or offline
4.	Watching live events on a public big screen 
5.	None of these
6.	Don’t know

----------------------------------------------------------------------------------------------------------------------------
[ASK ALL]
OLYMPICSV2B 
And looking at this card, in what other ways, if any, do you intend to follow, or get involved in the London 2012 Olympic or Paralympic Games?  This may include activities you are already doing.
CODE ALL THAT APPLY
SHOWCARD P

1.	Attending a free Olympic or Paralympic event (eg. marathon, cycling road racing)
2.	Attending a ticketed Olympic or Paralympic event.
3.	Taking part in a Games related sports or physical activity (e.g. AdiZone, Gold Challenge, Cadbury’s Spots V Stripes)
4.	Using a new or improved sports facility linked to the 2012 Games (e.g. Inspire-marked)
5.	Games related employment or training
6.	Taking part in a Games related cultural event or activity (e.g. Cultural Olympiad, London 2012 Festival)
7.	Volunteering during the Games (e.g. as a Gamesmaker, London Ambassador or for Cadbury’s Spots V Stripes)
8.	Taking part in a Games related community event or activity (e.g. street party or local Inspire Mark project)
9.	None of the above
10.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[IF OLYMSPN = 1]
SPNWHY 
In what ways has the UK hosting the 2012 Olympic and Paralympic Games motivated you to do more sport or physical recreational activity? 
CODE ALL THAT APPLY
SHOWCARD Q

1.	I’m more interested in sport in general
2.	It introduced me to new sports
3.	It encouraged me to take part in sport more often
4.	It encouraged me to take up a new sport
5.	I intend to take part in sport more often
6.	I intend to take up a new sport
7.	None of these
8.	Don’t know
----------------------------------------------------------------------------------------------------------------------------

[IF NOT ASKED OLYMSPN (those that have not done any sport in last 12 months)]
NOSPORT
Do you think that the UK hosting the 2012 Olympic and Paralympic Games has made you more interested in sport or recreational physical activity?
1.	Yes
2.	No
3.	Don’t know
----------------------------------------------------------------------------------------------------------------------------

[IF NOSPORT = 1]
NOSPWHY
In what ways has the UK hosting the 2012 Olympic and Paralympic Games made you more interested sport or physical recreational activity?
CODE ALL THAT APPLY
SHOWCARD R

1.	I’m more interested in sport in general
2.	It introduced me to new sports
3.	I intend to take part in sport more often
4.	I intend to take up a new sport
5.	None of these
6.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[ASK IF (ARTPENJ = 1-10 or ARTPENJ = -1) or (ARTAENJ = 1-10 or ARTAENJ = -1) or (LIBSAT = 1-5 or LIBSAT = -1) or (ARCSAT – 1-5 or ARCSAT = -1) or (MUSENJ1 = 1-10 or MUSENJ = -1) or (HERENJ = 1-10 or HERENJ = -1)]
OLYMPCULT
Earlier you said that you have participated in the following cultural activities in the last 12 months….
[participated in an arts activity], [attended an arts event], [visited a library], [visited an archive], [attended a museum or gallery] or [visited a heritage site] …..

INTERVIEWER ADD IF RESPONDENT ASKS WHY WE ARE ASKING ABOUT CULTURAL ACTIVITIES AND 2012 OLYMPICS AND PARALYMPICS:  There are a number of cultural events taking place around the UK as a result of UK hosting the 2012 Olympic and Paralympic Games.

Do you think that the UK hosting the 2012 Olympic and Paralympic Games has motivated you to do more cultural activities?  

1.	Yes
2.	 No
-1. Don’t know

----------------------------------------------------------------------------------------------------------------------------

[IF OLYMPCULT = 1]
CULTWHY 
In what ways has the UK hosting the 2012 Olympic and Paralympic Games motivated you to do more cultural activities? (code all that apply)
SHOWCARD S
1.	I’m more interested in cultural activities in general
2.	It introduced me to new cultural activities
3.	It encouraged me to participate in cultural activities more often
4.	It encouraged me to participate in new cultural activities
5.	I intend to participate in cultural activities more often
6.	I intend to take up a new cultural activity
7.	None of these
8.	Don’t know
----------------------------------------------------------------------------------------------------------------------------

[IF OLYMPVOL = 1]
VOLWHY
In what ways has the UK hosting the 2012 Olympic and Paralympic Games motivated you to do more volunteering?
CODE ALL THAT APPLY
SHOWCARD T
1.	I am now more interested in volunteering 
2.	I am now more aware of volunteering opportunities 
3.	I was motivated to volunteer for the first time
4.	I now volunteer more often 
5.	I intend to volunteer more often in the future
6.	None of these
7.	Don’t know

---------------------------------------------------------------------------------------------------------------------

[ASK ALL]
SATIS
All things considered, how satisfied are you with your life as a whole nowadays?
On a scale of 1 - 10, 10 = Completely Satisfied and 1 = Not at all Satisfied

1.	1 Not at all Satisfied
2.	2
3.	3
4.	4
5.	5
6.	6
7.	7
8.	8
9.	9
10.	10 Completely Satisfied 
11.	-1. Don’t know
12.	-2. Refused
---------------------------------------------------------------------------------------------------------------------

[ASK ALL IN SAMPLE B]
NATID
What do you consider your national identity to be?
Please choose your answer from this card. Please choose as many or as few as apply. 
SHOWCARD Y
CODE ALL THAT APPLY 
1.	English 
2.	Scottish 
3.	Welsh 
4.	Irish 
5.	British 
6.	Other (specify)
7.	Don’t know
8.	Refused

Appendix 3 – 5-10 Proxy Questions for CAPI Pilot

Now thinking about the London 2012 Olympic and Paralympic Games…..

[ASK ALL]
OLYMPICSV2Ach

Looking at this list, will [name of child] follow the London 2012 Olympic or Paralympic Games in any of the following ways?
BLUE SHOWCARD P4

1.	Attending a ticketed Olympic or Paralympic event
2.	Attending a free Olympic or Paralympic event (eg. marathon, cycling road racing)
3.	Watching on TV or the internet at home 
4.	Listening to the radio or internet at home
5.	Reading the newspaper online or offline
6.	Watching live events on a public big screen 
7.	None of these
8.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

OLYMINVCh510
Has [name of child] done any of the following….
BLUE SHOWCARD P5

1.	Taken part in Games related sports or physical activity at school (eg. School Games, Young Ambassadors, National School Sport Week) 
2.	Taken part in a Games related sports or physical activity out of school (eg. Adizone, Sportivate, Cadbury’s Spots V Stripes)
3.	Taken part in a Games related cultural event or activity (eg. Cultural Olympiad, London 2012 festival)
4.	Taken part in Games related volunteering (eg. Young Ambassador, official at School Games)
5.	Taken part in a Games related community event or activity (eg. Street party or local Inspire Mark project)
6.	None of these
7.	Don’t know

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL]
OLYMSPORT
Would you say that the UK hosting the London 2012 Olympic and Paralympic Games has encouraged [name of child] to take part in sport?
READ OUT

1.	A lot
2.	A little
3.	Or, not at all
4.	Can’t say

----------------------------------------------------------------------------------------------------------------------------

[ASK IF OLYMSPORT = 1 or 2]
OLYMSPWHYCh
In what ways has the UK hosting the London 2012 Olympic and Paralympic Games encouraged [name of child] to take part in sport?
BLUE SHOWCARD P6

1.	They are more interested in sport in general
2.	It introduced them to new sports
3.	It encouraged them to take part in sport more often
4.	It encouraged them to take up a new sport
5.	They intend to take part in sport more often
6.	They intend to take up a new sport
7.	None of these 
8.	Can’t say

Appendix 4 – 11-15s Questions for CAPI Pilot

Now thinking about the London 2012 Olympic and Paralympic Games…..

[ASK ALL]
OLYMPICSV2Ach
Now thinking about the London 2012 Olympic or Paralympic Games….
Will you follow the London 2012 Olympic or Paralympic Games in any of the following ways?
READ OUT AND CODE ALL THAT APPLY

1.	Watching the Games in person by attending an event
2.	Watching on TV or the internet at home 
3.	Listening to the radio or internet at home
4.	Reading the newspaper online or offline
5.	Watching live events on a public big screen 
6.	None of these
7.	DO NOT READ OUT: Not heard of the London 2012 Olympic or Paralympic Games
8.	DO NOT READ OUT: Don’t know
9.	Refused

----------------------------------------------------------------------------------------------------------------------------

[ASK ALL (UNLESS OLYMPICSV2Ach = 6)]
OLYMINVCh11-15
Have you done any of the following…
READ OUT AND CODE ALL THAT APPLY

1.	Sports activities in school linked to the London 2012 Olympics and Paralympic Games
2.	Sports activities outside school linked to the London 2012 Olympic and Paralympic Games
3.	Classes at school which were linked to the London 2012 Olympic and Paralympic Games
4.	Taken part in any activities (other than sport) outside school which have been linked to the London 2012 Olympic and Paralympic Games
5.	None of these
6.	DO NOT READ OUT: Don’t know
7.	Refused
----------------------------------------------------------------------------------------------------------------------------

[ASK ALL (UNLESS OLYMPICSV2Ach = 6)]
OLYMMOT
Do you think that the London 2012 Olympic and Paralympic Games has made you want to do more sports activities?

1.	Yes
2.	No
3.	Don’t know
4.	Refused

----------------------------------------------------------------------------------------------------------------------------

[IF OLYMMOT = 1]
MOTHOW
In what ways have the London 2012 Olympic and Paralympics made you want to do more sports activities? 
READ OUT AND CODE ALL THAT APPLY

1.	I’m more interested in sport in general
2.	I’ve learned about new sports
3.	It’s made me do sport more often
4.	It’s made me start doing a new sport
5.	I’d like to do sport more often
6.	I’d like to start doing a new sport
7.	None of these
8.	Don’t know

2-4 Cockspur Street
London SW1Y 5DH
www.culture.gov.uk