This is the published version: Available from Deakin Research - DRO

This is the published version: Available from Deakin Research - DRO

    This is the published version:     Janssen, Xanne, Cliff, Dylan P., Reilly, John J., Hinkley, Trina, Jones, Rachel A., Batterham, Marijka, E...

509KB Sizes 0 Downloads 0 Views

Recommend Documents

This is the published version. Available from Deakin Research - DRO
with two US firms, Coca-Cola and PepsiCo, together con- trolling 35.7 and 71.7 ..... The two leading brands were Coca-Co

This is the published version: Available from Deakin Research - DRO
United Nation's Food and Agriculture. Organization as existing 'when all people, at all times, have physical, social and

This is the published version. Available from Deakin Research - DRO
1 Ecology & Conservation Group, Institute of Natural Sciences, Massey University, New ... rangeland, involving two villa

This is the published version. Available from Deakin Research - DRO
Friday, 8:55pm. It's like saying that quinces are pretty. They're not. What they are is decent. Not trying to be supermo

This is the published version: Available from Deakin Research - DRO
Nov 26, 2012 - McCooey, David 2012, Poetry, terrorism, and the uncanny : “Timothy McVeigh's 'invictus'”,. Criticism,

This is the published version. Available from Deakin Research - DRO
Simson, Katherine J, Miller, Clint T, Ford, Jon, Hahne, Andrew, Main, Luana, Rantalainen, Timo, Teo,. Wei-Peng, Teychenn

This is the published version: Available from Deakin Research - DRO
In 1889, the first branch of the Theosophical Society (TS) in Australia was established in .... However, the rise in res

This is the published version: Available from Deakin Research - DRO
West, Patrick 2014, Pauline Kael and the Western genre as critical displacement of self & nation: metaphorics and affect

The published version is available online at : Available from - DRO
Ziino, Bart 2014, Soldiers' true war stories will live on in the digital archives, The Conversation, April 25. The publi

Deakin Research Online - DRO
Apr 2, 2001 - involved (Hughes, 2002). During the public hearings, the liquidator questioned 18 witnesses including One.





    This is the published version:     Janssen, Xanne, Cliff, Dylan P., Reilly, John J., Hinkley, Trina, Jones, Rachel A., Batterham, Marijka, Ekelund, Ulf, Brage, Soren and Okely, Anthony D. 2013, Predictive validity and classification accuracy of ActiGraph energy expenditure equations and cut‐points in young children, PLOS One, vol. 8, no. 11, Article e79124, pp. 1‐9.

Available from Deakin Research Online:    http://hdl.handle.net/10536/DRO/DU:30058933 Reproduced with the kind permission of the copyright owner. Copyright : 2013, Public Library of Science

 



Predictive Validity and Classification Accuracy of ActiGraph Energy Expenditure Equations and Cut-Points in Young Children Xanne Janssen1*, Dylan P. Cliff1, John J. Reilly2, Trina Hinkley3, Rachel A. Jones1, Marijka Batterham4, Ulf Ekelund5,6, Søren Brage6, Anthony D. Okely1 1 Interdisciplinary Educational Research Institute, University of Wollongong, Wollongong, New South Wales, Australia, 2 School of Psychological Sciences and Health, University of Strathclyde, Glasgow, Scotland, 3 Centre for Physical Activity and Nutrition Research (C-PAN), Deakin University, Melbourne, Victoria, Australia, 4 Centre for Statistical and Survey Methodology, University of Wollongong, Wollongong, New South Wales, Australia, 5 Department of Sport Medicine, Norwegian School of Sport Sciences, Ulleva˚l Stadion, Oslo, Norway, 6 MRC Epidemiology Unit, Institute of Metabolic Science, Addenbrooke’s Hospital, Cambridge, United Kingdom

Abstract Objectives: Evaluate the predictive validity of ActiGraph energy expenditure equations and the classification accuracy of physical activity intensity cut-points in preschoolers. Methods: Forty children aged 4–6 years (5.361.0 years) completed a ,150-min room calorimeter protocol involving ageappropriate sedentary, light and moderate-to vigorous-intensity physical activities. Children wore an ActiGraph GT3X on the right mid-axillary line of the hip. Energy expenditure measured by room calorimetry and physical activity intensity classified using direct observation were the criterion methods. Energy expenditure was predicted using Pate and Puyau equations. Physical activity intensity was classified using Evenson, Sirard, Van Cauwenberghe, Pate, Puyau, and Reilly, ActiGraph cutpoints. Results: The Pate equation significantly overestimated VO2 during sedentary behaviors, light physical activities and total VO2 (P,0.001). No difference was found between measured and predicted VO2 during moderate-to vigorous-intensity physical activities (P = 0.072). The Puyau equation significantly underestimated activity energy expenditure during moderate-to vigorous-intensity physical activities, light-intensity physical activities and total activity energy expenditure (P,0.0125). However, no overestimation of activity energy expenditure during sedentary behavior was found. The Evenson cut-point demonstrated significantly higher accuracy for classifying sedentary behaviors and light-intensity physical activities than others. Classification accuracy for moderate-to vigorous-intensity physical activities was significantly higher for Pate than others. Conclusion: Available ActiGraph equations do not provide accurate estimates of energy expenditure across physical activity intensities in preschoolers. Cut-points of #25counts?15 s21 and $420 counts?15 s21 for classifying sedentary behaviors and moderate-to vigorous-intensity physical activities, respectively, are recommended. Citation: Janssen X, Cliff DP, Reilly JJ, Hinkley T, Jones RA, et al. (2013) Predictive Validity and Classification Accuracy of ActiGraph Energy Expenditure Equations and Cut-Points in Young Children. PLoS ONE 8(11): e79124. doi:10.1371/journal.pone.0079124 Editor: Reury F.P Bacurau, University of Sao Paulo, Brazil Received June 13, 2013; Accepted September 17, 2013; Published November 11, 2013 Copyright: ß 2013 Janssen et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: This study was supported by the National Heart Foundation of Australia (GIA09S4441). Dylan Cliff is funded by a National Heart Foundation of Australia - Postdoctoral Research Fellowship (PH 09S 4603). Anthony Okely is supported by a National Heart Foundation of Australia Career Development Fellowship (CR 11S 6099). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing Interests: The authors have declared that not competing interests exist. * E-mail: [email protected]

counts per time unit. The accuracy of these equations for predicting EE over the range of PA intensities is, however, unclear. Differences in EE equations [4,5] and PA intensity cutpoints [4–9] exist. Differences may be due to the methods used to develop these equations and/or cut-points [4–9]. Some studies have used EE measured by indirect calorimetry as the criterion measure [4–6], whereas others have used direct observation [7–9] sometimes using different instruments or criteria to define PA intensity. In addition, there are differences in the age ranges examined, and activities included in the validation protocols vary from using only ambulatory activities (walking and running) [4] to

Introduction Measuring young children’s physical activity (PA) and sedentary behavior (SB) objectively is important to improve all aspects of PArelated research in this age group. Accelerometry has become the method of choice to objectively assess children’s free-living habitual PA and SB and the ActiGraph accelerometer is the most widely used in young children [1–3]. Although accelerometry is becoming more widely used among young children, this method is not without limitations. Several equations [4,5] and cut-points [4– 9] have been developed to predict energy expenditure (EE) and classify PA intensity or SB from ActiGraph accelerometer output

PLOS ONE | www.plosone.org

1

November 2013 | Volume 8 | Issue 11 | e79124

Predictive Validity of ActiGraph Equations

Individualized multiples of resting EE (METs) were calculated by dividing measured EE for each child by their individually estimated basal metabolic rate (BMR) using the Schofield equation for children aged 4–10 years [15]. The 10-min blocks of EE were classified based on their equivalent MET values, into PA intensities as follows; SB #1.5 times predicted BMR, LPA 1.5 to 3.0 times predicted BMR and MVPA $3.0 times predicted BMR. Activity energy expenditure (AEE) was calculated by deducting BMR from measured EE.

including free-living activities (e.g. arts and crafts and stair walking) [5–9]. Applying different cut-points results in substantial differences in the estimated time children spend in different intensities of PA. These inconsistencies make it difficult to compare findings between studies [9–11] and to determine the extent to which young children are physically active and meet PA guidelines [1]. To establish which, if any, equations and cut-points are most accurate, they need to be simultaneously cross-validated in an independent sample of children using a standardized activity protocol and appropriate criterion measures. To our knowledge, there are no studies demonstrating the most accurate equations and cut-points among preschool children. Therefore, the aims of this study were to: 1) examine the predictive validity of ActiGraph EE equations; and 2) compare the classification accuracy of ActiGraph cut-points for classifying SB and PA intensity, in 4–6 year-olds.

Direct Observation of PA Intensity Each child was videotaped during their time in the room calorimeter and activity start and end times, breaks and transitions were recorded. PA intensity was classified based on the Children’s Activity Rating Scale (CARS) [16]. CARS is based on a 1 to 5 coding scheme and is a reliable and valid tool to assess PA levels in young children [16]. It has been used in several accelerometer validation studies in young children [9,17]. Video footage was coded using Vitessa 0.1 (Version 0.1, University of Leuven, Belgium). Data were coded by one observer who undertook two days of CARS training. After coding, a weighted average CARS score was calculated by multiplying each numeric activity code by the percentage of 15 s or 60 s in that time interval and summing the products. Averaged epochs were classified into intensity categories using the CARS criteria: SB ,level 2.0; LPA $level 2.0 and #3.0; MVPA .level 3.0 [18].

Methods Ethics Statement The study was approved by the University of Wollongong/ South Eastern Sydney and Illawarra Area Health Service Human Research Ethics Committee. Parents provided informed written consent, and their children provided their verbal assent to participate in the study.

Study Participants Participants were recruited from the Illawarra region of New South Wales, Australia. Children were excluded from the study if they had a disease known to influence their energy balance, had a physical disability and/or were claustrophobic.

Accelerometry The ActiGraph GT3X (ActiGraph Corporation; Pensacola USA) uses a solid-state triaxial accelerometer. In this study only the vertical axis was used as the cut-points and equations included for testing were developed based on accelerometer counts from the vertical axis. Before each experiment the accelerometer was initialized to collect data in 15-s epochs. Before entering the room calorimeter children were fitted with an ActiGraph GT3X which was worn on the right mid-axillary line of the hip and secured with an elastic belt.

Protocol During a first visit to the university participants were familiarized with the room calorimeter and the activity protocol. A second visit occurred within a week after the first visit. Parents were asked to give their child a standardized breakfast 1.5 h before entering the room calorimeter as it was considered unfeasible to ask young children to fast overnight before completing a 2.5-h activity protocol in a room calorimeter. Participants followed a 150-min activity protocol within the room calorimeter. This included child-appropriate activities involving SB, light-intensity physical activity (LPA) and moderate-to vigorous-intensity physical activity (MVPA). All children were guided through the protocol by a research assistant and performed all activities in an identical order over a predetermined duration as described in Table 1. Children were encouraged to move immediately from one activity to the other. However, if children required a rest, they were allowed to have a break. Start and end times of these breaks were noted down and removed from the data for analysis.

Data Reduction Prediction of EE. ActiGraph counts were converted to AEE or VO2, using the Puyau (PU) or Pate (PT) equations according to the specified units in the equation [4,5] (Table 2) and averaged over 10-min blocks. To adjust for the high y-intercepts of the equations, a flex-point of 25 counts per 15 s, which is a commonly used SB cut-point, was used [6]. This meant that whenever counts per 15 s were ,25 predicted EE values were assigned AEE = 0 kJ?kg21?min21, or VO2 = 9.1 ml?kg21?min21 depending on the equation used [4,5]. Participants’ predicted and measured EE data were averaged per intensity and over the duration of the protocol. Predicted EE values were then compared to measured EE values by the room calorimeter. Prediction of physical activity intensity. ActiGraph output and direct observation data were used as 15-s epochs or converted to 60-s epochs depending on the cut-point used. ActiGraph data were classified as SB, LPA, or MVPA using ActiGraph cut-points defined by Evenson (EV), Sirard (SI), van Cauwenberghe (CB), Reilly (RE), PT and PU [4–9] (Table 2) and aligned with the criterion epochs. Epochs were excluded from data analyses if they were part of a break between activities or the child was off screen in the direct observation videos. Reilly et al. only examined SB and therefore no LPA or MVPA cut-point was available [7]. EV and PU were developed in older children, however, EV has been shown to be most

Room Calorimeter Oxygen consumption (VO2) and carbon dioxide production (VCO2) were measured continuously (paramagnetic O2 and infrared CO2 analyzers, Sable System Inc, Las Vegas USA) and corrected to standard temperature, pressure and humidity in the room calorimeter (3 m62.1 m62.1 m) at the University of Wollongong. Technical procedures are described in more detail elsewhere [12]. Chamber air was sampled every two minutes and rates of O2 consumption and CO2 production were then averaged over 10-min blocks to produce stable measures of EE [13]. EE for every 10-min block was calculated using the Weir equation [14]. PLOS ONE | www.plosone.org

2

November 2013 | Volume 8 | Issue 11 | e79124

Predictive Validity of ActiGraph Equations

Table 1. Room calorimetry protocol.

Activity

Time (min)

Sedentary Intensity Watching TV–sitting in a beanbag

30

Talking on telephone with parents – sitting

2

Reading books with a cassette – sitting

5

Drawing/colouring in – sitting

10

Subtotal

47

Light Intensity Playing with toys, Lego, dolls, puzzles, games – sitting on floor

20

Drawing on a whiteboard – standing

3

Personal grooming (brushing teeth, hair, washing hands/face)

3

Dressing up in costumes

5

Playing musical instruments – standing

5

Domestic chores (hanging out washing, setting table)

4

Mini-golf

5

Walking on spot – light effort (Wii game)

2

Playing quoits

3

Subtotal

50

Moderate and vigorous intensity Cleaning (packing away toys, dusting, sweeping)

5

Running on spot – moderate effort (Wii game)

5

Hopscotch, star jumps, walking stairs

5

Shooting small basketball into small ring on wall

3

Animal walks (e.g., like a chicken, kangaroo, bear)

5

Wii sports cycling

10

Hitting a balloon in the air and catching it

5

Circuit (walking up foam stairs, jumping off, crawling through a standing hoop, and running back)

5

Running on the spot (Wii game)

5

Dancing/aerobics (Wii Game)

2

Subtotal

50

GRAND TOTAL

147

doi:10.1371/journal.pone.0079124.t001

classification (e.g. for SB measured EE and the weighted CARS value had to be #1.5 METs and,level 2, respectively).In addition, to ensure that any small time lag in the calorimeter readings would not lead to mismatching criterion data with accelerometer data, epochs within the first and last minute of a 10-min EE data block were excluded. Likewise, criterion epochs which were part of a break between activities were excluded. Last, criterion epochs were excluded if they were not part of at least four consecutive 15-s epochs within which children were active at a consistent intensity (Figure 1). ActiGraph data were classified as described using procedures consistent with the direct observation only analysis. Classified ActiGraph data were then compared with criterion epochs derived from combining measured EE and direct observation data.

accurate in 5–15 year-olds and was therefore included [6]. The PU cut-point has been used extensively in preschool studies [19–21]. The required EE for a given activity varies between individual children [4,22]. Because direct observation systems such as CARS rely on subjective classification and use general category descriptions to assign levels to activities based on the apparent intensity of the activity, it is possible that misclassification may occur for some individuals. To overcome this potential limitation and confirm findings for PA intensity classification based on direct observation, we developed an additional criterion measure including both direct observation and EE measured by the room calorimeter. Ten-minute average EE values were divided by predicted BMR to define intensity levels. Each of the forty 15-s epochs within the 10 min immediately prior to the measured average EE value were classified as SB, LPA, or MVPA. Direct observation data and EE data were compared for every 15-s or 60-s epoch. Thereafter, criterion epochs were excluded if PA intensity defined using EE measured by the room calorimeter did not agree with the intensity levels derived via direct observation. That is, agreement was established if both measures provided the same intensity PLOS ONE | www.plosone.org

Statistical Analysis Measured EE and predicted EE were compared using dependent t-tests with a Bonferroni adjustment for multiple comparisons (i.e. SB, LPA, MVPA and AEE; P,0.0125). In addition, to assess the variance in the difference between predicted versus measured energy expenditure within subjects the coefficient of variation (CV) was calculated for each activity level. This was 3

November 2013 | Volume 8 | Issue 11 | e79124

Predictive Validity of ActiGraph Equations

Table 2. ActiGraph cut-points and equations for children.

Author

Evenson et al. [6]

Sample

n = 33

Criterion measure

Equation/Cut-point

Activities

Portable metabolic system Sit, watch TV, colouring in, SB

counts? 15 s21

counts? 60 s21

#25

#100

Age = 5–8 years

slow walk, stair climbing

LPA

.25

.100

Mean age = 7.3 years

dribble basketball, brisk

MVPA

$574

$2296

21 girls, 12 boys

walk, bicycling, jumping, jacks, running.

Sirard et al. [8]

n = 33

Direct observation (CARS)

Sitting, sitting and playing,

Age 4:

Age 5:

Age 4:

Age = 5–8 years

slow walking, fast walking, SB

#363

.398

#1452

#1592

Mean age = 7.3 years

jogging.

LPA

.363

#398

.1452

.1592

MVPA

$813

$891

$3252

$3564

21 girls, 12 boys v. Cauwenberghe et al. [9] n = 18

Pate et al. [4]

Sitting, standing, drawing, SB

#372

#1488

Age = 4–6 years

walking, jogging at seven LPA

.372

.1488

Mean age = 5.8 years

speed levels, free play

$585

$2340

10 girls, 8 boys

session

n = 29

Direct observation (CARS)

MVPA

Portable metabolic system Rest, slow walking, brisk

Age = 3–5 years

walk and running.

Mean age = 4.4 years 16 girls, 13 boys Puyau et al.` [5]

N = 26

Whole room calorimetry

VO2 = 10.0714+0.02366 6 counts?15 s21 SB

#37

#148

LPA

.37

.148

MVPA

$420

$1689

Computer games, arts and AEE = 0.0183+0.000010 6 counts?60 s21

Age = 6–16 years

crafts, playing with toys,

SB

#199

#799

Mean age = 10.7 years

walking, martial arts,

LPA

.199

.799

running, jumping a rope,

MVPA

$799

$3199

12 girls, 14 boys

Age 5:

skipping, soccer. Reilly et al.` [7]

SB

#274

#1099

Age = 3–4 years

N = 30

Direct observation (CPAF)

No structured activities.

LPA

NA

NA

Mean age = 3.7 years

MVPA

NA

NA

10 girls, 20 boys SB, Sedentary behaviour; LPA, Light physical activity; MVPA, Moderate-to-vigorous physical activity counts?15 s21. doi:10.1371/journal.pone.0079124.t002

developed as counts?60 s21 all others were developed as

significantly overestimated VO2 during SB and LPA and for total VO2 (P,0.001) but did not show a significant difference between measured and predicted VO2 during MVPA (P = 0.072). However, at individual level the CV was 52.9%, 78.0%, 67.5%, and 91.3% for SB, LPA, MVPA, and total VO2 respectively. The PU equation significantly underestimated AEE during MVPA and LPA and for total AEE (P,0.0125) but did not show a significant difference for activity energy expenditure during SB (P = 0.5481). For SB, LPA, MVPA, and total AEE the CV was 70.5%, 75.5%, 44.1%, and 98.8% respectively.

done by dividing the mean difference by the standard deviation per participant for each intensity. To evaluate classification accuracy, sensitivity (Se), specificity (Sp), and area under the receiver operating curve (ROC-AUC) were calculated. ROC-AUC values were defined as excellent (0.9–1.0), good (0.8–0.9), fair (0.7–0.8), or poor (,0.7) [23]. All statistical analyses were performed using STATA Version 12 (StataCorp, College Station, USA).

Results Of the 44 children enrolled in the study, four ended their participation early due to illness (n = 1); inability to schedule a second visit (n = 1); or refusal to participate in the activity protocol (n = 2). Of the 40 children who completed both visits, two had missing data due to calorimeter malfunction. For the remaining 38 children, 33 (86.8%), 36 (94.7%), and 34 (89.5%) had at least one 10-min block of SB, LPA, and MVPA, respectively, according to measured EE values. Descriptive characteristics are presented in Table 3.

Prediction of PA Intensity Table 4 reports the total numbers of epochs included when using direct observation alone and combined direct observation and measured EE as the criterion measure. Using direct observation alone as the criterion measure, classification accuracy for SB was good and significantly higher for EV compared to all others (P,0.05). For LPA, all cut-points exhibited poor classification accuracy. However, classification accuracy was significantly higher for EV compared to all others (P,0.05). For MVPA, using the PT cut-point resulted in fair classification accuracy which was

Prediction of EE Observed and predicted VO2 and AEE values for the PT and PU equations are shown in Figures 2A and B. The PT equation PLOS ONE | www.plosone.org

`

4

November 2013 | Volume 8 | Issue 11 | e79124

Predictive Validity of ActiGraph Equations

Figure 1. Selection procedures for including valid epochs to determine the classification accuracy of ActiGraph cut-points for defining physical activity intensity. doi:10.1371/journal.pone.0079124.g001

significantly higher compared to all others (P,0.05). Results are reported in Table 5. When combining direct observation with measured EE as criterion measure results were slightly inflated compared to using

direct observation alone. Classification accuracy for the EV cutpoint was excellent for SB and fair for LPA and MVPA. The EV cut-point showed significantly higher accuracy compared to all others except the PT cut-point. PT showed the highest

Table 3. Participant characteristics.

Total sample (n = 40)

Boys (n = 22)

Girls (n = 18)

Age (years)

5.361.0

5.261.0

5.361.1

Height (cm)

112.768.1

114.366.2

110.969.7

Weight (kg)

20.663.7

21.562.4

19.464.6

BMI (kg/m2)

16.161.5

16.561.3

15.561.6

Predicted BMR (kcal/kg/min)

0.03260.003

0.03260.002

0.03260.004

% overweight*

25.0

27.2

22.2

Values are mean 6 SD; *defined according to Cole et al. [34]. doi:10.1371/journal.pone.0079124.t003

PLOS ONE | www.plosone.org

5

November 2013 | Volume 8 | Issue 11 | e79124

Predictive Validity of ActiGraph Equations

during MVPA, overall it significantly overestimated EE. Notably, neither equation - PT or PU - performed equally well across all intensities at either group or individual levels. These findings are consistent with a previous study, which reported that the PU equation underestimated individual total EE in 3–6 year-olds [24]. In addition, a study conducted in 5–15 year-olds reported significant differences in predicted versus measured EE during a variety of activities using the PU equation [22]. Considering the results of this and previous studies, we do not recommend the use of current ActiGraph equations for predicting EE over the whole range of physical activity intensities in young children. However, when interested in energy expenditure during MVPA, the PT equation could possibly be used. Nevertheless, further assessment in a broader range of typical non-ambulatory activities is required for the equations to be used with confidence across a broad range of free-living physical activity. The EV cut-point showed significantly higher classification accuracy for SB, and the PT cut-point showed significantly higher classification accuracy for MVPA than all others. When using direct observation and measured EE simultaneously as criterion measure, EV did not differ significantly compared to PT. This is possibly due to the strict inclusion criteria when using the combined criterion measure which resulted in fewer epochs. For MVPA, the findings were consistent when using the combined direct observation and measured EE as criterion measure. To our knowledge this is the first study to examine the classification accuracy of ActiGraph PA and SB cut-points in 4–6 year-olds. Trost et al. evaluated several cut-points in 5–15 yearolds and found that the cut-point of #25 counts?15 s21 for SB resulted in excellent classification accuracy in that age range [22]. Results from the current study are similar and indicate that using the #25 counts?15 s21 (EV) provided good classification accuracy of SB in 4–6 year old children. For MVPA classification accuracy was highest for the PT cut-point in 4–6 year old children. This finding is consistent with previous studies. In toddlers, using the PT MVPA cut-point of $420 counts?15 s21 resulted in no significant difference in time spent in MVPA compared with direct observation [25]. Among 5–15 year-olds, a slightly higher cutpoint of $573 counts?15 s21 resulted in the best classification accuracy for MVPA [22]. The lower MVPA cut-point found in studies in younger children is plausible and might be due to physiological, biomechanical and structural factors, such as differences in gait parameters and body surface area to body mass ratios, which are thought to influence the association between accelerometer output and EE during childhood [26]. It is important to note that the results from this study are dependent on methodological decisions made in regards to defining SB and MVPA. Recently, there has been debate on the concept of SB and MVPA. SB has been defined as lying/sitting in some studies [4,6], whereas other studies include lying/sitting and

Figure 2. Measured versus predicted mean energy expenditure values (±SD) for the Pate (A) and Puyau (B) equations. *Statistically significant (P,0.0125). doi:10.1371/journal.pone.0079124.g002

classification accuracy for MVPA. Results for each cut-point using the combined criterion measure are reported in Table 6.

Discussion This study compared the validity of ActiGraph equations and cut-points for predicting EE and classifying PA intensity in young children. Although PT performed reasonable well predicting EE Table 4. Included data.

Included epochs when using direct observation as criterion measure % (number of epochs included)

Included epochs when using direct observation combined with EE as criterion measure. % (number of epochs included)

SB

96.3 (6881)

57.5 (4108)

LPA

96.4 (7325)

65.1 (4945)

MVPA

62.5 (4747)

21.3 (1617)

Total

84.8 (18953)

47.8 (10670)

doi:10.1371/journal.pone.0079124.t004

PLOS ONE | www.plosone.org

6

November 2013 | Volume 8 | Issue 11 | e79124

PLOS ONE | www.plosone.org

(0.61–0.63)

doi:10.1371/journal.pone.0079124.t005

0.69

(97.4–98.7)

(0.67–0.70)

39.2

(37.7–40.8)

98.2 Reilly [7]

0.62 96.7

(96.4–96.9) (25.8–28.4)

27.1 0.50

(0.50–0.51) (86.5–87.7)

87.1

standing [7,9,27]. In addition, a consistent definition of MVPA is lacking. There has been a debate on the use of $3 versus $4 METs as the threshold for MVPA in children [28,29], as well as differences in the use of EE units [4,5] and direct observation systems [9,30]. These methodological differences might explain why some studies reported higher SB and MVPA cut-points were more accurate compared to lower cut-points [27,30]. To overcome this limitation in methodological studies it is important to reach agreement on the definitions of SB and MVPA in young children. This study has several limitations. Due to the calorimeter sampling frequency and the time lag that exists when measuring EE in large volumes, it was not possible to measure EE in time blocks shorter than 10 min [13]. The room calorimeter is a confined space and the children followed a standardized activity protocol, limiting the ability to represent children’s free-living intermittent PA patterns. However, due to the small size and stature of the children, the limited space may have had less influence on their activity behavior than might be the case in older children or adults. In addition, as it was not feasible to ask preschool-aged children to fast overnight before completing a 2.5hour activity protocol no measures of basal metabolic rate were available. Therefore, the Schofield equation [15] was used as a proxy measure of predicted basal metabolic rate which might have influenced the results. However, the Schofield equation [15] has been shown to be valid for estimating basal metabolic rate in preschoolers [31] and has been used for the same purpose in activity monitor validation studies in older children [22,24,32]. The proportion of data classified as valid when using EE combined with direct observation as criterion measure was low, especially for MVPA. This was due to the strict screening protocol used to reduce potential misclassification error from including, for example, data points in the MVPA category that may have been LPA (e.g. transitions between activities). However, our findings were essentially consistent with those from analyses where direct observation was used as the only criterion measure and very little data were excluded, supporting the overall conclusion. This study had several strengths. The sample of 4–6 year old children was relatively large and evenly distributed by sex, and approximately representative with regards to weight status. Additionally, this accelerometer validation study is one of very few in young children that have used EE as criterion measure [4,5,24]. As EE was measured using a room calorimeter, children’s movements were not limited by wearing a facemask and the weight of a portable device. Wearing a facemask may not be tolerated by all young children, potentially impacting on how a given activity is performed. Conducting PA intensity classification analyses using only direct observation as a criterion measure as well as EE in combination with direct observation reduces the impact of the potential limitations associated with each of the methods. Last, the activity protocol used in this study complied with current best practice recommendations for activity monitor validation studies [33] as the protocol included a variety of child specific and developmentally appropriate ambulatory and nonambulatory activities, ranging in intensity from SB to MVPA. In summary, when measuring energy expenditure during MVPA, researchers may consider using the PT equation. However, neither the PT or PU equations, accurately predicted EE across all intensities, and therefore we do not recommend using these to predict EE in 4–6 year old children over a broad range of intensities. When assessing the prediction of PA intensity, EV resulted in good classification accuracy for SB, whereas the highest classification accuracy for MVPA was achieved when using PT. When classifying SB, LPA, and MVPA in 4–6 year old

(13.0–14.2)

13.6 0.64

(29.2–30.6) (98.0–98.6)

(0.64–0.65)

29.9 98.3 Sirard [8]

0.64

(0.63–0.65) (96.2–97.3)

96.8 31.5

(28.9–34.2) (0.55–0.57)

0.56 81.3

(79.8–82.7) (29.2–32.7)

30.9 0.72

(96.4–98.0)

(0.71–0.73)

47.2

(45.6–48.8)

97.3 Puyau [5]

0.72

(0.71–0.72) (88.4–89.3)

88.9 54.2

(52.8–55.7) (0.62–0.63)

0.62 81.7

(81.0–82.4) (41.8–43.7)

42.8 0.78

(88.4–89.9)

(0.78–0.79)

67.3

(66.6–68.0)

89.2 Pate [4]

0.69

(0.69–0.70) (92.3–93.0)

92.7 45.7

(44.3–47.1) (0.64–0.65)

0.65 74.8

(74.0–75.6) (53.8–55.7)

54.8 0.80

(72.1–73.6) (85.8–87.5)

(0.79–0.80)

72.9 86.7 Evenson [6]

(0.68–0.70)

0.69 92.8

(92.5–93.2) (43.6–46.4)

45.0 0.52

(0.51–0.52) (93.5–94.3)

93.9 9.2

(8.6–9.7) (0.64–0.65) (30.7–32.2) (97.8–98.5)

0.65 31.5 98.2 v. Cauwenberghe [9]

ROC-AUC (95% CI) Sp% (95% CI) Se% (95% CI)

Sp% (95% CI)

ROC-AUC (95% CI)

Se% (95% CI)

Sp% (95% CI)

ROC-AUC (95% CI) Se% (95% CI)

MVPA LPA SB

Table 5. Sensitivity (Se%), Specificity (Sp%) and area under the ROC curve (ROC-AUC) for the classification of SB, LPA and MVPA using direct observation as criterion measure.

Predictive Validity of ActiGraph Equations

7

November 2013 | Volume 8 | Issue 11 | e79124

PLOS ONE | www.plosone.org 50.3 (47.8–52.7)

99.1

(98.3–99.6)

39.5 (38.3–40.7)

(99.7–99.9)

(97.6–99.2)

99.9

60.7 (58.3–63.1)

98.6

86.2 (85.4–87.0)

(91.6–93.2)

(89.0–90.5)

(89.8–91.6)

92.4

89.7

(38.7–41.1)

(99.7–100.0)

90.7

39.9

Sp% (95% CI)

99.9

doi:10.1371/journal.pone.0079124.t006

Reilly [7]

Sirard [8]

Puyau [5]

Pate [4]

Evenson [6]

v. Cauwenberghe [9]

Se% (95% CI)

SB

(0.73–0.76)

0.75

(0.69–0.71)

0.70

(0.78–0.81)

0.80

(0.89–0.90)

0.89

(0.90–0.91)

0.90

(0.69–0.71)

0.70

ROC-AUC (95% CI)

(20.3–22.7)

21.5

(41.5–47.2)

44.3

(54.9–57.6)

56.2

(68.6–71.2)

69.9

(12.2–14.1)

13.1

Se% (95% CI)

(89.5–91.1)

90.3

(85.4–88.9)

87.2

(85.0–86.9)

86.0

(81.2–83.2)

82.2

(95.6–96.6)

96.2

Sp% (95% CI)

LPA

(0.55–0.57)

0.56

(0.64–0.68)

0.66

(0.70–0.72)

0.71

(0.75–0.77)

0.76

(0.54–0.56)

0.55

ROC-AUC (95% CI) Se% (95% CI)

(37.0–41.8)

39.4

(40.0–50.0)

44.9

(67.3–71.8)

69.6

(58.1–63.0)

60.5

(57.2–62.1)

59.7

(95.8–96.6)

96.2

(94.9–96.6)

95.8

(85.3–86.8)

86.4

(90.4–91.6)

91.0

(90.7–91.8)

91.3

Sp% (95% CI)

MVPA

(0.67–0.69)

0.68

(0.69–0.72)

0.70

(0.77–0.79)

0.78

(0.75–0.77)

0.76

(0.75–0.76)

0.75

ROC-AUC (95% CI)

Table 6. Sensitivity (Se%), Specificity (Sp%) and area under the ROC curve (ROC-AUC) for the classification of SB, LPA and MVPA using EE combined with direct observation as the criterion measure.

Predictive Validity of ActiGraph Equations

8

November 2013 | Volume 8 | Issue 11 | e79124

Predictive Validity of ActiGraph Equations

children, we recommend using #25counts?15 s21, 25–419 counts?15 s21, and $420 counts?15 s21, respectively.

Author Contributions Conceived and designed the experiments: DC AO MB SB UE JR RJ. Performed the experiments: XJ. Analyzed the data: XJ DC AO MB TH. Wrote the paper: XJ JR. Manuscript revision: DC AO JR SB UE RJ TH MB. Approval final manuscript: XJ DC JR TH RJ MB UE SB AO.

Acknowledgments We thank all our participants, Harry Battam for his technical support, Melinda Smith for her assistance with recruitment and implementation of the activity protocol.

References 17. De Bock F, Menze J, Becker S, Litaker D, Fischer J, et al. (2010) Combining Accelerometry and HR for Assessing Preschoolers’ Physical Activity. Med Sci Sports Exerc 42: 2237–2243. 18. Puhl J, Greaves K, Hoyt M, Baranowski T (1990) Children’s Physical Activity Rating Scale (CARS): description and calibration. Res Q Exerc Sport 61: 26–36. 19. Fisher A, Reilly JJ, Kelly LA, Montgomery C, Williamson A, et al. (2005) Fundamental movement skills and habitual physical activity in young children. Med Sci Sports Exerc 37: 684. 20. Reilly JJ, Jackson DM, Montgomery C, Kelly LA, Slater C, et al. (2004) Total energy expenditure and physical activity in young Scottish children: mixed longitudinal study. The Lancet 363: 211–212. 21. Reilly JJ, Kelly L, Montgomery C, Williamson A, Fisher A, et al. (2006) Physical activity to prevent obesity in young children: cluster randomised controlled trial. BMJ 333: 1041. 22. Trost SG, Loprinzi PD, Moore R, Pfeiffer KA (2011) Comparison of accelerometer cut points for predicting activity intensity in youth. Med Sci Sports Exerc 43: 1360–1368. 23. Metz CE (1978) Basic principles of ROC analysis. Seminars in Nuclear Medicine 8: 283–298. 24. Reilly JJ, Kelly LA, Montgomery C, Jackson DM, Slater C, et al. (2006) Validation of Actigraph accelerometer estimates of total energy expenditure in young children. Int J Pediatr Obes 1: 161–167. 25. Trost SG, Fees BS, Haar SJ, Murray AD, Crowe LK (2012) Identification and Validity of Accelerometer Cut-Points for Toddlers. Obesity 20: 2317–2319. 26. Trost SG (2007) State of the Art Reviews: Measurement of Physical Activity in Children and Adolescents. Am J Lifestyle Med 1: 299–314. 27. Martin A, McNeil M, Penpraze V, Dall P, Granat M, et al. (2011) Objective measurement of habitual sedentary behavior in pre-school children: comparison of activPAL with actigraph monitors. Pediatr Exerc Sci 23: 468–476. 28. Harrell JS, McMurray RG, Baggett CD, Pennell ML, Pearce PF, et al. (2005) Energy costs of physical activities in children and adolescents. Med Sci Sports Exerc 37: 329–336. 29. Ridley K, Olds TS (2008) Assigning energy costs to activities in children: a review and synthesis. Med Sci Sports Exerc 40: 1439–1446. 30. Hislop J, Bulley C, Mercer TH, Reilly JJ (2012) Comparison of accelerometry Cut Points for physical activity and sedentary Behavior in Preschool Children: a validation study. Pediatr Exerc Sci 24: 563–576. 31. Firouzbakhsh S, Mathis RK, Dorchester WL, Oseas RS, Groncy PK, et al. (1993) Measured resting energy expenditure in children. J Pediatr Gastroenterol Nutr 16: 136–142. 32. Trost SG, Way R, Okely AD (2006) Predictive Validity of Three ActiGraph Energy Expenditure Equations for Children. Med Sci Sports Exerc 38: 380–387. 33. Bassett DRJ, Rowlands A, Trost SG (2012) Calibration and Validation of Wearable Monitors. Med Sci Sports Exerc 44: 32–38. 34. Cole TJ, Bellizzi MC, Flegal KM, Dietz WH (2000) Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ 320: 1240–1243.

1. Beets MW, Bornstein D, Dowda M, Pate RR (2011) Compliance With National Guidelines for Physical Activity in U.S. Preschoolers: Measurement and Interpretation. Pediatrics 127: 658–664. 2. Cliff DP, Reilly JJ, Okely AD (2009) Methodological considerations in using accelerometers to assess habitual physical activity in children aged 0–5 years. J Sci Med Sport 12: 557–567. 3. Hinkley T, Salmon J, Okely AD, Crawford D, Hesketh K (2012) Preschoolers Physical Activity, Screen Time, and Compliance with Recommendations. Med Sci Sports Exerc 44: 458–465. 4. Pate RR, Almeida MJ, McIver KL, Pfeiffer KA, Dowda M (2006) Validation and calibration of an accelerometer in preschool children. Obesity 14: 2000– 2006. 5. Puyau MR, Adolph AL, Vohra FA, Butte NF (2002) Validation and calibration of physical activity monitors in children. Obes Res 10: 150–157. 6. Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG (2008) Calibration of two objective measures of physical activity for children. J Sports Sci 26: 1557–1565. 7. Reilly JJ, Coyle J, Kelly L, Burke G, Grant S, et al. (2003) An Objective Method for Measurement of Sedentary Behavior in 3- to 4-Year Olds. Obesity 11: 1155– 1158. 8. Sirard JR, Trost SG, Pfeiffer KA, Dowda M, Pate RR (2005) Calibration and evaluation of an objective measure of physical activity in preschool children. J Phys Act Health 2: 345–357. 9. Van Cauwenberghe E, Trost SG, De Bourdeaudhuij I, Cardon G (2011) Calibration and comparison of accelerometer cut points in preschool children. Int J Pediatr Obes 6: e582–e589. 10. Cliff DP, Okely AD (2007) Comparison of two sets of accelerometer cut-off points for calculating moderate-to-vigorous physical activity in young children. J Phys Act Health 4: 509–513. 11. Reilly JJ, Penpraze V, Hislop J, Davies G, Grant S, et al. (2008) Objective measurement of physical activity and sedentary behaviour: review with new data. Arch Dis Child 93: 614–619. 12. Janssen X, Cliff DP, Okely AD, Jones RA, Batterham M, et al. (2013) Practical utility and reliability of whole-room calorimetery in young children. Br J Nutr 109: 1917–1922. 13. Schoffelen PFM, Westerterp KR, Saris WHM, Ten Hoor F (1997) A dualrespiration chamber system with automated calibration. J Appl Physiol 83: 2064–2072. 14. Weir JB (1949) New methods for calculating metabolic rate with special reference to protein metabolism. J Physiol 109: 1–9. 15. Schofield WN (1985) Predicting basal metabolic rate, new standards and review of previous work. Hum Nutr Clin Nutr 39: 5–41. 16. DuRant RH, Baranowski T, Puhl J, Rhodes T (1993) Evaluation of the Children’s Activity Rating Scale (CARS) in young children. Med Sci Sports Exerc 25: 1415–1421.

PLOS ONE | www.plosone.org

9

November 2013 | Volume 8 | Issue 11 | e79124