Using Mobile Ecological Momentary Assessment to Understand Consumption and Context Around Online Food Delivery Use: Pilot Feasibility and Acceptability Study


IntroductionBackground

Unhealthy diets are a leading contributor to the global burden of disease []. Globally, there is an increasing trend toward the consumption of “out-of-home” foods, potentially exacerbating suboptimal diets. These foods include fast foods and takeaway or “take-out” foods from a variety of sources including restaurants, fast-food chains, convenience stores, coffee shops, and takeaway food outlets. An analysis of the UK National Diet and Nutrition Survey 2008-2012 found that 27% of adults had consumed meals outside the home once per week or more [], and research from the United States estimated that out-of-home meals comprised 50% of household budgets in 2018 []. Results from Australia’s National Household Expenditure and Time Use Surveys have shown a steady incline in spending on out-of-home foods—increasing from 22.8% of total food budgets in 1989 to 26.5% in 2010 []. Rising consumption of out-of-home foods has been similarly observed in low- and middle-income countries including China [,] and Latin American countries [].

However, these out-of-home meals are often high in fat, salt, and sugar and low in vitamins and minerals []. A systematic review of 15 prospective studies found that a high frequency of eating out and consuming out-of-home meals was associated with weight gain and a greater risk of becoming overweight or obese []. Moreover, studies have shown associations between frequent consumption of home-cooked meals and greater adherence to the Dietary Approaches to Stop Hypertension diet and Mediterranean diets as well as greater intake of fruits and vegetables []. Thus, the replacement of home-cooked meals with out-of-home meals may result in further detriments to dietary health.

In recent years, online food delivery (OFD) services such as Uber Eats, DoorDash, and JustEat have transformed the concept of out-of-home foods by allowing customers to order a variety of food and drink items straight from kitchen to doorstep []. With this added convenience, OFD potentially increases access to and consumption of out-of-home food. A study from the United Kingdom found that adults with access to the greatest number of food outlets available to them online had 71% greater odds of OFD use (odds ratio [OR] 1.71, 95% CI 1.09-2.68) compared with those with the lowest access [].

A growing number of studies have shown that a high proportion of menu offerings on popular OFD platforms are poor in nutritional quality. In Thailand, a majority of the most popular menu items were considered unhealthy against the World Health Organization’s recommended daily intake values []. Of the 25 most popular menu items, 23 exceeded the recommended sodium intake for adults, and 80% of all sweet items offered were 1.5 times above the recommended daily intake for sugar []. Similarly, more than three-quarters of menu items were classified as discretionary “junk foods” in Australia [] and New Zealand []. A cross-sectional study conducted in 3 international cities (Chicago, Melbourne, and Amsterdam) revealed “burgers,” “pizza,” and “Italian” were in the top 10 most advertised meals on the website or app of the OFD [].

OFD services are now regularly used by millions of people with heightened use found among young people aged between 16 and 34 years [,], who are already experiencing escalating rates of weight gain []. Furthermore, in Australia, by the age of 16 years, approximately 80% of young people have a debit card [] in their name. This is critical considering the ease of digital payment options and tools offered on OFD apps, which amplifies young people’s accessibility to takeaway foods. A study in China found that >47.8% of male university students and >30.7% of female university students have used OFD more than once per week []. Therefore, there is an urgent need to assess and understand the consumption and behaviors associated with the use of these OFD services.

Traditional dietary assessment methods such as 24-hour recalls, diet history, and food frequency questionnaires are reliant on participants retrospectively recalling their intake, whereas food records involve prospective recording, but both approaches are time-consuming and prone to inherent biases [,]. Recent studies have demonstrated that ecological momentary assessments (EMAs) can be a valid measure of dietary intake [,]. EMA is a data collection method that gathers real-time information from participants studying behaviors and contexts as they perform regular day-to-day activities in real-world settings []. Due to technological advances, researchers now use smartphones or mobile phones to conduct EMA studies, which have improved data collection and added flexibility to study designs []. A systematic review of 39 EMA studies conducted in young people aged 16 to 30 years indicated that EMA is an acceptable and feasible methodology to capture dietary intake and food consumption for this population [].

Objectives

Although dietary intake generally can be spontaneous and difficult to capture, OFD events are likely to be even more sporadic. Thus, compared with traditional dietary assessment methods, EMA may be an alternate method for capturing OFD events. In addition, unlike traditional dietary assessment methods, the context including social and psychological factors surrounding the real-time OFD event can be obtained using EMA. To the best of our knowledge, no previous study has used EMA to study OFD use. Therefore, this study aimed to determine the feasibility and acceptability of EMA in a sample of young people who are users of OFD. A secondary aim was to investigate associations between the frequency of OFD use and demographic variables such as age, gender, and socioeconomic level as well as other lifestyle chronic disease risk factors including diet quality score, physical activity levels, stress levels, and sleep quality.


MethodsRecruitment

From June to October 2022, participants were recruited via flyers, social media advertising, and word of mouth. Eligible participants were (1) aged between 16 and 35 years; (2) users of OFD, defined as at least once in the past 3 months; (3) living in Australia; and (4) having access to a smartphone. This was to ensure that participants were not first-time users of OFD, as this study aimed to gain a specific understanding of the behaviors and demographics of OFD users. The target sample comprised at least 140 participants accounting for a 30% (42/140) dropout rate. Using quota sampling, the target was 28 participants in the 16 to 18 years age group, 28 participants in the 30 to 35 years age group, and 42 participants each in the 19 to 24 and 25 to 29 years age groups. Previous pilot EMA studies used nonprobability sampling methods to recruit a similar number of participants [,].

Ethical Considerations

This study was approved by The University of Sydney Human Research Ethics Committee (2022/006). Reporting followed an adapted Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Checklist for Reporting EMA Studies (CREMAS) guidelines [] ().

Data Collection

After participants joined the study and provided consent, they were directed to a series of baseline surveys on REDCap (Research Electronic Data Capture; Vanderbilt University) to obtain data on participant demographics, usual OFD behaviors, physical activity levels, sleep quality, and perceived stress levels. The questions were adapted from the 7-item International Physical Activity Questionnaire—Short Form [], Pittsburgh Sleep Quality Index [], and Perceived Stress Scale [].

Upon completing the baseline surveys on REDCap, participants were sent a unique mobile code to download and set up the EMA mobile app (mEMASense, ilumivu Inc) on their personal smartphone devices. This app is available for both the Android and Apple operating systems. Using a computer-generated code, participants were randomly allocated 1:1 to 1 of 2 groups, “Prompts” or “No Prompts,” which determined the sampling approach used—respectively representative of the signal-contingent or event-contingent approach. A signal-contingent design involves sending prompts to participants randomly over the course of a given hour, day, or week []. In contrast, an event-contingent design allows participants to complete a prompt whenever they experience the event of interest [].

Participants in each group received a separate set of instructions via REDCap to inform them of their group allocation and what was required from them in either the Prompts or No Prompts group. An external link was also sent to participants to complete the Australian Eating Survey [], a validated food frequency questionnaire developed by researchers from the University of Newcastle, to capture usual dietary intake.

Data were collected over 1 monitoring period (1 wave). depicts a flow diagram of the overall data collection process, and provides an overview of the 2 varying EMA sampling protocols used in the study.

Figure 1. Flowchart of the data collection processes. mEMA: mobile-based ecological momentary assessment; REDCap: Research Electronic Data Capture. Figure 2. Overview of the 2 varying mobile-based ecological momentary assessment sampling protocols used in the study: signal-contingent (Prompts) group compared with the event-contingent (No Prompts) group. Participants in the No Prompts group were observed over 1 week (7 days), whereas those in the Prompts group were observed over 1 week with prompts sent on 3 separate days. EMA: ecological momentary assessment. EMA ProcedureSignal-Contingent Sampling (Prompts Group)

Participants in the Prompts group were monitored over 1 week on 3 days, including 2 weekdays (Monday-Friday) and 1 day on the weekend (Saturday or Sunday) between 7 AM and 10 PM. To ensure that at least 1 weekday and 1 weekend day were captured, the EMA prompt days were assigned on the second, fourth, and sixth day from the day participants joined the study. Participants were unaware of this prompting schedule and were only informed that they would be prompted on 3 “random days” over the 7 days from their enrollment into the study. This was implemented to improve the external validity of the study by aiming to capture unanticipated OFD events.

Participants were prompted by the app via a notification at a randomly assigned time during the 5 predetermined intervals (7 AM-10 AM, 10 AM-1 PM, 1 PM-4 PM, 4 PM-7 PM, and 7 PM-10 PM). An end-of-day prompt was sent at 10 PM on each of the study days to record any OFD ordering event that was not previously captured. When prompted, participants were asked to complete the short survey on the EMA app that started with the question “In the past 10-15 minutes, were you eating or drinking?” If unavailable at the time of the prompt, participants had a 45-minute time window to respond with 2 reminders sent 15 minutes apart after the initial prompt. After this point, the survey became inaccessible until the next prompt and recording opportunity. In total, 6 EMA surveys were prompted on each of the 3 study days, totaling 18 EMA surveys per participant across the data collection period.

Event-Contingent Sampling (No Prompts Group)

Participants in the No Prompts group were instructed to record any online food order they placed over 1 week from their enrollment in the study. An end-of-day prompt was sent at 10 PM on each of the 7 days to remind and allow participants to record any OFD event not previously captured.

Participants Attending High School

Participants aged between 16 and 18 years who were attending high school in the Prompts group were monitored across 3 days, including 2 weekdays (Monday-Friday) during nonschool hours (4 PM and 10 PM) and 1 day on the weekend (Saturday or Sunday) between 7 AM and 10 PM. This was done to ensure minimal disruption to high school commitments. Individuals attending high school in the No Prompts (the “event-contingent”) group were only required to answer the surveys during nonschool hours on weekdays (from 4 PM to 10 PM).

Capturing an OFD Order Event

Participants in both the Prompts and No Prompts groups were asked for the following details and surrounding context of their online food order: how they received their order (whether through pick-up or delivery), what they ordered, who they were with (by themselves, with romantic partner, work colleagues, friends, or family), where they were (home, workplace, or university), how far away they were from the food outlet in walking minutes, if any promotions or discount codes were used, their hunger levels, and cravings and stress levels at the time of ordering. All instances were timestamped to record when they consumed their online food order. Please see for a screenshot of the EMA survey questions delivered through the mEMASense app.

Figure 3. Selection of questions from the survey delivered through the mEMASense app to capture context surrounding an online food delivery event. Incentives

Participants were offered gift vouchers up to AUD 45 (US $29) for their completion of the entire pilot study. If participants completed one-third of the study, they were awarded 1 AUD 15 (US $9) voucher for their time, and participants who had completed two-thirds were compensated with AUD 30 (US $19) worth of gift vouchers.

Feasibility

The compliance rate was used to measure the feasibility of the study. This was calculated differently for the different sampling approaches. In the Prompts group, the compliance rate per participant was the number of answered prompts divided by 18, which was the total number of expected prompts. The mean compliance rate for the study was calculated to represent the sample in the Prompts group.

Similarly, for the No Prompts group, the compliance rate per participant was the number of answered end-of-day reminders divided by the total number of expected end-of-day reminders. These end-of-day reminders were sent daily over the 1-week study period, resulting in 7 total reminders. Furthermore, the percentage of online food ordering events captured by the end-of-day reminders was also analyzed. This indicated how likely participants were to forget their recording of each online food ordering event using the No Prompts approach.

Acceptability

Participants were administered a final end-of-study questionnaire composed of 5 items to gather insight into their acceptability of the EMA methodology, the mobile app used to send the EMA prompts, and the perceived participant burden from the 2 different sampling approaches. These 5-point Likert scale questions were adapted from a previous study [] with an additional closing open-ended question to gather general qualitative feedback.

Study Measurements and OutcomesDemographic

Age, gender, ethnicity, education status, working status, number of dependents, residential postcode, and car access were obtained from the demographic survey. Residential postcodes were matched to quintiles on the Index of Relative Socio-Economic Advantage and Disadvantage (IRSAD), an area-based socioeconomic measure, where a higher index value reflects an area of greater socioeconomic advantage compared with people residing in other areas []. Participants were also asked to report their height (cm) and weight (kg) so that their BMI could be determined.

Lifestyle Chronic Disease Risk Factors

Measures from the Australian Eating Survey generated the Australian Recommended Food Score, a diet quality index that reflects alignment with the Australian Dietary Guidelines []. Responses to the International Physical Activity Questionnaire allowed participants to be categorized into low, moderate, or high physical activity levels using scoring guidelines []. Similarly, a score was produced to categorize participants’ perceived stress levels into low, moderate, or high []. Sleep quality was reflected by the number of hours of sleep reported by the participants and compared with recommended sleep guidelines [].

Data collected from the EMA app were used as the outcome variables of interest, including the number of OFD events, OFD order details, and related contextual data, as shown in .

Statistical AnalysisOverview

The study’s analytic sample comprised participants who met the minimum requirements outlined in the sampling protocol. This entailed completing at least one-third of the study period, which translated to a minimum of 4 prompts for adults or 2 prompts for adolescents within a single study day for those in the signal-contingent group. For participants in the event-contingent group, it meant answering at least 2 end-of-day reminders. In addition, those who had finished the end-of-study acceptability questionnaire were also included in this sample. Data sets from REDCap surveys, the Australian Eating Survey, and the EMA app were downloaded and linked together via participants’ unique mobile code for the EMA app and REDCap ID number. Data were checked and cleaned before analysis. All statistical analyses were performed using R statistical software (version 2023.03.0+386; R Core Team).

Descriptive statistics, including means, SDs, and frequencies, were used to report the baseline characteristics of the sample and the OFD behaviors and context captured via the EMA app. Other statistical analyses were conducted as described below in the Feasibility Analysis, Acceptability Analysis, Comparison of Sampling Approaches, and Exploratory Analysis sections.

Feasibility Analysis

Compliance rates were the main outcome to determine the feasibility of the EMA protocol. In the Prompts group (signal-contingent), this was calculated as the total number of prompts answered over the expected total number of prompts answered. These compliance rate calculations slightly differed for adolescent participants who received fewer prompts per study day. In the No Prompts group, as the event of interest may not have occurred daily, compliance was measured by participant’s responses to the end-of-day study reminders. This was similarly measured as the total number of end-of-day reminders answered above the expected total of 7.

To investigate factors associated with compliance, a 2-level multilevel logistic regression analysis was conducted on participant data from the Prompts group. The outcome variable used for analysis was whether the participant had answered the delivered prompt (coded as “TRUE”) or had not answered (coded as “FALSE”). Level 1 factors were factors at the observation level such as time of the day (ie, morning, afternoon, or evening) and day of the week (weekday or weekend). Level 2 factors were at the person or participant level such as their demographics including age, gender, and IRSAD decile. The intraclass correlation coefficients were calculated to determine the proportion of variance that is because of between-person differences.

Acceptability Analysis

Median scores and IQRs were reported to summarize responses to the 5-item acceptability questionnaire in both the Prompts and No Prompts groups. Open-ended feedback was analyzed using content analysis methods. Concepts were developed based on the occurrence of terms.

Comparison of Sampling Approaches

A multivariable logistic regression model was used to analyze whether the sampling approach (ie, Prompts vs No Prompts) was associated with capturing OFD events during the study period. The outcome variable was whether an OFD event was recorded during the study period. The model was adjusted for age, gender, and frequency of OFD ordering reported at baseline.

Exploratory Analysis on Demographic and Lifestyle Risk Factors and Their Associations With OFD Use

A zero-inflated negative binomial regression model was built to analyze associations between participant demographic characteristics, lifestyle chronic disease risk factors, and number of OFD events in a week. Incidence rate ratios were the effect size from this model used to indicate how often OFD events occurred over the study period in relation to participants’ demographic characteristics and lifestyle chronic disease risk factors. A zero-inflated model was deemed appropriate as our data had an excess of “zeros” for the number of OFD events recorded by the participants. This model was adjusted for age, gender, and socioeconomic status as indicated by the IRSAD quintile. An influential point, which is an outlier that affects the slope of the regression, was identified through a bar plot of the Cook distance and subsequently removed as it had a significant impact on the coefficients.


ResultsParticipants

As shown in , of the 907 expressions of interest received on REDCap, 289 participants provided consent and continued to complete the baseline surveys. However, only 258 (89.2%) of the 289 participants completed all baseline surveys and were subsequently randomized into either the Prompts or No Prompts group. Only 159 (61.6%) of the 258 participants proceeded to the next stage of the study by downloading and setting up the mEMASense app. Of the 159 participants, 102 (64.2%) were part of the final analytical sample, as 57 (35.8%) did not meet the minimum requirements for study completion. Of the 102 participants, there were 53 (52.0%) in the Prompts group and 49 (48.0%) in the No Prompts group.

Figure 4. Participant recruitment process and attrition. Participant Characteristics

The mean age of all participants was 24.4 (SD 5.4) years. Women comprised 70.6% (72/102) of the study sample, men comprised 28.4% (29/102) of the study sample, and 1.0% (1/102) of the participants identified as nonbinary. In total, 63.7% (65/102) of the participants had a normal BMI range, whereas 28.4% (29/102) were overweight and obese. Approximately half of the sample (48/102, 47%) identified their ethnicity as White, approximately a quarter (24/102, 23.5%) identified as Chinese, and 14.7% (15/102) reported their ethnicity as Asian and South-East Asian (not further specified). Most of the participants (89/102, 87.3%) resided in areas of high socioeconomic advantage in the upper quintiles of the IRSAD, and most participants (58/102, 56.9%) were highly educated ().

Table 1. Demographics of participants (N=102).DemographicsValueAge (years), mean (SD)24.4 (5.4)Age (years), n (%)
16-1817 (16.7)
19-2434 (33.3)
25-2933 (32.3)
30-3518 (17.6)Gender identity, n (%)
Woman72 (70.6)
Man29 (28.4)
Nonbinary1 (1)BMI (kg/m2), n (%)
Underweight (<18.5)7 (6.9)
Normal weight (18.5-24.9)65 (63.7)
Overweight (25.0-29.9)20 (19.6)
Obese (>30.0)9 (8.8)
N/Aa1 (1)Ethnicity, n (%)
Asian (not specified)11 (10.8)
Bangladeshi1 (1)
Chinese24 (23.5)
Indian3 (2.9)
Japanese1 (1)
Jewish1 (1)
Southeast Asian (not further specified)4 (3.9)
Vietnamese1 (1)
White48 (47)
Multiracialb7 (6.9)
N/Aa 1 (1)IRSADc quintiles (1 representing most disadvantaged and 5 representing most advantaged), n (%)
Quintile 15 (4.9)
Quintile 22 (2)
Quintile 36 (5.9)
Quintile 417 (16.7)
Quintile 572 (70.6)Education level, n (%)
Current high school student13 (12.7)
Completed high school2 (2)
Currently studying for degree or diploma28 (27.4)
Completed trade or technical qualification0 (0)
Completed a degree or diploma33 (32.3)
Completed a postgraduate degree25 (24.5)
N/Aa1 (1)Car access, n (%)
Yes61 (59.8)
No41 (40.2)Number of dependents, n (%)
078 (76.5)
18 (7.8)
215 (14.7)
31 (1)

aN/A: not applicable (owing to missing values).

bIncluding White and Chinese, White and Japanese, White and Pacific Islander, White and Asian, and nonspecified.

cIRSAD: Index of Relative Socio-Economic Advantage and Disadvantage.

Usual OFD Behaviors and Lifestyle Behavioral Risk Factors

As shown in , in total, 52% (53/102) of the participants reported using an OFD service 1 to 2 times a month, and 27.5% (28/102) of the participants reported using it once a week at baseline. Approximately 89.2% (91/102) of the sample had used Uber Eats, which was followed by DoorDash as the next highly used service by 59.8% (61/102) of the participants. Only 23.5% (24/102) of the participants had membership with an OFD service, which was commonly a free 6-month trial.

The mean Australian Recommended Food Score for participants was 31 (SD 11.6) out of a maximum score of 73 indicating optimal nutrition. The median percentage of energy intake contributed by discretionary foods was 35% (IQR 26-44) among participants . Analyses from the International Physical Activity Questionnaire indicated that a large proportion of participants (64/102, 62.7%) had high physical activity levels, and 54.9% (56/102) of the sample experienced moderate levels of stress. The mean hours of sleep reported was 6.5 (SD 1.0) in adolescents and 7.2 (SD 1.1) in adults ().

Table 2. Online food delivery (OFD) behaviors at baseline and self-reported lifestyle behavioral risk factors (N=102).Lifestyle risk factorValueOFD behaviors
Frequency of using an OFD service, n (%)

Rarely or never0 (0)

1-2 times a month53 (52)

Once a week28 (27.4)

A few times a week13 (12.7)

Once a day4 (3.9)

More than once a day4 (3.9)
OFD service (those electing “Yes, I use this delivery service”), n (%)

Uber Eats91 (89.2)

MenuLog58 (56.9)

Deliveroo60 (58.8)

Doordash61 (59.8)

EASI18 (17.6)

Othersa12 (11.8)

Fantuan3 (2.9)

HungryPanda1 (1)

Panda3 (2.9)

PandaFresh2 (2)

Restaurant-specific delivery service1 (1)

N/Ab3 (2.9)
OFD services membership, n (%)

Yes24 (23.5)

No78 (76.5)
OFD membership (those electing “Yes, I have a membership subscription”)a, n (%)

Dashpass6 (5.9)

Deliveroo3 (2.9)

Uber Eats10 (9.8)

N/Ab5 (4.9)
Monthly cost of OFD membership for those with a subscription (US $), n (%)

Free trial for 6 months6 (5.9)

Dashpass (9.99)2 (2)

Uber Eats (9.99)3 (2.9)

Deliveroo plus (12.99)3 (2.9)

N/Ab10 (9.8)Usual dietary behaviorsc
Australian Recommended Food Score (maximum 73), mean (SD)31 (11.6)
Percentage of energy from noncore foods, median (IQR)35% (26-44)
Out-of-home food consumption (general, nonspecific to OFD), n (%)

<1 per week20 (19.6)

1-2 per week51 (50)

3-4 per week24 (23.5)

5-6 per week3 (2.9)

Once a day2 (2)

1 or more per day2 (2)Physical activity levelsd n, (%)
Low3 (2.9)
Moderate35 (34.3)
High64 (62.7)Perceived stress levelse n, (%)
Low30 (29.4)
Moderate56 (54.9)
High16 (15.7)Hours of sleep, mean (SD)
Adolescents aged 16-18 years (n=17)6.5 (1.0)
Adults aged 18-35 years (n=85)7.2 (1.1)

aParticipants were allowed to enter >1 other food delivery service or membership they used.

bN/A: not applicable (owing to invalid online food delivery service).

cObtained from the Australian Eating Survey results.

dPhysical activity levels were calculated according to the International Physical Activity Questionnaire analysis guidelines [].

ePerceived stress levels were calculated according to guidelines for the Perceived Stress Scale [].

Feasibility

Compliance rate was used as a measure of feasibility for the EMA study. Among the analytic sample, compliance with the study protocol was compared between the Prompts and No Prompts groups.

Prompts GroupAdolescents Aged 16-18 Years

The compliance rate for the adolescent Prompts group was 70.4% (76/108), with an average of 8 (out of 12) prompts answered per adolescent participant.

Adults Aged 18-35 Years

The compliance rate for the adult Prompts group was 72.5% (574/792), with an average of 13 (out of 18) prompts answered per adult participant.

No Prompts Group

Compliance in the No Prompts group was measured by the response to all end-of-day study reminders. The compliance rate for the No Prompts group was 73.2% (251/343). Furthermore, of 49 participants, 36 (73%) followed the protocol and logged instances of using an OFD service during their study period, unprompted, as per the “event-contingent” sampling protocol.

Factors Influencing Missing Prompt Data

Results from a multilevel logistic regression model showed that compliance or response to a prompt did not vary by age, gender, socioeconomic status, or whether it was a weekday or weekend (). However, compared with the evening between 6 PM and 12 AM, participants were 1.47 times more likely to answer prompts in the afternoon between 12 PM and 6 PM (95% CI 1.02-2.12). The intraclass correlation coefficients between participants were low (0.27), indicating that multilevel modeling was appropriate.

Table 3. Results from the multilevel logistic regression model to examine observation level and within-person level factors and their influence on a participant’s likelihood to respond to prompts (n=53).PredictorsResponse to prompt (yes or no)
Odds ratios (95% CI)P valueDays (weekend)0.81 (0.59-1.11).18Time of day (afternoon)1.47 (1.02-2.12).04aTime of day (morning)0.84 (0.58-1.22).36Age (years)1.02 (0.95-1.08).6Gender (woman)2.07 (1.00-4.31).05IRSADb decile1.19 (0.99-1.42).06

aIntraclass correlation coefficient: 0.27.

bIRSAD: Index of Relative Socio-economic Advantage and Disadvantage.

AcceptabilityPrompts

Responses from participants in the Prompts group reflected an overall opinion that the number of prompts sent during the study period was an appropriate amount, indicated by a median score of 3. The times of day that the prompts were sent were generally agreed upon by participants as being appropriate and not burdensome, with a high median score of 4 (). Participants were ambivalent in their response to the app being easy to use, with a median score of 3 indicating that they neither agreed nor disagreed with the statement. The EMA study did not appear to make a majority of participants more conscious of their diet and eating behaviors, with more responses skewed toward disagreeing with the statement. The length of study for the Prompts group, however, was distributed more toward being too short ().

No Prompts

In the No Prompts group, participants’ responses also showed that the number of prompts sent during the study period was appropriate, with a median score of 3. Many participants agreed that end-of-day reminders were necessary to remember to log an OFD order, as shown by the median score of 4 and with a distribution skewed toward “strongly agree” (). However, more participants disagreed that the mobile app was easy to use. This was indicated by a median score of 3, with more scores indicating strong disagreement. Furthermore, responses from participants varied on whether the surveys made them more conscious of their diet and eating behaviors, as shown by the median score of 3. Responses on length of study for the No Prompts group were also distributed more toward being too short.

Open Feedback

Open feedback was obtained from 45 participants. Responses from 38% (17/45) of the participants indicated the difficulty of navigating the app, with many stating that it was “clunky,” “not user-friendly,” and “cumbersome.” Moreover, 27% (12/45) of the responses indicated that the timing of the prompts could be improved. Participants in the group that received prompts suggested receiving prompts closer to mealtimes. Some participants in the No Prompts group commented on the timing of the “end of day” reminders as being “too late” and after they had gone to sleep.

Moreover, 4 participants suggested further clarity of the training instructions and to have these instructions available and accessible to them throughout the study period. There were variable open responses on study length, although more participants wrote that a longer study period would be more representative and able to capture their OFD behaviors.

OFD EventsAccuracy of Using EMA to Capture OFD Events

As shown in , this study captured 124 OFD events from 56.9% (58/102) unique participants. The actual frequency of OFD ordering throughout the study period did not match the reported frequency at baseline in 52% (53/102) of the participants and exactly matched in 48% (49/102) of the participants. For instance, if a participant had reported using an OFD service once a week in the baseline survey and the study did not capture an OFD event during the monitoring period, this would be a case where the reported frequency did not match the actual frequency. In the 53 participants where actual food ordering frequency differed, 26 (49%) had more OFD events during the study compared with 27 (51%) who had ordered less than what was reported at the start of the study.

Table 4. Comparison of the number of online food delivery (OFD) events captured between varying sampling approaches (event-contingent vs signal-contingent; n=58 unique participants).Sampling approachOFD events captured, nOFD orders from end-of-day reminders, nTotal, nNo Prompts (event-contingent)572279Prompts (signal-contingent)41445Total9826124

As shown in , there appeared to be more OFD events (79/124, 63.7%) captured from the event-contingent group compared with the signal-contingent group (45/124, 36.2%). Results from a multivariable logistic regression showed that there was a strong level of evidence to support a significant association between the sampling approach and the capture of an OFD event during the study period after adjusting for age and gender. Compared with the Prompts group, participants in the No Prompts group were 3.53 times more likely (95% CI 1.52-8.17) to have logged an OFD event.

Contextual Data Surrounding Online Food Ordering Events

A total of 124 instances of OFD were captured from 58 unique participants. More than half of all orders (65/124, 52.4%) were placed in the evening (between 6 PM and 12 AM) and were less common at night or morning, comprising 9.7% (12/124) of ordering events each (). As shown in , most orders were made on a Saturday (25/124, 20.2%), followed by Tuesday (22/124, 17.7%) and Friday (21/124, 16.9%). The most common food delivery orders were pizza (23/124, 18.5%), fried chicken (18/124, 14.5%), Chinese food (18/124, 14.5%), and burgers (17/124, 13.7%). However, 28.2% (35/124) of the orders were from a category other than what was provided, including Mexican; bubble tea; fast-food franchises (Red Rooster, KFC, and McDonald’s); cakes, pastries, and bakery items; groceries; and Vietnamese food. The following food categories were mentioned only once from all OFD events: hot chips and Caesar salad, breakfast platter, Malaysian, Nepalese, Afghan, modern Australian, Japanese, fried vegetables, Korean (fried chicken, chips, and seafood pancake), salad bowl, and sandwich.

For 50% (62/124) of the OFD orders captured, participants used Uber Eats, followed by DoorDash (23/124, 18.5% of the orders). In 54.8% (68/124) of the orders, participants ordered for just themselves, 15.3% (19/124) ordered for family, and 13.7% (17/124) ordered for their romantic partner.

The prevailing reason for using an OFD service was convenience, which contributed to 37.1% (46/124) of the responses. Taste and cravings attributed to 20.9% (26/124) of the orders. Most participants (98/124, 79%) ordered when they were at home, and 8.1% (10/124) of the participants ordered when they were at university or technical and further education. In 54.8% (68/124) of the online food ordering events, participants had ordered from a food outlet situated within a 15- to 30-minute walking distance, and 21.8% (27/124) of the participants ordered from an outlet that was between a 30-minute to 1-hour walk away ().

A promotional code or offer was used for approximately one-third (37/124, 29.8%) of all orders. A wide variety of promotions and discounts were reported by the participants, from free delivery to receiving 10% or 50% off on their orders. The following discounts and promotions were only mentioned once from all OFD events: first-order discount, free additional food, referral discount, ShopBack, 30% off, AUD $16 off, AUD $20 off, and AUD $30 off (AUD $1 = USD $0.66). For 50.8% (63/124) of recorded OFD events, participants described the hunger levels as “quite hungry” or “really hungry.” In 72.6% (90/124) of the OFD orders, participants responded that the order satisfied their cravings. Participants reported neutral to high levels of stress, ranging from not stressed or relaxed to very stressed in 72.6% (90/124) of all the OFD events.

Associations

In a zero-inflated negative binomial regression model adjusted for age, gender, and socioeconomic status, there was evidence that age and dependents were significantly associated with the number of OFD events in a week (). With every 1-year increase in age, the incidence rate of OFD events in a week decreased by 5% (95% CI 0.91-0.99). Compared with participants with no dependents, those with dependents had an incidence rate of OFD events 2.01 times higher (95% CI 1.16-3.49). Stress levels, age, gender, and socioeconomic status were not statistically significant factors associated with OFD events.

Table 5. Incidence rate ratios (IRRs) of demographic and lifestyle risk factors in a zero-inflated negative binomial regression model (N=101).FactorsIRR (95% CI)P valueDependents
No dependents (reference)N/AaN/A
Dependents2.01 (1.16-3.49).01
Diet quality score0.98 (0.96-1.00).1Stress levels
High stress (reference)N/AN/A
Moderate stress0.60 (0.36-1.00).05
Low stress0.51 (0.26-1.00).05Age (years)0.95 (0.91-0.99).03Gender
Man (reference)N/AN/A
Woman0.85 (0.47-1.54).59Socioeconomic status (IRSADb)0.97 (0.84-1.13).73

aN/A: not applicable.

bIRSAD: Index of Relative Socio-Economic Advantage and Disadvantage.


DiscussionPrincipal Findings

This pilot study tested the feasibility and acceptability of using EMA to capture OFD events and contextual behaviors in young people aged 16 to 35 years. Compliance rates, as an indicator of feasibility, to signal-contingent and event-contingent protocols were similar at 72% and 73%, respectively, in adults. However, participants in the event-contingent group were more likely to have captured an OFD event during the study period. The EMA protocols for both groups were acceptable; however, most participants agreed that the study could be improved by an app that was easier to navigate. Contextual data revealed that OFD orders consisted largely of unhealthy foods. These orders were commonly placed for evening meals, typically after 6 PM, were mostly for a single person, and were ordered at home. Moreover, the orders often originated from an outlet within a 15- to 30-minute walking distance. Analyses showed that there was a significant association between age, number of dependents, and number of OFD events. These formative findings warrant further investigation with refinement of the EMA methodology to increase acceptability and improve the OFD data captured from participants.

High compliance rates indicated a feasible and acceptable EMA protocol for the study population and events captured. In the guidelines proposed by Stone and Shiffman [] for EMA protocols, compliance rates of ≥80% are considered optimal. This study observed compliance rates between 70% and 73%, which fell short of the recommendations yet aligned with the findings from systematic reviews of similar dietary EMA studies conducted in young people. In a review by Liao et al [], an average compliance rate of 71% was reported among studies. However, this is in contrast with the review by Battaglia et al [], where compliance rates were reported to be >80% in more than half of the included studies. Stone et al [] suggested that noncompliance is mainly attributed to monitoring burden and participants forgetting to record. For this study, the 3 additional reminders set 15 minutes apart and 1 end-of-day prompt included in the protocol aimed to eliminate instances of noncompliance from forgetfulness. Therefore, the monitoring burden may have influenced compliance. Feedback from participants showed that 27% (12/45) of the participants thought that the timing of prompts could have been improved. Data from the multilevel regression analysis supported this as prompts were more likely responded to in the afternoon compared with the evening. Similarly, another feasibility study on a mobile EMA intervention reported that several participants disliked receiving alerts at night, which may have influenced response rates to prompts []. These are important considerations for future EMA study designs aiming to collect data from participants during evening hours.

Participants who were assigned to the event-contingent sampling approach were 3 times more likely to have had an OFD event captured during the study compared with the signal-contingent group. This indicates that event-contingent sampling appeared to be the better approach to capturing OFD events. It is likely that event-contingent sampling was more appropriate becaus

留言 (0)

沒有登入
gif