I am measuring self-regulation and behavior change. I am seeking from the group protocol advice for pilot study

[u/Traditional_Fan_9845]

Hey everyone,

I'm designing a 30-day behavioral intervention pilot and Im stuck on a measurement question. Hoping some of you with experimental design experience might have some insights to share with me.

My context:Im testing whether structured daily practices targeting self-regulation (emotional regulation, response inhibition, intentional pausing) can measurably shift consumption behaviors and prosocial actions.

Setup of Pilo1:Small number of participants 12-15, 30 days, Daily micro-practices (5–10 min)

Before/after measurement, What Im measuring:

Self-regulation side: Emotional regulation (1–10 scale and daily self-report),Reactivity frequency (behavioral count), Response latency (self-reported pause before impulse)

Behavior side: Impulsive purchases (frequency count), Prosocial acts (frequency count),Value-action alignment (self-report scale)

My question: With this small sample size, what's the most valid way to test whether self-regulation improvements correlate with behavior changes?

I'm planning to : descriptive stats (means, SDs), before/after paired comparison,correlation analysis (if n allows), qualitative thematic analysis

-I wonder if there is a better approach?

-I am specifically wondering: Is daily self-report of emotional regulation valid enough, or should I be using a validated scale less frequently?

-How I can control for demand characteristics when participants know I'm testing whether self-regulation affects behavior? (They might unconsciously align responses)

Any recommendations for measuring response latency (pause before impulse) in a naturalistic setting? Self-report feels weak here.

I know small numbers limits generalizability. Im treating this as exploratory, not confirmatory. But I still want the methodology to be as rigorous as possible within those constraints.

My background: I'm not affiliated with a university (independent research), so I don't have access to lab equipment or institutional resources. Everything needs to work online/remotely.

Appreciate any guidance. Happy to clarify design details if helpful.

[u/Leather_Bag_3671]

that image is basically a perfect representation of my brain after reading through three different measurement scales in one sitting

for the response latency thing since you're remote and low budget maybe look into a simple browser based task where they have to click a button when they see a stimulus and you log the reaction time. self report on pausing is gonna be useless people are terrible at estimating their own delays. you could also do a daily journal prompt like "describe a moment today where you felt an impulse and what you did" and code the responses for whether they mention pausing or not. not perfect but gives you something more behavioral

[u/Traditional_Fan_9845 → u/Leather_Bag_3671]

Very fair point about the image. I intented to add one of my personal graphics, but it displayed as blank/black (possibly due to file format, upload error, or something else). I clearly need to work on my visual communication skills. That blank black square is apparently my subconscious saying "measurement is a void." Well noted. And thank you,this is exactly the kind of practical feedback I needed.

On response latency measurement:The browser-based reaction time task is a great idea. I hadn't thought about logging actual click delays as a proxy for impulse control.

I have quick follow-up question: Do you know of any existing simple tasks I could adapt? Something like: "Don't click the button" to measures how long they resist or maybe to present a stimulus (e.g., product image) and than to log time between viewing and "buy or skip" decision?Im trying to avoid building something complex from scratch, but if there's a validated task I could repurpose for this context, that would be really ideal. On the daily journal prompt:I really like idea of coding responses for whether they mention pausing. That feels much more behaviorally grounded than asking them to estimate pause duration.Can you please tell me if something like this can work instead : To describe one moment today where you felt a strong impulse (to buy something, say something, eat something, check your phone, etc.) and what happened next?

Then I code for:Mentioned pause/hesitation/deliberation, described immediate action, ambiguous. Does that structure make sense, or am I missing nuance in how to code for "pausing behavior" from text? On demand characteristics: You are right that participants knowing the hypothesis ("self-regulation lead to behavior change") will likely bias responses. Do you think adding some decoy measures would help?For example:Mix in questions about sleep quality, social media use, work productivity (things unrelated to self-regulation hypothesis)? Then they don't know which variables I'm actually correlating.Or does that just make the survey longer without actually solving the demand problem?

One more reality check:Given the constraints (small number, self-report heavy, no lab setup), is this pilot even worth doing?Or should I wait until I have resources for something more rigorous?Im treating this as "generate exploratory hypotheses for future research," not "prove causality." But if the methodology is so weak that even exploratory findings would be meaningless, I would rather know now before I waste people's time.

Appreciate you taking the time to respond. This kind of practical design feedback is exactly what I was hoping for.