Notes from observing twelve first installs in a week

Last January we ran a first-session observation sitting for a consumer lifestyle app available in Malaysia and neighbouring markets. The team wanted a human reading before funding a larger measurement study. We watched twelve recent installs across iOS and Android.

Eight of the twelve people reached the home feed. Of the four who did not, three stalled on OTP entry when the SMS arrived late, and one abandoned when a store-rating prompt covered the first useful card on the feed. None of those exits appeared as a single “failed activation” reason in their existing dashboard; they were buried in session length.

We wrote timestamped notes rather than averages. The OTP stalls clustered after people had already accepted notifications. They had invested effort. The rating prompt, by contrast, arrived too early — before the app had given anything worth rating.

The debrief stayed concrete. The team moved the rating prompt behind a second session, and they added a visible resend state on the OTP screen with an estimated wait. Those changes became the subject of a later remeasurement.

Observation sittings do not replace a full onboarding flow measurement study. They do give product teams language for the first ten minutes that a funnel chart rarely provides on its own.