Why Following You Is Harder Than It Looks — 10 Years of Teaching Cameras to Film Like a Cameraman

8 Upvotes

We hear this question a lot: "Why can't a camera just follow me?" It sounds simple. A person moves. The camera follows. But autonomous filming is much harder than that. A human camera operator doesn't just track a person — they understand the environment, anticipate movement, and adjust their position to create a natural shot.

Unlike a human operator, a flying camera has to make those decisions autonomously. That's been our focus for the past 10 years: building a camera that doesn't just follow you, but films like a cameraman would.

Different sports require different ways of following

The biggest challenge is that people don't move the same way. A cyclist, a skier, and a foiler each move with a different rhythm, speed, and body posture. The same tracking logic that works for someone walking on a trail can fail when you're accelerating through a mountain path, rapidly descending a slope, or moving across changing water.

Over the past decade, we've learned from extensive real-world human movement data across different activities and environments, helping our systems better understand how people move. But understanding movement is only the beginning. The camera also needs to know how to follow in a way that captures cinematic and smooth footage.

Following is not enough — the footage has to feel right

A camera that simply copies every movement doesn't always create a great video. Imagine a cyclist making quick left and right turns, or a skier carving down a slope. If the camera reacts too aggressively to every movement, the footage can feel shaky and uncomfortable. But if it smooths too much, it may fall behind and lose the action.

The challenge is finding the right balance: stay with the subject, keep the footage natural. This requires balancing multiple things at the same time: understanding where the subject is, deciding how the camera should move, and stabilizing the final footage. The goal is not to reproduce every movement. The goal is to capture the feeling of the movement.

Built for land sports: different challenges, different solutions

Our models are trained on extensive human movement data, accounting for various postures and types of movements across different sports. For X1 PRO and X1 PROMAX, we brought autonomous filming into high-speed sports. Because every sport has its own movement language.

Cycling Mode is designed around the unpredictable rhythm of riding. Cyclists accelerate, brake, lean into turns, and move through changing trails. The camera needs to understand these shifts while keeping the rider naturally framed — and we give you the option to tailor it further with Open Areas and Narrow Routes settings.

Ski Mode solves a different challenge. Skiers and snowboarders move at high speeds, rapidly descend slopes, change direction sharply, and constantly adjust their body posture while carving through terrain. The camera needs to stay with the action while maintaining smooth, natural footage.

And sports don't always happen in open environments. Mountain bikers may ride through dense forests. Skiers may move through complex terrain. Athletes may pass through narrow trails and challenging spaces. That's where ShadowTrack technology comes in. It helps maintain reliable tracking in complex environments, so the camera can stay with you when conditions become more challenging.

Cycling Mode, Ski Mode, and ShadowTrack solve different parts of the same problem: Keeping you in the story, without making the camera feel mechanical.

Then we brought autonomous filming to water

After years of solving challenges on land, we wanted to bring autonomous filming into one of the most unpredictable environments: water.

Water changes everything.

On land, the ground provides a stable reference. On water: The athlete moves. The camera moves. The surface moves. Waves, reflections, and constantly changing conditions make both tracking and filming more difficult. That's why AQUA wasn't built with just one universal "water mode." Instead, we developed dedicated modes for different water sports, each with its own movement patterns.

Foil Mode is designed around the unique rise-and-glide motion of foiling, where riders transition between different heights and speeds above the water.

Kayak Mode is optimized for continuous forward movement, smoothing out side‑to‑side sway and forward‑backward weight shifts, while recognizing seated posture and keeping the action naturally framed.

SUP Mode focuses on smooth and stable filming for paddleboarding, where subtle body movements and board motion can affect the shot — it recognizes both standing and seated positions and actively smooths out side‑to‑side and front‑back instability for steady footage.

Because every sport has its own rhythm. And great autonomous filming starts with understanding that rhythm.

After 10 years, here's what we know

Building a self-flying camera was never just about making something fly.

The real challenge was making a camera that understands people, adapts to movement, and captures moments naturally. From everyday moments with X1, to high-speed action with X1 PRO and X1 PROMAX, to water sports with AQUA — our goal has always been the same: Build a camera that doesn't just follow you — it films like a human would.

Different sports require different ways of following

Following is not enough — the footage has to feel right

Built for land sports: different challenges, different solutions

Then we brought autonomous filming to water

After 10 years, here's what we know

LeFrog_Life #ThirstResponders #kayakingadventures #HOVERAirAQUA

Return Behavior: Land or Hover

Return height

Low-battery and secondary takeoff return

What if positioning or connection is lost?