Bulk data processing, API reliability, and the battle-tested approach to handling gigabytes of camera footage