SentEdge AI
← Back to Portfolio Contact Us
Video AI

AI Clip Producer

Autonomous video capture and editing pipeline that transforms raw gameplay into viral-ready vertical shorts for TikTok, YouTube Shorts, and Instagram Reels.

Watch Example Clips

The Problem

Creating engaging gaming content for social media platforms is time-consuming and labor-intensive. Content creators spend hours:

  • Manual Spectating & Recording

    Watching live matches and manually triggering recording at the right moments

  • Frame-by-Frame Editing

    Finding highlight moments, trimming clips, and applying transitions in video editors

  • Platform Optimization

    Reformatting for vertical aspect ratios, adding overlays, and syncing audio for each platform

Result: Inconsistent output quality, missed opportunities for viral content, and content creators spending more time editing than creating.

Timeline 00:00 00:05 00:10 00:15 00:20 00:25 00:30 V4 Text Overlays V3 Transitions V2 B-Roll V1 Main Video A2 Sound FX A1 Game Audio Winner Text 00:02 - 00:08 Chipz # 00:09... End Card 00:25... ⚡ ⚡ ⚡ Close-up Insert 00:12 - 00:18 Gameplay_01.mp4 00:00 - 00:10 Gameplay_02.mp4 00:10 - 00:15 Gameplay_03.mp4 00:15 - 00:22 Highlight_Final.mp4 00:22 - 00:30 whoosh.mp3 hit.mp3 bass.mp3 game_audio_01.wav game_audio_02.wav game_audio_03.wav Hours of manual work...

The Solution

Clip Producer is a fully autonomous pipeline that handles the entire content creation workflow—from spectating live matches to publishing platform-optimized clips—with zero manual intervention.

90% Reduction in Production Time
3 Platforms Supported
100% Automated Workflow

How It Works

1. Spectate

Playwright automation joins live matches and monitors game state

2. Record

FFmpeg captures gameplay with hardware-accelerated encoding

3. Analyze

AI detects scenes, audio peaks, and optimal trim points

4. Edit

Remotion renders with overlays, effects, and voiceover

5. Publish

Auto-upload to YouTube Shorts with metadata

🌐 Playwright Auto Spectating ⏺️ FFmpeg Screen Recording 📊 Extract Signals Scene Detection 🧠 AI Editor OpenAI GPT-4 ⚛️ Remotion React Rendering 📤 YouTube API Auto Upload raw video signals.json edl.json video.mp4 short.mp4 Automated Content Pipeline

Key Features

AI-Powered Scene Detection

OpenAI analyzes extracted video signals (scene changes, audio peaks, silence periods) to determine optimal trim points and select the most engaging moments.

sig_a3f7b2c.json 1 { 2 "file_path" : "bonez_match_1738445780.mp4" , 3 "duration" : 127.45 , 4 "scene_changes" : [ 5 { "timestamp" : 2.34 , "score" : 0.82 }, 6 { "timestamp" : 8.91 , "score" : 0.76 }, 7 { "timestamp" : 15.67 , "score" : 0.91 } 8 ], 9 "audio_peaks" : [ 10 { "timestamp" : 3.12 , "amplitude" : 0.89 }, 11 { "timestamp" : 12.45 , "amplitude" : 0.95 } 12 ], 13 "silence_periods" : [ 14 { "start" : 45.2 , "end" : 47.8 , "duration" : 2.6 } 15 ], 16 "game_metadata" : { 17 "winner" : "CryptoKing42" , 18 "chipz_won" : 3250000 , 19 "outcome" : "clutch_finish" , 20 "match_duration" : 127.45 , 21 "excitement_level" : "high" 22 }, 23 "extracted_at" : "2025-02-01T18:23:00Z" 24 } JSON UTF-8

Dynamic Text Overlays

Automatically generated text overlays with winner names, chip counts, and animated effects (bold, bounce, impact) synchronized to gameplay events.

Remotion Studio Composition: BonezShort ▼ Frame 245 / 900 30 fps TIMELINE 📁 Scenes ▶ IntroScene ▼ GameplayScene ├ Video Layer ├ Text: Winner └ Text: Chipz ▶ OutroScene PROPS winner "CryptoKing42" chipz 3250000 duration 30s fps 30 PREVIEW 1080 × 1920 (9:16) ♥ K ♠ A CRYPTOKING42 WINS! 3,250,000 CHIPZ ⏮ ▶ ⏭ 0:00 0:30 0:08 Render

TTS Voiceover Narration

AI-generated hype commentator narration using local Jetson TTS service. Narration targets casual gamers with sports announcer energy and game context.

FastKoko TTS Interface showing voice selection and audio waveform

FastKoko TTS interface with af_alloy voice generating narration

Platform Optimization

Automatically formats clips for TikTok (1080x1920), YouTube Shorts, and Instagram Reels with platform-specific metadata, tags, and aspect ratios.

Multi-Platform Optimization Same clip, optimized for each platform's unique format and audience ♥ ♠ CRYPTOKING42 WINS! 3,250,000 CHIPZ TikTok @zoombies ❤️ 12.5K 💬 342 ➤ 1.2K @zoombies 🎮 Epic Bonez showdown! #bonez #gaming #clutch ♥ ♠ CRYPTOKING42 WINS! 3,250,000 CHIPZ ▶ Shorts 👍 8.4K 👎 💬 156 ↗ Bonez: 3.2M Chipz Win! Zoombies Gaming • 24K views Subscribe ♥ ♠ CRYPTOKING42 WINS! 3,250,000 CHIPZ Instagram 📷 ✉️ 🤍 9.2K 💬 203 ✈️ 🔖 ⋯ zoombies_official 🎮 Epic 3.2M chipz win in Bonez! #bonez #gaming #reels 🏠 🔍 ➕ ▶️ 👤 TikTok YouTube Shorts Instagram Reels 12.5K likes • 1.2K shares 8.4K likes • 24K views 9.2K likes • 203 comments

Technology Stack

Built with modern video processing and AI tools for maximum performance and developer experience.

OpenAI GPT-4 Remotion (React) Playwright FFmpeg Node.js TypeScript Jetson TTS YouTube API

Example Output

AI-generated highlight with dynamic overlays, scene detection, and platform optimization

Outcomes & Benefits

  • Time Savings

    Reduced content production from hours of manual editing to minutes of automated processing

  • Consistency

    Standardized output quality across all clips with repeatable AI-driven editing decisions

  • Scalability

    Process multiple matches simultaneously with parallel recording and editing pipelines

  • Recipe Tracking

    A/B testing framework tracks all editing parameters for correlation with engagement metrics

  • Multi-Platform

    Single pipeline outputs optimized clips for TikTok, YouTube Shorts, and Instagram Reels

  • Live Preview

    Remotion Studio provides real-time preview of React-based compositions during development

See It In Action

Watch AI-generated gaming clips on the Zoombies YouTube Shorts channel, all created with the Clip Producer pipeline.

Watch Examples Back to Portfolio