GUM Platform Enhancement: Unified AI Client, Faster Video Processing

[parmar-abhinav]

GUM Platform Enhancement: Unified AI Client, Faster Video Processing, and Web Interface

This PR adds new features to the GUM system, bringing support for multiple AI providers, parallel video analysis.

---

Key Updates

Unified AI Client

GUM now supports multiple AI providers — Azure OpenAI, OpenAI, and OpenRouter — through a unified client interface. You can switch between providers using environment variables.

---

Parallel Video Processing

Video uploads and analysis now done in parallel.
Performance highlights:

• 3–5x faster video processing across different file sizes
• Hardware acceleration when available

---

Other Improvements

• Retry logic was added for calls to vision and text AI models to automatically retry requests if they fail.

• Handling of large video files was improved to support uploads and processing of videos over 1GB.

• A separate vision model was added to handle image data extraction.

---

Environment Configuration

If you prefer to set up environment variables manually, create a .env file in the root directory with the following structure:

# Provider Selection
TEXT_PROVIDER=azure
VISION_PROVIDER=openrouter
 
# Azure OpenAI Configuration (if using TEXT_PROVIDER=azure)
AZURE_OPENAI_API_KEY=your_azure_openai_api_key_here
AZURE_OPENAI_ENDPOINT=https://your-resource-name.openai.azure.com/
AZURE_OPENAI_API_VERSION=2025-01-01-preview
AZURE_OPENAI_DEPLOYMENT=gpt-4o
 
# OpenAI Configuration (if using TEXT_PROVIDER=openai)
OPENAI_API_KEY=your_openai_api_key_here
 
# OpenRouter Configuration (if using VISION_PROVIDER=openrouter)
OPENROUTER_API_KEY=your_openrouter_api_key_here
OPENROUTER_API_URL=https://openrouter.ai/api/v1/chat/completions
OPENROUTER_MODEL=qwen/qwen-2.5-vl-72b-instruct:free
 
# Default Settings
DEFAULT_USER_NAME=WebUser

[parmar-abhinav]

@oshaikh13 Raised micro pr for unified ai client integration.

[parmar-abhinav]

Hi @oshaikh13 please review this PR when you get a chance

[parmar-abhinav]

Hi @oshaikh13 just a gentle reminder to review this PR when you get time. Thanks!

[parmar-abhinav]

Hi @oshaikh13, gentle reminder on this PR. I understand you may be busy, but if you could share even a quick initial review, it would help me proceed.

[parmar-abhinav]

Hi @oshaikh13, Whenever you get a chance, please review my PR and let me know if any changes are needed — I’ll be happy to update it.

I’m excited to work on this project and have a few ideas to explore further. Getting this initial PR reviewed and merged will help me understand how to proceed.