title: Vault-based Credential Management

content: Use HashiCorp Vault or AWS Secrets Manager to encrypt and store credentials. Never store raw. Request credentials from vault at runtime.


title: Kubernetes for Agent Orchestration

content: Use Kubernetes (K8s) to manage agent containers, handling deployment, scaling, self-healing, and resource management.


title: Retry Logic with Exponential Backoff

content: Implement exponential backoff with jitter for retries (e.g., 3-5 retries with delays of 1s, 2s, 4s, 8s) at the Playwright level.


title: Workflow Definition Language (DSL)

content: Define workflows using YAML/JSON with primitives like navigate_to, click, invoke_lux_action, invoke_gemini_vision. Include a Visual Builder for non-developers.


title: Infrastructure Cost per Agent

content: Estimated infra cost is $7-14/agent/month based on VPS sizing (500MB RAM, 0.5 CPU core per active agent).


title: Marketplace Cold Start Strategy

content: Phase 1: Internal team builds 5-10 Flagship Agents. Phase 2: Strategic partners build next 10-15 Agents via bounty/revenue share. Phase 3: Scale marketplace.


title: Hyper-Vertical Specialization Moat

content: Deep specialization in specific industry workflows (e.g., Dental, Plumbing) vs general purpose tools like Zapier. Agents understand specific UI nuances and business context.


title: Telnyx to Playwright Integration

content: Connect Telnyx (AIVA) to Playwright via a Bridge/Orchestrator service using WebSockets for real-time feedback during calls.


title: Headless Mode for Stability

content: Always run browsers in headless mode for stability and performance in the agent runtime.


title: Builder Revenue Share Model

content: Revenue share model: 70-80% to builder initially, shifting to 60-70% to builder (30-40% to platform) after initial period.


title: Secure Credential Storage Flow

content: Customer provides credentials -> Encrypted client-side -> Sent to backend -> Encrypted further by backend -> Stored in Vault. Agent requests creds from Vault -> Vault decrypts and provides to runtime.


title: AI Integration Moat

content: Using Lux (Mind2Web) for UI understanding/adaptation and Gemini 3.0 Flash for multimodal analysis creates a robust agent that handles UI changes better than selectors.


title: Asynchronous Task Processing

content: Use message queues (Kafka, RabbitMQ) to decouple task submission from execution. Agents pull tasks from queue.


title: Pricing Strategy

content: Price point of $97-$497/month allows for healthy builder share and covers infrastructure costs.


title: Human Intervention Primitive

content: Use prompt_user primitive in DSL for critical failures or setup, allowing human intervention during agent execution.


title: OAuth 2.0 for Authentication

content: Prefer OAuth 2.0 for target applications (Google, Salesforce) for secure, long-term access without storing passwords.


title: Automated Re-authentication

content: If a session expires or login fails, the agent should attempt to re-authenticate with stored credentials. If consistent failure, pause workflow and alert customer.


title: Persistent Memory Moat

content: Persistent context, personalization, and learning over time using AI Memory MCP. Traditional automation tools are stateless.


title: Lux in DSL

content: DSL supports lux_execute primitive where a natural language prompt drives Lux directly for dynamic actions.


title: Resource Isolation

content: Each agent (or a small group for a customer) should run in its own isolated browser context or dedicated container.


title: Browser Agent WebSocket Communication Architecture

content: When the browser agent starts an action, it opens a WebSocket connection back to the orchestrator service. As the browser agent progresses (e.g., 'Navigating to CRM,' 'Fetching details,' 'Update successful'), it sends updates over the WebSocket. The orchestrator then relays these updates back to the Telnyx voice agent (or AIVA directly if it supports WebSocket callbacks) or through a custom API call for AIVA to speak out loud. Upon completion (success or failure), a final status is sent.


title: Sub-2 Second Conversational Response Target

content: The system targets human-level conversational response with sub-2 seconds latency. For critical actions, the goal is to complete and provide spoken feedback within 2-4 seconds. For longer actions, the system should provide intermediate 'Please wait a moment while I...' messages to maintain caller engagement.


title: End-to-End Latency Budget Breakdown

content: Caller Speech to AIVA Interpretation: ~200-500ms (Telnyx ASR + Gemini inference). AIVA Function Call to Orchestrator: ~100-200ms (Network latency). Orchestrator to Message Queue: ~50ms. Queue to Browser Agent Pickup: ~50-200ms (Depends on worker availability). Browser Action Execution (Playwright/Lux): Fast actions 500ms-1s, Complex actions 1s-5s+. Lux Inference is a key variable - Gemini Flash helps optimize speed. Browser Agent Feedback to Orchestrator/AIVA: ~100-200ms. AIVA Text-to-Speech (TTS) & Playback: ~300-500ms.


title: Browser Action Execution with Playwright/Lux

content: Browser actions are executed via Playwright/Lux. Fast actions (navigate, simple click) take 500ms-1s. Complex actions (multiple steps, data extraction, Lux reasoning) take 1s-5s+. Lux inference speed is critical for live calls - using Gemini Flash helps optimize inference speed for real-time voice interactions.