Built on OpenAI's Realtime API. Connection to Data Warehouse, Text-to-SQL, Statistical Analysis, Web Scrape, Charts, Python Processing and Automation.
Text and voice-input options (non-realtime) also live.
OpenAI recently released it advanced sound mode via its Realtime API. Wanted to test it out. REX-1 was the result
✔ 𝐓𝐫𝐲 𝐢𝐭 𝐡𝐞𝐫𝐞: Realtime Analytics Assistant
▸Web version. Best on full screen.
▸Realtime features need an API key. API Costs: ~$1/min.
▸Non-realtime with voice input: Free to use, but some features require DB credentials. Ignore the OpenAI key popup or enter random digits to close it. Click on the Task Agent or Yahoo Finance Agent to get started. Ask the agents what they can do, and you’re good to go.
✔ 𝐑𝐄𝐗-𝟏 𝐂𝐚𝐩𝐚𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬:
▸Connect to Data Warehouses (AWS, Azure, MySQL)
▸Text-to-SQL, Data Analysis & Transformation
▸Statistical Analysis & Python Charts
▸Websites Scraping
▸Stock Market Technical Charts & Data
▸Reporting Automation (Trackers, PDFs, Emails)
✔ 𝐘𝐨𝐮𝐓𝐮𝐛𝐞 𝐕𝐢𝐝𝐞𝐨
'𝐻𝑜𝑤 𝑡𝑜 𝐵𝑢𝑖𝑙𝑑 & 𝐷𝑒𝑝𝑙𝑜𝑦 𝑅𝑒𝑎𝑙𝑡𝑖𝑚𝑒 𝐴𝑃𝐼 𝐴𝑛𝑎𝑙𝑦𝑡𝑖𝑐𝑠 𝐴𝑠𝑠𝑖𝑠𝑡𝑎𝑛𝑡 𝐴𝑔𝑒𝑛𝑡 𝑆𝑦𝑠𝑡𝑒𝑚' . (90 mins). https://lnkd.in/gJ_pyhjW
See time stamped table of contents below
✔ 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠𝐬 𝐚𝐧𝐝 𝐢𝐧𝐬𝐢𝐠𝐡𝐭𝐬
▸Performance is mind blowing and pricing blows your purse.
▸$1 per minute or realtime , while text (with voice input ) less than $1 over hours of use.
▸Prices may drop by a tenth in 6-9 months, giving early developers a first mover advantage
▸WebSockets and other approaches offer near realtime alternatives
▸If use case allows, Custom GPTs very cost-effective; agents can be connected easily
▸Deploy with various agent setups (sequential, specialized, master, backend etc). Architecture depends on the use case.
✔ 𝐁𝐚𝐬𝐢𝐜 𝐁𝐮𝐢𝐥𝐝
𝐅𝐫𝐨𝐧𝐭𝐞𝐧𝐝: TypeScript (OpenAI quick start repo)
𝐋𝐋𝐌 𝐀𝐠𝐞𝐧𝐭𝐬: Flowise AI. Agent API access, nested agents, code interpreter, FastAPI integration, rapid deployment, voice input. Open source with self-hosting option. FlowiseAI (YC S23) makes it incredibly easy to build and deploy complex apps quickly.
𝐖𝐨𝐫𝐤𝐟𝐥𝐨𝐰 automation: Make.com.
𝐅𝐚𝐬𝐭𝐀𝐏𝐈 𝐂𝐮𝐬𝐭𝐨𝐦 𝐒𝐞𝐫𝐯𝐞𝐫𝐬: for DW connectivity and custom python processing
✔ 𝐒𝐨𝐮𝐫𝐜𝐞 𝐂𝐨𝐝𝐞 𝐉𝐒𝐎𝐍𝐬, 𝐒𝐜𝐡𝐞𝐦𝐚𝐬 𝐚𝐭:
✔ 𝐀𝐝𝐝𝐢𝐭𝐢𝐨𝐧𝐚𝐥
1. Five-part detailed hands-on implementation guide to build AI Analytics Voice Based Assistant
Table of Contents and Resources: https://link.tigzig.com/NMMWmZ
Data Warehouse Text-to-SQL guide: https://link.tigzig.com/8s9ffG
OpenAI Realtime API Docs: https://link.tigzig.com/tvbNGe
✔ 𝐘𝐨𝐮 𝐓𝐮𝐛𝐞 𝐓𝐢𝐦𝐞 𝐒𝐭𝐚𝐦𝐩𝐬 / 𝐓𝐚𝐛𝐥𝐞 𝐨𝐟 𝐂𝐨𝐧𝐭𝐞𝐧𝐭𝐬
00:04 - Introduction and Demo of tool capabilities
02:01 - Agenda for video
02:33 - Detailed Demo
17:34 - Performance and Pricing Details
24:37 - Architecture Overview
Frontend, APIs, backend agent setup, tool by tool overview of all tools
38:54 - Build Step 1: Setting up user interface
44:45 - Build Step 2: Setup backend LLM Agents and Tools in Flowise
48:18 - Database Tool
51:57 - Reporting Automation Tool
55:59 - Website Scraper Tool
1:00:20 - Document Update Tool
1:02:28 - Code Interpreter Tool
1:05:28 - Yahoo Finance Agent
1:11:04 - Google Custom Search Tool
1:13:40 - Build Step 3: Connecting Backend to Frontend
1:25:12 - Conclusion
✔ 𝐂𝐚𝐯𝐞𝐚𝐭𝐬:
Prototype app. Working prototype.