myron 56c9e2d914 Phase 4: Vision Protocol — screenshot + Claude vision
- reactor.py: v4.0.0; adds screenshot, vision, sysinfo handlers;
  _dispatch_agent_command() shared helper; FastAPI /screenshots endpoints
- jarvis-agent.py: v3.0; screenshot command handler (scrot/import/fbcat/
  ImageMagick render fallback); sysinfo command returns structured snapshot;
  detect_capabilities() advertises screenshot + sysinfo caps
- chat.php: Tier 0.9c detects screenshot (show screen on X, screenshot X)
  and sysinfo (check status of X) voice/text commands
- arc.php: screenshots, screenshot_get, screenshot_delete actions
- index.html: VISION PROTOCOL lightbox overlay; SCREENSHOT + SYSINFO
  buttons on each online agent card; keyboard Escape to close
- admin/index.php: VISION PROTOCOL tab under ARC REACTOR nav; gallery view
  with image thumbnails + analysis; take screenshot modal; purge action
2026-06-11 04:42:21 +00:00

JARVIS

Iron Man-style AI assistant for home and network management.

Features

  • Home Assistant control (lights, climate, scenes, switches)
  • Proxmox VM management (start/stop/status)
  • 4-tier chat: KB intents > Groq cloud > Ollama local > Claude API
  • Real-time status bar (HA, Proxmox, DigitalOcean)
  • Iron Man HUD at jarvis.orbishosting.com

Stack

  • PHP 8.x / Apache / MySQL on Ubuntu 24.04
  • Ollama VM at 10.48.200.95 (llama3.2:1b)
  • Groq API (llama-3.3-70b / compound-mini with web search)
  • Claude API (Anthropic) final fallback

Setup

cp api/config.example.php api/config.php Fill in all credentials in config.php before running.

Key Files

  • public/index.html Iron Man HUD frontend
  • public/api.php API router
  • api/config.example.php Config template
  • api/endpoints/chat.php 4-tier chat handler
  • api/endpoints/facts_collector.php HA entity sync cron
  • api/lib/kb_engine.php KB intent engine
  • api/lib/db.php PDO database wrapper
S
Description
Mirror of github.com/myronblair/jarvis
Readme 856 KiB
Languages
PHP 43.3%
Python 29.9%
JavaScript 14.9%
CSS 6.2%
Shell 2.2%
Other 3.5%