113 lines
2.8 KiB
Markdown
113 lines
2.8 KiB
Markdown
# MoltMobile 📱
|
|
|
|
**Molt in your pocket** — The mobile extension for Molt AI assistant.
|
|
|
|
MoltMobile gives Molt physical presence through your Android phone:
|
|
- 👀 See (camera, screenshots)
|
|
- 👂 Hear (microphone, call audio)
|
|
- 🗣️ Speak (TTS via MiniMax)
|
|
- 📍 Know where you are (location)
|
|
- 🔔 See your notifications
|
|
- 📞 Handle your calls
|
|
- 🚨 Get your attention when it matters
|
|
|
|
## Features
|
|
|
|
### 📞 Smart Call Handling
|
|
- Answer/reject calls via gateway command
|
|
- Spam detection and auto-response (TTS)
|
|
- Known caller greeting
|
|
- Call audio streaming (coming soon)
|
|
|
|
### 🔔 Notification Relay
|
|
- All notifications forwarded to Molt
|
|
- Action execution (reply, dismiss, etc.)
|
|
- Smart filtering
|
|
|
|
### 🔊 Voice (MiniMax Integration)
|
|
- TTS playback on device
|
|
- Audio recording for STT (coming soon)
|
|
- Real-time voice conversations (coming soon)
|
|
|
|
### 🚨 SUPER ATTENTION MODE
|
|
When Molt needs you NOW:
|
|
- Volume MAX (bypasses DND)
|
|
- Screen strobe (red/white)
|
|
- Camera flash strobe
|
|
- Continuous vibration
|
|
- Alarm sound loop
|
|
- Full-screen alert
|
|
- Only stops when you acknowledge
|
|
|
|
### 🌐 Remote Browser
|
|
Molt can control Chrome on your phone:
|
|
- Open URLs
|
|
- Execute JavaScript
|
|
- Take screenshots
|
|
- Navigate pages
|
|
|
|
## Architecture
|
|
|
|
```
|
|
Your Phone (MoltMobile app)
|
|
↓ WebSocket
|
|
MoltMobile Gateway (server)
|
|
↓
|
|
MiniMax API (LLM + TTS)
|
|
↓
|
|
Molt/Clawdbot (escalation)
|
|
```
|
|
|
|
## Setup
|
|
|
|
1. Install the app on your Android phone (Android 10+)
|
|
2. Grant permissions (notifications, calls, microphone, camera)
|
|
3. Ensure phone is on Tailscale network
|
|
4. App auto-connects to gateway at `ws://100.123.216.65:9878`
|
|
|
|
## Commands (from Gateway)
|
|
|
|
| Command | Description |
|
|
|---------|-------------|
|
|
| `audio.play` | Play TTS audio (hex or base64) |
|
|
| `audio.stop` | Stop playback |
|
|
| `audio.volume.max` | Set volume to maximum |
|
|
| `attention.super` | 🚨 SUPER ATTENTION MODE |
|
|
| `attention.stop` | Stop attention mode |
|
|
| `browser.open` | Open URL in remote browser |
|
|
| `browser.navigate` | Navigate to URL |
|
|
| `browser.js` | Execute JavaScript |
|
|
| `browser.screenshot` | Capture screenshot |
|
|
| `browser.close` | Close browser |
|
|
| `call.answer` | Answer incoming call |
|
|
| `call.reject` | Reject incoming call |
|
|
| `call.hangup` | Hang up active call |
|
|
| `notification.action` | Trigger notification action |
|
|
|
|
## Permissions Required
|
|
|
|
- **Internet** — Gateway connection
|
|
- **Notifications** — Relay to Molt
|
|
- **Phone/Calls** — Call handling
|
|
- **Microphone** — Voice recording
|
|
- **Camera** — Flash for attention mode
|
|
- **Vibrate** — Attention mode
|
|
|
|
## Building
|
|
|
|
```bash
|
|
cd moltmobile-android
|
|
./gradlew assembleDebug
|
|
```
|
|
|
|
APK will be at `app/build/outputs/apk/debug/app-debug.apk`
|
|
|
|
## Version History
|
|
|
|
- **0.2.0** — Renamed from ClawdNode, added MiniMax audio, SUPER ATTENTION MODE, remote browser
|
|
- **0.1.0** — Initial release (as ClawdNode)
|
|
|
|
---
|
|
|
|
*MoltMobile — Molt in your pocket.*
|