Skip to main content

Performance

Why Performance Matters​

When running AI on modest hardware, every millisecond and megabyte counts. Llumen is engineered from the ground up for efficiency.

Resource Requirements​

Minimum Specs​

These are the absolute minimum requirements:

ComponentRequirement
CPU1 core, 1 GHz
RAM256MB available
Storage50MB
Network1 Mbps

Example devices:

  • Raspberry Pi 3B+
  • Old laptops (5+ years)
  • Budget VPS ($3-5/month)
note

50MB is insufficient if you plan to upload file.

Optimization Tips​

For Minimal Devices​

Reduce memory usage
  • Set SQLite page cache size(default 128MB)
  • Limit conversation history length
  • Disable image generation
  • Use text-only responses
Improve response time
  • Choose faster API providers
  • Use smaller language models
  • Enable response caching
  • Optimize network path

Trade-offs​

Llumen makes deliberate trade-offs for performance:

What We Optimized For​

  • ✅ Fast startup
  • ✅ Low memory usage
  • ✅ Small binary size
  • ✅ Efficient streaming
  • ✅ Mobile performance

What We Don't Do​

  • ❌ Built-in model hosting
  • ❌ Heavy analytics
  • ❌ Complex plugins
  • ❌ Bloated features

This keeps llumen lean and fast for its core purpose.