Skip to main content

ai

ai — ɳSelf documentation.

AI Plugin

Multi-provider AI inference service with prompt marketplace and consensus mode. Max plugin.

Requires: A paid bundle license or ɳSelf+. nself license set nself_pro_...

Install

nself license set nself_pro_xxxxx...
nself plugin install ai

What It Does

Runs a unified AI inference service supporting 7 providers: OpenAI, Anthropic, Gemini, Groq, Mistral, Ollama, and custom endpoints. Implements a 3-layer request pipeline (pre-processing → inference → post-processing), prompt marketplace for sharing and reusing prompts, consensus mode for multi-model agreement, and shadow testing to compare providers without affecting production. Required by the claw, mux, and voice plugins.

Configuration

Env Var Default Description
AI_PORT 3709 AI service port
AI_DEFAULT_PROVIDER openai Default inference provider
OPENAI_API_KEY none OpenAI API key
ANTHROPIC_API_KEY none Anthropic API key
GEMINI_API_KEY none Google Gemini API key
GROQ_API_KEY none Groq API key
MISTRAL_API_KEY none Mistral API key
OLLAMA_HOST none Ollama server URL (for local models)
AI_CONSENSUS_THRESHOLD 0.7 Agreement threshold for consensus mode

Ports

Port Purpose
3709 AI inference REST API

Database Tables

6 tables added to your Postgres database:

  • np_ai_providers: provider configurations and status
  • np_ai_prompts: prompt marketplace entries
  • np_ai_requests: inference request log
  • np_ai_responses: response cache and audit log
  • np_ai_pipeline_configs: 3-layer pipeline configurations
  • np_ai_shadow_tests: shadow testing results

Nginx Routes

Route Target
/ai/ AI inference API

API

GET  /health: Health check
POST /chat: Chat completion (OpenAI-compatible)
POST /complete: Text completion
POST /embed: Embeddings
GET  /providers: List available providers
GET  /models: List available models
POST /prompts: Save to prompt marketplace
GET  /prompts: Browse marketplace

Used By

  • claw: AI agent reasoning
  • mux: Email/message classification
  • voice: Speech transcription and synthesis