ORVYN FIELD GUIDE
MUJOCO 3.X ONLINE
← Return to App Enter Playground ↗
SYSTEM SPECIFICATION // V0.1.0 MUJOCO 3.X KERNEL

Intent.
Into motion.

A MARS mobile manipulator situated in an ordinary apartment. High-fidelity MuJoCo physics, LLM intent translation, deterministic controller judges, and real-time sensor streams.

PHYSICS ENGINE MuJoCo 3.x Deterministic sub-step
CHASSIS PLATFORM MARS Dual-Wheel Differential drive + arm
NETWORK TRANSPORT ~40 ms Loopback Direct socket stream
BENCHMARK JUDGE Innate OS Pinned Spatial goal validation
01 / GETTING STARTED

Give the agent a task.

The ORVYN simulator provides a direct loop between natural language planning, deterministic path controllers, and full rigid-body physics.

STEP 01

Acquire control lease

Open the playground. The web layer negotiates an exclusive control token with the private physics process. Wait for the green “Physics online” indicator and the live camera feed.

STEP 02

Select a scenario

Open Mission / AI from the floating bottom tool dock. Select Explore, Search & Rescue, or Shepherd. Selecting a mission automatically resets the simulation to its authored initial scene.

STEP 03

Execute controller or AI plan

Click Run skill for immediate deterministic trajectory execution. Alternatively, enter a free-form instruction, click Plan with AI, inspect the structured intent review, and click Run reviewed plan.

STEP 04

Safety & emergency brake

Hit SPACE or click ■ Stop in any panel at any moment. The manual watchdog instantly zeroes wheel velocities and brakes the chassis.

💡
Pro Tip: You can drive the MARS robot manually at any time by focusing the camera stage or the Keyboard Driving pad and pressing W A S D or the arrow keys.
02 / ARCHITECTURE

From intent to physics execution.

ORVYN decouples natural language reasoning from low-level joint actuators through a validated deterministic execution pipeline.

INPUT
💬 User Intent Natural Language Prompt
➔
REASONING
🧠 LLM Planner Orbio Model / Intent Router
➔
VALIDATION
⚖️ Innate Judge Deterministic Rules & Goals
➔
PHYSICS
⚡ MuJoCo Kernel Rigid-body Dynamics
➔
PERCEPTION
👁️ Robot Stream JPEG Frames & 2D SLAM Map

The server validates that all proposed motions map to safe, bounded controllers before sending actuator inputs to the MuJoCo simulation worker.

03 / SIMULATION MISSIONS

An ordinary world. Specific goals.

The simulation tests embodied agent competence across navigation, search, and dynamic object manipulation inside an authentic residential layout.

MISSION 01 FREE ROAM

Explore the Apartment

A bounded autonomous scan and drive lasting approximately 30 simulation seconds. The robot navigates Parquet hallways and living areas, discovering room bounds.

  • Scoring Occupancy coverage (non-scored)
  • Target Apartment boundaries
  • Duration ~30 simulation seconds
Test in Playground ↗
MISSION 02 BENCHMARK CHALLENGE

Search & Rescue

Approach the human avatar seated in the living room and remain nearby. The pinned Innate challenge judge monitors continuous proximity and ordered find-and-hold spatial constraints.

  • Scoring Innate Benchmark Judge
  • Target Human avatar (spatial radius)
  • Condition Find and hold proximity
Launch Challenge ↗
MISSION 03 DYNAMIC CONTACT

Shepherd

Reach the soccer ball within 0.8 meters, then physically push it with the chassis and articulated bumper to within 1.2 meters of the dog avatar. Tests multi-step continuous contact mechanics.

  • Scoring Upstream Physics Evaluator
  • Target Soccer Ball ➔ Dog Avatar
  • Tolerance Ball < 0.8m, Dog < 1.2m
Test in Playground ↗
⚠️
Deterministic Controller Note: Built-in controllers use the ground-truth occupancy map and object coordinates. Collisions or blocked paths can occur under dynamic interactions; use Reset or ■ Stop to recover.
04 / ROBOT KINEMATICS

MARS mobile manipulator specs.

MARS combines a stable differential mobile base with an articulated inspection manipulator and binocular stereo head.

Subsystem Specification Simulation Parameter
Drive Kinematics Dual-wheel differential drive + passive casters Linear velocity 0.22 m/s, angular 0.65 rad/s
Perception Head Binocular camera sensor mounted at eye level Perspective projection, real-time JPEG stream
Manipulation Arm High-visibility articulated yellow linkage Forward contact bumper and spatial probing
Occupancy Sensor 2D Ground-truth simulation SLAM projection Occupancy grid cells, resolution = 0.05 m
Safety Watchdog Heartbeat monitor on manual drive inputs 350 ms timeout automatic brake
05 / WORLD & PERCEPTION

Ground-truth vs sensor feed.

In ORVYN, the robot perceives its environment through two distinct modalities:

MODALITY 01

MuJoCo Binocular Camera

The primary visual stream rendered from MARS’s viewpoint. The camera captures authentic perspective, lighting, Parquet floors, furniture, and environmental obstacles. The View panel allows toggling between Fill viewport and Full camera frame.

MODALITY 02

2D Occupancy Map

The Map panel displays ground-truth coordinates computed directly by the physics engine. MARS is plotted as a vibrant lime circle with heading vector; interactive props (soccer ball, avatar, dog) are marked with high-contrast color pins.

06 / AI PLANNING

Review intent before motion.

The backend translates natural language prompts into bounded robotic intent via the configured Orbio chat model.

The model can select strictly from four authorized symbolic skills: explore, rescue, shepherd, or stop. An AI plan is a hypothesis, not a guarantee of task completion: the physics simulation must physically execute the trajectory and satisfy upstream spatial judges.

ai-intent-router.json SCHEMA
{
  "intent": "Find the person and stay nearby",
  "plan": {
    "skill": "rescue",
    "summary": "Navigate toward human coordinates and maintain <1.2m proximity",
    "parameters": { "target": "human", "tolerance_meters": 1.2 }
  },
  "reviewed": false
}

The human-in-the-loop interface requires selecting Run reviewed plan after inspecting the model’s intent summary, ensuring transparent agent behavior.

07 / GUARDRAILS & LIMITS

Security and rate limiting.

ORVYN enforces strict server-side boundaries to protect compute resources and model API allocations:

  • API Rate Limit: Requests are throttled to one every 15 seconds, and capped at 20 per hour across active sessions.
  • State Invalidation: Triggering manual driving, pressing Stop, clicking Reset, or closing the playground immediately invalidates any pending or reviewed AI plan.
  • Zero Client Storage: Credentials and model keys remain exclusively in server process memory. The browser never receives or stores secret keys.
  • Deterministic Fallback: Built-in skill controllers and manual controls operate independently of AI availability, requiring zero provider balance.
08 / PILOTING & CONTROLS

You keep the controls.

Take manual control over the MARS mobile base at any moment using keyboard keys, touch buttons, or the virtual directional pad.

W or ↑
Drive Forward (0.22 m/s)
S or ↓
Drive Backward (-0.15 m/s)
A or ←
Turn Counter-Clockwise (0.65 rad/s)
D or →
Turn Clockwise (-0.65 rad/s)
SPACE
Emergency Brake (Instant Stop)
ESC
Close Active Panel / Exit to Landing

Keyboard driving activates when either the Camera stage or the Keyboard Driving pad is focused. Keyboard events inside inputs or menus do not move the robot.

09 / SAFETY & WATCHDOG

Fail-safe mechanical watchdogs.

Robotic control requires active liveness verification. ORVYN implements a multi-layer watchdog:

350 MS MANUAL WATCHDOG

Every manual velocity command is bounded. If the client fails to renew drive ticks within 350 ms, the physics engine automatically applies mechanical brakes.

90 SECOND SESSION LEASE

Exclusive control tokens expire after 90 seconds without user heartbeat, automatically freeing the simulator for subsequent sessions.

RELEASE ON EXIT

Closing the modal or navigating away sends an asynchronous /api/release signal that halts actuators and releases the hardware locks.

10 / PRIVATE ACCESS

Running on private infrastructure.

The ORVYN deployment runs securely on server loopback ports, isolated from unauthorized external access. The web server listens on port 8092 and forwards validated API requests to the physics daemon on port 8091.

ssh - port-forwarding.sh
ssh -N -L 8091:127.0.0.1:8092 web3
# Open http://127.0.0.1:8091 in your browser
11 / REMOTE EXECUTION

Provisioning AI sessions securely.

For an approved AI planning session, invoke the secure remote starter script from the ORVYN root directory:

bash - secure-remote.sh
sh scripts/start-secure-remote.sh
# Enter the approved model ID and API key at the masked terminal prompt
🔒
Security Rule: The API key is held in session-only memory. Keep the terminal open; pressing Ctrl+C terminates the session and restores the keyless physics daemon. Never paste API keys into chats, repositories, or browser forms.
12 / PROVENANCE & CREDITS

Know what you are seeing.

The landing page features editorial concept visualizations. Inside the simulator, the feed is generated in real time by the actual MuJoCo physics camera, rendered at calibrated resolution and refresh rate.

This is simulated embodied AI research, not physical-robot deployment. No financial tokens, wallets, or on-chain mechanisms are required or active.

Built upon Innate OS, revision 4be109a501aa8fd5fb69d11394b878592e53789e. Apache 2.0 license and Creative Commons apartment asset credits are preserved in ATTRIBUTION.md. Motion and visualization utilize Three.js and Anime.js (both MIT licensed).