Skip to content

LeapRobot & Embodied Intelligence - #52

Merged
wangxingjun778 merged 4 commits into
mainfrom
feat/framework_enhance
Oct 8, 2026
Merged

wangxingjun778 merged 4 commits into
mainfrom
feat/framework_enhance

Conversation

@wangxingjun778

Copy link
Copy Markdown
Member

LeapFlow — LeapRobot & Embodied Intelligence

Feature

  • Introduced LeapRobot: governed robot control, local/remote VLA inference, real-time control, and post-operation verification.
  • Added physical teaching workflows for teleoperation and kinesthetic recording, with optional Parquet/MP4 episode export.
  • Added fleet operations and progressively disclosed hardware-context snapshots for LLM planning.

Enhance

  • Added hc.v1 hardware descriptors, robot-arm and ROS 2 transports, Feetech support, and optional leapflow[robot] / leapflow[robot-ros2] dependencies.
  • Added centralized hardware health monitoring with configurable degradation responses, including halt, hold position, safe return, and sensor fallback.
  • Connected physical-environment observations and session-scoped runtime metrics to the daemon and self-awareness surfaces.

Refactor

  • Refactored the Hardware Context Protocol around separate device descriptors, providers, transports, and governed execution boundaries to simplify extensibility.

Phase 0: HCP bridge + BatchTransport + high-speed sampling
Phase 1: VLA inference + PhysicalSkillPlugin + operation verification
Phase 1.5: Runtime safety/trust/degradation enforcement + interface fixes
Phase 2: HighFrequencyControlBus + RT control loop (PID/Impedance/PolicyChain)
Phase 3: System-1/1.5/2 control hierarchy + TaskDecomposer
Phase 4: Fleet deployment management (FleetManager + MCP bridge)
Phase 5: LHP IR Gateway (LLM-Hardware intermediate representation)

LeapRobot core: absorbed inference-side source (zero lerobot dependency)
Brand: unified LeapRobot naming, leapflow[robot] extras
hc.v1: declarative hardware descriptors with kinematics/capability/safety/trust/degradation

Includes:
- 12 HCP hardware tools (hw_read/write/actuate/batch_actuate/halt/control_start/stop/status/orchestrate/fleet)
- 3 inference strategies (VLA local/remote, position control)
- Physical teach/learn extension (/teach --mode=teleop/kinesthetic)
- Episode recording + Parquet/MP4 export
- Physical capability resolver (four-value adjudication)
- 3 PCD levels for hardware context (minimal/task_relevant/rich_context)

Tests: 5000+ passed, 0 regressions
…itor

- ControlHierarchy: PhysicalSkillPlugin creates per-device hierarchy on demand
- LHPGateway: exposed as hw_context_snapshot tool for LLM context queries
- FleetManager: instantiated in daemon when fleet_nodes configured, hw_fleet_* tools registered
- HardwareHealthMonitor: centralized health supervision + full DegradationPolicy execution
  (halt/hold_position/safe_return/switch_sensor/continue_blind)
@wangxingjun778
wangxingjun778 merged commit 79b1119 into main Oct 8, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant