Research

I work on robotics, perception, and how machines read the people in front of them. Right now that means multimodal AI for autonomous characters.

Efficient Multimodal Tokenization for Real-Time Social Perception in Autonomous Robotic Characters

How does a robot read human social cues in real time? The hard part is fusing vision, audio, and balance data into one stream that's light enough to run on edge hardware like the Jetson Orin, while staying fast enough that the interaction still feels natural.

Multimodal TransformersEdge AISocial RoboticsReal-time SystemsHRI

Build Progress

Build notes on the mechanical design, control systems, and behavior layer for a self-balancing inverted pendulum robot that interacts with people in character.

Mechanical DesignComplete
PID Control LoopComplete
ROS2 IntegrationIn Progress
Behavior LayerPlanned
Social PerceptionResearch

Multimodal tokenization for real-time social perception

In Progress2026

Edge-optimized transformer architectures for robotic perception

Planned2026

Character behavior modeling in autonomous social robots

Planned2025
EOF

Joey Schnepel · Phoenix, AZ · 2026