RISE Research Radar

Computer Science Open House 2022-2025

2025

Talking with a robot

Anders Holst, Nicolas Farre, Nicolas Tsiftes, Joakim Eriksson

Summary

Demonstrates hybrid AI systems combining speech, vision, and language models to control a physical robot arm. Integrates speech recognition (whisper), speech synthesis (piper), large language model (llama3.1), and computer vision (yolo) into a unified system. All models run locally on consumer-grade hardware for privacy.

Themes

roboticsllm

Keywords

multimodal AI, robot control, speech recognition, LLM, computer vision

Poster

Talking with a robot poster

Click image to open full size