A mobile application for augmented reality teleoperation of robotic systems, built on Google's ARCore platform.
This project extends the Google ARCore Android SDK to enable AR-based teleoperation. It's designed to work with MujocoAR for robotic simulation and control.
- Android device with ARCore support
- Google Play Services for AR (ARCore) installed
- Camera permissions enabled on your device
- Download the APK from here
- Install the APK on your Android device
- Grant camera permissions when prompted
Clone this repository and build using Android Studio.
-
Set up the server side:
cd samples/hello_ar_kotlin mjpython server/simple.py # This will display a box in the Mujoco environment
-
On your Android device:
- Launch the AR Teleoperation app
- Connect to the server by entering the IP address and port
- Follow the on-screen instructions to establish the connection
For detailed usage instructions, refer to the MujocoAR documentation.
- Thanks to Omar Rayyan for the MujocoAR project and collaboration
- Based on Google's ARCore Android SDK
The application will be available on F-Droid and Google Play Store in future releases.