Skip to main content

Virtual Joystick Overview

tip

This tutorial builds off of the Tutorial Introduction and the Camera Streamer Tutorial, so please check those out if you have not already.

This example application and tutorial is designed to enable you to develop your own custom applications and deploy them to the Amiga brain. The goal of this tutorial is to take you step-by-step from the template repository to the full virtual-joystick example. Then you can mirror what you've done here in your own custom app development!

On the brain, there are multiple gRPC services running in the background, including the oak camera service and the canbus service. We will teach you how to interact with these two services through the camera client and canbus client, respectively. We will also show you how to create a basic kivy application, a custom kivy widget, and use gRPC and asyncio in that application.

The topics covered in this tutorial include:

  • Creating kivy applications
  • Custom kivy widgets
  • GRPC / asyncio application development
  • Streaming an Oak camera with the camera client
  • Streaming Amiga state information with the canbus client
  • Auto control mode of Amiga robot with the canbus client
info

We hope that after completing this tutorial, and the predecessors, you are prepared to develop your own custom Amiga brain applications on the Amiga brain. If you feel we missed any key details, please let us know at discourse.farm-ng.com so we can help you through it and add it to the tutorial for everyone else to benefit from!

Block diagram​

flowchart BT; subgraph kivy_window direction LR VirtualJoystickWidget ImageTexture Displayed_Labels end subgraph AmigaOS OakCameraServices CanbusService end subgraph VirtualJoystickApp VirtualJoystickWidget -- commands --> CanbusClient CanbusClient -- measured rates --> Displayed_Labels OakCameraClient -- decoded jpeg --> ImageTexture end subgraph OakCameraServices direction LR Oak0 Oak1 Oak2 Oak3 end Oak0 -- streamFrames rpc --> OakCameraClient CanbusService -- streamCanbusMessages rpc --> CanbusClient CanbusService <-- sendCanbusMessage rpc --> CanbusClient