We are able to conduct green ball detection end-to-end pipeline using ESP 32 Cam

The closed-loop communication figure:

We are now able to transfer detected data (X,Y) position of the center of the green ball) to Esp32 feather board

1. ESP 32 Camera (as an Access Point) broadcast video it saw
2. PC Receive it under ESP32CAM HotSpot
3. On PC (with CUDA) using Python Process It locally
4. If detected, feed the ( x, y ) data out of a serial port, which connects to a ESP 32 board (Master - Transmitter ); Otherwise, Feed (-1, -1)
5. ESP 32 board (Slave - Receiver) is able to receive the information
   • Whether we have detected ball or not
   • If detected, what is the (x,y) position of the ball.

Note:

1. This setup does not require WiFi connection. The ESP32 broadcast its own hotspot, and ESP 32 Tx and Rx are peer-to-peer connections.
2. The ML code, written by Aaron is very robust. It can detect the balls with very great confidence.

Next:

1. More information can be sent other than (x,y). Also area, and distance.
2. Put it onto the blimp system

Next Post Previous Post