16 May

Andruino Progress

Jiale (Jack) He

Andruino

Andruino is a project that I started after the idea of a phone controlled paper robot got brought up in my research group. Smartphones are almost ubiquitous in our everyday life meaning that everybody has the means to provide a cheap paper robot with a collection of advanced sensors and a powerful processor without having to go out of their way to purchase extra parts.

I started the project by first looking into what phones I could use and how the devices could communicate by simply putting them together through a USB connection. One guide in particular suggested that I simply needed an adapter to connect a phone and an arduino, and also provided most of the code for an Android app that would implement serial communication between the two. This was a very good step in the right direction and I was able to send strings of text to the arduino. I then had code on the arduino that would interpret and run the received instructions. Examples would be: "led on", "led off", "sweep servo".

Link to tutorial.

The next step was to use built in sensors in the phone to provide information to the microcontroller. I started by trying to implement the accelerometer. Having no Android programming experience it was initially a rather unintuitive process to me and I spent a lot of time trying to have it do exactly what I wanted. I was successful in the end and was able to map the phone's inclination to a servo's angle as a demonstration.

After that, I took a step back to think of the details of how I would implement a phone controlled robot. The current app only allows written commands to be sent to the Arduino but if the robot were to be moving it would be impossible to use the touchscreen therefore I needed to use a different method to provide input. The first one that came to mind was voice control. After some research I found that Android has a library dedicated to voice-to-text. As I am getting more familiar with the Android IDE, implementing it was relatively painless and I am now able to send the same instructions by saying them instead of writing them. One problem I have ran into is that the phone stops looking for input after a while if none is detected and then I have to restart voice recognition manually while I need the phone to continuosly look for input so that the robot can work for an indefinite amount of time.

Jack He

Video: WIN_20170516_00_06_01_Pro.mp4

Next Post Previous Post

Search

Popular Tags

foray origami robots blimp ducky vr edg SLAM computer vision computational design roco slam Origami rocolib arduino RoCo design Robot Compiler simulation Motion Planning autonomy edg-model create; kalman filter; mesh reinforcement learning; multi-agent; mean-field; logics imu contacts mesh network motors esp32 friction networking tank dynamics pushing auxetic esp now machine learning multi-agent visual processing communication wireless control i2c webapp ROCO pcbs structure path planning computer skill cars openmv Robotica reinforcement learning power consumption modeling origami dataset test visual odometry surface structure dash port-arrays Battery DARPA motor gondola machine vision controller semantic paper auxetics infrastructure feedback gestural interface frequency diversity mixed reality robot Consensus bistable auxetic unit cell gestural intuition crawler darpa; create; logic create; kalman filter; EM; structures Foray network open house propeller lidar sensors apriltags 433mhz optimization Quantum Information 4-wheeled FORAY perception control environmental design refactoring icra2021 radio Kullback-Leibler Divergence crazyflie DER Auxetics lasercutter distributed optimization blynk gate von Mises Fisher Distribution pushing problem experiment results or nodemcu offline reinforcement learning exam research proposal conference object detection simulink webots project management modeling contacts tutorial thrust IR motor configuration integration test localization UAV legs joystick altimeter decentralized ros2 balloon test painlessmesh mesh networking swarm vision processing arnhold matlab fusionbot RL arduino nano multi-agent path planning gazebo PCB rviz2 nonholonomic systems Integrated Demo reinforcement learning; slam; paper review vision Short Post trajectory optimization edg-examples serial monitor python Model-Free Machine Learning Q-Learning rssi controls feedback-controlled grant writing system ID multirobot system signal strength quasi-static pushing marginal cost pricing in-situ design IROS neural network hot plates cell reinforcement learning; multi-agent; mean-field; game theory; mean field; reinforcement learning current reinforcement learning; multi-agent; Xbee Zigbee robot compiler origami robot deployment spi dynamic modeling rhino boat literature review multipack buoyancy equations contact surp paper review Writing motorized boats throughput range surfaces ML reservoir computing multi-agent path finding solar cars detectionrate distance shape color edg-ide pain Characterization tool concept surface contact liquid crystal elastomer conferences release peripheral device differential keyboard swarm control car von Mises-Fisher von Mises Fisher port-array quasi-static modeling Kalman Filter Zero Elastic Energy modes Liquid Crystal Elastomers Discrete Elastic Rods Consensus Algorithms power pivoting Learning 3D-CHESS; kinematic_model elastic polymers 2.4 GHz 433 MHz creative Computer skill internal misc edg-refactoring 433 ceres debug coriolis force structured field dynamic model proposal wtf deep learning interpolation wireless signal strength reinforcement learning; multi-agent; decentralized reinforcement learning; multi-agent; mean-field; stationary demo video flytrap papers steering plastic multi-object tracking pvdf prelab actuation von Mises Distribution Barycenter Multi-Agent Systems integration flapping color_segmentation center of friction lab_data result segmentation on multiple object and centers finding competition ZMP buoyancy current sensor multiple blimps battery pid defender Synthesizable Radio integrated system 3d printing catching mechanism kalman filter barometer detection balloon slam; flowchart; depth estimation grid chiral square unit cell state space multi-robot pressure distribution model prediction thrust configuration kalman filter; ESP32 paper cutter COVID 19 manipulation fabrication code hardware offline Rl firmware protobuf #activecapturingmechanism #claw ensemble methods Bayesian networks 3D-CHESS; kalman filter bootstrapping model-based RL boxboat tracking lift force cad nylon scenic adaptive control motor driver MIMO communications Euler-Bernoulli beam newton's method spring-mass submission kalman filtering point cloud 2.4ghz latency der codesign sma-based actuator presentations machine training cameras preliminary exam multiple devices inkscape material delta tolling semantic segmentation instance segmentation pdms silicone optitrack multirobot solidworks ICLR design tool board design HDL pixracer pixhawk ardupilot flight controller regression fly test motor distribution Python DNN ICRA game theory ICML guassian processes probabilistic neural networks graph generators MBRL ide batch learning ros sensor fusion von Mises-Fisher Distributions edg-compiler Bessel functions iot