01 Feb

FORAY - Monocular Depth Estimation

Parth Agrawal

I reimplemented the Gtech paper for primitive monocular depth estimation. It works relatively well but requires a certain measurement of the object before the estimation. Reference - N. Yao, E. Anaya, Q. Tao, S. Cho, H. Zheng and F. Zhang, "Monocular vision-based human following on miniature robot...

01 Feb

FORAY - Pipeline for running model on Laptop

Parth Agrawal

To explore another method for object detection, I have built the pipeline to stream the video feed from the camera to the laptop and run the model on the video stream. Therefore, we now have the functionality to use any ML / neural network model for object detection Github Repo - https://github.co...

01 Feb

FORAY - On Device ML

Parth Agrawal

I explored the idea of running object detection on the microcontroller itself. I explored the following libraries – Tensorflow Lite ESP WHO Eloquent Conclusion – I found the TensorFlow lite library extremely unstable. There are many bugs in the repo. I was not able to build a single exampl...

05 Nov

FORAY - multiple peripheral devices connected to the same laptop

Parth Agrawal

In case, we have a limited number of laptops to connect the game controllers and master devices. This experiment shows that multiple game controllers can be connected to the same laptop for communication. The current communication system is limited by the number of ports. We can overcome this limita...

21 Oct

FORAY - Integrated System ( Joystick Controller + 2.4 GHz Communication + Motors)

Parth Agrawal

Specifications of the system - Blimp with 2 motors used for horizontal propagation connected to ESP32 microcontroller (Slave Device) NodeMCU with ESP 8266 acting as the master device 2.4GHz with ESP Now protocol is used for communication between the 2 devices A joystick controller is used...

21 Oct

FORAY - Controlling Multiple NodeMCU using Controller

Parth Agrawal

This experiment demonstrates that by using ESP Now protocol we have the capability to control multiple blimps from a single joystick controller. We can switch between different control modes at the click of a button. In the following video - 1 ESP32 microcontroller is connected to the motors. 1...

07 Oct

Using Peripheral Device to Control Motors using ESP NOW

Parth Agrawal

I was looking for ways to control the motors using peripheral hardware. I initially used Keyboard to control the motors. The input characters were sent to an ESP32 device (Master) via serial communication. The data was sent to another ESP32 device (Slave) connected to the motor drivers. I used a 2.4...

28 Sep

FORAY Integration Test - Motor Driver + WIFI

Parth Agrawal

Microcontroller - ESP32 Motor Driver - TB6612FNG Dual Motor Driver Propeller Size - 45mm (diameter) Communication - WIFI Module using Blynk I also found out that ESP32 does not have a native implementation of the AnalogWrite function. This has led to problems for PWM. I will look for a...

09 Sep

Experiment Results II - Communication

Parth Agrawal

I determined the change in the signal strength of the network due to metal interference. I used the same setup as the previous experiment. Received Signal Strength Indicator (RSSI) was used as a metric to measure signal strength. ESP32 WIFI (2.4 GHz) A point to point connection was established u...

02 Sep

Experiment Results - Communication

Parth Agrawal

Motivation The objective of the experiments was to test various communication methods (different protocols and frequency) under different conditions. I am using the following communication devices – ESP32 Wifi Module – 2.4GHz ESP32 Bluetooth Low Energy – 2.4 GHz NRF24L01 module - 2.4GHz Lo...

Search

Popular Tags

foray origami robots blimp ducky vr edg SLAM computer vision computational design roco slam Origami rocolib arduino RoCo design Robot Compiler simulation Motion Planning autonomy edg-model create; kalman filter; mesh reinforcement learning; multi-agent; mean-field; logics imu contacts mesh network motors esp32 friction networking tank dynamics pushing auxetic esp now machine learning multi-agent visual processing communication wireless control i2c webapp ROCO pcbs structure path planning computer skill cars openmv Robotica reinforcement learning power consumption modeling origami dataset test visual odometry surface structure dash port-arrays Battery DARPA motor gondola machine vision controller semantic paper auxetics infrastructure feedback gestural interface frequency diversity mixed reality robot Consensus bistable auxetic unit cell gestural intuition crawler darpa; create; logic create; kalman filter; EM; structures Foray network open house propeller lidar sensors apriltags 433mhz optimization Quantum Information 4-wheeled FORAY perception control environmental design refactoring icra2021 radio Kullback-Leibler Divergence crazyflie DER Auxetics lasercutter distributed optimization blynk gate von Mises Fisher Distribution pushing problem experiment results or nodemcu offline reinforcement learning exam research proposal conference object detection simulink webots project management modeling contacts tutorial thrust IR motor configuration integration test localization UAV legs joystick altimeter decentralized ros2 balloon test painlessmesh mesh networking swarm vision processing arnhold matlab fusionbot RL arduino nano multi-agent path planning gazebo PCB rviz2 nonholonomic systems Integrated Demo reinforcement learning; slam; paper review vision Short Post trajectory optimization edg-examples serial monitor python Model-Free Machine Learning Q-Learning rssi controls feedback-controlled grant writing system ID multirobot system signal strength quasi-static pushing marginal cost pricing in-situ design IROS neural network hot plates cell reinforcement learning; multi-agent; mean-field; game theory; mean field; reinforcement learning current reinforcement learning; multi-agent; Xbee Zigbee robot compiler origami robot deployment spi dynamic modeling rhino boat literature review multipack buoyancy equations contact surp paper review Writing motorized boats throughput range surfaces ML reservoir computing multi-agent path finding solar cars detectionrate distance shape color edg-ide pain Characterization tool concept surface contact liquid crystal elastomer conferences release peripheral device differential keyboard swarm control car von Mises-Fisher von Mises Fisher port-array quasi-static modeling Kalman Filter Zero Elastic Energy modes Liquid Crystal Elastomers Discrete Elastic Rods Consensus Algorithms power pivoting Learning 3D-CHESS; kinematic_model elastic polymers 2.4 GHz 433 MHz creative Computer skill internal misc edg-refactoring 433 ceres debug coriolis force structured field dynamic model proposal wtf deep learning interpolation wireless signal strength reinforcement learning; multi-agent; decentralized reinforcement learning; multi-agent; mean-field; stationary demo video flytrap papers steering plastic multi-object tracking pvdf prelab actuation von Mises Distribution Barycenter Multi-Agent Systems integration flapping color_segmentation center of friction lab_data result segmentation on multiple object and centers finding competition ZMP buoyancy current sensor multiple blimps battery pid defender Synthesizable Radio integrated system 3d printing catching mechanism kalman filter barometer detection balloon slam; flowchart; depth estimation grid chiral square unit cell state space multi-robot pressure distribution model prediction thrust configuration kalman filter; ESP32 paper cutter COVID 19 manipulation fabrication code hardware offline Rl firmware protobuf #activecapturingmechanism #claw ensemble methods Bayesian networks 3D-CHESS; kalman filter bootstrapping model-based RL boxboat tracking lift force cad nylon scenic adaptive control motor driver MIMO communications Euler-Bernoulli beam newton's method spring-mass submission kalman filtering point cloud 2.4ghz latency der codesign sma-based actuator presentations machine training cameras preliminary exam multiple devices inkscape material delta tolling semantic segmentation instance segmentation pdms silicone optitrack multirobot solidworks ICLR design tool board design HDL pixracer pixhawk ardupilot flight controller regression fly test motor distribution Python DNN ICRA game theory ICML guassian processes probabilistic neural networks graph generators MBRL ide batch learning ros sensor fusion von Mises-Fisher Distributions edg-compiler Bessel functions iot