01 Feb

FORAY - Monocular Depth Estimation

Parth Agrawal

I reimplemented the Gtech paper for primitive monocular depth estimation. It works relatively well but requires a certain measurement of the object before the estimation. Reference - N. Yao, E. Anaya, Q. Tao, S. Cho, H. Zheng and F. Zhang, "Monocular vision-based human following on miniature robot...

01 Feb

FORAY - Pipeline for running model on Laptop

Parth Agrawal

To explore another method for object detection, I have built the pipeline to stream the video feed from the camera to the laptop and run the model on the video stream. Therefore, we now have the functionality to use any ML / neural network model for object detection Github Repo - https://github.co...

01 Feb

FORAY - On Device ML

Parth Agrawal

I explored the idea of running object detection on the microcontroller itself. I explored the following libraries – Tensorflow Lite ESP WHO Eloquent Conclusion – I found the TensorFlow lite library extremely unstable. There are many bugs in the repo. I was not able to build a single exampl...

05 Nov

FORAY - multiple peripheral devices connected to the same laptop

Parth Agrawal

In case, we have a limited number of laptops to connect the game controllers and master devices. This experiment shows that multiple game controllers can be connected to the same laptop for communication. The current communication system is limited by the number of ports. We can overcome this limita...

21 Oct

FORAY - Integrated System ( Joystick Controller + 2.4 GHz Communication + Motors)

Parth Agrawal

Specifications of the system - Blimp with 2 motors used for horizontal propagation connected to ESP32 microcontroller (Slave Device) NodeMCU with ESP 8266 acting as the master device 2.4GHz with ESP Now protocol is used for communication between the 2 devices A joystick controller is used...

21 Oct

FORAY - Controlling Multiple NodeMCU using Controller

Parth Agrawal

This experiment demonstrates that by using ESP Now protocol we have the capability to control multiple blimps from a single joystick controller. We can switch between different control modes at the click of a button. In the following video - 1 ESP32 microcontroller is connected to the motors. 1...

07 Oct

Using Peripheral Device to Control Motors using ESP NOW

Parth Agrawal

I was looking for ways to control the motors using peripheral hardware. I initially used Keyboard to control the motors. The input characters were sent to an ESP32 device (Master) via serial communication. The data was sent to another ESP32 device (Slave) connected to the motor drivers. I used a 2.4...

28 Sep

FORAY Integration Test - Motor Driver + WIFI

Parth Agrawal

Microcontroller - ESP32 Motor Driver - TB6612FNG Dual Motor Driver Propeller Size - 45mm (diameter) Communication - WIFI Module using Blynk I also found out that ESP32 does not have a native implementation of the AnalogWrite function. This has led to problems for PWM. I will look for a...

09 Sep

Experiment Results II - Communication

Parth Agrawal

I determined the change in the signal strength of the network due to metal interference. I used the same setup as the previous experiment. Received Signal Strength Indicator (RSSI) was used as a metric to measure signal strength. ESP32 WIFI (2.4 GHz) A point to point connection was established u...

02 Sep

Experiment Results - Communication

Parth Agrawal

Motivation The objective of the experiments was to test various communication methods (different protocols and frequency) under different conditions. I am using the following communication devices – ESP32 Wifi Module – 2.4GHz ESP32 Bluetooth Low Energy – 2.4 GHz NRF24L01 module - 2.4GHz Lo...

Search

Popular Tags

foray origami robots blimp ducky vr edg SLAM computer vision computational design roco slam Origami rocolib arduino RoCo design Robot Compiler simulation Motion Planning autonomy edg-model mesh reinforcement learning; multi-agent; mean-field; logics create; kalman filter; motors imu friction mesh network tank esp32 networking contacts multi-agent pushing auxetic machine learning dynamics esp now visual processing wireless control communication webapp pcbs structure ROCO i2c path planning cars Robotica reinforcement learning computer skill openmv test motor dataset visual DARPA odometry Battery surface structure power consumption dash port-arrays modeling origami paper frequency diversity semantic infrastructure auxetics feedback gondola machine vision Consensus bistable auxetic controller gestural intuition mixed reality unit cell robot crawler gestural interface open house network create; kalman filter; EM; refactoring 4-wheeled darpa; create; icra2021 apriltags lidar logic control FORAY perception Quantum Information crazyflie 433mhz optimization propeller Foray structures sensors environmental design radio DER Kullback-Leibler Divergence lasercutter tutorial von Mises Fisher Distribution IR simulink legs project management localization distributed optimization blynk Auxetics painlessmesh experiment results offline reinforcement learning exam research proposal altimeter thrust PCB sensor fusion gate or webots multi-agent path planning UAV RL integration test arnhold joystick balloon test vision processing pushing problem modeling contacts mesh networking motor configuration nodemcu swarm object detection fusionbot ros2 rviz2 gazebo conference matlab arduino nano decentralized surfaces keyboard IROS Integrated Demo throughput peripheral device paper review reinforcement learning; motorized boats Writing slam; paper review rhino Short Post range distance surp origami robot nylon pvdf elastic polymers plastic hot plates reinforcement learning; multi-agent; mean-field; game theory; mean field; reinforcement learning current reinforcement learning; multi-agent; Xbee Zigbee robot compiler spi contact neural network dynamic modeling quasi-static modeling edg-examples Kalman Filter port-array von Mises Fisher von Mises-Fisher literature review multipack car Zero Elastic Energy modes swarm control solar cars system ID serial monitor edg-ide Discrete Elastic Rods ceres debug Consensus Algorithms coriolis force dynamic model proposal wtf deep learning pdms interpolation wireless signal strength reinforcement learning; multi-agent; decentralized misc reinforcement learning; multi-agent; mean-field; stationary demo video flytrap papers steering structured field pivoting differential power detectionrate color shape edg-refactoring pain python vision Machine Learning Q-Learning Model-Free release conferences quasi-static pushing liquid crystal elastomer nonholonomic systems iot grant feedback-controlled controls trajectory optimization surface contact Characterization tool ML multi-agent path finding Liquid Crystal Elastomers Learning kinematic_model reservoir computing 2.4 GHz concept 433 MHz Bayesian Network creative Computer skill internal silicone integrated system instance segmentation marginal cost pricing bootstrapping Bayesian networks ensemble methods offline Rl hardware manipulation COVID 19 paper cutter ESP32 kalman filter; multi-robot state space delta tolling buoyancy chiral square unit cell pressure distribution model prediction thrust configuration grid fabrication firmware protobuf #activecapturingmechanism #claw 3D-CHESS; kalman filter boxboat tracking model-based RL von Mises Distribution slam; flowchart; spring-mass 3D-CHESS; 433 rssi signal strength multirobot system writing in-situ design buoyancy equations boat deployment cell cameras der newton's method Barycenter Euler-Bernoulli beam sma-based actuator game theory Bessel functions von Mises-Fisher Distributions ide HDL board design battery current sensor ZMP center of friction Multi-Agent Systems code balloon semantic segmentation MIMO communications ICRA ICML guassian processes probabilistic neural networks graph generators MBRL batch learning ros edg-compiler multirobot optitrack adaptive control motor driver submission DNN kalman filtering point cloud 2.4ghz latency scenic codesign presentations machine training preliminary exam multiple devices inkscape material multi-object tracking ICLR Python actuation catching mechanism integration flapping color_segmentation lab_data result segmentation on multiple object and centers finding competition prelab multiple blimps pid defender Synthesizable Radio 3d printing kalman filter motor distribution barometer detection lift force depth estimation cad solidworks design tool pixracer pixhawk ardupilot flight controller regression fly test sensor selection