Category: Robotics

AI, Computer Vision, Deep Learning, Depth-Estimation, Python, RoboticsLeave a comment

Depth Estimation and 3D Mapping on Nvidia Jetson Nano

Foundations of DL

Python project.

The goal of this project is to build a robot capable of mapping its environment in a 3D simulation view. This article describes how to configure and use a Jetson Nano for a 3D mapping project where a neural network is used for depth estimation. The Jetson will also be connected to an Arduino Nano to get the gyro data from its IMU to project the depth values in a 3D world based on the orientation of the robot.

Continue reading “Depth Estimation and 3D Mapping on Nvidia Jetson Nano”
AI, Deep Learning, NN from scratch, Python, Robotics2 Comments

Neural Network from scratch: Part 4; control a drone with hand signals

Foundations of DL

Python project.

This article shows how to build a dataset for a specific task and train a neural network through the homemade Deep Learning framework implemented in the previous articles. This neural network will allow controlling a drone with hand signals.

We will create a dataset of hand signals, train several neural networks on it and convert their outputs to commands. The full pipeline will be connected to an Anafi drone to control it through an USB camera.

Continue reading “Neural Network from scratch: Part 4; control a drone with hand signals”
C++, Computer Vision, EPFL Robotics Competition, Python, RoboticsLeave a comment

Bottle recognition

Foundations of DL

Python and C++ projects.

To realize my bottle recycling robot project, I had to find a way to recognize bottles. This article will show how I installed a camera on the robot and the solutions I found to do visual recognition using: ImageAI lib, OpenCV and a Haar Cascade. Finally, how to convert the position of the bottles in pixels of the image into a real 3D position to guide the robot towards its goals.

Continue reading “Bottle recognition”