wiki:Other/Summer/2023/First

First-Person View Self-Driving Car

Team: Adam Daniel Strub, Elliot Li, Mei Mei Castranova, and Divya Krishna

Directed by: Professor Rich Martin

Objective

In this project, we used specialized low-latency cameras and radios to operate remote-mode cars. The goal is to control the cars with virtual network connections and to evaluate how controllable the cars are inside a model city environment.

Abstract

The most common usages of remotely piloted systems come in the form of drones and aircraft. This project dives into the concept of remotely piloting a car from one local network. With a local network, we can control a car from anywhere as long both computers (laptop and Raspberry Pi) are on the same network.

Hardware & Software

Robotic Car: Osoyoo Servo Steer Smart Car

Computer System: Raspberry Pi 4 Model B

Camera: Runcam2, used as a USB camera

Local Area Network:

Also includes a Micro Servo Motor so the camera has a more peripheral view

Sockets

We used UDP sockets to communicate between the Raspberry Pi on the car and a laptop. With sockets, we can connect with the local virtual network. The server side would be on the Raspberry Pi running, while the client side would run on the laptop.

OpenCV and Camera

OpenCV is a Python library that allows image processing through a camera. When using the Runcam2, there were two modes: USB memory card, and USB camera. Using USB camera mode allows the display of the camera to be seen when plugged into the Raspberry Pi.

Challenges

Downloading CV2 to the Raspberry Pi

Switching the camera between the two different modes

Installing the basic code between the older and newer versions of the Raspberry Pi

Socket binding between the computer and the Raspberry Pi.

Future Goals

Create a 3D-printed platform for all the hardware to go on

Have a camera that detects objects and sends a message to the laptop

Be able to drive the car efficiently and without any errors in a complicated environment

Link to Presentations

Week 1

Week 2 & Project Overview

Week 3

Week 4

Week 5

Week 6

Link to Poster

Project Poster

Last modified 15 months ago Last modified on Aug 13, 2023, 9:18:47 PM
Note: See TracWiki for help on using the wiki.