Roadmap: Computer Vision

Owned by Shrinjay Mukherjee
Last updated: 2021-11-12
1 min read

 

25-Oct202101-Nov08-Nov15-Nov22-Nov29-Nov06-Dec13-Dec20-Dec27-Dec03-Jan202210-Jan17-Jan24-Jan31-Jan07-Feb14-Feb21-Feb28-Feb07-Mar14-Mar21-Mar28-Mar04-Apr11-Apr18-Apr25-Apr02-May09-May16-May23-May30-May06-Jun13-Jun20-Jun27-Jun04-Jul11-Jul18-Jul25-Jul01-Aug08-Aug15-Aug22-Aug29-Aug05-Sep12-Sep19-Sep26-Sep
QR Scan
Target Detect

Implement QR Scan Functionality

QR Flight Communication Library

QR Flight Communication Implementation

QR Ground Communication Library

QR Ground Communication Implementation

Ingest new QR info from XBee

Display QR Info on Ground Station

Dataset Preparation

Train model on top-view-mutli-person

Train model on stanford drone dataset

Collect benchmark dataset

Benchmark top-view-mutli-person

Bechmark stanford drone

Retrain with selected datasets combined

Integrate trained weights into local YOLOv5

Scope piping processed video out from CV program

Setup Ground Station to Ingest Video

Setup ground station to display video

Setup video save and export to USB

Validate geolocation (UPDATE LATER)

Requirements to Tasks

  1. QR Scan (Task 2): Allows for autonomous takeoff and message reading

    1. Implement QR Scan

    2. Test QR scanner (Use the QR image from the CONOPS) using DecklinkSrc input

    3. Take a frame as input from DeckLink SRC

    4. Send information extracted in QR code to aircraft

    5. update ground station to show QR Questions (ex. T-shirt colour, hair colour and item carried?)

2. Detect and high light intruder

a. Train the YoloV5 model for Aerial view of the person.

i. Prepare dataset for training (draw out the bounding box labels on the image)

ii. Prepare benchmark dataset

iii. Train and test each dataset independently
iv. Combine datasets and retrain, evaluate performance

v. extract the model weights and deploy the detection on the local machine.

vi. integrate with target acquisition code

b. Display video output to ground station

c. Export video to USB stick

d. Track the intruder for 500m:

i. implement the tracking module

e. Draw the intruder path on the map of the competition area

i. Get the map from Google Satellite

ii. Use the Geolocation module to get the sequence of lat and long data of the path

iii. Draw the path of the Google Satellite Image

 

 

 

 

 

 

Â