Flight interface worker

Interfaces with the flight controller. The output of the worker is used for perception and decision making; the input is used for controlling the drone.

Task:

• Telemetry:

  • Polls the common flight controller for drone telemetry

  • Converts the telemetry position from world to local

  • Timestamps the telemetry and sends it to the appropriate worker(s)

• Commands:

  • Receives commands from decision worker

  • If applicable, converts the command from local space to world space: https://uwarg-docs.atlassian.net/wiki/spaces/CV/pages/2529034495

Video input worker

Interfaces with the camera device.

Task:

• Gets frames from the common camera and timestamps them

Detect target worker

Detects objects (if any) in images.

Task:

• Gets images and detect objects to create bounding boxes

  • There may be 0 object detections and therefore 0 bounding boxes in the list

• Sends the bounding boxes and with forwarded timestamp

  • Decision worker controls which output queue is used

Decision worker

Builds a model of the world and takes action.

Input list is sorted in descending order of confidence (i.e. index 0 is best, 1 is next best, etc.).

Task:

• Maintain model of world

• Decide which landing pad to investigate

  • Search if there is no landing pad: TODO Write documentation

TODO CREATE DECISION WORKER DOCUMENT

Data merge worker

Synchronizes telemetry and detected objects.

Task:

• Gets telemetry data and bounding boxes along with their corresponding timestamp

• Merges the telemetry data to the bounding boxes by closest timestamp

Geolocation worker

Finds out where the detected object is in the world.

Task:

• Gets telemetry data and bounding boxes

• Converts bounding boxes to locations in the world

Cluster estimation worker

Estimates the location of objects in the world based on groups of detections.

Input list length is the number of simultaneous detections in a single frame.

Task:

• Collects a scatter plot of locations of detected objects in the world

• Estimates the location of each object

Autonomous landing worker

Lands on selected landing pad.

Task:

• Gets bounding boxes

• Converts the bounding boxes into TODO