2021-06-29 Competition Debrief 2021
Slides: WARG Competition Debriefs.pdf
The Good
Safety firmware and retreat-retreat worked well
Productivity and module testing took place at an impressive scale
We put a plane in the sky!
We won an award!
Â
Telemetry
Got to developing it later so wasn't ready for competition
Video transmission didn't work with CV
Video transmission was only tested at Lucy's house
Only certain people were in the place/position to test - made a bottle neck so things had to be prioritized
In the future:
Integrate more in advance
Respond faster on status of telemetry task
More frequent videos of set-ups so they can easily be replicated by others
More range testing in advance - in real conditions, not just at someone's house
Test more
Treat it as a very important system (that it is)
Lessons learned:
Importance of frequent updates and good documentation that can be updated and can be used to replicating
Take photos of stuff such as connecting servos so that when someone else goes to do it, it's easier to reference. When work needs to be redone in the future, can easily get the same results
Â
Zeropilot
Was never really tested, harder to evaluate
Wasn't ready for comp which is under stable since it is a big system
Huge flood of PR's close to comp, hard to review everything well
Members only got development boards in May
 In the future:
More frequent testing so code can be evaluated and improved
Better portfolio of boards to send to firmware members so that more people can test - need more dev boards
Better PR system, assign someone to improve the code
Better organization
 Lessons learned:
Testing boards should be prioritized
Develop layers for tests to occur - simulation layers should be developed so they can replicate the aircraft so we can test without boards
Hardware in the loop - need to check that code works for the board it was designed on, not just on a computer - every time a test is done flash the code to the board to make sure it works, hill test set-up
Continue to develop with simulations in Matlab - software in the loop
Need: hardware in the loop, software in the loop and unit testing!
Â
CV - Architectural
Overly complex transmission system
Distributed system so failure potential between two computers
Data transmission was its own network
 In the future:
Possibly one system
Run CV on plane itself and have wired connection between 2 computers, not as complex as we originally thought
DGI uses Qualcom snap dragon (hard to buy), Jetson's use a low of power
 Lessons learned:
More steps = more failing points
Â
CV - Operational
Generator fiasco, wanted to rent from Home Depot but then thought rocketry had one we could use
Ended up not having proper communication channels with rocketry
 In the future:
Responsibilities should be given in pairs, harder for lead to keep track of everything with a larger team
 Lessons learned:
Should think of back-up plans when close to comp, not relying on people/things out of our control
Keep track of tasks in Asana and person to reach out to
Â
CV - Operational (Pt 2)
Tests were failing but couldn't replicate it
Poor repository management, used a lot of forks which was bad and taxi was only merged late into main
Unit tests were run but it wasn't run on comp machines
Tests were organized poorly
Documentation was lacking so debugging was slow
No easy way to test
Couldn't run test on production environment
 In the future:
Keep using branches for repo's
Should use CI Pipelines
Code base on production environment should have been reset to what's on the core repository
Test should be run in production environment before competition
Documentation should be completed external to code base (pdf/test doc somewhere), should have people in charge of documentation
CV create a docker image
Docker image could also be used for firmware
Make a better timeline - enough time for changes
Add a timeline to tickets (ex: geolocation took very long, target acquisition was very short)
 Lessons learned:
Lots of timeline issues and documentation
Prepare for a "dress-rehearsal" a week before comp to minimize last minute tasks
Integration testing should start a lot earlier - as soon as 2 models are done
Full testing rig
Asana was really helpful! (maybe we could get Jira)
Dual responsibility
Have a minimum viable product - something a lot simpler but we know will work
 Moral of the Story:
Complex system with not enough time to test
Â
Flight Testing
WARG wasn't able to flight test anywhere near enough that we should have
Only Anthony is able to fly Spike
Not enough airframes, we shouldn't have spent time fixing airframes at critical moments of the year
 In the future:
Have lots of airframes in advance - "infinite supply"
Have more RC pilots - a long process that takes a few months so hard to train enough people
Could recruit RC test pilots - clubs in KW, aviation majors
Thoughts should be put into how the test pilot team will be allocated
 Lessons learned:
More pilots
Â
Gimbal
Expected fixed-range servos - we got free rotating ones
Prototyping should have been done a lot earlier!
Didn’t have a full CAD model so we're going based on measurements that aren't the most accurate
 In the future:
Test plan for all mechanisms
More documentation so other sub teams can see what we're doing
Have a full model of a plane to see changes
Have a solid inventory - we don't know what we have in the bay for any sub team
 Lessons learned:
Focus members on this year's competition
Prototype a lot more and make iterations as needed
Design model with the complete plane CAD to make sure it fits/clearances and all that
 Other:
Make a single axis gimbal to test CV
Â
Grabber
Hit the ground and snapped before flying
Was tested indoors on smooth floor, should have been improved early on
 In the future:
Develop test fixtures on a bench so don't have to test with plane
Should have focused off-site members to redesign/improve
Prototype early on
Â
Communication
Take every opportunity possible to test and use flight tests to their full extent
 In the future:
Have someone from every sub team at competition
Someone should be checking the competition manual and acting as a PM
Have some protocol between inter-sub team testing
Go more to other sub team meetings
Â
Â
Â
Â
Â
Â
Â
Â