Lumen Project

Lumen is our AI autonomy software powering the Vulcan drone platform.

To fulfill our mission of developing open-source, low-cost autonomous drones, we need a powerful AI model which takes mission descriptions in English, and carries them out.

It needs to accomplish this using only the sensors onboard the drone and by reporting back to the ground station. The AI model needs to be small enough to run inference on the drone’s compute (~300 TFLOPS) in <1-second latency. 

We are training this model in a cloud-based simulation environment. The simulation is powered by high-resolution graphics and physics modeling and uses our flight controller software-in-the-loop.

We are training the model with realistic training scenarios and applying reinforcement learning to optimize its performance in the simulator.