DARPA (Defense Advanced Research Projects Agency) is developing a new system to help military personnel perform complex tasks. Perceptually-enabled Task Guidance (PTG) technology uses sensors to see and hear what the user sees and hears, guiding them through AI-produced instructions displayed in augmented reality (AR).PTG combines sensors (a microphone and head-mounted camera) with AI and AR headsets to integrate into the user’s environment. The idea is to help soldiers and other military personnel enhance their skills, complete complicated tasks and perform them better. DARPA has narrowed its focus to three areas: battlefield medicine (like untrained personnel helping medics in the field), sustainment (keeping military equipment up and running) and co-piloting (especially helicopters).However, DARPA’s training demos use something more pedestrian: cooking. Dr. Bruce Draper, the program’s manager, describes it as the ideal proxy task. “[Cooking is] a good example of a complex physical t
