{"id":113,"date":"2023-11-17T17:25:38","date_gmt":"2023-11-17T17:25:38","guid":{"rendered":"https:\/\/gpt-jordan.com\/?p=113"},"modified":"2023-11-17T17:25:38","modified_gmt":"2023-11-17T17:25:38","slug":"swift-ai-drones-with-deep-reinforcement-learning-rl","status":"publish","type":"post","link":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/","title":{"rendered":"Swift AI Drones with Deep Reinforcement Learning (RL)"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">First-person view (FPV) drone racing is a televised sport in which professional competitors pilot high-speed aircraft through a 3D circuit. Each pilot sees the environment from the perspective of their drone by means of video streamed from an onboard camera. Reaching the level of professional pilots with an autonomous drone is challenging because the robot needs to fly at its physical limits while estimating its speed and location in the circuit exclusively from onboard sensors. Here we introduce Swift, an autonomous system that can race physical vehicles at the level of the human world champions. The system combines deep reinforcement learning (RL) in simulation with data collected in the physical world. Swift competed against three human champions, including the world champions of two international leagues, in real-world head-to-head races. Swift won several races against each of the human champions and demonstrated the fastest recorded race time. This work represents a milestone for mobile robotics and machine intelligence<sup><a href=\"https:\/\/www.nature.com\/articles\/s41586-023-06419-4#ref-CR2\">2<\/a><\/sup>, which may inspire the deployment of hybrid learning-based solutions in other physical systems.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.nature.com\/articles\/s41586-023-06419-4\">https:\/\/www.nature.com\/articles\/s41586-023-06419-4<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Authors: Elia Kaufmann, Leonard Bauersfeld, Antonio Loquercio, Matthias M\u00fcller, Vladlen Koltun &amp; Davide Scaramuzza<\/p>\n\n\n\n<figure class=\"wp-block-video\"><video height=\"720\" style=\"aspect-ratio: 1280 \/ 720;\" width=\"1280\" controls src=\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/ai-drones-1.mp4\"><\/video><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>First-person view (FPV) drone racing is a televised sport in which professional competitors pilot high-speed aircraft through a 3D circuit. Each pilot sees the environment from the perspective of their [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":702,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_EventAllDay":false,"_EventTimezone":"","_EventStartDate":"","_EventEndDate":"","_EventStartDateUTC":"","_EventEndDateUTC":"","_EventShowMap":false,"_EventShowMapLink":false,"_EventURL":"","_EventCost":"","_EventCostDescription":"","_EventCurrencySymbol":"","_EventCurrencyCode":"","_EventCurrencyPosition":"","_EventDateTimeSeparator":"","_EventTimeRangeSeparator":"","_EventOrganizerID":[],"_EventVenueID":[],"_OrganizerEmail":"","_OrganizerPhone":"","_OrganizerWebsite":"","_VenueAddress":"","_VenueCity":"","_VenueCountry":"","_VenueProvince":"","_VenueState":"","_VenueZip":"","_VenuePhone":"","_VenueURL":"","_VenueStateProvince":"","_VenueLat":"","_VenueLng":"","_VenueShowMap":false,"_VenueShowMapLink":false,"footnotes":""},"categories":[6,8,12,29],"tags":[31,33],"class_list":["post-113","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-autonomous-drones","category-drones","category-reinforcement-learning","tag-autonomous-drones","tag-deep-reinforcement-learning"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Swift AI Drones with Deep Reinforcement Learning (RL) - Innovative Digital Transformation Jordan<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Swift AI Drones with Deep Reinforcement Learning (RL) - Innovative Digital Transformation Jordan\" \/>\n<meta property=\"og:description\" content=\"First-person view (FPV) drone racing is a televised sport in which professional competitors pilot high-speed aircraft through a 3D circuit. Each pilot sees the environment from the perspective of their [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\" \/>\n<meta property=\"og:site_name\" content=\"Innovative Digital Transformation Jordan\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-17T17:25:38+00:00\" \/>\n<meta name=\"author\" content=\"Editor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\"},\"author\":{\"name\":\"Editor\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/person\/260ed75841f0c76d83d1b2bc3121f6f6\"},\"headline\":\"Swift AI Drones with Deep Reinforcement Learning (RL)\",\"datePublished\":\"2023-11-17T17:25:38+00:00\",\"dateModified\":\"2023-11-17T17:25:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\"},\"wordCount\":202,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#organization\"},\"image\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png\",\"keywords\":[\"Autonomous Drones\",\"Deep Reinforcement learning\"],\"articleSection\":[\"AI\",\"Autonomous Drones\",\"Drones\",\"Reinforcement Learning\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\",\"url\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\",\"name\":\"Swift AI Drones with Deep Reinforcement Learning (RL) - Innovative Digital Transformation Jordan\",\"isPartOf\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png\",\"datePublished\":\"2023-11-17T17:25:38+00:00\",\"dateModified\":\"2023-11-17T17:25:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage\",\"url\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png\",\"contentUrl\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png\",\"width\":1024,\"height\":768},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Swift AI Drones with Deep Reinforcement Learning (RL)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#website\",\"url\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/\",\"name\":\"Innovative Digital Transformation Jordan\",\"description\":\"Improve Your Life with NetBookLM\",\"publisher\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#organization\",\"name\":\"Innovative Digital Transformation Jordan\",\"url\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2024\/09\/cropped-cropped-Designer-1.jpeg\",\"contentUrl\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2024\/09\/cropped-cropped-Designer-1.jpeg\",\"width\":70,\"height\":70,\"caption\":\"Innovative Digital Transformation Jordan\"},\"image\":{\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/person\/260ed75841f0c76d83d1b2bc3121f6f6\",\"name\":\"Editor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g\",\"caption\":\"Editor\"},\"url\":\"https:\/\/idtjo.hosting.acm.org\/wordpress\/author\/editor\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Swift AI Drones with Deep Reinforcement Learning (RL) - Innovative Digital Transformation Jordan","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/","og_locale":"en_US","og_type":"article","og_title":"Swift AI Drones with Deep Reinforcement Learning (RL) - Innovative Digital Transformation Jordan","og_description":"First-person view (FPV) drone racing is a televised sport in which professional competitors pilot high-speed aircraft through a 3D circuit. Each pilot sees the environment from the perspective of their [&hellip;]","og_url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/","og_site_name":"Innovative Digital Transformation Jordan","article_published_time":"2023-11-17T17:25:38+00:00","author":"Editor","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Editor","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#article","isPartOf":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/"},"author":{"name":"Editor","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/person\/260ed75841f0c76d83d1b2bc3121f6f6"},"headline":"Swift AI Drones with Deep Reinforcement Learning (RL)","datePublished":"2023-11-17T17:25:38+00:00","dateModified":"2023-11-17T17:25:38+00:00","mainEntityOfPage":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/"},"wordCount":202,"commentCount":0,"publisher":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#organization"},"image":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage"},"thumbnailUrl":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png","keywords":["Autonomous Drones","Deep Reinforcement learning"],"articleSection":["AI","Autonomous Drones","Drones","Reinforcement Learning"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/","url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/","name":"Swift AI Drones with Deep Reinforcement Learning (RL) - Innovative Digital Transformation Jordan","isPartOf":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#website"},"primaryImageOfPage":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage"},"image":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage"},"thumbnailUrl":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png","datePublished":"2023-11-17T17:25:38+00:00","dateModified":"2023-11-17T17:25:38+00:00","breadcrumb":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#primaryimage","url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png","contentUrl":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png","width":1024,"height":768},{"@type":"BreadcrumbList","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/swift-ai-drones-with-deep-reinforcement-learning-rl\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/idtjo.hosting.acm.org\/wordpress\/"},{"@type":"ListItem","position":2,"name":"Swift AI Drones with Deep Reinforcement Learning (RL)"}]},{"@type":"WebSite","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#website","url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/","name":"Innovative Digital Transformation Jordan","description":"Improve Your Life with NetBookLM","publisher":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/idtjo.hosting.acm.org\/wordpress\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#organization","name":"Innovative Digital Transformation Jordan","url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/logo\/image\/","url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2024\/09\/cropped-cropped-Designer-1.jpeg","contentUrl":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2024\/09\/cropped-cropped-Designer-1.jpeg","width":70,"height":70,"caption":"Innovative Digital Transformation Jordan"},"image":{"@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/person\/260ed75841f0c76d83d1b2bc3121f6f6","name":"Editor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/idtjo.hosting.acm.org\/wordpress\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","caption":"Editor"},"url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/author\/editor\/"}]}},"jetpack_featured_media_url":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-content\/uploads\/2023\/11\/image-4-1.png","_links":{"self":[{"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/posts\/113","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/comments?post=113"}],"version-history":[{"count":0,"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/posts\/113\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/media\/702"}],"wp:attachment":[{"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/media?parent=113"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/categories?post=113"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/idtjo.hosting.acm.org\/wordpress\/wp-json\/wp\/v2\/tags?post=113"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}