Airffic InstituteAERIAL PHYSICAL AI
Luhlu ☰

Sikhungo se-Aerial Physical AI

I-Vision AI: indlela i-drone lecondza ngayo loko leyikubonako

Kubona akwanele kuze undize. Ingcondvo idzinga kucondza loko lekubonako.

Imphendvulo lemfisha: I-Vision AI ye-drone ikhule ngetigaba letine: ① kutfola tintfo (detection), ② kutilandzela (tracking), ③ kwati indzawo yayo (SLAM, VIO), ④ kucondza ticondziso ngemagama (ema-foundation model). Sisemnyango wesigaba ④.

Kuvuselelwe: · Imizuzu lengu-3 yekufundzaIndlela lesacwaninga ngayo →

Sir Airffic GoLokunyenti lapha kuvela emaphepheni elucwaningo, kodvwa emagama alula. Hamba nami.

Tigaba letine tekucondza

  1. Kutfola (detection): kutfola bantfu, timoto netintsambo tagesi esitfombeni bese udvweba emabhokisi lativungeletako.
  2. Kulandzela (tracking): kulandzela kutsi intfo letfoliwe iya kuphi ngemuva kwaloko.
  3. Kutati indzawo: kubala kutsi uhambe kangakanani nekutsi uye kuphi ngekunyakaza kwesitfombe kanye ne-IMU (VIO: visual-inertial odometry).
  4. Kucondza nekulalela ticondziso: kucondza “hlola ngemuva kwendlu lenophahla lolubovu” bese uxhumanisa emagama naloko lokubonako (VLM: i-AI lephatsa titfombe nelulwimi ndzawonye).

Kundiza ngesikhatsi wakha libalave: i-SLAM ne-VIO

Ngasekupheleni kweminyaka ya-2000, emalabhorethri emanyuvesi acala kubala indzawo ye-drone lencane ngekhamera yinye ne-IMU. Konkhe kwacala lapho.

Tindlela letinjenge-SVO, VINS-Mono ne-ORB-SLAM tashicilelwa futsi taba sisekelo lesabelwanako. Lucwaningo lolusobala lwaphenduka tincenye temikhicito.

Ema-drone emsebenti anamuhla angandiza ngaphansi kwemabhuloho nangekhatsi etakhiweni ngenca yalomsebenti lowakheka ngekuhamba kwesikhatsi.

Kusuka etulu, tintfo tibukeka tincane futsi tigobekile

I-AI lefundziswe ngetitfombe letitsatfwe emhlabatsini iyahlupheka nayibuka kusuka etulu: bantfu baba ngemachashazi, timoto tishintja simo.

Ema-dataset asemoyeni njenge-VisDrone ne-DOTA akhiwa kuze kufundziswe i-AI lelungele sibhakabhaka.

Loyo lophetse idatha uncuma kutsi i-AI ihlakaniphe kangakanani. Loku akukashintji nasesikhatsini sema-foundation model.

Sir Airffic GoEmagebe e-AI avame kuvela ebunyentini bedatha yasemoyeni lonayo, kakhulu kunema-algorithm. Khumbula loku esehlukweni semasu.

Lilanga i-AI lehlula ngalo bompetsa babantfu

Nga-2023, i-drone ye-AI lebitwa ngekutsi yi-Swift, leyakhiwa eNyuvesi yase-Zurich, yehlula bompetsa bemhlaba babantfu bekugijimisa ema-drone. Lomsebenti washicilelwa ku-Nature.

I-Swift yabala indzawo yayo ngekhamera ne-IMU kuphela, futsi yafundza kundiza nge-reinforcement learning — kutijwayeta kanyenti ku-simulation.

Loku bekusendleleni lengashintji. Kufinyelela lelikhono esibhakabhakeni sangempela, lapho simo selitulu netiphazamiso kushintja khona, kuseyinselele.

Kugijimisa ema-drone ezingeni lebompetsa nge-deep reinforcement learning (UZH)

Ividiyo ye-drone ye-AI i-Swift leshicilelwe yi-Robotics and Perception Group yeNyuvesi yase-Zurich. YouTube ↗ · Kute lokulayishwa ku-YouTube ngaphambi kwekutsi ucindzetele kudlala

Ligagasi lelilandzelako: kubona, kucabanga nekwenta ngemagama

Kusukela nga-2023, ema-model e-AI lamakhulu laphatsa titfombe nelulwimi ndzawonye (ema-foundation model) acala kusebenta njengengcondvo yemarobhothi.

Lucwaningo lwe-drone ngekulandzela ticondziso letikhulunywako ngesikhatsi icondza lokuyizungelezile (aerial vision-language navigation) luyakhula.

Ema-model lamakhulu ayasindza, futsi kuwasebentisa ngekushesha endizeni kusamatima. Ngiko nje ema-chip — sehluko lesilandzelako — kufanele afundvwe kanye nalokhu.

Imibuto levame kubutwa

Ngumiphi imisebenti lesebentisa kubona kwekhompyutha kwe-drone?

Kutfola imifantfo emabhulohweni nasetintsanjeni tagesi, kuhlola imphilo yetitjalo, kufuna bantfu ekusindziseni, kuphepha nekubuka timoto, nekuhlola tindzawo tekuletsa timphahla kuyindlela leyejwayelekile.

Yini i-visual-inertial odometry (VIO)?

Yindlela lehlanganisa kunyakaza kwesitfombe netilinganiso te-IMU tekusheshisa nekujika kuze ibale kutsi i-drone ihambe kangakanani. Bubuchwepheshe lobusisekelo bekundiza ngaphandle kwe-GPS.