Airffic InstituteAERIAL PHYSICAL AI
Ibirimwo ☰

Ikigo ca Aerial Physical AI

Vision AI: ingene drone itahura ivyo ibona

Kubona ntibihagije kugira ngo uguruke. Ubwonko bukeneye gutahura ivyo bubona.

Inyishu ngufi: Vision AI ya drone yateye imbere mu ntambwe zine: ① kumenya ibintu (detection), ② kubikurikira (tracking), ③ kumenya aho uri (SLAM, VIO), ④ gutahura amabwirizwa mu majambo (foundation models). Turi ku muryango w'intambwe ④.

Vyavuguruwe: · Iminota 3 yo gusomaIngene twakoze ubushakashatsi →

Sir Airffic GoIvyinshi muri ivi bikomoka ku nyandiko z'ubushakashatsi, ariko amajambo yagumijwe ari yoroshe. Gumana nanje.

Intambwe zine zo gutahura

  1. Kumenya ibintu (detection): kurondera abantu, imiduga n'insinga z'umuyagankuba mu ishusho no kubishira mu dusanduku.
  2. Gukurikira (tracking): gukurikira aho ikintu cabonetse kiza kuja.
  3. Kumenya aho uri: kumenya ingene wagiye kure n'aho wagiye ukoresheje ukugenda kw'amashusho na IMU (VIO: visual-inertial odometry).
  4. Gutahura n'amabwirizwa: gutahura "raba inyuma y'inzu ifise igisenge gitukura" no guhuza ayo majambo n'ivyo ubona (VLM: AI itahura amashusho n'amajambo icarimwe).

Kuguruka mu gihe wubaka ikarata: SLAM na VIO

Mu mpera z'imyaka ya 2000, za kaminuza zatanguye kumenya aho drone ntoyi iri zikoresheje kamera imwe na IMU. Vyose vyatanguriye aho.

Uburyo nka SVO, VINS-Mono na ORB-SLAM bwarasohowe maze buba umusingi rusangi. Ubushakashatsi bwuguruye bwahindutse ibice vy'ibidandazwa.

Drone z'ubucuruzi z'ubu zishobora kuguruka munsi y'ibiraro no mu nzu kubera ico gikorwa cegeranijwe imyaka n'imyaka.

Ibimenyamenya: [P01] [P02] [P08] [P09] [P21] [P15]

Uvuye hejuru, ibintu biboneka bitoyi kandi bigoramye

AI yigishijwe ku mafoto yafatiwe hasi igorwa n'amashusho afatiwe hejuru: abantu baba utudomo, imiduga igahindura ishusho.

Ibikoranyo vy'amashusho (datasets) vyo mu kirere nka VisDrone na DOTA vyubatswe kugira ngo AI yihariye ikirere ishobore kwigishwa.

Uwufise amakuru ni we agena ingene AI igira ubwenge. Ivyo ntibirahinduka no mu gihe ca foundation models.

Sir Airffic GoItandukaniro ry'AI kenshi riva ku bwinshi bw'amakuru yo mu kirere ufise, kuruta ku buryo bwo guharura (algorithm). Ibuka ivyo ku gice c'umugambi.

Ibimenyamenya: [P14] [P23] [P24]

Umusi AI yatsinda abatsinzi b'abantu

Mu 2023, drone ya AI yitwa Swift, yakozwe na Kaminuza ya Zurich, yatsinze abatsinzi b'isi b'abantu mu gusiganwa kwa drone. Ico gikorwa casohowe mu kinyamakuru Nature.

Swift yamenya aho iri ikoresheje kamera na IMU gusa, kandi yize kuguruka biciye kuri reinforcement learning — kwimenyereza incuro nyinshi muri simulator.

Ivyo vyabereye ku nzira yateguwe. Gushika kuri ubwo buhinga mu kirere nyakuri, aho ikirere n'intambamyi bihinduka, biracari ingorane itarakemuka.

Gusiganwa kwa drone ku rugero rw'abatsinzi biciye kuri deep reinforcement learning (UZH)

Video ya drone ya AI Swift yasohowe n'umurwi Robotics and Perception Group wa Kaminuza ya Zurich. YouTube ↗ · Nta na kimwe kiva kuri YouTube imbere y'uko uyifungura

Ibimenyamenya: [N124]

Umuraba ukurikira: kubona, kuzirikana no gukurikiza amajambo

Kuva nko mu 2023, za AI nini zitahura amashusho n'amajambo icarimwe (foundation models) zatanguye gukora nk'ubwonko bwa robo.

Ubushakashatsi kuri drone zikurikiza amabwirizwa avuzwe mu gihe zitahura ibizikikuje (aerial vision-language navigation) buriko buriyongera.

AI nini ziraremereye, kandi kuzikoresha ningoga mu ndege biracagoye. Ni co gituma chip — igice gikurikira — zitegerezwa gusomwa hamwe n'iki.

Ibimenyamenya: [N133]

Ibibazo bikunze kubazwa

Ni ibihe bikorwa bikoresha computer vision ya drone?

Kurondera ahasadutse ku biraro no ku nsinga z'umuyagankuba, kuraba amagara y'ibiterwa, kurondera abantu mu gutabara, umutekano no kuraba urujya n'uruza, no kugenzura ahantu bashikiriza ibintu ni vyo bikunze gukorwa.

Visual-inertial odometry (VIO) ni iki?

Ni uburyo buhuza ukugenda kw'amashusho n'ivyo IMU ipima ku muvuduko wiyongera no ku kuzunguruka kugira ngo hamenyekane ingene drone yagiye kure. Ni ubuhinga bw'ishimikiro bwo kuguruka hatagira GPS.