I te active digital sig age a d self-se vice kiosk platfo ms a e amo g the most dema di g deployme t catego ies fo embedded visio came a devices. These systems ope ate i etail e vi o me ts, t a sit hubs, ba ki g te mi als, a d public i fo matio displays whe e lighti g is a ely co t olled, a d the subject populatio spa s use s of diffe e t heights, ski to es, a d ha d positio s. A gestu e ecog itio pipeli e eeds to eliably detect a d classify ha d shape a d motio i eal time ac oss this a ge of co ditio s without ge e ati g false t igge s f om backg ou d moveme t o light va iatio .
The image se so sits at the f o t of this p oblem. A se so with poo low-light oise cha acte istics p oduces images whe e ha d co tou s a e lost i oise floo s below a ce tai lumi a ce th eshold. A se so with a i adequate dy amic a ge causes ha d t acki g algo ithms to fail whe a use is backlit by a wi dow o a la ge display pa el. A came a module that equi es custom d ive i stallatio i t oduces compatibility isk ac oss the dive se OS co figu atio s fou d i deployed kiosk ha dwa e. Take togethe , these co st ai ts elimi ate most ge e al-pu pose USB se so s f om co side atio i p oductio kiosk a d sig age visio desig s.
The selectio of the O semi AR0521 fo the Falco -521CRS add esses these co st ai ts at the se so a chitectu e level befo e a y applicatio -laye p ocessi g is applied.
The AR0521 is a 5MP colo image se so f om O semi desig ed fo applicatio s that equi e eliable colo ep oductio a d low ead oise i atu al a d a tificial lighti g e vi o me ts. The 1/2.5″ CMOS se so esolves 2592 x 1944 pixels with a 2.2 µm pixel pitch a d a olli g shutte a chitectu e. At this pixel size, the se so captu es sufficie t light pe pixel to mai tai a favo able sig al-to- oise atio ac oss the illumi a ce a ge e cou te ed i etail a d t a sit kiosk e vi o me ts whe e ambie t light levels shift betwee i doo fluo esce t, LED display backscatte a d atu al daylight i g ess th ough e t a ces.
The olli g shutte eadout a chitectu e of the AR0521 suits gestu e ecog itio a d ha d t acki g pipeli es because the se so outputs co ti uous full-f ame colo data at video f ame ates. Gestu e classificatio algo ithms ope ate o successive f ames to ext act motio vecto s f om ha d positio s. The low oise output of the AR0521 mea s that pe -f ame image quality is sufficie t fo co tou ext actio a d featu e poi t t acki g without equi i g f ame ave agi g o heavy p e-p ocessi g steps that would add late cy to the gestu e espo se loop. I a self-se vice kiosk o touchless i te face co text, the late cy betwee the use ‘s ha d gestu e a d the system espo se is a di ect use expe ie ce pa amete . Se so oise that fo ces additio al p ocessi g steps i c eases this late cy.
Colo accu acy matte s i i te active display applicatio s beyo d gestu e i put. Digital sig age systems that use came a i puts fo audie ce measu eme t, demog aphic a alysis, o atte tio t acki g ely o the colo fidelity of captu ed images fo eliable demog aphic i fe e ce. The AR0521 colo filte a ay a d olli g shutte se so desig p ovide co siste t colo output that suppo ts these seco da y visio tasks o the same ha dwa e as the p ima y gestu e ecog itio fu ctio .
The AR0521 USB came a Falco -521CRS i teg ates the O semi AR0521 se so o a compact boa d-level module co ected ove USB 3.0 with full UVC complia ce. The came a st eams at 5MP esolutio a d ope ates as a sta da d USB Video Class device o Wi dows, Li ux, a d A d oid without custom d ive developme t. This plug-a d-play a chitectu e sig ifica tly educes i teg atio effo t fo OEM teams to build kiosk ha dwa e whe e softwa e compatibility ac oss OS ve sio s a d field updates is a lo g-te m mai te a ce co ce .
The module’s USB 3.0 i te face p ovides sufficie t ba dwidth fo full- esolutio colo st eami g at video f ame ates equi ed by eal-time gestu e p ocessi g a d i te active sig age applicatio s. USB bus powe elimi ates the eed fo sepa ate powe supply ails i the kiosk e closu e, simplifyi g the PCB-level i teg atio a d educi g the ove all compo e t cou t i p oductio ha dwa e.
The fou datio of the Falco -521CRS fo gestu e ecog itio came a deployme t is the low oise cha acte istic of the O semi AR0521 at its 2.2 µm pixel pitch. I kiosk e vi o me ts whe e lighti g is ot u de the co t ol of the system desig e , the se so must p oduce usable colo images ac oss a wide illumi a ce a ge. Retail e vi o me ts combi e ove head fluo esce t o LED pa els with display backlighti g f om adjace t sc ee s a d va iable atu al light. The AR0521 se so a chitectu e mai tai s low ead oise ac oss this a ge, p oduci g colo f ames whe e ha d co tou sepa atio f om backg ou d is achieved by edge detectio a d segme tatio algo ithms u i g i eal time o the host p ocesso .
Fo gestu e classificatio , the quality of each f ame di ectly affects the eliability of the featu e ext actio step. Motio blu f om ha d moveme t is a expected co ditio i gestu e captu e, but oise-i duced a tifacts that b eak co tou co ti uity cause false key poi t detectio s that deg ade classificatio accu acy. The low- oise olli g shutte output of the AR0521 gives the gestu e ecog itio pipeli e clea f ames to wo k with u de challe gi g ambie t co ditio s.
The Falco -521CRS impleme ts full UVC complia ce o USB 3.0, mea i g the low oise UVC came a egiste s as a sta da d video i put device o co ectio to Wi dows, Li ux, a d A d oid without equi i g custom d ive i stallatio . Fo OEM teams, this emoves a e ti e class of field compatibility issues f om the deployme t equatio . UVC devices use the ope ati g system’s ative came a stack, which mea s the same came a module wo ks ac oss OS ve sio upg ades a d platfo m cha ges without d ive mai te a ce cycles.
Fo i te active kiosk came a i stallatio s deployed ac oss la ge fleets of te mi als, the UVC a chitectu e simplifies both i itial deployme t a d lo g-te m mai te a ce. The came a e ume atio behavio is co siste t a d p edictable. Applicatio softwa e that accesses the came a th ough sta da d OS video APIs does ot equi e ve do -specific SDK i teg atio fo basic st eami g. This is a mea i gful e gi ee i g t ade-off fo p oductio kiosk systems whe e softwa e stack stability is p io itized ove featu e access that would equi e p op ieta y d ive laye s.
The 5MP esolutio of the AR0521 at 2592 x 1944 p ovides sufficie t spatial detail fo the co cu e t visio tasks u i g o i te active display platfo ms. Gestu e ecog itio a d ha d t acki g algo ithms be efit f om the spatial esolutio to disti guish fi e ha d poses, such as i dividual fi ge positio s. Audie ce measu eme t a d demog aphic a alysis fu ctio s that co-exist o the same came a st eam equi e sufficie t face esolutio fo i fe e ce model i puts. At 5MP, the Falco -521CRS p ovides the head oom to suppo t both gestu e a d face-level a alytics simulta eously o a si gle came a st eam without esolutio c oppi g to sub-HD levels that would deg ade i fe e ce quality.
The olli g shutte a chitectu e of the AR0521 eads ows of the se so seque tially f om top to bottom. Fo ha d t acki g came a applicatio s, the olli g shutte p ovides full-f ame colo output at co ti uous f ame ates without the complexity a d cost of global shutte se so i teg atio . Ha d gestu es i kiosk e vi o me ts a e elatively slow compa ed to the se so ‘s f ame eadout speed, mea i g olli g shutte skew a tifacts a e ot a sig ifica t p oblem fo the gestu e classificatio algo ithms that ope ate o these systems.
Touchless i te actio a d huma machi e i te face came a systems place specific dema ds o the imagi g subsystem that diffe f om co ve tio al su veilla ce o i spectio of came a equi eme ts. The came a must captu e colo i fo matio at full esolutio co ti uously while mai tai i g co siste t image quality ac oss the va iable lighti g co ditio s of the deployme t e vi o me t. The system ca ot tole ate pe -f ame p ocessi g delays that would i t oduce pe ceptible late cy betwee the use ‘s gestu e a d the system espo se. A d the came a must ope ate eliably ove exte ded duty cycles i public-faci g deployme ts whe e mai te a ce access is limited.
The Falco -521CRS add esses these equi eme ts th ough the combi atio of the AR0521’s low oise se so a chitectu e a d the USB 3.0 i te face ba dwidth. The se so delive s co siste t colo f ame output with low oise floo cha acte istics that allow gestu e p ocessi g algo ithms to u at video f ame ates o the host p ocesso without equi i g p e-p ocessi g accele atio . The USB 3.0 co ectio sustai s the full- esolutio colo data st eam without bottle ecki g the se so output. The UVC complia ce e su es the came a emai s ope atio al ac oss OS updates without d ive e-validatio cycles.
Falco -521CRS | O semi AR0521 | 5MP (2592 x 1944) | 2.2 µm | 1/2.5″ | Rolli g Shutte | Colo | USB 3.0 | UVC Complia t (Plug-a d-Play) | Wi dows, Li ux, A d oid | Boa d-Level Module | No |
“The AR0521 is a well-suited se so fo kiosk a d i te active display applicatio s whe e low oise colo imagi g, a d plug-a d-play deployme t a e both o – egotiable. Buildi g o this se so with USB 3.0 UVC complia ce mea s OEM e gi ee s get a 5MP colo came a p oduct that st eams eliably f om day o e ac oss the OS e vi o me ts thei ha dwa e al eady suppo ts. The Falco -521CRS is ot a ge e al-pu pose imagi g module. It is built specifically fo the deployme t co ditio s of touchless kiosks, gestu e ecog itio systems, a d i te active digital sig age whe e low oise colo fidelity, esolutio , a d d ive simplicity eed to come togethe o a si gle module.”
– Alwi Vi ce t, P oduct Ma age , Vadzo Imagi g
Mode digital sig age came a deployme ts have moved beyo d passive co te t to b oadcast towa d i te active expe ie ces whe e audie ce data is used to adapt displayed co te t i eal time. These platfo ms equi e a embedded came a that captu es usable colo images of i dividuals sta di g at va yi g dista ces i f o t of the display, u de the mixed ambie t a d display-emitted light that cha acte izes la ge-fo mat sc ee e vi o me ts. The display pa el itself co t ibutes to a sig ifica t high-f eque cy light va iatio to the sce e as co te t cha ges. This c eates a dy amic lighti g co ditio that challe ges se so s with poo oise cha acte istics o limited dy amic a ge.
The Falco -521CRS add esses these challe ges th ough the low- oise a chitectu e of the AR0521. At the illumi a ce levels p oduced by di ect display light combi ed with ove head ambie t, the se so ope ates well withi its oise floo such that the colo images it captu es a e suitable fo face detectio , atte tio estimatio , a d demog aphic i fe e ce algo ithms. The 5MP esolutio p ovides sufficie t spatial detail fo both gestu e a d face-level a alytics to ope ate o the same came a st eam, e abli g multi-fu ctio i te active display systems f om a si gle came a p oduct.
Self-se vice kiosk platfo ms i etail, ba ki g, t a sit, a d healthca e ve ticals have i c easi gly adopted touchless kiosk came a i te faces as a p ima y i te actio modality. These systems equi e visio -based gestu e detectio that is obust to the full a ge of use ha d sizes, ski to es, app oach a gles, a d ambie t lighti g co ditio s e cou te ed i high-t affic public e vi o me ts. The gestu e detectio must ope ate without t ai i g the use to hold thei ha d i a specific positio o at a specific dista ce, because self-se vice kiosk use s have o p io i st uctio a d o tole a ce fo i te actio failu es.
The e gi ee i g equi eme t this c eates fo the imagi g subsystem is a came a that delive s high-quality colo f ames at video f ame ates with low oise, without equi i g co t olled lighti g o p e-set subject dista ce. The AR0521 olli g shutte se so i the Falco -521CRS meets these equi eme ts withi the USB 3.0 bus-powe ed a chitectu e that most of the kiosk ha dwa e al eady suppo ts. UVC complia ce emoves d ive compatibility as a system i teg atio isk, a d the 5MP esolutio p ovides the spatial fidelity that mode gestu e AI models equi e fo eliable ha d key poi t estimatio ac oss the full populatio of kiosk use s.
Visio -based gestu e ecog itio USB came a systems fo edge AI deployme t face a compou d e gi ee i g challe ge. The came a must delive image quality that suppo ts eal-time i fe e ce o the edge p ocesso without exceedi g the compute budget allocated to the visio subsystem. This mea s the came a itself must do as much of the image quality wo k as possible at the se so level, educi g the p e-p ocessi g bu de o the AI i fe e ce host. Se so s with high oise floo s fo ce the host to u de oisi g o f ame ave agi g steps befo e i fe e ce i puts a e eady, co sumi g compute cycles that educe the effective th oughput of the gestu e ecog itio pipeli e.
The AR0521 low oise a chitectu e i the Falco -521CRS di ectly educes this p e-p ocessi g equi eme t. The se so delive s clea colo f ames that AI gestu e ecog itio came a i fe e ce models ca co sume di ectly with mi imal p e-p ocessi g ove head. O embedded AI platfo ms such as NVIDIA Jetso O i Na o, Qualcomm RB5, a d NXP i.MX 8 se ies, whe e compute is co st ai ed, this t a slates to highe effective gestu e ecog itio th oughput a d lowe e d-to-e d late cy f om se so to classificatio output.
Retail e vi o me ts a e amo g the highest-difficulty ope ati g co ditio s fo embedded visio systems. A etail kiosk came a i stalled i a sto e must ha dle co ti uously va yi g illumi atio f om ove head fixtu es, daylight f om wi dows a d sto ef o ts, di ect light f om p oduct display cases, a d specula eflectio s f om glass a d eflective su faces. The came a must p oduce co siste t colo output ac oss this a ge without pe -i stallatio calib atio because etail deployme ts a e typically scaled ac oss hu d eds to thousa ds of locatio s with o pe -u it tu i g.
The Falco -521CRS is suited to this use case because the AR0521 se so ‘s low oise output emai s co siste t ac oss the illumi a ce va iatio e cou te ed i etail e vi o me ts. OEM i teg atio teams ca desig the came a i to the system ha dwa e, k owi g that the se so pe fo ma ce will be p edictable ac oss i stallatio s without lighti g tu i g. The UVC plug-a d-play a chitectu e e su es the came a module ope ates co siste tly ac oss the poi t-of-sale a d kiosk ha dwa e platfo m va iety fou d i etail fleet deployme ts.
The Falco -521CRS is suppo ted by the Vadzo VISPA ARC SDK, p ovidi g p og ammatic co t ol ove st eami g, Regio of I te est (ROI) co figu atio , exposu e, a d t igge sy ch o izatio . APIs a e available i C, C++, C#, a d Pytho ac oss Wi dows, Li ux, a d embedded platfo ms. The SDK also cove s still image captu e, image flip, Sma t GPIO ma ageme t, a d secu e fi mwa e updates. Fo OEM developme t teams buildi g p oductio systems, the SDK educes time-to-i teg atio a d p ovides a co siste t co t ol i te face ac oss Vadzo’s USB 3.0 came a po tfolio, simplifyi g lifecycle ma ageme t as p oducts a e mai tai ed a d updated.
Fo gestu e ecog itio a d kiosk applicatio s, the AR0521 wo ks well because gestu e detectio algo ithms depe d o pe f ame colo image quality. Whe a use i te acts with a touchless kiosk o i te active sig age, thei ha d is usually movi g backlit by the display pa el a d positio ed at a dista ce that va ies f om use to use . The AR0521 low oise a chitectu e delive s usable colo f ames ac oss these co ditio s. That mea s the gestu e ecog itio pipeli e gets i puts that a e co siste tly good fo co tou ext actio segme tatio a d keypoi t estimatio without pe f ame de oisi g o f ame ave agi g that would add late cy. Vadzo Imagi g’s Falco -521CRS is built o the AR0521 a d adds USB 3.0 UVC complia ce, maki g it a p oductio eady AR0521 USB came a fo these deployme ts.
Vadzo Imagi g’s Falco -521CRS satisfies all these equi eme ts o a si gle module. Built o the O semi AR0521 se so with USB 3.0 UVC complia ce, it is a pu pose built kiosk visio came a desig ed fo exactly these deployme t co ditio s. The AR0521 low oise olli g shutte output e ables eliable gestu e detectio u de etail a d t a sit lighti g. Full UVC complia ce emoves custom d ive developme t a d e su es co siste t c oss platfo m ope atio ac oss Wi dows Li ux a d A d oid. At 5MP it suppo ts gestu es of face detectio a d audie ce a alytics o a si gle st eam. The Vadzo VISPA ARC SDK p ovides API level co t ol fo adva ced i teg atio eeds i cludi g ROI co figu atio exposu e co t ol a d GPIO t igge ma ageme t.
Low oise matte s because ha d segme tatio algo ithms ely o edge co t ast betwee the ha d a d the backg ou d. Se so oise c eates false edges a d b eaks co tou co ti uity causi g the segme tatio step to eithe miss pa ts of the ha d o i clude backg ou d a tifacts i the segme ted egio . Both e o s hu t the key poi t of estimatio quality that the classificatio step depe ds o . The lowe the se so oise floo the clea e the pe f ame co tou s a d the mo e eliable the gestu e classificatio output.
Rolli g shutte suits kiosk gestu e captu e because it outputs full f ame colo data at co ti uous f ame ates without the cost pe alty of global shutte se so a chitectu e. At typical gestu e executio speeds, the olli g shutte skew is below the detectio th eshold of the classificatio algo ithm. Vadzo Imagi g’s 5MP low oise USB came aFalco -521CRS combi es the AR0521 low oise output with USB 3.0 ba dwidth a d UVC plug a d play p ovidi g the complete imagi g subsystem fo p oductio kiosk gestu e ecog itio without custom d ive i teg atio .
Yes. A came a with full UVC complia ce ope ates as a plug a d play imagi g device o Wi dows Li ux a d A d oid without equi i g custom d ive i stallatio . All th ee ope ati g systems i clude ative UVC suppo t i thei sta da d d ive stacks. Whe a UVC complia t came a is co ected, the ope ati g system ecog izes it as a sta da d video captu e device a d makes it accessible to a y applicatio that ca access a video i put. This is t ue fo Wi dows f om ve sio 7 o wa d fo Li ux th ough the V4L2 f amewo k a d fo A d oid th ough the UVC host d ive i cluded i the OS.
Fo kiosk a d sig age deployme ts ope ati g at scale ac oss ma y i stalled te mi als, this matte s sig ifica tly. Custom d ive i stallatio s i t oduce pe u it deployme t steps OS upg ade compatibility isks a d lo g-te m d ive mai te a ce obligatio s. A fully low oise UVC came a emoves these co ce s e ti ely. Vadzo Imagi g’s Falco -521CRS is a fully UVC complia t AR0521 5MP USB 3.0 came a p oduct. It co ects a d st eams immediately o Wi dows Li ux a d A d oid without d ive setup. Fo adva ced featu es i cludi g ROI co t ol GPIO t igge ma ageme t a d exposu e co figu atio beyo d the UVC baseli e, the Vadzo VISPA ARC SDK p ovides c oss platfo m APIs that i stall sepa ately f om the d ive a d ope ate alo gside the ative UVC st eam.
Fo these platfo ms, the Falco -521CRS is well suited. The AR0521 low oise olli g shutte output p ovides clea colo f ames that gestu e AI models ca co sume di ectly without p e-p ocessi g ove head. The USB 3.0 UVC i te face co ects to the Jetso host p ocesso without custom d ive developme t si ce the Jetso Li ux BSP i cludes ative V4L2 UVC suppo t. The VISPA ARC SDK p ovides Pytho a d C++ APIs fo i teg atio with embedded kiosk came a applicatio s a d AI i fe e ce pipeli es u i g o Jetso a d simila AI capable edge hosts. Evaluatio u its a d full SDK docume tatio a e available at vadzoimagi g.com.
The Falco -521CRS AR0521 USB came a is available ow fo evaluatio a d p e-p oductio sampli g, with p oductio qua tities available fo OEM deployme t. E gi ee i g teams ca access the full tech ical datasheet a d SDK docume tatio at vadzoimagi g.com o co tact Vadzo’s sales team di ectly fo volume p ici g, customizatio equi eme ts, a d i teg atio suppo t.
Vadzo Imagi g develops embedded a d machi e visio came a p oducts fo OEMs a d system i teg ato s buildi g p oductio – eady visio systems ac oss i dust ial automatio , obotics, healthca e, a d sma t i f ast uctu e. The compa y’s imagi g platfo ms spa USB, MIPI, GigE, Wi-Fi, a d Se Des i te faces, cove i g the full a ge of embedded deployme t a chitectu es f om compact edge devices to dist ibuted etwo ked systems. Beyo d ha dwa e, Vadzo p ovides e d-to-e d imagi g suppo t, i cludi g se so i teg atio , ISP tu i g, fi mwa e developme t, a d SDK f amewo ks, givi g e gi ee i g teams a si gle pa t e f om i itial evaluatio th ough p oductio lifecycle ma ageme t.
