Energy Characterization and Optimization of Image Sensing Toward Continuous Mobile Vision

October 16, 2022 Post a Comment

energy-proportional image sensing for robert likamwa bodhi priyantha matthai philipose victor bahl...

Download ENERGY-PROPORTIONAL IMAGE SENSING FOR Robert LiKamWa Bodhi Priyantha Matthai Philipose Victor Bahl Lin Zhong CONTINUOUS MOBILE VISION

If you can't read please download the document

Post on 17-Dec-2015

213 views

Download

Embed Size (px)

TRANSCRIPT

Slide 1
ENERGY-PROPORTIONAL IMAGE SENSING FOR Robert LiKamWa Bodhi Priyantha Matthai Philipose Victor Bahl Lin Zhong CONTINUOUS MOBILE VISION http://roblkw.com http://research.microsoft.com
Slide 2
CONTINUOUS MOBILE VISION CONTINUOUS MOBILE VISION Conversational Face Detection 2 of 33
Slide 3
CONTINUOUS MOBILE VISION CONTINUOUS MOBILE VISION Gestures Object Memory 3 of 33 Face Recognition Victor Fine-grained Localization
Slide 4
BATTERY LIFE BATTERY DEATH Google Glass 2-3 hours LooxCie 2-3 hours GoPro Hero 2-3 hours 4 of 33
Slide 5
2000 mWh 10 h 200 mW 5 of 33
Slide 6
Image Sensor Goal < 25 mW Sensors ~ 5 mW Processor ~150 mW Network Stack ~20 mW 6 of 33
Slide 7
Image Sensor Goal < 25 mW 7 of 33 Image Sensor Reality > 250 mW
Slide 8
KEY IDEA: ENERGY QUALITY Power Frame rate Power Resolution
Slide 9
ENERGY PROFILE OF AN IMAGE SENSOR 1 MP, 5 fps 250 mW 1 MP, 5 fps 250 mW 0.3 MP, 15 fps 245 mW 0.3 MP, 15 fps 245 mW 1 MP, 15 fps 295 mW 1 MP, 15 fps 295 mW < 25 mW Goal: Reality: 0.3 MP, 5 fps 232 mW 0.3 MP, 5 fps 232 mW 9 of 38
Slide 10
ENERGY-EFFICIENT IMAGE SENSING Image Sensor Characterization Energy Reduction Techniques Energy vs. Vision Performance 10 of 38
Slide 11
IMAGE SENSOR MEASUREMENT Camera Module Programmable Clock (I2C) NI DAQ Device Power Rail Resistors Power Rail Resistors Power VDDCLK * Profiled 5 state-of-the-art image sensors from 2 manufacturers * 11 of 38
Slide 12
Camera Module Programmable Clock (I2C) NI DAQ Device Power Rail Resistors Power Rail Resistors IMAGE SENSOR MEASUREMENT 12 of 38
Slide 13
IMAGE SENSOR WAVEFORMS Active Period Idle Period Analog Digital PLL 13 of 38
Slide 14
IMAGE SENSOR WAVEFORMS Active Period Idle Period 14 of 38
Slide 15
IMAGE SENSOR WAVEFORMS Active Period Idle Period Pixel Count divided by Clock Frequency Frame Time minus Active Time
Slide 16
IMAGE SENSOR PIXEL COUNT (N) Region-of-Interest (Windowing) Active Power Time Power Time 16 of 38 Scaled Resolution (Pixel Skipping)
Slide 17
IMAGE SENSOR PIXEL COUNT (N) Active Power Time Power Time Video (30 FPS) Power vs. Resolution 17 of 38
Slide 18
Active Frame Readout Active Power Time Active IMAGE SENSOR FRAME RATE (R) Video (0.1 MP) Power vs. FPS Active Frame Readout Active Power Time Active 1.0s 18 of 38
Slide 19
CHARACTERIZATION CONCLUSION: NO ENERGY PROPORTIONALITY Video (0.1 MP) Power vs. FPS Video (30 FPS) Power vs. Resolution 19 of 38
Slide 20
ENERGY-EFFICIENT IMAGE SENSING Image Sensor Characterization Energy Reduction Techniques Energy vs. Vision Performance 20 of 38
Slide 21
TECHNIQUE # 1 : AGGRESSIVE STANDBY Active 21 of 38
Slide 22
Active CAVEAT TO AGGRESSIVE STANDBY Active Not enough exposure time This wont work for long active periods, i.e., high resolution, high frame rate. 22 of 38
Slide 23
TECHNIQUE # 2 : CLOCK SCALING (f) One pixel per clock period 23 of 38
Slide 24
TECHNIQUE # 2 : CLOCK SCALING (f) Faster clock Lower Active Time Higher Active Power Higher Idle Power Slower clock Higher Active Time Lower Active Power Lower Idle Power 24 of 38
Slide 25
TECHNIQUE # 2 : CLOCK SCALING (f) Active Low Pixel Count Low Frame Rate Slowed Clock Optimal clock frequency depends on Pixel Count & Frame Rate 25 of 38
Slide 26
AGGRESSIVE STANDBY + CLOCK OPTIMIZATION Sped-up Clock Aggressive Standby Active Readout Active Readout Activ e Read out Activ e Read out Optimal clock frequency depends on Pixel Count & Frame Rate Exposure Time 26 of 38
Slide 27
ENERGY QUALITY Frame rate (FPS) Resolution (MP) 30 25 20 15 10 5 0 21345 Frame rate (FPS) Resolution (MP) 30 25 20 15 10 5 0 21345 Power (mW) 350 300 250 200 150 100 50 0 Aggressive Standby & Clock Optimization Unoptimized Power (mW) 350 300 250 200 150 100 50 0 27 of 38
Slide 28
CPU Driver 28 of 37
Slide 29
29 of 38
Slide 30
CURRENT IMAGE SENSOR DESIGN Image Processor Pixel Array Column Output Pixel Array Column Output Gain, ADC Analog Signal Chain 70-85% Power Consumption 30 of 38
Slide 31
Image Processor Pixel Array Column Output Pixel Array Column Output High-Speed ADC Mid-Speed ADC Low-Speed ADC Gain HETEROGENEOUS SENSOR DESIGN Analog Signal Chain Heterogeneous 31 of 38
Slide 32
ENERGY QUALITY Default Clock select Standby HW Fix Power vs. Framerate (at 0.1 MP) Power vs. Resolution (at 5 FPS) Default Clock select Standby HW Fix 32 of 36
Slide 33
ENERGY-EFFICIENT IMAGE SENSING Image Sensor Characterization Energy Reduction Techniques Energy vs. Vision Performance 33 of 38
Slide 34
ENERGY vs. VISION: VISION TASK IMAGE REGISTRATION 34 of 36
Slide 35
ENERGY vs. VISION: PERFORMANCE Image Registration Success Power Reduction with software assist Estimated Power Reduction with hardware assist Full VGA Resolution 0.1 MP, 30 FPS 99.9%51%84% Frame Rate Reduction 0.1 MP, 3 FPS 95.7%95%98% 30% Window 0.06 MP, 30 FPS 96.5%63%91% Subsampled by 2 0.3 MP, 30 FPS 91.8%71%94% 185 mW Typical Average Power 10 mW With aggr. standby & optimal clock 3 mW With heterogeneous analog signal chain
Slide 36
Scalable Computer Vision Algorithms Integrated Systems Design Developer Support Energy Proportional Image Sensing 36 of 36
Slide 37
Slide 38
ENERGY-PROPORTIONAL IMAGE SENSING FOR CONTINUOUS MOBILE VISION http://roblkw.com http://research.microsoft.com Image sensors are not energy-proportional Frame rate (FPS) Resolution (MP) 30 20 10 0 135 but we can make them energy-proportional Aggressive Standby Clock Optimization Sensor Modifications and this is just the beginning.

An Overview of the CHOICE Network Victor Bahl bahl December 18, 2000

Mobile Location Sensing Tutorial Jie Liu, Dimitrios Lymberopoulos, Bodhi Priyantha, Jacky Shen Microsoft Research

Venerable Bhikkhu Bodhi - English Dharma آ Venerable Bhikkhu Bodhi Venerable Bhikkhu Bodhi, born in

Bodhi Meditation LA Journal 2013 Vol 6

Victor Bahl Microsoft hy439/lectures11/ON ICMU 2010 Bahl آ analysis (SIFT), demo-ed at internal

Bhikkhu Bodhi - Nyanaponika

Distance and Angle Measurements- based Indoor Location Estimation Bodhi Priyantha (bodhip@ )

RushNet: Practical Traffic Prioritization for Saturated Wireless Sensor Networks Chieh-Jan Mike Liang â€ , Kaifei Chen â€, Nissanka Bodhi Priyantha â€ , Jie

BODHI MEDITATION ENGLISH MAGAZINE_2013_VOL3_NO.1

Bodhi & liam.v

Bodhi Mind in your Bodhi Mind Inbox the Vancouver Buddhist Temple and the 40th anni-versary of the completion

chemical kinetics by arun bahl

Priyantha\'s Portfolio Profile

Ravi J Matthai Library - rjml-irma.in Ravi J Matthai Library . New Arrivals of Books: March & April

Bhikkhu Bodhi - Plemeniti Osmostruki Put

2015 Bodhi Surf Initiatives

Running Tide 29: Bodhi

Barack Obama - Bodhi T

Priyantha Wijayatunga - Policies for Clean Energy Development in South Asia

Sangha by Bhikkhu Bodhi

2014 Bodhi Surf Initiatives

Bodhi Mind in your Inbox Bodhi Mindvan ... VBT¢â‚¬â€‌Bodhi Mind May 2017, Issue #408 5 May Shotsuki (Memorial)

Bodhi Tree - 2017. 11. 29.¢ Bodhi Tree Buddha at Moment of Enlightenment, 2nd century CE . Bodhi Tree

Bodhi Puja and Protection Chanting

Connections through Innovations Victor Bahl Senior Researcher / Manager Networking Research Microsoft Corporation Victor Bahl Senior Researcher / Manager

SHALINI BAHL MARKETING STRATEGIST 2018. 4. 10.¢ SHALINI BAHL. 2 (CONTINUED) When we settle our minds,

Syriac Peshitta NT (Matthai)

WiFi vs. GPRS vs. 3G: Whats the answer? Victor Bahl bahl Microsoft Research

[ bodhi ] - Fedora History of Fedora updates bodhi ... adopted by yum, pup/puplet, and various other

The Cricket Indoor Location The Cricket Indoor Location System by Nissanka Bodhi Priyantha S.M. Computer

Website Design â€" Bodhi Swag

VBTâ€"Bodhi Mind Feb. & Mar. 2016, Issue #397 Membership Fees 2016 VBT Bodhi van 2020-01-22آ VBTâ€"Bodhi

The Cricket Indoor Location System Nissanka Bodhi Priyantha

SACRED SPACES (samsara). Bodhi is also translated as "awakening" or "understanding". Nirvana and bodhi

Bodhi Yoga kat

coppolawhichisatur.blogspot.com

Source: https://vdocument.in/energy-proportional-image-sensing-for-robert-likamwa-bodhi-priyantha-matthai.html

Coppola Whichisatur