Embedded media processing 好书分享

pengruojing

目录在这里，自己看吧，需要的下。ADI两位伙计的力作
音频视频图像都有了。

Preface............................................................................................ xix
History of This Book.................................................................................................. xix
Chapter Overviews........................................................................................................xx
Chapter 1: Embedded Media Processing................................................................xx
Chapter 2: Memory Systems ..................................................................................xx
Chapter 3: Direct Memory Access (DMA)........................................................... xxi
Chapter 4: System Resource Partitioning and Code Optimization....................... xxi
Chapter 5: Basics of Embedded Audio Processing............................................... xxi
Chapter 6: Basics of Embedded Video and Image Processing............................. xxi
Chapter 7: Media Processing Frameworks.......................................................... xxii
Chapter 8: Power Management for Embedded Systems...................................... xxii
Chapter 9: Application Examples....................................................................... xxiii
Acknowledgments..................................................................................................... xxiii
Acronyms........................................................................................ xxv
About the Authors.......................................................................... xxix
What’s on the CD-ROM?................................................................ xxxi
Chapter 1: Embedded Media Processing................................................1
Why Are You Reading This Book?.................................................................................1
So What’s All the Excitement About Embedded Multimedia Systems?........................2
A Simplified Look at a Media Processing System..........................................................4
Core Processing .......................................................................................................4
Input/Output Subsystems—Peripheral Interfaces.....................................................6
Subsystem Control..............................................................................................6
Storage ...............................................................................................................8
Contents
Contents
Connectivity........................................................................................................9
Data Movement.................................................................................................10
Memory Subsystem................................................................................................11
Laying the Groundwork for an EMP Application ........................................................11
What Kind(s) of Media Am I Dealing With? .........................................................12
What Do I Need to Do With the Data? ..................................................................12
Are My System Needs Likely to Change Over Time, or
Will This Be a Static System? ..........................................................................12
Is This a Portable Application?...............................................................................12
Does my Application Require a Fixed-Point or Floating-Point Device?................13
How Does the Data Get Into and/or Out of the Chip? ...........................................14
How Do I Develop on the Processor?.....................................................................14
Do I Need an Operating System?............................................................................14
What Are the Different Ways to Benchmark a Processor?.....................................15
How Much Am I Willing to Spend? .......................................................................16
OK, So What Processor Choices Do I Have? ........................................................17
ASIC and ASSP ...............................................................................................17
FPGA (Field-Programmable Gate Array).........................................................18
MCU.................................................................................................................19
DSP...................................................................................................................22
Discrete DSP + MCU ......................................................................................23
Convergent Processor........................................................................................24
A Look Inside the Blackfin Processor..........................................................................26
System View............................................................................................................27
Computational Units...............................................................................................28
Memory Model.......................................................................................................29
DMA.......................................................................................................................30
Instruction Flow......................................................................................................30
Event Handler.........................................................................................................31
Protection of Resources..........................................................................................32
Programming Model...............................................................................................32
Power Management ...............................................................................................33
What’s Next?.................................................................................................................35
Chapter 2: Memory Systems..............................................................37
Introduction...................................................................................................................37
Memory Spaces.............................................................................................................38
L1 Instruction Memory...........................................................................................40
Using L1 Instruction Memory for Data Placement...........................................40
viii
Contents
L1 Data Memory.....................................................................................................41
Cache Overview............................................................................................................42
What Is Cache?.......................................................................................................42
Direct-Mapped Cache.......................................................................................45
Fully Associative Cache....................................................................................45
N-Way Set-Associative Cache..........................................................................46
More Cache Details.................................................................................................46
Write-Through and Write-Back Data Cache....................................................49
More Cache in Our Future................................................................................51
External Memory..........................................................................................................51
Synchronous Memory.............................................................................................52
SDRAM............................................................................................................52
CAS Latency...............................................................................................57
Refreshing the SDRAM..............................................................................58
Mobile SDRAM..........................................................................................59
Double Data Rate (DDR) SDRAM/DDR1.......................................................60
DDR2 SDRAM ................................................................................................61
Asynchronous Memory...........................................................................................62
Nonvolatile Memories.......................................................................................65
NAND and NOR Flash Memories..............................................................66
Hard Disk Storage—IDE, ATA and ATAPI................................................70
Other Hard Drive Interfaces..................................................................71
Serial ATA (SATA)..........................................................................71
SCSI................................................................................................72
Microdrive.......................................................................................72
USB/Firewire..................................................................................72
Emerging Nonvolatile Memory Technologies............................................73
What’s Next?.................................................................................................................73
Chapter 3: Direct Memory Access......................................................75
Introduction...................................................................................................................75
DMA Controller Overview.....................................................................................76
More on the DMA Controller.......................................................................................78
Programming the DMA Controller...............................................................................80
DMA Classifications.....................................................................................................92
Register-Based DMA .......................................................................................92
Descriptor-Based DMA....................................................................................95
Descriptor Management..............................................................................96
Advanced DMA Features..............................................................................................99
ix
Contents
System Performance Tuning...................................................................................99
External DMA.......................................................................................................100
What’s Next?...............................................................................................................101
Chapter 4: System Resource Partitioning and Code Optimization.........103
Introduction.................................................................................................................103
Event Generation and Handling..................................................................................104
System Interrupts..................................................................................................104
Programming Methodology .......................................................................................107
Architectural Features for Efficient Programming.....................................................108
Multiple Operations per Cycle..............................................................................109
Hardware Loop Constructs...................................................................................110
Specialized Addressing Modes.............................................................................112
Byte Addressability.........................................................................................112
Circular Buffering...........................................................................................112
Bit Reversal.....................................................................................................115
Interlocked Instruction Pipelines..........................................................................116
Compiler Considerations for Efficient Programming.................................................119
Choosing Data Types......................................................................................120
Arrays versus Pointers....................................................................................120
Division...........................................................................................................121
Loops ..............................................................................................................121
Data Buffers....................................................................................................123
Intrinsics and In-lining....................................................................................123
Volatile Data ...................................................................................................125
System and Core Synchronization..............................................................................125
Load/Store Synchronization..................................................................................126
Ordering ...............................................................................................................126
Atomic Operations ...............................................................................................129
Memory Architecture—The Need for Management...................................................129
Memory Access Tradeoffs....................................................................................129
Instruction Memory Management—To Cache or To DMA?................................131
Data Memory Management..................................................................................132
What About Data Cache?................................................................................133
System Guidelines for Choosing Between DMA and Cache...............................135
Instruction Cache, Data DMA........................................................................135
Instruction Cache, Data DMA/Cache.............................................................136
Instruction DMA, Data DMA.........................................................................136
Memory Management Unit (MMU).....................................................................140
Contents
CPLB Management...................................................................................140
Memory Translation..................................................................................141
Physics of Data Movement.........................................................................................141
Grouping Like Transfers to Minimize Memory Bus Turnarounds.......................142
Understanding Core and DMA SDRAM Accesses..............................................144
Keeping SDRAM Rows Open and Performing Multiple Passes on Data............145
Optimizing the System Clock Settings and Ensuring Refresh Rates
are Tuned for the Speed At Which SDRAM Runs..........................................147
Exploiting Priority and Arbitration Schemes Between System Resources...........
148
What’s Next?...............................................................................................................148
Chapter 5: Basics of Embedded Audio Processing...............................149
Introduction.................................................................................................................149
What Is Sound?.....................................................................................................149
Audio Signals........................................................................................................151
Speech Processing.................................................................................................152
Audio Sources and Sinks............................................................................................152
Converting Between Analog and Digital Audio Signals.......................................152
Background on Audio Converters.........................................................................155
Audio ADCs....................................................................................................155
Audio DACs....................................................................................................156
Connecting to Audio Converters...........................................................................156
An ADC Example...........................................................................................156
I2S (Inter-IC-Sound)..................................................................................158
SPI (Serial Peripheral Interface)...............................................................158
DACs and Codecs...........................................................................................159
AC ’97 (Audio Codec ’97)........................................................................159
Speech Codecs..........................................................................................160
PWM Output.............................................................................................160
Interconnections..........................................................................................................160
Connectors................................................................................................161
Digital Connections..................................................................................161
Dynamic Range and Precision....................................................................................162
Numeric Formats for Audio..................................................................................166
Fixed-Point Arithmetic....................................................................................168
Floating-Point Arithmetic...............................................................................168
Emulation on 16-Bit Architectures.................................................................170
Floating-Point Emulation on Fixed-Point Processors...............................171
Double-Precision Fixed-Point Emulation.................................................171
xi
Contents
32-Bit-Accurate Emulation.......................................................................171
31-Bit-Accurate Emulation.......................................................................173
Audio Processing Methods.........................................................................................174
Getting Data to the Processor’s Core....................................................................174
Block Processing versus Sample Processing........................................................174
Double-Buffering..................................................................................................174
2D DMA...............................................................................................................176
Basic Operations...................................................................................................176
Signal Generation..................................................................................................178
Filtering and Algorithms.......................................................................................178
Finite Impulse Response (FIR) Filter.............................................................178
Infinite Impulse Response (IIR) Filter............................................................179
Fast Fourier Transform....................................................................................179
Sample Rate Conversion.......................................................................................180
Audio Compression..............................................................................................181
MP3.................................................................................................................183
AAC................................................................................................................183
AC-3................................................................................................................183
WMA..............................................................................................................183
RealAudio.......................................................................................................184
Vorbis..............................................................................................................184
FLAC..............................................................................................................184
Speech Compression.............................................................................................184
GSM................................................................................................................185
The “G-Dot” Standards...................................................................................186
G.711...............................................................................................................186
G.723.1............................................................................................................186
G.729...............................................................................................................187
Speex...............................................................................................................187
What’s Next?...............................................................................................................187
Chapter 6: Basics of Embedded Video and Image Processing................189
Introduction.................................................................................................................189
Human Visual Perception......................................................................................189
What’s a Video Signal?.........................................................................................191
Broadcast TV—NTSC and PAL.................................................................................193
Video Resolution...................................................................................................193
Interlaced versus Progressive Scanning................................................................194
Color Spaces...............................................................................................................195
xii
Contents
Gamma Correction................................................................................................196
Chroma Subsampling............................................................................................198
Digital Video...............................................................................................................201
ITU-R BT.601 (formerly CCIR-601) ...................................................................202
ITU-R BT.656 (formerly CCIR-656) ...................................................................202
A Systems View of Video...........................................................................................206
Video Sources.......................................................................................................207
Analog Video Sources.....................................................................................207
Digital Video Sources.....................................................................................208
CCDs and CMOS Sensors........................................................................208
Bayer Pattern.......................................................................................208
Connecting to Image Sensors..............................................................211
Image Pipe..........................................................................................211
Video Displays......................................................................................................214
Analog Video Displays...................................................................................214
Video Encoder...........................................................................................214
Cathode Ray Tubes (CRTs)......................................................................216
Digital Video Displays....................................................................................217
Liquid Crystal Display (LCD) Panels.......................................................217
OLED (Organic Light-Emitting Diode) Displays.....................................219
Embedded Video Processing Considerations..............................................................219
Video Port Features ..............................................................................................219
Packing............................................................................................................221
Possible Data Flows........................................................................................222
Video ALUs..........................................................................................................223
DMA Considerations............................................................................................227
Planar versus Interleaved Buffer Formats.......................................................228
Double-Buffering............................................................................................228
Classification of Video Algorithms.......................................................................229
Bandwidth Calculations........................................................................................230
Sample Video Application Walk-Through..................................................................231
Deinterlacing.........................................................................................................232
Scan Rate Conversion ..........................................................................................233
Pixel Processing....................................................................................................234
2D Convolution.....................................................................................................235
Dealing With Image Boundaries ..........................................................................236
Chroma Resampling, Gamma Correction and Color Conversion.........................237
Scaling and Cropping............................................................................................238
Increasing or Decreasing Pixels per Row.......................................................238
xiii
Contents
Increasing or Reducing Lines per Frame........................................................239
Display Processing................................................................................................239
Alpha Blending...............................................................................................239
Compositing....................................................................................................240
Chroma Keying...............................................................................................240
Rotation...........................................................................................................240
Output Formatting...........................................................................................241
Compression/Decompression.....................................................................................241
Lossless versus Lossy Compression.....................................................................242
Image Compression..............................................................................................243
BMP................................................................................................................243
GIF..................................................................................................................244
PNG.................................................................................................................244
JPEG...............................................................................................................244
JPEG2000.......................................................................................................244
Video Compression ..............................................................................................245
Motion JPEG (M-JPEG).................................................................................246
H.261...............................................................................................................247
MPEG-1..........................................................................................................247
MPEG-2..........................................................................................................247
H.263...............................................................................................................248
MPEG-4..........................................................................................................248
DV...................................................................................................................248
QuickTime .....................................................................................................249
RealVideo........................................................................................................249
Windows Media Video (WMV)/VC-1............................................................249
Theora.............................................................................................................249
H.264...............................................................................................................249
Encoding/Decoding on an EMP............................................................................250
Transcoding ....................................................................................................251
What’s Next?...............................................................................................................252
Chapter 7: Media Processing Frameworks.........................................253
Introduction.................................................................................................................253
What Is a Framework?..........................................................................................254
Defining Your Framework ..........................................................................................255
The Application Timeline.....................................................................................256
Evaluating Bandwidth.....................................................................................257
Processor Bandwidth................................................................................260
xiv
Contents
DMA Bandwidth.......................................................................................261
Memory Bandwidth..................................................................................261
Asymmetric and Symmetric Dual-Core Processors...................................................264
Programming Models..................................................................................................265
Asymmetric Programming Model........................................................................265
Homogeneous Programming Model.....................................................................267
Master-Slave Programming Model.................................................................268
Pipelined Programming Model.......................................................................269
Strategies for Architecting a Framework....................................................................270
Processing Data On-the-Fly .................................................................................270
Programming Ease Trumps Performance ............................................................273
Performance-Based Framework............................................................................276
Image Pipe and Compression Example..........................................................277
High Performance Decoder Example.............................................................278
Framework Tips ...................................................................................................282
Other Topics in Media Frameworks............................................................................283
Audio-Video Synchronization..............................................................................283
Managing System Flow........................................................................................285
Frameworks and Algorithm Complexity...............................................................289
What’s Next?...............................................................................................................289
Chapter 8: Power Management for Embedded Systems.......................291
Introduction.................................................................................................................291
A Processor’s View of Power......................................................................................292
Input Clock............................................................................................................293
Phase-Locked Loop (PLL)....................................................................................293
Frequency, Voltage and Power..............................................................................294
Processor Power Modes........................................................................................297
Full-On Mode..................................................................................................298
Active Mode....................................................................................................298
Sleep Mode.....................................................................................................298
Deep-Sleep Mode............................................................................................299
Hibernate Mode..............................................................................................299
Taking Advantage of Power Modes................................................................299
Power Domains.....................................................................................................301
Other Considerations............................................................................................302
Power-Friendly Architectures ........................................................................302
Symmetric Multiprocessing......................................................................302
Software Tools................................................................................................303
xv
Contents
Voltage Regulation......................................................................................................303
Linear Regulators..................................................................................................304
Switching Regulators............................................................................................305
Step-Down Switching Regulator....................................................................306
Efficiency .............................................................................................................310
Component Selection for Step-Down Regulators.......................................................311
Schottky Diode and FET Switch...........................................................................311
Inductor Considerations........................................................................................312
Inductance Value.............................................................................................312
Saturation Current...........................................................................................313
DC Resistance.................................................................................................314
Self-Resonant Frequency................................................................................314
Capacitor Considerations......................................................................................314
Technology/Construction................................................................................314
Capacitance Value...........................................................................................314
Ripple Current.................................................................................................316
Input and Output Filtering..............................................................................316
Switching Frequency............................................................................................317
Calculating System Power..........................................................................................318
Average Power Dissipation ..................................................................................318
Average Internal Power Consumption ...........................................................319
Average External Power Dissipation .............................................................320
Battery Fundamentals.................................................................................................321
Primary Batteries..................................................................................................322
Alkaline...........................................................................................................322
Lithium............................................................................................................323
Silver Oxide....................................................................................................323
Zinc Air...........................................................................................................323
Rechargeable Batteries..........................................................................................323
Nickel Cadmium (NiCd).................................................................................323
Nickel Metal Hydride (NiMH).......................................................................323
Lithium Ion (Li+ or Li-Ion)............................................................................324
Lithium Polymer.............................................................................................324
Relative Power for External Devices..........................................................................326
Chapter 9: Application Examples......................................................327
Introduction.................................................................................................................327
Automotive Driver Assistance....................................................................................328
Automotive Safety Systems..................................................................................328
xvi
Contents
Smart Airbags..................................................................................................328
Collision Avoidance and Adaptive Cruise Control ........................................329
Lane Departure—A System Example...................................................................331
Image Acquisition...........................................................................................333
Memory and Data Movement...................................................................333
Projection Correction......................................................................................336
Image Filtering ...............................................................................................336
Edge Detection................................................................................................338
Straight Line Detection—Hough Transform..................................................339
Lane Tracking.................................................................................................342
Decision Making.............................................................................................343
Baseline JPEG Compression Overview......................................................................344
Preprocessing........................................................................................................344
Color Space.....................................................................................................344
Spatial Filtering.....................................................................................................345
Discrete Cosine Transform (DCT)........................................................................346
Quantization..........................................................................................................347
Zigzag Sorting.......................................................................................................348
Coding the DC Coefficients..................................................................................349
Coding the AC Coefficients (Run-Length Coding)...............................................350
Entropy Encoding ................................................................................................350
Huffman Coding.............................................................................................351
JPEG File Interchange Format (JFIF)...................................................................352
MPEG-2 Encoding......................................................................................................353
Motion Estimation/Compensation........................................................................354
Frame Types..........................................................................................................356
Format Conversion................................................................................................357
MPEG-2 Encoder Frameworks.............................................................................359
Code Optimization Study Using Open-Source Algorithms........................................363
What Is Open Source?..........................................................................................363
What Is Ogg?..................................................................................................363
What Is Vorbis?...............................................................................................364
What Is Speex?...............................................................................................366
Optimizing Vorbis and Speex on Blackfin............................................................366
Compiler Optimization...................................................................................368
System Optimization.......................................................................................370
Instruction Execution......................................................................................370
Data Management...........................................................................................371
Assembly Optimization..................................................................................372
xvii
Contents
Appendix: Sources and Further Reading............................................373
Chapter 1.........................................................................................................373
Chapter 2.........................................................................................................373
Chapter 3.........................................................................................................374
Chapter 4.........................................................................................................374
Chapter 5.........................................................................................................374
Chapter 6.........................................................................................................375
Chapter 7.........................................................................................................377
Chapter 8.........................................................................................................377
Chapter 9.........................................................................................................378
Index.............................................................................................379
xviii

waveguides

听起来很不错

waveguides

A book from 2006 or 2005.

pupukid

Old book but good one

keenforce001

好东西啊，不得不赞啊

jshx1987

回复 1# pengruojing


    学习看看

thanhmaikmt

thank you,

五柠檬

回复 1# pengruojing


   挺不错的 顶一下

kuan

谢谢分享.不错

wolf_totem_369

好东西，必须赞！！