340 likes | 446 Views
Learn how to combine DIS for video stabilization and H.264 for improved coding efficiency. Explore architectures, motion estimation techniques, and address issues for future work.
E N D
H.264 and DIS 指導教授:楊士萱 老師 學生:鄭馥銘
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
Introduction • Why use DIS in video-footage device • Video footage from hand-held camera is typically jerky due to small,unwanted camera movements. • We present a video stabilization algorithm aimed to produce a compensated video sequence so that the camera’s undesirable shake or jiggle can be removed.
Categories of DIS • Mechanical-Optical system • Mechanical-Digital system • Fully Digital system
Architecture of DIS - 1 • Pre-processing Diadv :Need additional memory、sensor、chip input output Stabilization Video-Encoder Video-Decoder
Architecture of DIS - 2 • Post-processing Adv:No motion estimation computation Disadv:Coding efficiency can not be increased Stabilization input output Video-Encoder Video-Decoder
Architecture of DIS - 3 • Combine-Encoder • Adv:Save memory、sensor、chip、Coding efficiency can be increased。 • Disdv :? Stabilization input output Video-Encoder Video-Decoder
Summarize the goal of DIS-system • Combine DIS and H.264 Encoder • Our DIS using block-base ME is suited with encoder so that DIS can immediate get MV form encoder. • Coding efficiency can be increased • Jitter can be removed
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
H.264 Baseline Profile • Free to use • Tools • I Slice • P Slice • CAVLC • Slice Group • Redundant Slice
Review of DIS system Block-Blased Motion Estimation MVs MV Validation LMVs FMV Generation FMV Hand – shake Estimation SMV , HMV , AMV Motion correction
Review of DIS system Block-Blased Motion Estimation MVs MV Validation LMVs FMV Generation FMV Hand – shake Estimation SMV , HMV , AMV Motion correction
ME - In DIS system • MB Size
ME - In DIS system • Reference picture management • Short term • Long term
ME - In DIS system • Pixel Resolution • Full pixel • Half pixel • Quarter pixel
ME - In DIS system • H.264 Main profile • B Slice
ME - In DIS system • H.264 Main profile • Interlaced
ME - In DIS system • Slice group • Ex 1:interlace • Ex 2:foreground & background
Combine DIS system and H.264 Block-Blased Motion Estimation Block-Blased Motion Estimation MVs MV Validation MVs LMVs Hand – shake Estimation FMV Generation FMV Hand – shake Estimation SMV , HMV , AMV SMV , HMV , AMV Motion correction Motion correction
Combine DIS system and H.264 Block-Blased Motion Estimation MVs Hand – shake Estimation SMV , HMV , AMV Motion correction
H.264 Encoder Architecture HE Motion Correction ?
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
Some problem of combination issue • Where to place Motion Correction module • What we need • MV buffer • Delay residual coding
DIS-H.264 system architecture-1 MV Buffer HE Motion Correction
Some problem of combination issue • DIS-H.264 system architecture-1 • Maybe jitter can be removed • But it does not increase coding efficiency
Remark of combination issue • Shifting frame to stable position(Motion Correction) before motion estimation, in order to increase coding efficiency. • Shifting frame to stable position(Motion Correction) before motion estimation ,Because the size of reference frame is smaller than current frame.
Future work • Ability to modify reference software program • To assess the effects of DIS-H.264 system