Path: EDN Asia >> Design Centre >> Consumer Electronics >> Off-screen video frame composition, decomposition
Consumer Electronics Share print

Off-screen video frame composition, decomposition

10 Jan 2014  | Sharath Bhat

Share this page with your friends

In the case of video streams with a frame rate of 30 fps, these operations have to be carried out at every 1/30s, i.e., a 33.33-ms frame period. And if the frame's pixel resolutions are higher, i.e., 720p, 1080p, then it becomes a highly CPU intensive task to process such frames. The CPU loading results in a poor user interface due to less I/O interactivity. It also results in dropping of frames during frame composition if the processor is unable to process a frame within the frame period.


Using platform specific resizer/scaler
Some embedded processors provide platform-specific resizer hardware implementation. These are poly-phase filters implemented in the hardware with programmable filter coefficients for different scaling ratios.

In order to expose this platform-specific feature for the application, a custom device driver will be provided by the CPU chip vendor. The application can use this resizer through the resizer device driver for composition functionality. The application resizes one input frame at a time on to the output frame with different input/output crop parameters. The resizer interrupts the CPU core once it completes resizing of one input frame onto an output frame.

For the application to compose N input frames on to one output frame, it has to perform N resize operations in one frame period. These resizers are very efficient and perform resize operations within acceptable time limits. The output frame rate of the composited frames depends on the resize time taken for every single resize operation.

For N to 1 composition, involving input/output frames of same pixel resolution,



In the case of composition involving input/output frames of different pixel resolution,


The above formulas are also applicable to a decompositor with one input and N output channels.

Though using this method provides an efficient solution, it fails to address portability. These hardware features are specific to an embedded processor. Either it will not be available on a different embedded processor or it will be implemented in a different way with different feature list.

The interfaces and the features provided by the device drivers controlling this custom hardware are different on each embedded processor. Also, in general, some features like rotation, alpha blending etc., cannot be implemented using such resizer hardware.


About the author
Sharath Bhat is lead engineer for Multimedia Systems, System On Chip IP Business Unit at Ittiam Systems Pvt. Ltd, Bangalore, India.


To download the PDF version of this article, click here.


 First Page Previous Page 1 • 2 • 3


Want to more of this to be delivered to you for FREE?

Subscribe to EDN Asia alerts and receive the latest design ideas and product news in your inbox.

Got to make sure you're not a robot. Please enter the code displayed on the right.

Time to activate your subscription - it's easy!

We have sent an activate request to your registerd e-email. Simply click on the link to activate your subscription.

We're doing this to protect your privacy and ensure you successfully receive your e-mail alerts.


Add New Comment
Visitor (To avoid code verification, simply login or register with us. It is fast and free!)
*Verify code:
Tech Impact

Regional Roundup
Control this smart glass with the blink of an eye
K-Glass 2 detects users' eye movements to point the cursor to recognise computer icons or objects in the Internet, and uses winks for commands. The researchers call this interface the "i-Mouse."

GlobalFoundries extends grants to Singapore students
ARM, Tencent Games team up to improve mobile gaming


News | Products | Design Features | Regional Roundup | Tech Impact