Open an image using as little RAM as possible

1
votes

I want to open some relative big files (jpg, gif, bmp) using as little RAM as possible. Inside my program I need all open files converted to BMP so I can process them. However the conversion from JPG to BMP takes 27.1MB of RAM if I use the classic conversion code:

function ConvertJPG2BMP(FullFileName: string; BMP: TBitmap);
VAR JPG:  TJpegImage;
begin
 JPG:= TJpegImage.Create;
 TRY
   TRY
     JPG.LoadFromFile(FullFileName);
     BMP.Assign(JPG);
   EXCEPT
   END;
 FINALLY
   FreeAndNil(JPG);
 end;
end;

because it uses two images (a jpeg that is transferred to a bitmap then).

--

However, if I use a TPicture to load the file, I use only 7.1MB of RAM. But in this case the TPicture.Bitmap is empty and I need a valid TBitmap object.

Is there any way to load images from disk while keeping the mem footprint small?

--

(Test file: 1.JPG 2.74MB 3264x1840 pix)

2
delphigraphics
Why you need to keep mem usage low? Modern PC has usually so much memory that 30 MB is barely noticeable. If you really want to keep memory usage low, you need probably deconstruct JPEG file "block by block".. – Harriv
agree with Harriv on decoding remark, tiny footprint requires a) decoding JPEG 8×8px blocks separately and b) writing raster data to memory mapped DIB section. TJpegImage and TBitmap are incapable to comply with a) and b) respectively. GPL? – Premature Optimization
Disargee about "just buy more RAM", tho. – Premature Optimization
For the sake of comparison, convert your JPEG file to BMP and load the BMP file directly. How much memory does your program consume when you skip the JPEG? – Rob Kennedy
@Harriv, i guess its a natural programmer's desire to minimize unneeded memory usage. And the OP's task not required having entire raster in memory. Also, OP's test raster is pretty small, naïve approach will eat more. @Altar, got an idea for comparison - TJPEGImage.Scale affects decoding memory footprint, make sure competing method(s) are not optimizing decompression this way. – Premature Optimization

2 Answers

1
votes

Back of the envelope calculation gives 6 mega pixels. Assuming 32 bit colour this takes you to 24MB.

You aren't going to do any better than your current code.

1
votes

The memory usage does not come from the JPEG library, but in the way you use it.

If you convert a JPEG into a TBitmap, it will create a bitmap resource, then uncompress the JPEG into the bitmap memory buffer.

You can paint directly from the JPEG content into the screen. Depending on the JPEG implementation, it will use (or not) a temporary TBitmap.

You are not tied to the JPEG unit supplied by Borland.

For instance, you may try calling directly the StretchDIBits() windows API from the uncompressed memory buffer, as such (this code is extracted from our SSE JPEG decoder):

procedure TJpegDecode.DrawTo(Canvas: TCanvas; X, Y: integer);
var BMI: TBitmapInfo;
begin
  if @self=nil then
    exit;
  ToBMI(BMI);
  StretchDIBits(Canvas.Handle,X,Y,width,height,0,0,width,height,pRGB,
   BMI,DIB_RGB_COLORS,SrcCopy);
end;

Creating a huge bitmap is sometimes not possible (at least under Windows XP), because it uses shared GDI resources, whereas using plain RAM and StretchDIBits will always work, even for huge content. You can create a memory mapped file to handle the binary content, but just allocating the memory at once would suffice (and Windows will use hard drive only if short of RAM). With today's PCs, you should have enough RAM available even for big pictures. (17 MB is not a big deal, even for your 3264x1840 pix).

Then, from this global uncompressed memory buffer containing raw pixel triplets, you can use a smaller bitmap corresponding to a region of the picture, then work on the region using StretchDIBits(aBitmap.Handle,.... It will use less GDI resource.

You could also rely for instance on GDI+ drawing, which will draw it without any temporary bitmap. See e.g. this OpenSource unit. From our testing, it's very fast and can be used without any TBitmap. You could also ask only for a region of the whole picture, and draw it using GDI+ on your bitmap canvas: this will use less RAM. And your exe will be a bit smaller than the default JPEG unit. And you'll be able to display and save not only JPEG, but GIF and TIFF formats.

If you want to minimize even further the memory usage, you'll have to call directly the JPEG library, at lowest-level. It's able to uncompress only a region of the JPEG. So you would be able to minimize used RAM. You may try using the IJL library with Delphi, a bit old, but still working.