You are here: Foswiki>Tasks Web>Item1613 (11 Oct 2015, SvenDowideit)Edit Attach

Item1613: GetAWebPlugin: Out of memory error

pencil
Priority: Urgent
Current State: Needs Developer
Released In: n/a
Target Release: n/a
Applies To: Extension
Component: GetAWebPlugin
Branches:
Reported By: PhilippLeufke
Waiting For:
Last Change By: SvenDowideit

Description

Exporting a web with GetAWebPlugin ends up with an Out of memory message in apache2/error.log:

[Mon May 11 10:17:40 2009] [error] [client XXX.XXX.XXX.XXX] Out of memory!
[Mon May 11 10:17:42 2009] [error] [client XXX.XXX.XXX.XXX] Premature end of script headers: rest

While the export of the Main and System webs worked flawlessly, the export of a web with quite many image attachments resulted in the error printed above.

System Info

Disk usage of the mentioned webs:
  • the Main web, where it worked, is: 3.6M for data and 179M for pub
  • the web which gave the error is: 2.1M for =data and 589M for pub

Memory usage:
             total       used       free     shared    buffers     cached
Mem:       1945104     130872    1814232          0       3696      30412
-/+ buffers/cache:      96764    1848340
Swap:      2715640      40708    2674932

The server is running Debian stable with following foswiki and perl packages installed:
gnuift-perl                                              0.1.14-9                             
libalgorithm-diff-perl                                   1.19.02-1                            
libapache2-mod-perl2                                     2.0.4-5                              
libapache2-reload-perl                                   0.10-2                               
libarchive-zip-perl                                      1.18-1                               
libberkeleydb-perl                                       0.34-1+b1                            
libbit-vector-perl                                       6.4-7+b1                             
libbsd-resource-perl                                     1.28-1+b1                            
libcarp-clan-perl                                        6.00-1                               
libcgi-session-perl                                      4.35-1                               
libcompress-raw-zlib-perl                                2.012-1                              
libcompress-zlib-perl                                    2.012-1                              
libconfig-inifiles-perl                                  2.39-5                               
libconvert-asn1-perl                                     0.21-1                               
libconvert-binhex-perl                                   1.119+pristine-3                     
libcrypt-smbhash-perl                                    0.12-2                               
libcrypt-ssleay-perl                                     0.57-1+b1                            
libdate-calc-perl                                        5.4-5+b1                             
libdate-manip-perl                                       5.54-1                               
libdbd-mysql-perl                                        4.007-1                              
libdbi-perl                                              1.605-1                              
libdevel-symdump-perl                                    2.08-1                               
libdigest-hmac-perl                                      1.01-7                               
libdigest-md4-perl                                       1.5.dfsg-1.2+b1                      
libdigest-sha1-perl                                      2.11-2+b1                            
liberror-perl                                            0.17-1                               
libexpect-perl                                           1.20-1                               
libfile-copy-recursive-perl                              0.36-1                               
libfile-path-expand-perl                                 1.02-1                               
libfile-rsyncp-perl                                      0.68-1.1+b1                          
libfile-temp-perl                                        0.20-1                               
libfinance-quote-perl                                    1.13-3                               
libfont-afm-perl                                         1.20-1                               
libglib-perl                                             1:1.190-2                            
libgnome2-vfs-perl                                       1.080-1+b1                           
libgraphics-magick-perl                                  1.1.11-3.2                           
libhtml-format-perl                                      2.04-2                               
libhtml-parser-perl                                      3.56-1+b1                            
libhtml-tableextract-perl                                2.10-3                               
libhtml-tagset-perl                                      3.20-2                               
libhtml-template-perl                                    2.9-1                                
libhtml-tree-perl                                        3.23-1                               
libhttp-cache-transparent-perl                           1.0-1                                
libio-compress-base-perl                                 2.012-1                              
libio-compress-zlib-perl                                 2.012-1                              
libio-pty-perl                                           1:1.07-1+b1                          
libio-socket-ssl-perl                                    1.16-1                               
libio-stringy-perl                                       2.110-4                              
libio-stty-perl                                          0.02-10                              
libio-zlib-perl                                          1.09-1                               
libjcode-pm-perl                                         2.06-1                               
liblocale-gettext-perl                                   1.05-4                               
liblocale-maketext-lexicon-perl                          0.66-1                               
libmail-sendmail-perl                                    0.79-5               
libmail-spf-perl                                         2.005-1                              
libmail-spf-query-perl                                   1:1.999.1-3                          
libmailtools-perl                                        2.03-1                               
libmime-perl                                             5.427-1                              
libmime-tools-perl                                       5.427-1                              
libmldbm-perl                                            2.01-2                               
libnet-cidr-lite-perl                                    0.20-2                               
libnet-daemon-perl                                       0.38-1.1                             
libnet-dbus-perl                                         0.33.6-1+b1                          
libnet-dns-perl                                          0.63-2                               
libnet-ip-perl                                           1.25-2                               
libnet-ldap-perl                                         1:0.36-1                             
libnet-ssleay-perl                                       1.35-1                               
libnetaddr-ip-perl                                       4.007+dfsg-2+b1                      
libnews-nntpclient-perl                                  0.37-7                               
libole-storage-lite-perl                                 0.17-1                               
libparse-recdescent-perl                                 1.95.1+dfsg-3                        
libparse-yapp-perl                                       1.05-11                              
libperl5.10                                              5.10.0-19                            
libplrpc-perl                                            0.2017-1.1                           
libsocket6-perl                                          0.20-1                               
libspreadsheet-parseexcel-perl                           0.3200-2                             
libspreadsheet-writeexcel-perl                           2.22-1                               
libsys-hostname-long-perl                                1.4-2                                
libsys-syslog-perl                                       0.26-1                               
libterm-readline-gnu-perl                                1.17a-2+b1                           
libtext-charwidth-perl                                   0.04-5+b1                            
libtext-diff-perl                                        0.35-3                               
libtext-iconv-perl                                       1.7-1+b1                             
libtext-template-perl                                    1.44-1.2                             
libtext-wrapi18n-perl                                    0.06-6                               
libtime-modules-perl                                     2006.0814-2                          
libtimedate-perl                                         1.1600-9                             
libunicode-map-perl                                      0.112-10+b1                          
libunicode-map8-perl                                     0.12-3+b1                            
libunicode-maputf8-perl                                  1.11-2                               
libunicode-string-perl                                   2.09-3+b1                            
libuniversal-require-perl                                0.11-1                               
liburi-perl                                              1.35.dfsg.1-1                        
libuuid-perl                                             0.02-3+b1                            
libwww-perl                                              5.813-1                              
libxml-dom-perl                                          1.44-1                               
libxml-handler-trees-perl                                0.02-5                               
libxml-libxml-common-perl                                0.13-6+b1                            
libxml-libxml-perl                                       1.66-1+b1                            
libxml-namespacesupport-perl                             1.09-3                               
libxml-parser-perl                                       2.36-1.1+b1                          
libxml-perl                                              0.08-1                               
libxml-regexp-perl                                       0.03-7                               
libxml-sax-expat-perl                                    0.40-1                               
libxml-sax-perl                                          0.16+dfsg-3                          
libxml-twig-perl                                         1:3.32-1                             
libxml-writer-perl                                       0.604-1                              
libxml-xql-perl                                          0.68-4                               
perl                                                     5.10.0-19                            
perl-base                                                5.10.0-19                            
perl-doc                                                 5.10.0-19                            
perl-modules                                             5.10.0-19                            
perl-suid                                                5.10.0-19                            
perl-tk                                                  1:804.028-1+b1                       
perlmagick                                               7:6.3.7.9.dfsg2-1~lenny1             
foswiki                                                  1.0.5-1                              
foswiki-attachcontentplugin                              081124-194                           
foswiki-attachlinkplugin                                 081224-194                           
foswiki-autocompletionlibplugin                          090316-194                           
foswiki-batchuploadplugin                                090320-194                           
foswiki-dbcachecontrib                                   090409-194                           
foswiki-dbicontrib                                       090320-194                           
foswiki-editrowplugin                                    090225-194                           
foswiki-excelimportexportplugin                          090313-194                           
foswiki-filterplugin                                     090418-194                           
foswiki-findelsewhereplugin                              090326-194                           
foswiki-formqueryplugin                                  090409-194                           
foswiki-foswikisiteskin                                  090417-194                           
foswiki-fugueiconscontrib                                090421-194                           
foswiki-genpdfaddon                                      090301-194                           
foswiki-getawebplugin                                    090220-194                           
foswiki-glueplugin                                       090418-194                           
foswiki-gouptotocplugin                                  090203-194                           
foswiki-imagegalleryplugin                               090425-194                           
foswiki-imageplugin                                      090425-194                           
foswiki-jhotdrawplugin                                   090206-194                           
foswiki-jquerycompatibilitymodeplugin                    090315-194                           
foswiki-mathmodeplugin                                   090424-194                           
foswiki-mediaplugin                                      090509-194                           
foswiki-moveabletypeskin                                 090220-194                           
foswiki-publishplugin                                    090327-194                           
foswiki-redirectplugin                                   090410-194                           
foswiki-topiclistplugin                                  090203-194                           
foswiki-widgetsskin                                      090127-194                           


wow, thats a pain, the tar or gziping of the rather large pub dir is eating memory. I'm not sure there's much we can do to prevent this.

its quite likely that you're running up against apache's memory limit (its settable iirc), not physical memory.

one thing I do differently, is to not call the rest handler from th web browser, rather do it from the command line, but this may not help either :/

-- SvenDowideit - 19 May 2009


Could you tell me how to do that?

-- PhilippLeufke - 31 May 2009

ItemTemplate edit

Summary GetAWebPlugin: Out of memory error
ReportedBy PhilippLeufke
Codebase
SVN Range Foswiki-1.0.0, Thu, 08 Jan 2009, build 1878
AppliesTo Extension
Component GetAWebPlugin
Priority Urgent
CurrentState Needs Developer
WaitingFor
Checkins
TargetRelease n/a
ReleasedIn n/a
CheckinsOnBranches
trunkCheckins
masterCheckins
ItemBranchCheckins
Release01x01Checkins
Topic revision: r4 - 11 Oct 2015, SvenDowideit
The copyright of the content on this website is held by the contributing authors, except where stated elsewhere. See Copyright Statement. Creative Commons License    Legal Imprint    Privacy Policy