You need to be logged in to post in the forum - Log In

An active JCE Pro Subscription is required to post in the forum - Buy a Subscription

Support is currently Offline

Official support hours
Monday to Friday
09:00 - 17:00 Europe/London (BST)

Please create a new Ticket and we will get back to you as soon as we can.

#107658 Bulk upload stalling and/or failing

Posted in ‘Editor’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Latest post by kcoweb on Friday, 30 April 2021 02:05 BST

kcoweb
Hi, I'm struggling with the File Browser - it works fine with single uploads or batches of 5-7 files, uploading them in a fraction of second, but if I select 20 or more it takes forever to complete and some files end up with invalid JSON response message. The files are just jpegs 200-300k each. All processing is off - no cropping, no resizing, no watermarking, no exif removing, nothing. Imagick is present, GD is there. It's clearly some sort of server misconfiguration but I can't figure it out yet (it's my own so there's no hoster to complain to). The only relevant log entries were from apache error log, basically it times out due to PHP_FPM refusing to swallow the lot. All while the server itself is plenty powerful in all respects and literally idling. I'm trying to raise different limits here and there to absurdly high values but that didn't help much so far: now the upload stalls for five minutes then fails, sometimes partially.


[Tue Apr 27 12:13:04.585171 2021] [proxy_fcgi:error] [pid 18083:tid 46961746544384] (70007)The timeout specified has expired: [client 180.150.90.48:50642] AH01075: Error dispatching request to : (polling), referer: https://zzz.com/administrator/index.php?option=com_jce&task=plugin.display&plugin=browser&standalone=1&8c7cdf0fa3237f17bf2f04af2766a6bb=1&client=1&context=10000
[Tue Apr 27 12:13:04.657582 2021] [proxy_fcgi:error] [pid 18083:tid 46961778063104] (70007)The timeout specified has expired: [client 180.150.90.48:50642] AH01075: Error dispatching request to : (polling), referer: https://zzz.com/administrator/index.php?option=com_jce&task=plugin.display&plugin=browser&standalone=1&8c7cdf0fa3237f17bf2f04af2766a6bb=1&client=1&context=10000
[Tue Apr 27 12:13:05.692422 2021] [proxy_fcgi:error] [pid 18083:tid 46961752848128] (70007)The timeout specified has expired: [client 180.150.90.48:50642] AH01075: Error dispatching request to : (reading input brigade), referer: https://zzz.com/administrator/index.php?option=com_jce&task=plugin.display&plugin=browser&standalone=1&8c7cdf0fa3237f17bf2f04af2766a6bb=1&client=1&context=10000
[Tue Apr 27 12:13:24.646586 2021] [proxy_fcgi:error] [pid 18083:tid 46961790670592] (70007)The timeout specified has expired: [client 180.150.90.48:50642] AH01075: Error dispatching request to : (reading input brigade), referer: https://zzz.com/administrator/index.php?option=com_jce&task=plugin.display&plugin=browser&standalone=1&8c7cdf0fa3237f17bf2f04af2766a6bb=1&client=1&context=10000
[Tue Apr 27 12:13:24.683572 2021] [proxy_fcgi:error] [pid 18083:tid 46961803278080] (70007)The timeout specified has expired: [client 180.150.90.48:50642] AH01075: Error dispatching request to : (reading input brigade), referer: https://zzz.com/administrator/index.php?option=com_jce&task=plugin.display&plugin=browser&standalone=1&8c7cdf0fa3237f17bf2f04af2766a6bb=1&client=1&context=10000
[Tue Apr 27 12:13:24.767153 2021] [proxy_fcgi:error] [pid 18083:tid 46961746544384] (70007)The timeout specified has expired: [client 180.150.90.48:50642] AH01075: Error dispatching request to : (reading input brigade), referer: https://zzz.com/administrator/index.php?option=com_jce&task=plugin.display&plugin=browser&standalone=1&8c7cdf0fa3237f17bf2f04af2766a6bb=1&client=1&context=10000

it's PHP 7.4.16, Joomla 3.9.26, Centos7.9, cPanel 94.0.5, Apache 2.4 with mod_mpm_event, PHP_FPM, http/2 (so it's a single connection) I don't expect anyone to fix it for me but would really appreciate a nudge in the right direction. p.s. is it at all feasible to change the logic of bulk upload to chain XHR calls and not fire them all at once? That would remove the immediate problem.

Ryan
p.s. is it at all feasible to change the logic of bulk upload to chain XHR calls and not fire them all at once? That would remove the immediate problem.


This would mean that each file would have to finish uploading before the next file is uploaded, which is not very efficient.

I was able to upload 70+ files on my local test (MAMP) server without any issue, and similar amount to this site without any errors.

Ryan Demmer

Lead Developer / CEO / CTO

Just because you're not paranoid doesn't mean everybody isn't out to get you.

kcoweb
Hi Ryan,

Thanks for your help,

It's getting even messier though.

I've spent the evening tuning PHP-FPM then realised the problem exists only in Firefox and Tor; Chrome and Edge upload any number of files with no hiccups while in Firefox progress bars freeze at random positions then wake up in a few minutes if I'm patient enough (raised request time limit to insane value).

Firefox console log is clean, php-fpm error log is clean, tried with all extensions turned off, network connection is reasonably fast and stable (tried from two places).

Now the confusing part: my local test site (Windows 10, apache 2.4, php-fpm 7.3) also has no problem uploading hundreds of files at once in any browser. *facepalm*

I'll update if I figure it out.

Cheers