Unable to retrieve images

Currently we try to provide another party with our product images via a productfeed. Unfortunately they don’t seem to be able to retrieve the images and can only share that there is an error instead of what the actual error is. They could share the IP-address but I can’t find it in the firewall logs, also I added it within the firewall rules to provide acces but there doesn’t seem to be any activity.

Is there maybe a way to debug this issue via other logs within the cloudflare interface?

Hm, could you re-check in case if you have got the Hotlink Protection enabled under the Scrape Shield tab at Cloudflare dashboard for your domain name?

Kindly, add it to both a Firewall Rule and IP Access Rule with action “Allow”.

Does any request appear from that IP or some other in Firewall Events log?

Hi @fritex , thanks for all suggestion! I checked them all and Hotlink Protection wasn’t enabled, I already added the IP-addresses they provided (2 possible IP’s) a couple of weeks ago, both in Firewall Rules and IP Access Rules with the action Allow. Also I don’t see any of the IP’s as blocked IP’s in the Firewall Events log, only a couple of requests via Tor.

I use these headers, maybe that could have an impact?
Header always set Strict-Transport-Security: “max-age=31536000” env=HTTPS
Header always set Content-Security-Policy “upgrade-insecure-requests”
Header always set X-Content-Type-Options “nosniff”
Header always set X-XSS-Protection “1; mode=block”
Header always set Expect-CT “max-age=7776000, enforce”
Header always set Referrer-Policy: “no-referrer-when-downgrade”
Header always append X-Frame-Options SAMEORIGIN
Header always set Permissions-Policy “geolocation=(); midi=();notifications=();push=();sync-xhr=();accelerometer=(); gyroscope=(); magnetometer=(); payment=(); camera=(); microphone=();usb=(); xr=();speaker=(self);vibrate=();fullscreen=(self);”

This is what they came back with “we experienced timeouts on the requests. The connection is accepted, but we get no data…”

Maybe any other suggestions or logs I could check?

Could you share with us an URL link to the image you tried to provide to the another party?

RSS feed or?

Of course, hereby a link to an image within the feed that couldn’t be retrieved:

The feed is setup as an XML feed via the Product Feed Pro Wordpress plugin.

I also found some additional information on how they would like to process images:
Ensure that all image URLs are accessible by the ip addresses and that there is no rate limit.
To reduce the latency when updating an ad we suggest that the response contains either an ETag and/or Last-Modified header which only changes when the image itself has changed. It should also be possible to check these headers using a HEAD request.

Media types
Each resource has a specific media type of the following form to support content negotiation and versioning : application/sellside.{entity}-{version}+json;charset=utf-8

The version field is mandatory.
The media type is used for the Content-Type and Accept headers.
This allows us to change the structure of a response without breaking existing code since you have to request the new content type while the old version is still available for some time. For backwards compatible changes like adding a new field to an existing structure we will not change the version number.

Content-Type and Accept Headers
Every request must set the Accept header to:

, application/json

This permits the server to generate the response in the format the caller expects. application/json is required to return the error response.

Additionally, each POST and PUT request must also set the Content-Type header to:

@fritex any other suggestions maybe based on the information I shared?

I am not aware what else could be blocking it.

There was one more topic, the same day about the same or similar WP Plugin for Product Feed here:

We have discussed through few posts to determine what it could be, but unfortunately again I am not 100% sure what could be the issue.
The OP stated as far as he switch to :grey: (DNS-only), it works, but why it doesn’t work with :orange: proxied mode enabled then?

Should it be delivered as JSON instead of XML to them maybe?

Maybe this HTTP request methods are being blocked?

Maybe because the images are delivered using KeyCDN?
Are you using a CNAME setup for some subdomain to serve them, or?

I could try myself to setup and install WordPress/WooCommerce including the same plugin and check that way, if I would get some error, if so.

@fritex thanks for the reply and suggestions again!

The problem isn’t with the feed, that is picked up correctly. However only the images don’t seem to be retrieved successfully although the connection is accepted, but no image data is delivered.

HTTP request methods could be the issue, I will investigate that a little further.

We are not using a DNS CNAME record as far as I’m aware. We have 2 CNAME records set up, one for www which is proxied and a wildcard for the domain with * in front which is DNS only.

Apart from this plugin we also installed Wordfence, I can’t find anything being blocked there but could imagine it could block something as well…

1 Like

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.