403 Error when scraping images

[alfkoblischke]

I have a problem with some Image-URLS and get a 403 Error. It is no problem to call the URL in the Browser - that works perfectly.
Can anybody help? URL: [https://www.allianz.de/content/dam/onemarketing/azde/azd/newsletter/images/august-2024/lp3/newsletter-august-teaser-600x600-wohnwagenversicherung-lp3.jpg]

[spekulatius]

Hey @alfkoblischke

have you tried setting a browser agent?

Peter

[alfkoblischke]

Hi Peter,
yes I have. My code:

`require_once './vendor/autoload.php';

use Spekulatius\PHPScraper\PHPScraper;

$url = 'https://www.allianz.de/content/dam/onemarketing/azde/azd/newsletter/images/august-2024/lp3/newsletter-august-teaser-600x600-wohnwagenversicherung-lp3.jpg';

$web = new PHPScraper;
$web->setConfig([
'agent' => 'Mozilla/5.0 (X11; Linux x86_64; rv:107.0) Gecko/20100101 Firefox/107.0'
]);

$sharingImage = $web->fetchAsset($url);`

And the following Error: "Fatal error: Uncaught Symfony\Component\HttpClient\Exception\ClientException: HTTP/2 403 returned for "https://www.allianz.de/content/dam/onemarketing/azde/azd/newsletter/images/august-2024/lp3/newsletter-august-teaser-600x600-wohnwagenversicherung-lp3.jpg....""

The strange thing is, that i can call the url in the browser and it works there.

Alf

[spekulatius]

hmm, I guess the site does validate the request against further criteria. You probably want to look at the other headers send over with the request. Copying the request from the browser console as curl, then striping the things away until it breaks might help