Skip to content

Instantly share code, notes, and snippets.

@remoharsono

remoharsono/scraping.php

Last active October 6, 2020 05:51
Show Gist options
  • Save remoharsono/72d60a93846de69ce4587ceb0f63dffd to your computer and use it in GitHub Desktop.
Save remoharsono/72d60a93846de69ce4587ceb0f63dffd to your computer and use it in GitHub Desktop.
Download ZIP
answering question on twitter
Raw
scraping.php
<?php
// https://twitter.com/the_paTiku/status/1276075890812878848
require 'vendor/autoload.php';
use GuzzleHttp\Client;
use GuzzleHttp\Exception\RequestException;
use GuzzleHttp\Psr7\Request;
use DiDom\Document;
use DiDom\Query;
$client = new \GuzzleHttp\Client();
$base = 'https://resellers.tp-partner.pl';
$url = $base . '/?action=sklepy&cmd=getCity&pr=zachodniopomorskie';
$response = $client->request('GET', $url);
$html = (string) $response->getBody();
$document = new Document($html);
$links = $document->find('.miasta > li > a::attr(href)');
foreach($links as $link) {
$url = $base . $link;
$response = $client->request('GET', $url);
$html = (string) $response->getBody();
$document = new Document($html);
$emails = $document->find('.email > a::attr(href)');
if (!empty($emails)) {
echo str_replace("mailto:", "", $emails[0]) . "\n";
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment