I want the commented items from an external website. I cannot edit the website.
The website looks like this, i editted a lot of things out but this is the path from the body:
JavaScript
x
<body> <div class="js-standby-status tn-relative"> <div class="tn-container serp-mobile-container"> <div class="tn-row tn-row-sm-spacing search-page"> <section class="span-d-9 section-main-content-SERP"> <div id="js-products"> <section class="js-results-wrapper"> <section> <ul class="product-list main-product-list-wrapper"> <li class="product-list-item product-list-item-first standby-status"> <article> <div class="sl-search-result mobile-search-result"> <a class="sl-search-result-link" href="$url"></a> <!-- Link is needed --> <div class="search-result-body"> <a class="top-item-title_wrapper"> <h2 class="search-result-name"> Dunlop Winter Sport 5</h2> <span itemprop="mpn"> 5452000470454 </span> </a> <div class="tn-row"> <div class="span-d-6"> <div class="product-description"> <ul class="search-result-desc-list"> <li class="search-result-desc-list-item" title="205/55 R16 91H">205/55 R16 91H </li> </ul> </div> </div> </div> </div> </div> </article> </li> </ul> </section> </section> </div> </section> </div> </div> </div></body></html>I am using PHP HTML Simple Dom and PHP 7.3.
I am currently using this code to get the information from the website:
JavaScript
$html = file_get_html($url); if(!empty($html)){ $content_url = $html->find(".product-list-item", 0)->find('.sl-search-result', 0)->find('.sl-search-result-link', 0)->getAttribute('href', 0); $content_naam = $html->find(".product-list-item", 0)->find('.sl-search-result', 0)->find('.sl-search-result-link')->find('.search-result-body', 0)->find('.top-item-title_wrapper', 0)->find('.search-result-name', 0)->plaintext; $content_ean = $html->find(".product-list-item", 0)->find('.sl-search-result', 0)->find('.sl-search-result-link')->find('.search-result-body', 0)->find('.top-item-title_wrapper', 0)->find("span[itemprop='mpn")->plaintext; $content_maat = $html->find(".product-list-item", 0)->find('.sl-search-result', 0)->find('.sl-search-result-link')->find('.search-result-body', 0)->find('.tn-row', 0)->find('span-d-6', 0)->find('.product-description')->find('.search-result-desc-list')->find('.search-result-desc-list-item')->plaintext; if(!empty($content_url)){ if(!empty($content_naam)){ if(!empty($content_ean)){ if(!empty($content_maat)){ echo $item . ". <a href='" . $content_url . "'>EAN: " . $content_ean . " Product naam: " . $content_naam ."</a><br/>"; }else{ echo "Content maat is empty."; } }else{ echo "Content ean is empty"; } }else{ echo "Content naam is empty"; } }else{ echo "Content URL is empty"; } }else{ echo "No HTML found!"; } }I get an error in the script, not on the website but in the logs of my apache2 server. See below:
JavaScript
Uncaught Error: Call to a member function find() on null in /var/www/html/scraper/bandenNL.php:30nStack trace:n#0 {main}n thrown in /var/www/html/scraper/bandenNL.php on line 30Do you want more information, just comment.
Advertisement
Answer
If I understand you correctly, something along these lines should get you close enough to what you are looking for:
JavaScript
include('simple_html_dom.php');$htmlDoc = new DOMDocument();$htmlDoc->loadXML($html);$xpath = new DOMXpath($htmlDoc);$link = $xpath->query("//a[@href]/@href");$name = $xpath->query('//h2[@class="search-result-name"]/text()');$mpn = $xpath->query('//span[@itemprop="mpn"]/text()');$title_attr = $xpath->query('//li[@class="search-result-desc-list-item"]/@title');$title = $xpath->query('//li[@class="search-result-desc-list-item"]/text()');echo "Link: ". $link[0]->textContent . "<br>";echo "Name: ". $name[0]->textContent . "<br>";echo "MPN: ". $mpn[0]->textContent . "<br>";echo "Title attribure: ". $title_attr[0]->textContent . "<br>";echo "Title: ". $title[0]->textContent . "<br>";Output:
JavaScript
Link: my.urlName: Dunlop Winter Sport 5 MPN: 5452000470454 Title attribure: 205/55 R16 91HTitle: 205/55 R16 91H