# Scrape html pages

**URL:** <https://community.glideapps.com/t/scrape-html-pages/3074>\
**Category:** Ask for Help\
**Created:** [December 23, 2019, 1:23am UTC](https://community.glideapps.com/t/scrape-html-pages/3074 "2019-12-23T01:23:06Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![mrdobelina](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/mrdobelina/32/2308_2.png) [@mrdobelina](https://community.glideapps.com/u/mrdobelina)\
**Post date:** [December 23, 2019, 1:23am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/1 "2019-12-23T01:23:06Z")

</div>

Hello,

After my tour of the 24 record stores in Brooklyn taking pics, I wanted to make an app. So, I’ve started to build - [https://recordstoresnyc.glideapp.io](https://recordstoresnyc.glideapp.io) - and I’m pretty happy about it!

But now I want to complicate things (obviously) and add information coming from Discogs profile for those stores who have it.

So far, for now, I made it retrieve the first page of listings from a profile page with =IMPORTHTML(“[Vinyl Records, CDs, and More from FaceRecordsNYC For Sale at Discogs Marketplace](https://www.discogs.com/seller/FaceRecordsNYC/profile)”, “table”,3)

But now I’m facing some issues and questions:

- how can I retrieve the image, name, and price of the records? At the moment with =importhtml I’m importing a field with more generic info that I don’t need. So, for the image, I’m trying with the below, with no luck

=IMPORTXML(“[Vinyl Records, CDs, and More from FaceRecordsNYC For Sale at Discogs Marketplace](https://www.discogs.com/seller/FaceRecordsNYC/profile)”, “//\*[@id=‘pjax\_container’]/table/tbody/tr[1]/td[1]/a/img/data-src”)

- can I make pagination to retrieve all pages of a profie to get all their records?

Basically, what I need is: _If the record store has a Discogs account, I want to display the list of records with image and price, scraping their Discogs page._

Sounds easy! But not enough for me 😂— any help would be highly appreciated!

---

<div class="post-metadata">

**Author:** ![Jeff\_Hager](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/jeff_hager/32/43_2.png) [@Jeff\_Hager](https://community.glideapps.com/u/Jeff_Hager)\
**Post date:** [December 23, 2019, 2:31am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/2 "2019-12-23T02:31:51Z")

</div>

For pagination, you could modify the URL to grab 250 results and do multiple queries to try to retrieve maybe 10 results.

> [https://www.discogs.com/seller/FaceRecordsNYC/profile?sort=listed%2Cdesc&limit=\*\*250\*\*&page=\*\*1](https://www.discogs.com/seller/FaceRecordsNYC/profile?sort=listed%2Cdesc&limit= **250** &page=**1)\*\*

---

<div class="post-metadata">

**Author:** ![George\_B](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/george_b/32/534_2.png) [@George\_B](https://community.glideapps.com/u/George_B)\
**Post date:** [December 23, 2019, 2:39am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/3 "2019-12-23T02:39:23Z")

</div>

Very cool, I like the pictures you took.

They do have an API that apparently gives you direct access to the data but you should check their TOC and Polices to see what is allowed and what is not. By using the API you can get access to all that you need.

That said, I have used Google script to retrieve and add and update data into Mailchimp via their API, and it was a pretty challenge for me. So for someone without programming experience it could be significantly more difficult to pull off.

> **[Terms of Service](https://support.discogs.com/hc/en-us/articles/360009334333#licenseandsite)**
>
> View Discogs Terms of Service effective through December 31, 2019 
> View NearMint Terms of Service effective through December 31, 2019 
> \------
> Effective Date: January 1, 2020
> ACKNOWLEDGMENT AND ACCE...

  

> **[API Terms of Use](https://support.discogs.com/hc/en-us/articles/360009334593-API-Terms-of-Use)**
>
> Effective Date: December 11, 2019
> These Terms of Use (“TOU”) govern your (“You” or “Your”) use of Zink Media, LLC (d/b/a Discogs) and our affiliates (“We”, “Our”, “Us” or “Discogs”) Application Pro...

---

<div class="post-metadata">

**Author:** ![mrdobelina](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/mrdobelina/32/2308_2.png) [@mrdobelina](https://community.glideapps.com/u/mrdobelina)\
**Post date:** [December 23, 2019, 2:43am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/4 "2019-12-23T02:43:22Z")

</div>

Ah that’s cool! Haven’t noticed I could do the 250 results, thanks. However, how would I have to set multiple queries in a sheet?

---

<div class="post-metadata">

**Author:** ![George\_B](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/george_b/32/534_2.png) [@George\_B](https://community.glideapps.com/u/George_B)\
**Post date:** [December 23, 2019, 2:44am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/5 "2019-12-23T02:44:48Z")

</div>

Here is a link to their API if you are interested in exploring that route.  
[https://www.discogs.com/developers](https://www.discogs.com/developers)

---

<div class="post-metadata">

**Author:** ![mrdobelina](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/mrdobelina/32/2308_2.png) [@mrdobelina](https://community.glideapps.com/u/mrdobelina)\
**Post date:** [December 23, 2019, 2:47am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/6 "2019-12-23T02:47:34Z")

</div>

Hi George! Thanks.

I know about their API but not being a developer I’m having hard time to understand how to integrate them, so I was looking into a “simpler” solution with importhtml/importxml or any other trick. I was thinking to use [https://parabola.io/](https://parabola.io/) to make it easier, but I still haven’t looked in detail.

---

<div class="post-metadata">

**Author:** ![Jeff\_Hager](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/jeff_hager/32/43_2.png) [@Jeff\_Hager](https://community.glideapps.com/u/Jeff_Hager)\
**Post date:** [December 23, 2019, 2:51am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/7 "2019-12-23T02:51:15Z")

</div>

I was thinking of just putting an ImportHtml query every 250 rows or something like that, and just changing the page number for each query. Didn’t put a whole lot of thought into it. 😉

---

<div class="post-metadata">

**Author:** ![ionamol](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/ionamol/32/1951_2.png) [@ionamol](https://community.glideapps.com/u/ionamol)\
**Post date:** [December 23, 2019, 4:25am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/8 "2019-12-23T04:25:10Z")

</div>

Hi @mrdobelina, I think that the best way for you is by using [parabola.io](http://parabola.io) but you can also try something like Simple Scraper

> **[Simplescraper - Product Information, Latest Updates, and Reviews 2023 |...](https://www.producthunt.com/products/simplescraper#simple-scraper)**
>
> Web scraping made easy — a fast and free Chrome extension for scraping websites in your browser, automated in the cloud, or via API.

Loop

> **[Loop - Product Information, Latest Updates, and Reviews 2023 | Product Hunt](https://www.producthunt.com/products/loop-10#loop-10)**
>
> Loop is a Chrome Extension that lets you trigger Zapier workflow and loop back result directly in your browser! Push information to Zapier (note, URL, screenshot) from the page you're on, and send back from Zapier rich notification to the Chrome...

IMPORTJSON (it’s a custom script)

> <https://github.com/bradjasper/ImportJSON/blob/master/ImportJSON.gs>

And IMPORTXML (I’ve talked about it in this post)

> [@Glide Translator and Gas Prices](https://community.glideapps.com/t/glide-translator-and-gas-prices/2578):
>
> Hello everyone, I just want to share these simple tests I’m creating because I think they can help the community. I created an app called Minimaker Labs, is just a sandbox to test some ideas and Glide features. [https://thelab.glideapp.io](https://thelab.glideapp.io) Right now I have 2 pages running: Transend - Translate text and send it to any telephone number via SMS or Whatsapp I used the Google Sheet function “GOOGLETRANSLATE” to translate (obviously) the text the user inputs. To send SMS with the body using the tra…

Hope it helps you, let me know if you need help with any of these tools/tips.

---

<div class="post-metadata">

**Author:** ![mrdobelina](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/mrdobelina/32/2308_2.png) [@mrdobelina](https://community.glideapps.com/u/mrdobelina)\
**Post date:** [December 23, 2019, 4:29am UTC](https://community.glideapps.com/t/scrape-html-pages/3074/9 "2019-12-23T04:29:15Z")

</div>

Awesome, thank you @ionamol! Lots of things to read and learn. Will check and let you know if I have any questions 🙏
