How would I clear the JS based data in this web page?

Last week, there was a new tool called #Homescreen that allows people to share screenshots of the apps they have on their iPhone home screen. For example: https://homescreen.is/iamfinnym

I would like to create a scraper that extracts the names of all applications given on the user page (in addition to their location on the screen). How should I do it? I know how to create a normal HTML scraper, but it looks like apps are being created on the page via some kind of JavaScript React.js call, and I'm not sure how to figure it out. (I can write basic Javascript, but I've never used React.js before, and I don't know how to get started.)

+3


source to share


1 answer


This is how you can get the data through the Chrome dev console:

If you open the Chrome dev console ( Ctrl / Cmd+ Shift+ C) and go to the net you will find this :

hosted image chrome console



If you click on it, you will see that the API is configured so that when you make a GET request for https://homescreen.is/api/user/{USERNAME}

, you will receive your applications data as responseData.apps

. Click Preview to get a preview of the data sent by the API:

hosted image chrome console pt 2

Now you can use any library of the language's http pages to make GET requests to the API.

+4


source







All Articles