Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,208,270 members, 8,002,115 topics. Date: Thursday, 14 November 2024 at 01:22 AM

Data Scraping Of Jumia Product Using Selenium And Flask In An API Format - Programming - Nairaland

Nairaland Forum / Science/Technology / Programming / Data Scraping Of Jumia Product Using Selenium And Flask In An API Format (350 Views)

Does Opay Have An Api / How To Retrieve Data From An Api Using Fetch Api In Javascript / Django And Flask Users, Your Help Is Needed Please (2) (3) (4)

(1) (Reply) (Go Down)

Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 11:01am On Mar 25
In time of high cost of goods we can leverage the deal of scraping different product and compere the price to get the best deal out of everything. Building data acquisition and transformation pipelines. Leave a star grin

https://github.com/Arinze1020/jumia_market_scraper
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by ShoeGetSize: 11:14am On Mar 25
Isn't this illegal?

1 Like

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 11:47am On Mar 25
ShoeGetSize:
Isn't this illegal?
You can scrap check their robots.txt file check the git link everything is there.
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Felixitie(m): 9:34pm On Mar 27
This is cool bro.

Why not just use BS4 only instead of starting with selenium, since bs4 is faster and lighter, also considering the fact that the jumia site is not dynamically loaded by Javascript.

1 Like

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by airsaylongcome: 10:32pm On Mar 27
ShoeGetSize:
Isn't this illegal?

How is scrapping illegal?

1 Like

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 1:19pm On Mar 29
Felixitie:
This is cool bro.

Why not just use BS4 only instead of starting with selenium, since bs4 is faster and lighter, also considering the fact that the jumia site is not dynamically loaded by Javascript.
They have Javascript which I have to load first. Using only BS4 won't get me the data I needed.
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 1:20pm On Mar 29
airsaylongcome:


How is scrapping illegal?
In most case it's illegal, but you just have to look up the robots.txt file to see what the site allows and what they don't allow.
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Felixitie(m): 11:06pm On Mar 29
Mrquote:

In most case it's illegal, but you just have to look up the robots.txt file to see what the site allows and what they don't allow.

I doubt if it is illegal to scrape . Site owners are only scared of the effect of bombarding their site with series of request on their website. So, The way you make use of the data you finally scraped makes it illegal or legal!
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by CORPSEFUCKER: 5:09am On Mar 30
Based Chad



Selenium is only for chads
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 12:50pm On Mar 30
CORPSEFUCKER:
Based Chad



Selenium is only for chads
What do you mean by chad?
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 12:51pm On Mar 30
Felixitie:


I doubt if it is illegal to scrape . Site owners are only scared of the effect of bombarding their site with series of request on their website. So, The way you make use of the data you finally scraped makes it illegal or legal!
In all that's why you have to read their robots.txt

(1) (Reply)

Ios 13 – Features And Improvements. What’s In It For Developers! / 7 Skills To Become A Web Developer / ..

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 12
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.