Stats: 3,191,066 members, 7,942,864 topics. Date: Saturday, 07 September 2024 at 06:39 PM |
Nairaland Forum / Science/Technology / Programming / Data Scraping Of Jumia Product Using Selenium And Flask In An API Format (309 Views)
Does Opay Have An Api / How To Retrieve Data From An Api Using Fetch Api In Javascript / Django And Flask Users, Your Help Is Needed Please (2) (3) (4)
Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 11:01am On Mar 25 |
In time of high cost of goods we can leverage the deal of scraping different product and compere the price to get the best deal out of everything. Building data acquisition and transformation pipelines. Leave a star ![]() https://github.com/Arinze1020/jumia_market_scraper |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by ShoeGetSize: 11:14am On Mar 25 |
Isn't this illegal? 1 Like |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 11:47am On Mar 25 |
ShoeGetSize:You can scrap check their robots.txt file check the git link everything is there. |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Felixitie(m): 9:34pm On Mar 27 |
This is cool bro. Why not just use BS4 only instead of starting with selenium, since bs4 is faster and lighter, also considering the fact that the jumia site is not dynamically loaded by Javascript. 1 Like |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by airsaylongcome: 10:32pm On Mar 27 |
ShoeGetSize: How is scrapping illegal? 1 Like |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 1:19pm On Mar 29 |
Felixitie:They have Javascript which I have to load first. Using only BS4 won't get me the data I needed. |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 1:20pm On Mar 29 |
airsaylongcome:In most case it's illegal, but you just have to look up the robots.txt file to see what the site allows and what they don't allow. |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Felixitie(m): 11:06pm On Mar 29 |
Mrquote: I doubt if it is illegal to scrape . Site owners are only scared of the effect of bombarding their site with series of request on their website. So, The way you make use of the data you finally scraped makes it illegal or legal! |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by CORPSEFUCKER: 5:09am On Mar 30 |
Based Chad Selenium is only for chads |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 12:50pm On Mar 30 |
CORPSEFUCKER:What do you mean by chad? |
Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote: 12:51pm On Mar 30 |
Felixitie:In all that's why you have to read their robots.txt |
(1) (Reply)
Website Development / #ideas 0003 – Electricity Payment Platform. / Rust: The Most Impressive Kid On The Block
(Go Up)
Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health religion celebs tv-movies music-radio literature webmasters programming techmarket Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 12 |