Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,208,210 members, 8,001,916 topics. Date: Wednesday, 13 November 2024 at 06:53 PM

Chronicle Of A Data Scientist/analyst - Programming (40) - Nairaland

Nairaland Forum / Science/Technology / Programming / Chronicle Of A Data Scientist/analyst (356417 Views)

Chronicle Of A Data/cloud Engineer / Net Salary For A Data Analyst Or Scientist Or Web Dev / Aspiring Data Scientist. (2) (3) (4)

(1) (2) (3) ... (37) (38) (39) (40) (41) (42) (43) ... (147) (Reply) (Go Down)

Re: Chronicle Of A Data Scientist/analyst by mbhs139(m): 8:40pm On Jun 01, 2020
Toppytek:


I am sure you’re enjoying what you’re paying especially the Internet speed, our network for here no dey see small rain oo.

For the Machine I’ll check the review on YouTube, thou I prefer DELL, MacBook, and HP, and non-touchscreen Machines with backlight keyboard.

Bro, instead of name, and hype, think about your pocket first! Most machine, on budget, will do the work of a data analytics or data scientist, particularly if you have not started earning big time like the original creator of this thread.

All you need is a bigger RAM, 16GB minimum, with a good processor speed, say a base speed of 2.5Ghz, that can turbo up to... well, I don't know, and a solid state disk (SSD) minimum of 512GB. Baba, once your machine has any of this, you're good to go. Forget about name.

7 Likes 1 Share

Re: Chronicle Of A Data Scientist/analyst by Samzeal(m): 9:42pm On Jun 01, 2020
mbhs139:


wink wink wink smiley

There's no much to it bro. Just get a HDMI or VGA cable and connect your monitor to the laptop, and do some settings in the views settings. There are lots of YouTube videos to help.

The machine is an Asus Vivobook S15, with a touchscreen trackpad. I think Asus is the first to have that on their Machine. You can check the review on YouTube.

Having a second screen makes studying easy for you. You open your YouTube video on one screen and follow the examples, hands-on, on the other machine. You may also open your text book same way.

There's no issue of data here. I have 20GB on my mobile plan, same as my wife, for 200CAD every month, including two iPhone XR; and an unlimited data for the home plan, which comes with my rent. Home internet is like having electrical power in the apartment. It comes with your rent.

Which programme are you learning now. Is it python?
Re: Chronicle Of A Data Scientist/analyst by mbhs139(m): 12:29am On Jun 02, 2020
Samzeal:


Which programme are you learning now. Is it python?

Python
MySQL
R
Power BI, and
Tableau.

I paid for Mosh online courses on MySQL and Python. I want to have a good grasp of all these courses first, before going into their application in data science. I don't just want to jump into the data science application without having a good grasp and background understanding of what and what each of the programmes are used for or can be used for.

Other ones I am watching free YouTube videos and reading free books on Amazon Kindle. I don't know if that can work in Nigeria, I'd encourage you guys to check it out. There are a handful of books there.

2 Likes 1 Share

Re: Chronicle Of A Data Scientist/analyst by gargoylern: 2:31am On Jun 02, 2020
Re: Chronicle Of A Data Scientist/analyst by gargoylern: 2:34am On Jun 02, 2020
Meanwhile,
You can now get "Automate the Boring Stuff with Python" from Udemy free this June.
This is probably one of the best open-source books written on python.
You use this coupon JUN2020FREE or just visit this link
www(dot)udemy(dot)com(forward_slash)course(forward_slash)automate(forward_slash)(question_mark)couponCode(equal_sign)JUN2020FREE

4 Likes

Re: Chronicle Of A Data Scientist/analyst by Samzeal(m): 4:51am On Jun 02, 2020
mbhs139:


Python
MySQL
R
Power BI, and
Tableau.

I paid for Mosh online courses on MySQL and Python. I want to have a good grasp of all these courses first, before going into their application in data science. I don't just want to jump into the data science application without having a good grasp and background understanding of what and what each of the programmes are used for or can be used for.

Other ones I am watching free YouTube videos and reading free books on Amazon Kindle. I don't know if that can work in Nigeria, I'd encourage you guys to check it out. There are a handful of books there.

Thank you I really need a book on data science. And if you can share some materials on python that can help it would be appreciated.
Re: Chronicle Of A Data Scientist/analyst by dollyj1996(m): 8:16am On Jun 02, 2020
hello house,i ve started learning d use of excel up to a level and decided to go thru d tutorial videos i have regarding python and i notice almost all the functions performed by excel can b done by python(vice versa). question is cant i just do deep learning on excel alone and what is d advantage of using python libraries,power i.b,mySQL etc over excel?

3 Likes

Re: Chronicle Of A Data Scientist/analyst by mightguy(m): 9:55am On Jun 02, 2020
Hello guys. This excel for Android how good is that? Is it similar to the one on lappy. can u use it for practice after watching Excel videos online? Am planning on buying a laptop next month
Re: Chronicle Of A Data Scientist/analyst by Schoolhike: 10:22am On Jun 02, 2020
dollyj1996:
hello house,i ve started learning d use of excel up to a level and decided to go thru d tutorial videos i have regarding python and i notice almost all the functions performed by excel can b done by python(vice versa). question is cant i just do deep learning on excel alone and what is d advantage of using python libraries,power i.b,mySQL etc over excel?

Not all bro, only few of excel functions, power Bi and excel power pivot perform excellently when it comes to DAX in performing powerful stuffs,
I’d advice you to have a good grasp of excel first.

SQL is soo powerful when it comes to querying data from a database.
Re: Chronicle Of A Data Scientist/analyst by mbhs139(m): 10:26am On Jun 02, 2020
Samzeal:


Thank you I really need a book on data science. And if you can share some materials on python that can help it would be appreciated.

Drop your email here if you don't mind. The files are too large for this site
Re: Chronicle Of A Data Scientist/analyst by mbhs139(m): 10:35am On Jun 02, 2020

23 Likes 6 Shares

Re: Chronicle Of A Data Scientist/analyst by dollyj1996(m): 11:05am On Jun 02, 2020
Schoolhike:


Not all bro, only few of excel functions, power Bi and excel power pivot perform excellently when it comes to DAX in performing powerful stuffs,
I’d advice you to have a good grasp of excel first.

SQL is soo powerful when it comes to querying data from a database.
thank u.
Re: Chronicle Of A Data Scientist/analyst by mayprince(m): 3:56pm On Jun 02, 2020
Hello guys. I just finish learning Excel to a point where I can move to the next step in Data Science. Now my question is what next? Should I start learning python or learn other data visualization software such as Tableau or Power BI?

1 Like

Re: Chronicle Of A Data Scientist/analyst by Schoolhike: 5:08pm On Jun 02, 2020
AnalysisGuru:


Very correct bro. Stats and Maths give you the foundation to ace Data Science. As an Econs student, when i was learning Numpy,.

A good introductory course on statistics check “Intro to statistics” on udemy it’s free


josh_wills says "Data Scientist is a person who is better at statistics than any software engineer and better at software engineering than any statistician.”
That's the balance you need to achieve and maintain.

3 Likes

Re: Chronicle Of A Data Scientist/analyst by Schoolhike: 5:32pm On Jun 02, 2020
I’d advice you read at least first 3 chapters of this book, “An introduction to statistical learning with application in R” by springer tech in statistics, if you want pursue career in data science, suitable for those without math/stats background.

When you reach the part R of programming apply the knowledge of python if you don’t know R, I also don’t know R

4 Likes 3 Shares

Re: Chronicle Of A Data Scientist/analyst by Toppytek(m): 6:42pm On Jun 02, 2020
Schoolhike:
I’d advice you read at least first 3 chapters of this book, “An introduction to statistical learning with application in R” by springer tech in statistics, if you want pursue career in data science, suitable for those without math/stats background.

When you reach the part R of programming apply the knowledge of python if you don’t know R, I also don’t know R

If you have the soft copy or link to the said pls help us with it
Re: Chronicle Of A Data Scientist/analyst by brashear: 7:07pm On Jun 02, 2020
Toppytek:

If you have the soft copy or link to the said pls help us with it
b-ok dot xyz. just type the title of the book into the search bar.
Re: Chronicle Of A Data Scientist/analyst by dollyj1996(m): 7:47pm On Jun 02, 2020
mayprince:
Hello guys. I just finish learning Excel to a point where I can move to the next step in Data Science. Now my question is what next? Should I start learning python or learn other data visualization software such as Tableau or Power BI?
bro,which video tutorial did u use for ur excel lesson?
Re: Chronicle Of A Data Scientist/analyst by Gundel001: 10:02pm On Jun 02, 2020
mcemmy0z:
If you reside around songo Ota I have these available
*Udemy - Beginner to Pro in Excel Financial Modeling and Valuation
*Udemy - SQL - MySQL for Data Analytics and Business Intelligence
*Tableau 10 A-Z Hands-On Tableau Training For Data Science!
*Tableau Hands-on Learn Data Visualization with Tableau
*Udemy - Power BI A-Z Hands-On Power BI Training For Data Science
*Udemy - Machine Learning A-Z™ Hands-On Python & R In Data Science
*Udemy - Python for Financial Analysis and Algorithmic Trading
where in Ota bro
Re: Chronicle Of A Data Scientist/analyst by Gundel001: 10:31pm On Jun 02, 2020
mcemmy0z:
If you reside around songo Ota I have these available
*Udemy - Beginner to Pro in Excel Financial Modeling and Valuation
*Udemy - SQL - MySQL for Data Analytics and Business Intelligence
*Tableau 10 A-Z Hands-On Tableau Training For Data Science!
*Tableau Hands-on Learn Data Visualization with Tableau
*Udemy - Power BI A-Z Hands-On Power BI Training For Data Science
*Udemy - Machine Learning A-Z™ Hands-On Python & R In Data Science
*Udemy - Python for Financial Analysis and Algorithmic Trading
where in Ota bro??
Re: Chronicle Of A Data Scientist/analyst by Dthinkerman: 11:03pm On Jun 02, 2020
mbhs139:


Python
MySQL
R
Power BI, and
Tableau.

I paid for Mosh online courses on MySQL and Python. I want to have a good grasp of all these courses first, before going into their application in data science. I don't just want to jump into the data science application without having a good grasp and background understanding of what and what each of the programmes are used for or can be used for.

Other ones I am watching free YouTube videos and reading free books on Amazon Kindle. I don't know if that can work in Nigeria, I'd encourage you guys to check it out. There are a handful of books there.

Thanks for the share. I am quite interested in the Mosh's paid Python course. I would appreciate it if I could have it.

1 Like

Re: Chronicle Of A Data Scientist/analyst by Samzeal(m): 3:56am On Jun 03, 2020
mbhs139:


Drop your email here if you don't mind. The files are too large for this site

amoosamson@gmail.com
Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 7:02am On Jun 03, 2020
As a budding data scientist who visits NL often, it's not surprising that you start to get more than interested in the some of the topics making front page and how frequent topics from individual sections reach the top. I have been looking into this for a while and thought it would be nice to do some investigation in this regard. For example, which section makes front page most often? How often do we see programming topics get to the front page? Who posts more often on the front page? Is it really lalasticlala, as is frequently supposed, or is it someone else? What exactly has been the relationship between lalasticalala and snakes over the past year? Some people think he loves to push snake topics to the frontpage more often than other topics. What else can we learn from the topics making frontpage? Like for example, are they mostly about Buhari or something else?

To this end, I scrapped the front page data and obtained more than 28,000 records. You can download this data set I obtained here on my github. If you are a data science enthusiast who also likes Nairaland, this may be good motivation to dig into a topic that interests you. You will find a metadata file in the sublink as well and can investigate what the attributes are about. You've got titles, links, sections and time that posts made front page. It's a year of data from 31st May 2019 till date. It turns out to get the whole frontpage information may need more than 230,000 records! That's huge, and probably not so wise to collect for a quick, lazy analysis. Except, of course, you have business motives

For me, I was interested in a few topics.
First, from which section did we get the most frontpage material over the past year? Apparently, it is "Politics". It trumps everything. "Celebrities" come a close second. Not surprising, right? What with the volume of Bobrisky posts and co. And then "Crime" comes third. Does this point to a high frequency of crime in Nigeria? I leave that question to you. "Programming"? Didn't even make bank one time!
The fact that politics make frontpage more often clearly shows that top on our discourse as Nigerians is probably politics, if Nairaland reflects a microcosm of the Nigerian environment, which I feel it does.

Who posts more often on the frontpage? Not lalasticlala like you might think. It's a person called dre11; at least over the last year. Maybe you know him, may you don't. Lalasticlala is not even in the top three.

One quirky thing I found, however, was that the time it takes for a post to get to frontpage has a heavily right-skewed distribution. Before plotting this, I lazily thought it might be dome-shaped, cos...well, a lot of things in life are and it shouldn't be unusual to have this behave the same; few make front page early, few late, and most are in between. Right? On the contrary, the reality is skewed. I feel the heavy skewness and bimodal attribute probably points to deliberate human intervention. Most posts make front page early, not late. They are created and in little time pushed to the front page. Evidently in a deliberate fashion. Else the data should be dome-shaped, don't you think? Anyways, that's what my data shows. Maybe, better insight could be derived though if one scraped randomly over the past several years in order to obtain a truly random sample.

And there were a few threads which made front page late. Very late! In the past year, we have had threads from 8 years ago make frontpage. Yes, 8 years ago! Thats's 2012. And then there are those that were initially posted 5 years ago before they made front page. Perhaps you can find more if you looked into the data set?

Anyways, getting your hands dirty with a data set is always a good way to learn data analysis. If you need help with navigating this, you can buzz me.

31 Likes 3 Shares

Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 7:39am On Jun 03, 2020
What are the longest years between the creation of a post and when it made front page? (first figure).

And has lalasticlala posted anything associated with snakes in the past year? Apparently not. (second figure).
The data shows that hasn't been the case.

4 Likes

Re: Chronicle Of A Data Scientist/analyst by Dum20: 8:27am On Jun 03, 2020
cochtrane:
As a budding data scientist who visits NL often, it's not surprising that you start to get more than interested in the some of the topics making front page and how frequent topics from individual sections reach the top. I have been looking into this for a while and thought it would be nice to do some investigation in this regard. For example, which section makes front page most often? How often do we see programming topics get to the front page? Who posts more often on the front page? Is it really lalasticlala, as is frequently supposed, or is it someone else? What exactly has been the relationship between lalasticalala and snakes over the past year? Some people think he loves to push snake topics to the frontpage more often than other topics. What else can we learn from the topics making frontpage? Like for example, are they mostly about Buhari or something else?

To this end, I scrapped the front page data and obtained more than 28,000 records. You can download this data set I obtained here on my github. If you are data science enthusiast who also likes Nairaland, this may be good motivation to dig into a topic that interests you. You will find a metadata file in the sublink as well and can investigate what the attributes are about. You've got titles, links, sections and time that posts made front page. It's a year of data from 31st May 2019 till date. It turns out to get the whole frontpage information may need more than 230,000 records! That's huge, and probably not so wise to collect for a quick, lazy analysis. Except, of course, you have business motives

For me, I was interested in a few topics.
First, from which section did we get the most frontpage material over the past year? Apparently, it is "Politics". It trumps everything. "Celebrities" come a close second, and then "Crime". "Programming"? Didn't even make bank one time!

Who posts more often on the frontpage? Not lalasticlala like you might think. It's a person called dre11; at least over the last year. Maybe you know him, may you don't. Lalasticlala is not even in the top three.

One quirky thing I found, however, was that the time it takes for a post to get to frontpage has a heavily right-skewed distribution. Before plotting this, I lazily thought it might be normally distributed, cos...well, a lot of things are normally distributed and it shouldn't be unusual to have this normally distributed as well; few make front page early, few late, and most are in between. I feel the heavy skewness probably points to deliberate human intervention. Most posts make front page early, not late. They are created and in little time pushed to the front page. That's what my data shows. Maybe, better insight could be derived though if one scraped randomly over the past several years in order to obtain a truly random sample.

And there were a few threads which made front page late. Very late! In the past year, we have had threads from 8 years ago make frontpage. Yes, 8 years ago! And then there are those that were initially posted 5 years ago before they made front page. Perhaps you can find more if you looked into the data set?

Anyways, getting your hands dirty with a data set is always a good way to learn data analysis. If you need help with navigating this, you can buzz me.

Bro this is fantastic and awesome.

I have plenty questions for you later
Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 9:07am On Jun 03, 2020
And how frequently has a topic containing the "Buhari" keyword appeared on the frontpage? Comprises about 5% of all topics in the past year.
You would think this is not such a big number, until you see that the frontpage topics that contain the keyword "Tinubu" or "Osibanjo" were only 0.63% and 0.0069% respectively. Crazy, right? Nigerians do talk a lot about the number one man.

I feel the fact that politics dominate discussion on Nairaland is some evidence that the site is becoming more like a news website than a social network. It's probably firstly a news website, then it is a social network.

What more can we discover from this data?
-A time analysis of post frequency? using cumulative sums
-A time analysis of front page posts especially for the top posters? using cumulative sums
-A bag of words model for frontpage titles over the past years. Would be nice to see the most frequent words which make frontpage
-The shortest intervals between when a post is created and when it makes frontpage
-The last time some infrequent sections made frontpage
-The sections with the most frontpage material per month (probably politics, but need to confirm)
-How often have you or your friend or someone you know made frontpage? -you really may want to find this out, if you think you've been on the frontpage before

I leave the rest to you! smiley

5 Likes

Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 9:07am On Jun 03, 2020
Dum20:


Bro this is fantastic and awesome.

I have plenty questions for you later
Thanks! Just drop a message here if you've got a question.
Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 9:44am On Jun 03, 2020

Nice one @ cochtrane cool
I'll use Tableau/Power bi to analyse mine..
Pandas needs more logic...not to talk of matplotlib grin...
Although i'll still use them ( pandas nd mpl) later
Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 10:08am On Jun 03, 2020
Zabiboy:

Nice one @ cochtrane cool
I'll use Tableau/Power bi to analyse mine..
Pandas needs more logic...not to talk of matplotlib grin...
Although i'll still use them ( pandas nd mpl) later
Cool. Share the results with us when you are done.
Re: Chronicle Of A Data Scientist/analyst by Dum20: 10:39am On Jun 03, 2020
cochtrane:

Thanks! Just drop a message here if you've got a question.

Okay great.

1. Firstly how did you start?
2. What are the courses you took to get to this stage of competence.
3. For how long have been in Data Science

My background i am taking a Bussiness Intelligence course on Udemy. I have taken the statistics, SQL, Tableau parts of the course. I am just started the python section. But i still feel inadequate.
I have also taken courses on Excel Power tools and Power BI.


N.B. Can you give a step by step guide on how you got to final charts above.
You do not need to go into details. Something like:
1. You used XYZ to extract data
2. You used ABC to clean the data
3. Used MNOP to visualise the data

Thanks

There are a lot of courses to study. I am wondering if i should stop for now and practice real life examples of the subjects i have learnt.

2 Likes

(1) (2) (3) ... (37) (38) (39) (40) (41) (42) (43) ... (147) (Reply)

I Want To Learn Programming. Which Language Should I Start With?

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 79
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.