Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,208,203 members, 8,001,882 topics. Date: Wednesday, 13 November 2024 at 05:58 PM

Chronicle Of A Data Scientist/analyst - Programming (48) - Nairaland

Nairaland Forum / Science/Technology / Programming / Chronicle Of A Data Scientist/analyst (356410 Views)

Chronicle Of A Data/cloud Engineer / Net Salary For A Data Analyst Or Scientist Or Web Dev / Aspiring Data Scientist. (2) (3) (4)

(1) (2) (3) ... (45) (46) (47) (48) (49) (50) (51) ... (147) (Reply) (Go Down)

Re: Chronicle Of A Data Scientist/analyst by DrinkWater10: 9:46pm On Jun 12, 2020
BoleAndFish:
What course were you trying to download?
Re: Chronicle Of A Data Scientist/analyst by DrinkWater10: 1:41am On Jun 13, 2020
Should I learn python with PyCharm or Anaconda or Jupiter
Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 11:04am On Jun 13, 2020
DrinkWater10:

Anyone is cool
But I THINK Jupyter is better and flexible...
I havnt used pycharm tho
GL cool
Re: Chronicle Of A Data Scientist/analyst by Oospi(m): 2:16pm On Jun 13, 2020
Good day all, newbie here....I was working on some data that involved choropleth maps but I just can't get the maps to display on Jupyter notebook. All I see is the colorbar, I only get to see the map when I go online...any pointers on how I can see the choropeth maps offline?
Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 2:57pm On Jun 13, 2020
Oospi:
Good day all, newbie here....I was working on some data that involved choropleth maps but I just can't get the maps to display on Jupyter notebook. All I see is the colorbar, I only get to see the map when I go online...any pointers on how I can see the choropeth maps offline?

%matplotlib inline
Try this after importing matplotlib
Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 4:36pm On Jun 13, 2020
Please @Ejiod and any other person vast in sql, please how do I test a query? I was given two excel files and was told to test the query on the environment. Please I need help on this
Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 4:37pm On Jun 13, 2020
Any one with a clue should please help out.
Re: Chronicle Of A Data Scientist/analyst by Toppytek(m): 9:18pm On Jun 13, 2020
yemyke001:
Please @Ejiod and any other person vast in sql, please how do I test a query? I was given two excel files and was told to test the query on the environment. Please I need help on this

Create a database in SQL, and create 2 tables... I stand to be corrected tho.
Re: Chronicle Of A Data Scientist/analyst by Jay3999: 9:48pm On Jun 13, 2020
Please I need help installing my sql(Microsoft) on my system 2017
Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 9:54pm On Jun 13, 2020
yemyke001:
Please @Ejiod and any other person vast in sql, please how do I test a query? I was given two excel files and was told to test the query on the environment. Please I need help on this

Could have helped...buh i cant really comprehend ur question...
Maybe u can make it clearer
Have you tried googling it tho...it could help
GL cool
Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 9:55pm On Jun 13, 2020
Jay3999:
Please I need help installing my sql(Microsoft) on my system 2017
32 or 64 bit?
Where exactly do u need help?
Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 7:52am On Jun 14, 2020
Toppytek:


Create a database in SQL, and create 2 tables... I stand to be corrected tho.


Thanks for the response. I did that. But I was told to return result on the one that gives the best result. The csv files are similar
Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 7:53am On Jun 14, 2020
Zabiboy:


Could have helped...buh i cant really comprehend ur question...
Maybe u can make it clearer
Have you tried googling it tho...it could help
GL cool

I was given two csv files that are similar, and I was told to test the query on the environment and return the one that gives the right result. Still confused till now. It was an interview question
Re: Chronicle Of A Data Scientist/analyst by mcemmy0z: 8:25am On Jun 14, 2020
yemyke001:


I was given two csv files that are similar, and I was told to test the query on the environment and return the one that gives the right result. Still confused till now. It was an interview question
Those two files might look the same on your eye but they are different. Import the two of them into SQL,( MSQL will do better), try and query them u will realized that it will return error, so u will have to convert them to standard format that you will be able to query them easily. But from the question u were asked, one will surely work while you will have to convert the other one.. creating a new table for it will do or u use the normal conversation in the beginning when importing them.
So still go learn ETL process.
Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 9:17am On Jun 14, 2020
mcemmy0z:

Those two files might look the same on your eye but they are different. Import the two of them into SQL,( MSQL will do better), try and query them u will realized that it will return error, so u will have to convert them to standard format that you will be able to query them easily. But from the question u were asked, one will surely work while you will have to convert the other one.. creating a new table for it will do or u use the normal conversation in the beginning when importing them.
So still go learn ETL process.


Thank you so much mcemmy0z. Please how do I convert to standard format after importing. BTW I use postgresql
Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 9:28am On Jun 14, 2020
yemyke001:



Thank you so much mcemmy0z. Please how do I convert to standard format after importing. BTW I use postgresql


Moreso I believe this is more of database administration, I applied as a data analyst, or am I getting something wrong?
Re: Chronicle Of A Data Scientist/analyst by mcemmy0z: 9:41am On Jun 14, 2020
yemyke001:



Moreso I believe this is more of database administration, I applied as a data analyst, or am I getting something wrong?
Not data base... U know when dealing with real data u have to be careful, a professional in SQL will tell never to import data directly.. you Know data analysis/ science is an art u can do many things to achieve same results.
Although I started with PostgrSQL then moved to mysql, I later realised I can be more flexible in Microsoft SQl than the rest. Although there are different ways to convert data, after importing them u can create a new table and copy the data into the new table. Have created a store procedures on my MSQl just to convert any data within 5 minutes.
I was using visual studio shell before but all the process has been added to the lastest Msql version, but using VSS for ETL is still cool cause within it u can do some data clearing, removing NaN values, or unnecessary column and doing some adjustments.

1 Like

Re: Chronicle Of A Data Scientist/analyst by yemyke001(m): 10:32am On Jun 14, 2020
mcemmy0z:

Not data base... U know when dealing with real data u have to be careful, a professional in SQL will tell never to import data directly.. you Know data analysis/ science is an art u can do many things to achieve same results.
Although I started with PostgrSQL then moved to mysql, I later realised I can be more flexible in Microsoft SQl than the rest. Although there are different ways to convert data, after importing them u can create a new table and copy the data into the new table. Have created a store procedures on my MSQl just to convert any data within 5 minutes.
I was using visual studio shell before but all the process has been added to the lastest Msql version, but using VSS for ETL is still cool cause within it u can do some data clearing, removing NaN values, or unnecessary column and doing some adjustments.

Thanks for being explicit bro. Really appreciate

1 Like

Re: Chronicle Of A Data Scientist/analyst by Nobody: 11:37am On Jun 14, 2020
please can I get a latest version of excel without paying the fee?
Re: Chronicle Of A Data Scientist/analyst by kunleiky(m): 11:39am On Jun 14, 2020
I don't know if you ever observed, when you install MYSQL, an add-in called MYSQL FOR EXCEL is automagically added to Excel. That add-in allows you to easily import data to and from MySQL using Excel. It's under the DATA tab of Excel. Check it out.

1 Like

Re: Chronicle Of A Data Scientist/analyst by kunleiky(m): 12:20pm On Jun 14, 2020
cochtrane:

Download it here

If I may ask cochtrane, is it possible to download from Github using a mobile device, or it's best done on a PC, cos I've been trying to download this dataset and it's only bringing the data raw,only allowing me to copy and paste, unfortunately not everything is copying.
Also is it possible to scrape it directly from Github?
Re: Chronicle Of A Data Scientist/analyst by Toppytek(m): 12:21pm On Jun 14, 2020
kunleiky:
I don't know if you ever observed, when you install MYSQL, an add-in called MYSQL FOR EXCEL is automagalically added to Excel. That add-in allows you to easily import data to and from MySQL using Excel. It's under the DATA tab of Excel. Check it out.

I’ve seen that option before but I haven’t used it before.
Re: Chronicle Of A Data Scientist/analyst by kunleiky(m): 1:19pm On Jun 14, 2020
Toppytek:


I’ve seen that option before but I haven’t used it before.

It's really cool, very intuitive. You can create a new schema/table rght in there, and import your data into it, then commit. Voila, you have the data in MySQL.
Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 2:03pm On Jun 14, 2020
kunleiky:


If I may ask cochtrane, is it possible to download from Github using a mobile device, or it's best done on a PC, cos I've been trying to download this dataset and it's only bringing the data raw,only allowing me to copy and paste, unfortunately not everything is copying.
Also is it possible to scrape it directly from Github?
Yes, it's possible to just assess the raw file directly using this link
Re: Chronicle Of A Data Scientist/analyst by kunleiky(m): 2:06pm On Jun 14, 2020
cochtrane:

Yes, it's possible to just assess the raw file directly using this link
Thanks a lot, you're appreciated
Re: Chronicle Of A Data Scientist/analyst by tintedniggz(m): 8:26pm On Jun 14, 2020
Ejiod:

I've always been good in maths. Infact did
further maths then in school and even got C5 in it.
It was sheer foolishness that lured me to biochemistry.
Biochemistry lol, I studied that as well.
Just started my data science journey, you're doing a fantastic job with this thread.
Re: Chronicle Of A Data Scientist/analyst by Toppytek(m): 9:16pm On Jun 14, 2020
kunleiky:


It's really cool, very intuitive. You can create a new schema/table rght in there, and import your data into it, then commit. Voila, you have the data in MySQL.

Wow, I’ll give it a try.
Re: Chronicle Of A Data Scientist/analyst by Twirelex: 11:41pm On Jun 14, 2020
cochtrane:
Finally. this won't be complete without mentioning the resultant "Confusion Matrix".
Managed to create a visualization for it. When visualized, we see that for most of the sections, the correct prediction was made. There were a few sections where probably not enough values to form a cell. These appear to be "Programming", "Pets", etc. Red cells mean zero. For example, there were no successful predictions for "Webmasters". Light cells mean successful predictions. Most of the cells along the diagonal are light, correlating with the fairly good accuracy obtained.
If this catches your interest, you can download the notebook here on my github and play around with it, if you want. The code is in R.


Cool...
tidymodels + textrecipe would have saved you a lot of stress though...
I like it when I see R programmers
Re: Chronicle Of A Data Scientist/analyst by Dsholla: 6:05am On Jun 15, 2020
someone pls help me, I just finished mysql tutorials videos now, what's the next phase to continue with
Re: Chronicle Of A Data Scientist/analyst by Toppytek(m): 7:14am On Jun 15, 2020
Dsholla:
someone pls help me, I just finished mysql tutorials videos now, what's the next phase to continue with

Excel
Re: Chronicle Of A Data Scientist/analyst by mbhs139(m): 10:15am On Jun 15, 2020

1 Like 1 Share

Re: Chronicle Of A Data Scientist/analyst by Savagethe21st(m): 4:21pm On Jun 15, 2020
Ejiod:
Out of the 3,
One from from lekki asked me to analyze data as assessment of which I pythonize grin it,running pandas and Power BI on it.Had to utilize all my skills to solve the problem.This was a big edge I had over others.Some excel users will be calling theirselves data analyst but they are just far from it... before you knew it,in just a week I got a notification that "Can I resume the following week" with a net pay of 180k. Damn!... I was so so happy... first data analyst job and the best thing about it was that it was remote..No transport, just me in my house and I report to boss every Friday what I've been doing.
Had to share my story too to freetutorials.us because they were helpful with tons of tutorials I downloaded from them.
Fast forward..4 month into the job damn, I started expanding and experimenting my skills. I became more of a Business intelligence developer. Before a year, I've toured round 15 states in Nigeria all by flight....
I loved what I was doing then,but one thing about remote job is that sometimes it may make you lazy and extravagant sometimes. Its then you will be thinking of going to cinema to watch film or event centers......
boss what do u have to say about android developers... Do u thinks its lucrative here in nigeria?

(1) (2) (3) ... (45) (46) (47) (48) (49) (50) (51) ... (147) (Reply)

I Want To Learn Programming. Which Language Should I Start With?

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 59
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.