Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,207,214 members, 7,998,232 topics. Date: Saturday, 09 November 2024 at 10:31 AM

Chronicle Of A Data Scientist/analyst - Programming (54) - Nairaland

Nairaland Forum / Science/Technology / Programming / Chronicle Of A Data Scientist/analyst (356047 Views)

Chronicle Of A Data/cloud Engineer / Net Salary For A Data Analyst Or Scientist Or Web Dev / Aspiring Data Scientist. (2) (3) (4)

(1) (2) (3) ... (51) (52) (53) (54) (55) (56) (57) ... (147) (Reply) (Go Down)

Re: Chronicle Of A Data Scientist/analyst by Dum20: 8:24pm On Jul 01, 2020
So guys i am still a learner. I believe that practice makes perfect.

I am a seller on Fiverr and created a gig related to data science. I plan to share some of the problems that clients submit that they need solved.

We can use it for practice to prepare for actual job interviews and to have an idea of the problems in real world.

So below is the first one i want to share:


I am setting up a spreadsheet to measure lead and lag measures for my staff I have started it but thought it would be better if an expert get it done for me. The nurses will input patient names and then the spreadsheet will count the number of patients The count will then be compared to their target This will occur each workday Each staff member will have two sheets The first spreadsheet will be a record of patients they have invited to care plans for patients with chronic disease The second sheet is for patients that they have actually done the plan on Data will be entered by the responsible nurse For both sheets they have targets to achieve For invitations 9 per day For plans 3 per day Some of the staff work part-time. I put a column in so the nurse can say if they were at work that day or not. The spreadsheet to automatically exclude weekend days The column that counts the number of patients invited/seen should change. If they meet or exceed the target then I would like the cell to be green, if less than the target I would like red If the cell has no data I would like it to be blank I would like the targets to be easily modified so that I can change the target in one cell and that would be reflected across the whole spreadsheet for every nurse For every spreadsheet I would l like two graphs It should display where they should be and where they are at, like the picture below One for the current week and one for the month This should be a template so that we can reset the numbers each month I would then like a dashboard that displays all of the graphs on one page so that the nursing team can compare themselves to their peers. Please don't waste time give me proper answer if you can work.[b][/b]


His budget is $45

I do not understand what he wants self.

1 Like 1 Share

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 11:26pm On Jul 01, 2020
Dum20:
[quote author=lymelyte post=91270518]Please I need una help.. Have been trying to import a csv file on a folder in my desktop to python via jupyter notebook but I keep getting errors.


FileNotFoundError: [Errno 2] File Absenteeism_data.csv does not exist: "Absenteeism_data.csv"

I have even gone to stack overflow and try out Solns but the problem still persist
[/quote

You are not referencing the right folder where the "Absenteeism_data.csv" file is located.

Share your complete code, we will be able to guide to the problem. But make sure the .csv is in the correct folder you are referencing in your code.

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 11:28pm On Jul 01, 2020
let me try this..
KingyKing:


import os
Then type
os.getcwd()

Then copy and paste the csv file to the same computer folder that the above command generated.

Then you can try to open it now.
Be sure to type in the same case
I.e If the file starts with Capital letter, you type it exactly same.
Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 11:36pm On Jul 01, 2020
did exactly as you suggested putting the csv file in hp folder but same issue
KingyKing:


import os
Then type
os.getcwd()

Then copy and paste the csv file to the same computer folder that the above command generated.

Then you can try to open it now.
Be sure to type in the same case
I.e If the file starts with Capital letter, you type it exactly same.

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 11:40pm On Jul 01, 2020
the thing confuse you abi grin grin cheesy
Dum20:
So guys i am still a learner. I believe that practice makes perfect.

I am a seller on Fiverr and created a gig related to data science. I plan to share some of the problems that clients submit that they need solved.

We can use it for practice to prepare for actual job interviews and to have an idea of the problems in real world.

So below is the first one i want to share:


I am setting up a spreadsheet to measure lead and lag measures for my staff I have started it but thought it would be better if an expert get it done for me. The nurses will input patient names and then the spreadsheet will count the number of patients The count will then be compared to their target This will occur each workday Each staff member will have two sheets The first spreadsheet will be a record of patients they have invited to care plans for patients with chronic disease The second sheet is for patients that they have actually done the plan on Data will be entered by the responsible nurse For both sheets they have targets to achieve For invitations 9 per day For plans 3 per day Some of the staff work part-time. I put a column in so the nurse can say if they were at work that day or not. The spreadsheet to automatically exclude weekend days The column that counts the number of patients invited/seen should change. If they meet or exceed the target then I would like the cell to be green, if less than the target I would like red If the cell has no data I would like it to be blank I would like the targets to be easily modified so that I can change the target in one cell and that would be reflected across the whole spreadsheet for every nurse For every spreadsheet I would l like two graphs It should display where they should be and where they are at, like the picture below One for the current week and one for the month This should be a template so that we can reset the numbers each month I would then like a dashboard that displays all of the graphs on one page so that the nursing team can compare themselves to their peers. Please don't waste time give me proper answer if you can work.[b][/b]


His budget is $45

I do not understand what he wants self.
Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 11:41pm On Jul 01, 2020

@lymelyte
Type the full file path...
Use / instead of \

1 Like

Re: Chronicle Of A Data Scientist/analyst by nwele2017: 11:44pm On Jul 01, 2020
Dum20:
So guys i am still a learner. I believe that practice makes perfect.

I am a seller on Fiverr and created a gig related to data science. I plan to share some of the problems that clients submit that they need solved.

We can use it for practice to prepare for actual job interviews and to have an idea of the problems in real world.

So below is the first one i want to share:


I am setting up a spreadsheet to measure lead and lag measures for my staff I have started it but thought it would be better if an expert get it done for me. The nurses will input patient names and then the spreadsheet will count the number of patients The count will then be compared to their target This will occur each workday Each staff member will have two sheets The first spreadsheet will be a record of patients they have invited to care plans for patients with chronic disease The second sheet is for patients that they have actually done the plan on Data will be entered by the responsible nurse For both sheets they have targets to achieve For invitations 9 per day For plans 3 per day Some of the staff work part-time. I put a column in so the nurse can say if they were at work that day or not. The spreadsheet to automatically exclude weekend days The column that counts the number of patients invited/seen should change. If they meet or exceed the target then I would like the cell to be green, if less than the target I would like red If the cell has no data I would like it to be blank I would like the targets to be easily modified so that I can change the target in one cell and that would be reflected across the whole spreadsheet for every nurse For every spreadsheet I would l like two graphs It should display where they should be and where they are at, like the picture below One for the current week and one for the month This should be a template so that we can reset the numbers each month I would then like a dashboard that displays all of the graphs on one page so that the nursing team can compare themselves to their peers. Please don't waste time give me proper answer if you can work.[b][/b]


His budget is $45

I do not understand what he wants self.
This job requires the use of Data validation in Excel spreadsheet. I have done something like this for pharmaceutical store in area. I would like see the copy of the Excel he or she
Re: Chronicle Of A Data Scientist/analyst by nwele2017: 11:56pm On Jul 01, 2020
Dum20:
[quote author=lymelyte post=91270518]Please I need una help.. Have been trying to import a csv file on a folder in my desktop to python via jupyter notebook but I keep getting errors.


FileNotFoundError: [Errno 2] File Absenteeism_data.csv does not exist: "Absenteeism_data.csv"

I have even gone to stack overflow and try out Solns but the problem still persist
[/quote

You are not referencing the right folder where the "Absenteeism_data.csv" file is located.

Share your complete code, we will be able to guide to the problem. But make sure the .csv is in the correct folder you are referencing in your code.
it's either you did not get the exact spelling of the CSV file or it's not in the current Folder where Pandas is looking for it. try to check if you got the spelling correctly and if it's in the current Folder where Pandas is searching for it. These things are the only reason why you could get FileNotExist error. Another reason could be, though it's same as the first reason I gave, the file might not be a CSV file. try and check all these things I pointed out.

1 Like

Re: Chronicle Of A Data Scientist/analyst by teewhydope(m): 12:53am On Jul 02, 2020
lymelyte:
did exactly as you suggested putting the csv file in hp folder but same issue

path should have this format 'C:/Users/TeeWhyDope/Downloads/example.csv'

1 Like

Re: Chronicle Of A Data Scientist/analyst by rastaxarm(m): 1:08am On Jul 02, 2020
A Voting System WebApp created with Python/Flask

Home Page: https://digitavote.pythonanywhere.com


VOTING LIVE VIEW: https://digitavote.pythonanywhere.com/vote/view/live/

Equipped with dashboard. Good for schools and organization elections

Still under development
cool

5 Likes

Re: Chronicle Of A Data Scientist/analyst by Dum20: 6:15am On Jul 02, 2020
[quote author=lymelyte post=91284395][/quote]

Based on your code ensure the .pnyb file you are using for your code is in the same folder where your Absenteeism_data.csv file is.

the_raw_csv = pd.read_csv('Absenteeism_data.csv')

From the above pd.read_csv is looking for the Absenteeism_data.csv file and cannot locate it.

so within the ('Ab...') you need to specify the file path.

For example if the absenteeism file is in your desktop you can do something like this:

pd.read_csv('C:/Users/Documents/Desktop/Absenteeism_data.csv')

The key is to specify the right file path.

What i do is to make sure the file i want to read is in the same folder as the .pynb notebook book i am working with so i will not type a long file path within ('......') the brackets

1 Like

Re: Chronicle Of A Data Scientist/analyst by Dum20: 6:18am On Jul 02, 2020
nwele2017:

This job requires the use of Data validation in Excel spreadsheet. I have done something like this for pharmaceutical store in area. I would like see the copy of the Excel he or she

He did not share any Excel file. He posted that and was asking for people to bid to do it.

He shared the attached image though.

Can you explain the steps for on how to approach so we all learn

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 7:42am On Jul 02, 2020
nwele2017:
it's either you did not get the exact spelling of the CSV file or it's not in the current Folder where Pandas is looking for it. try to check if you got the spelling correctly and if it's in the current Folder where Pandas is searching for it. These things are the only reason why you could get FileNotExist error. Another reason could be, though it's same as the first reason I gave, the file might not be a CSV file. try and check all these things I pointed out.
Please check out this double dot csv.is it right?

Re: Chronicle Of A Data Scientist/analyst by Dum20: 8:11am On Jul 02, 2020
Try the_raw_csv = pd.read_csv('Absenteeism_data.csv.csv')


The file name has to match what you have inside the brackets
Re: Chronicle Of A Data Scientist/analyst by nwele2017: 8:16am On Jul 02, 2020
lymelyte:
Please check out this double dot csv.is it right?
This is not right, little wonder Pandas could not see it. Have you tried opening it with excel, I doubt it will but try, you should try to download the data again or try opening with winrar to extract the exact CSV file.
Re: Chronicle Of A Data Scientist/analyst by Shepherdd(m): 8:19am On Jul 02, 2020
lymelyte:
Please check out this double dot csv.is it right?

To see where the jupyter kernel is looking for files

execute %ls #the percentage should be there.
and %pwd

this should give you an idea of your active files that python is seeing, and the current directory python is scanning.

1 Like

Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 9:31am On Jul 02, 2020
lymelyte:
did exactly as you suggested putting the csv file in hp folder but same issue
Check to make sure your file is actually a .csv file.
Right click on it and check the file type. Make sure it's not Absenteeism_data.csv.csv"
Open it and actually save it as a .csv file. What causes this issue sometimes is that the file type is wrong.
Re: Chronicle Of A Data Scientist/analyst by cochtrane(m): 9:32am On Jul 02, 2020
Dum20:


He did not share any Excel file. He posted that and was asking for people to bid to do it.

He shared the attached image though.

Can you explain the steps for on how to approach so we all learn
Use an excel sheet and a chart that updates in real time after user entry. That should be appropriate.
Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 10:28am On Jul 02, 2020
the circled file is the csv file
Shepherdd:


To see where the jupyter kernel is looking for files

execute %ls #the percentage should be there.
and %pwd

this should give you an idea of your active files that python is seeing, and the current directory python is scanning.

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 10:38am On Jul 02, 2020
cochtrane:

Check to make sure your file is actually a .csv file.
Right click on it and check the file type. Make sure it's not Absenteeism_data.csv.csv"
Open it and actually save it as a .csv file. What causes this issue sometimes is that the file type is wrong.
this is exactly it shows on my jupyter notebook.. .csv.csv. how do i correct that? the file is in excel ,stored as csv but what format of csv should i save it in? there is CSV, csv(MS-dos),csv(utf-8 ),csv(macintosh)
Re: Chronicle Of A Data Scientist/analyst by Shepherdd(m): 11:32am On Jul 02, 2020
lymelyte:
the circled file is the csv file

There is a prepended number in the name of the file with a space, try and edit it out by renaming the file. Then copy the name into pandas.
Re: Chronicle Of A Data Scientist/analyst by wisemania(m): 12:10pm On Jul 02, 2020
Change the file to Absenteeism_data.csv

2 Likes

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 12:48pm On Jul 02, 2020
Shepherdd:


There is a prepended number in the name of the file with a space, try and edit it out by renaming the file. Then copy the name into pandas.
Finally! I did it.. Your solution worked.. Thanks man grin

Re: Chronicle Of A Data Scientist/analyst by lymelyte(m): 1:01pm On Jul 02, 2020
Thanks to
@Shepherdd
@cochtrane
@nwele2017
@dum20
@teewhydope
@Zabiboy
@KingyKing..I'm grateful for the soln..

1 Like

Re: Chronicle Of A Data Scientist/analyst by Abcruz(m): 2:22pm On Jul 02, 2020
rastaxarm:
A Voting System WebApp created with Python/Flask

Home Page: https://digitavote.pythonanywhere.com


VOTING LIVE VIEW: https://digitavote.pythonanywhere.com/vote/view/live/

Equipped with dashboard. Good for schools and organization elections

Still under development
cool

Wow this is awesome!
Did you use flask for both backend and frontend?

1 Like

Re: Chronicle Of A Data Scientist/analyst by Regards2U: 2:50pm On Jul 02, 2020
LinkedIn Learning: Data Analyst

It's a free course from LinkedIn Learning for those who want to become a data analyst

Valid till march 2021

Link: https://www.linkedin.com/learning/paths/become-a-data-analyst?trk=li-data-become-en&src=re-other&veh=%7Cre-other

4 Likes 1 Share

Re: Chronicle Of A Data Scientist/analyst by Zabiboy: 3:28pm On Jul 02, 2020
Abcruz:


Wow this is awesome!
Did you use flask for both backend and frontend?

It looks like django to me...
Re: Chronicle Of A Data Scientist/analyst by rastaxarm(m): 5:00pm On Jul 02, 2020
Abcruz:


Wow this is awesome!
Did you use flask for both backend and frontend?

Frontend: Jinja2 + Bootstrap + JS
Backend: Flask

1 Like

Re: Chronicle Of A Data Scientist/analyst by rastaxarm(m): 5:01pm On Jul 02, 2020
Zabiboy:


It looks like django to me...

Flask not Django
Re: Chronicle Of A Data Scientist/analyst by mbhs139(m): 6:35pm On Jul 02, 2020
TOP 7 Books for python developers to read must in 2020
Share this message with other python developers or python
learners to grow python community

Learn to Program with Python
https://www.bookelf.in/book/467/pt

Python Unit Test Automation.
https://www.bookelf.in/book/522/pt

Expert Python Programming
https://www.bookelf.in/book/513/pt

Hands-On Machine Learning with Scikit-Learn and TensorFlow
https://www.bookelf.in/book/474/pt

Machine Learning with python
https://www.bookelf.in/book/473/pt

Mastering Natural Language Processing with Python
https://www.bookelf.in/book/470/pt

An Introduction to Statistics with Python
https://www.bookelf.in/book/458/pt

https://www.tutorialbar.com/python-for-data-science-and-data-analysis-masterclass-2020/

https://www.tutorialbar.com/complete-python-bootcamp-2020-with-practical-projects/

https://www.tutorialbar.com/python-for-beginners-anyone-can-code/

https://www.tutorialbar.com/neural-networks-in-python-deep-learning-for-beginners/

https://www.tutorialbar.com/software-development-in-python-a-practical-approach/

https://www.tutorialbar.com/the-self-taught-programmer/

https://www.tutorialbar.com/step-by-step-guide-to-machine-learning/

https://www.tutorialbar.com/time-series-analysis-and-forecasting-using-python/

https://www.tutorialbar.com/the-complete-python-3-course-beginner-to-advanced/

Introduction to Machine Learning with Python

AUTHOR:- ANDREAS C. MUELLER AND SARAH GUIDO

Download Book Now����

http://dynamicduniya.com/bookdetails?id=68/introduction-to-machine-learning-with-python


A beginner-friendly list of data science projects


1) Rainfall in India

Project type: Visualization
Link to dataset : https://www.kaggle.com/rajanand/rainfall-in-india

2) Global Suicide Rates

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/russellyates88/suicide-rates-overview-1985-to-2016

3) Summer Olympic Medals

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/divyansh22/summer-olympics-medals

4) World Happiness Report

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/unsdsn/world-happiness

5) Pollution in the United States

Project type: Visualization
Link to dataset : https://www.kaggle.com/sogun3/uspollution

6) Nutrition Facts for McDonald’s Menu

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/mcdonalds/nutrition-facts

7) Red Wine Quality

Project type: Prediction Modeling
Link to dataset : https://www.kaggle.com/uciml/red-wine-quality-cortez-et-al-2009

18 Likes 8 Shares

Re: Chronicle Of A Data Scientist/analyst by MrScamp(m): 4:05am On Jul 03, 2020
mbhs139:
TOP 7 Books for python developers to read must in 2020
Share this message with other python developers or python
learners to grow python community

Learn to Program with Python
https://www.bookelf.in/book/467/pt

Python Unit Test Automation.
https://www.bookelf.in/book/522/pt

Expert Python Programming
https://www.bookelf.in/book/513/pt

Hands-On Machine Learning with Scikit-Learn and TensorFlow
https://www.bookelf.in/book/474/pt

Machine Learning with python
https://www.bookelf.in/book/473/pt

Mastering Natural Language Processing with Python
https://www.bookelf.in/book/470/pt

An Introduction to Statistics with Python
https://www.bookelf.in/book/458/pt

https://www.tutorialbar.com/python-for-data-science-and-data-analysis-masterclass-2020/

https://www.tutorialbar.com/complete-python-bootcamp-2020-with-practical-projects/

https://www.tutorialbar.com/python-for-beginners-anyone-can-code/

https://www.tutorialbar.com/neural-networks-in-python-deep-learning-for-beginners/

https://www.tutorialbar.com/software-development-in-python-a-practical-approach/

https://www.tutorialbar.com/the-self-taught-programmer/

https://www.tutorialbar.com/step-by-step-guide-to-machine-learning/

https://www.tutorialbar.com/time-series-analysis-and-forecasting-using-python/

https://www.tutorialbar.com/the-complete-python-3-course-beginner-to-advanced/

Introduction to Machine Learning with Python

AUTHOR:- ANDREAS C. MUELLER AND SARAH GUIDO

Download Book Now����

http://dynamicduniya.com/bookdetails?id=68/introduction-to-machine-learning-with-python


A beginner-friendly list of data science projects


1) Rainfall in India

Project type: Visualization
Link to dataset : https://www.kaggle.com/rajanand/rainfall-in-india

2) Global Suicide Rates

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/russellyates88/suicide-rates-overview-1985-to-2016

3) Summer Olympic Medals

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/divyansh22/summer-olympics-medals

4) World Happiness Report

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/unsdsn/world-happiness

5) Pollution in the United States

Project type: Visualization
Link to dataset : https://www.kaggle.com/sogun3/uspollution

6) Nutrition Facts for McDonald’s Menu

Project type: Exploratory Data Analysis
Link to dataset : https://www.kaggle.com/mcdonalds/nutrition-facts

7) Red Wine Quality

Project type: Prediction Modeling
Link to dataset : https://www.kaggle.com/uciml/red-wine-quality-cortez-et-al-2009
Thank you for this�

2 Likes

Re: Chronicle Of A Data Scientist/analyst by Abcruz(m): 8:00am On Jul 03, 2020
rastaxarm:


Frontend: Jinja2 + Bootstrap + JS
Backend: Flask

Cool!
Pls is the hosting on PythonAnywhere free?
If it isn't how much is the cost?

(1) (2) (3) ... (51) (52) (53) (54) (55) (56) (57) ... (147) (Reply)

I Want To Learn Programming. Which Language Should I Start With?

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 73
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.