Skip to content

Commit 0b27d03

Browse files
committed
Update the project notebooks
Update explanations and fixed typos.
1 parent 7839d45 commit 0b27d03

File tree

5 files changed

+16
-57
lines changed

5 files changed

+16
-57
lines changed

3_Project/1_EDA_Intro.ipynb

Lines changed: 2 additions & 45 deletions
Original file line numberDiff line numberDiff line change
@@ -69,53 +69,10 @@
6969
},
7070
{
7171
"cell_type": "code",
72-
"execution_count": 1,
72+
"execution_count": null,
7373
"id": "f3dac2c7",
7474
"metadata": {},
75-
"outputs": [
76-
{
77-
"data": {
78-
"application/vnd.jupyter.widget-view+json": {
79-
"model_id": "d128595bf3844deaa2d23932ca313c0f",
80-
"version_major": 2,
81-
"version_minor": 0
82-
},
83-
"text/plain": [
84-
"Downloading readme: 0%| | 0.00/28.0 [00:00<?, ?B/s]"
85-
]
86-
},
87-
"metadata": {},
88-
"output_type": "display_data"
89-
},
90-
{
91-
"data": {
92-
"application/vnd.jupyter.widget-view+json": {
93-
"model_id": "32c68ae095ef486ca9ace3fa2c7b0ad5",
94-
"version_major": 2,
95-
"version_minor": 0
96-
},
97-
"text/plain": [
98-
"Downloading data: 0%| | 0.00/231M [00:00<?, ?B/s]"
99-
]
100-
},
101-
"metadata": {},
102-
"output_type": "display_data"
103-
},
104-
{
105-
"data": {
106-
"application/vnd.jupyter.widget-view+json": {
107-
"model_id": "44f90b12d99a4d23b34120b6fdcf8bb6",
108-
"version_major": 2,
109-
"version_minor": 0
110-
},
111-
"text/plain": [
112-
"Generating train split: 0%| | 0/785741 [00:00<?, ? examples/s]"
113-
]
114-
},
115-
"metadata": {},
116-
"output_type": "display_data"
117-
}
118-
],
75+
"outputs": [],
11976
"source": [
12077
"# Importing Libraries\n",
12178
"import ast\n",

3_Project/2_Skill_Demand.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -755,7 +755,7 @@
755755
"cell_type": "markdown",
756756
"metadata": {},
757757
"source": [
758-
"Filters and sorts a DataFrame to get the top 10 skills percentages for these top 3 roles. After sorting the skills by descending percentage, reverse the order of these top 5 entries to use in a horizontal bar plot, which by default starts plotting from the bottom."
758+
"Filters and sorts a DataFrame to get the top 5 skills percentages for these top 3 roles. After sorting the skills by descending percentage, reverse the order of these top 5 entries to use in a horizontal bar plot, which by default starts plotting from the bottom."
759759
]
760760
},
761761
{

3_Project/3_Skills_Trend.ipynb

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@
6565
"cell_type": "markdown",
6666
"metadata": {},
6767
"source": [
68-
"Select only those job postings that are for Data Analysts and then extracts the month from each job's posting date to see when jobs are listed. Next, converts a column that lists skills into a usable list format. Finally, it rearranges the data so that each skill from the list gets its own row."
68+
"Select only those job postings that are for Data Analysts and the job country is the United States. Then extract the month from each job's posting date to see when jobs are listed. Next, converts a column that lists skills into a usable list format. Finally, it rearranges the data so that each skill from the list gets its own row."
6969
]
7070
},
7171
{
@@ -89,7 +89,7 @@
8989
"source": [
9090
"### Pivot in Prep for Plotting\n",
9191
"\n",
92-
"Create a pivot table from the `df_DA_US_explode`, setting 'month' as the index, `job_skills` as the columns, and fills missing entries with zero. It adds a new row labeled `Total` that sums up counts across all months for each skill. Finally, it reorders the columns based on the total counts, displaying them from highest to lowest, and shows the updated pivot table. "
92+
"Create a pivot table from the `df_DA_US_explode`, setting 'month' as the index, `job_skills` as the columns, and fills missing entries with zero."
9393
]
9494
},
9595
{
@@ -524,7 +524,9 @@
524524
"cell_type": "markdown",
525525
"metadata": {},
526526
"source": [
527-
"#### Sort columns by count and change month numbers to names"
527+
"#### Sort columns by count and change month numbers to names\n",
528+
"\n",
529+
"It adds a new row labeled `Total` that sums up counts across all months for each skill. Finally, it reorders the columns based on the total counts, displaying them from highest to lowest, and shows the updated pivot table. "
528530
]
529531
},
530532
{
@@ -983,7 +985,7 @@
983985
"cell_type": "markdown",
984986
"metadata": {},
985987
"source": [
986-
"Plot a line chart of the top five skills for data analysts, indexed by month. It excludes the 'Total' row and plots only the monthly data. Then it selects the first five columns and plots them. "
988+
"Plot a line chart of the top 5 skills for data analysts, indexed by month. It selects the first five columns and plots them. "
987989
]
988990
},
989991
{
@@ -1525,7 +1527,7 @@
15251527
"source": [
15261528
"## Plot Monthly Skill Demand \n",
15271529
"\n",
1528-
"Creates a line plot for the top five skills of data analysts, shown as percentages of the total job entries per month, using the first five columns of the `df_DA_pivot_percent` DataFrame. Also the legend is moved outside of the plot for readability."
1530+
"Creates a line plot for the top five skills of data analysts, shown as percentages of the total job entries per month, using the first 5 columns of the `df_DA_pivot_percent` DataFrame. Also the legend is moved outside of the plot for readability."
15291531
]
15301532
},
15311533
{

3_Project/4_Salary_Analysis.ipynb

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -176,7 +176,7 @@
176176
"cell_type": "markdown",
177177
"metadata": {},
178178
"source": [
179-
"Filters the original dataset to focus on entries where the job title is 'Data Analyst', to create a new DataFrame `df_DA`. Converts the `job_skills` column, from string format to actual list objects if they are not null. Then it uses the `explode` method on the `job_skills` column to create a new row in the DataFrame for each skill associated with a job. Finally, it displays the first five entries of the `salary_year_avg` and `job_skills` columns."
179+
"Filters the original dataset to only get rows where the job title is 'Data Analyst' and the country is 'United States', to create a new DataFrame `df_DA_US`. Drop NaN values from the 'salary_year_avg' column. Then it uses the `explode` method on the `job_skills` column to create a new row in the DataFrame for each skill associated with a job. Finally, it displays the first five entries of the `salary_year_avg` and `job_skills` columns."
180180
]
181181
},
182182
{
@@ -276,7 +276,7 @@
276276
"cell_type": "markdown",
277277
"metadata": {},
278278
"source": [
279-
"Gets the top ten highest-paying skills for Data Analysts by calculating the median salary for each skill listed in the `df_DA`. It groups the data by job skills, computes the median salary, sorts these values in descending order, and then selects the top ten. This is then formatted into a new DataFrame (`df_DA_top_pay`) with a reset index and a renamed salary column labeled 'median_salary'."
279+
"Gets the top ten highest-paying skills for Data Analysts by calculating the median salary for each skill listed in the `df_DA_US`. It groups the data by job skills, computes the median salary, sorts these values in descending order by median, and then selects the top 10. This is then formatted into a new DataFrame (`df_DA_top_pay`) with a reset index and a renamed salary column labeled 'median_salary'."
280280
]
281281
},
282282
{
@@ -401,7 +401,7 @@
401401
"cell_type": "markdown",
402402
"metadata": {},
403403
"source": [
404-
"Calculates the count and median salary for each skill in `df_DA`. It groups the data by `job_skills`, aggregates it to find the count and median salary for each skill, and then sorts the results by count in descending order. It re-sorts this subset by median salary in descending order."
404+
"Calculates the count and median salary for each skill in `df_DA_US`. It groups the data by `job_skills`, aggregates it to find the count and median salary for each skill, and then sorts the results by count in descending order by count. It re-sorts this subset by median salary in descending order."
405405
]
406406
},
407407
{

3_Project/5_Optimal_Skills.ipynb

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -70,7 +70,7 @@
7070
"source": [
7171
"## Clean Data\n",
7272
"\n",
73-
"Clean the data and convert the `job_skills` list to a list object. Get the salary_year_average for each job skill."
73+
"Filters the original dataset to only get rows where the job title is 'Data Analyst' and the country is 'United States', to create a new DataFrame `df_DA_US`. Drop NaN values from the 'salary_year_avg' column. Then it uses the `explode` method on the `job_skills` column to create a new row in a new DataFrame (`df_DA_US_exploded`) for each skill associated with a job. Finally, it displays the first 5 entries of the `salary_year_avg` and `job_skills` columns."
7474
]
7575
},
7676
{
@@ -169,7 +169,7 @@
169169
"cell_type": "markdown",
170170
"metadata": {},
171171
"source": [
172-
"Group the data by job skills and calculates the count and median salary for each skill, sorting the results in descending order by count. It then determines the total number of Data Analyst positions that have non-missing salary information. Then calculates the percentage that each skill count represents out of the total number of Data Analyst jobs. Finally, filter out any skills that don't have any jobs associated with them."
172+
"Group the data by job skills and calculates the count and median salary for each skill, sorting the results in descending order by count. It then renames the columns. Calculates the percentage that each skill count represents out of the total number of Data Analyst jobs. Finally, filter out any skills that don't have any jobs associated with them."
173173
]
174174
},
175175
{
@@ -330,7 +330,7 @@
330330
"cell_type": "markdown",
331331
"metadata": {},
332332
"source": [
333-
"Filters for Data Analyst skills that exceed a certain percentage (`skill_limit`) and plots a scatter plot to show how the median salary for these high-demand skills."
333+
"Filters for Data Analyst skills that exceed a certain percentage (`skill_limit`)."
334334
]
335335
},
336336
{

0 commit comments

Comments
 (0)