Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I191855 branch feat addition #168

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Create README.md
fisa712 authored Feb 24, 2023
commit 8968c20945eadc41687fa40a31fda0da562fd0d0
22 changes: 22 additions & 0 deletions ch08/additional_features/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
Task: Add more data preprocessing steps
In this task, we will explore the impact of adding more data preprocessing steps on the accuracy and generalization of our sentiment analysis model. Specifically, we will add stemming, lemmatization, and/or stop-word removal to the existing data preprocessing steps.

Files and Folders
sentiment_analysis.py: This is the main script that performs sentiment analysis on a given input text.

preprocessing.py: This script contains the existing data preprocessing steps. You will modify this script to add more preprocessing steps.

data: This folder contains the training and test data.

Instructions
Clone the repository and create a new branch for this task.

Open the preprocessing.py script and add more data preprocessing steps such as stemming, lemmatization, or stop-word removal. You can use any NLP library such as NLTK or spaCy to implement these preprocessing steps.

Train the model using the modified data preprocessing steps and evaluate its accuracy and generalization using the test data.

Update the README file with the results of the evaluation and a description of the added preprocessing steps.

Push the changes to the branch and create a pull request.

Wait for the reviewer to approve the pull request and merge it with the main branch.