Need help with Review-Helpfulness-Prediction?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

128 Stars 151 Forks 12 Commits 4 Opened issues


Project of automatically detecting review helpfulness. Using

Services available


Need anything else?

Contributors list

# 258,916
12 commits

Review Helpfulness Prediction

Intro: Project of automatically finding helpful reviews.

Using text mining technique. Include natural language processing, sentiment analysis and machine learning technique.
Language: Python. (standard library: xlrd, jieba, gensim, nltk, scikit-learn)

This project include four main parts:
1. Review data set
2. Text preprocessing module.
3. Review helpfulness feature extraction module.
4. Review helpfulness prediction module.

1. Review data set

This dataset include review data of 7 cellphone brands grabbed from (

2. Text preprocessing module

Functions include: Read txt file and excel file, doing Chinese word segmentation and postag.

Using Python xlrd library to read excel data.
Using Python jieba library to do Chinese word segmentation and postag

Files include:
- User dictionary to increase segmentation accuracy.
- Stopwords and sentiment stopwords to filter irrelevant words.

3. Feature extraction module

There is four categories of review helpfulness feature.
* Linguistic features
6 features including review words and sentences number, review average length, review adjectives, adverbs and verbs number.
* Informative features
4 features including product name, brand and attributes' appearing times in a review. And review centroid score.
* Difference features
2 features including review entropy and perplexity socre.
* Sentiment feautres
8 features including review positive/negative score, average score and standard deviation score. And review positive/negative probability score.

Using Python nltk library to compute review entropy/perplexity and doing sentiment analysis.
Using Python gensim library to calculate review words tf-idf weight.

Files include:
- Labeled positive and negative review corpus.
- Trained sentiment classifier, aim to automatically classify review positive and negative.
- Sentiment dictionary including positive and negative words and adverbs of degree.
- Raw sentiment dictionary including Hownet and NTUSD.

4. Review helpfulness prediction module

This module use features calculated from above module as training set. Using machine learning method to train review helpfulness classifier. We test five popular machine learning algorithm and use cross validation method to evaluate helpfulness prediction accuracy.

Using Python scikit-learn library to train classifier and evaluated classifier performance.

Files include:
- Feature vector matrix with different threshold.


聂卉 & 容哲.(2015).面向评论效用评估的文本情感特征提取. 现代图书情报技术(Z1),113-121. doi:CNKI:SUN:XDTQ.0.2015-Z1-022.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.