App reviews delivers user opinions and emerging issues (e.g., new bugs) about the app releases. TOUR provides entries for developers to analyzing users' opinions and detecting emerging issues from user reviews.
Topic-based summarization of thousands of user reviews and further predicts sentiment polarities towards the topics.
Visualize the features favorable and unfavorable by users through an interative and structured agenda.
Identify user opinions towards app features based on customized polarity seed words;
Distill actionable change tasks for improving app features.
In order to evaluate the usefulness of this tool, we conducted empirical evaluation involving 15 industrial practitioners from several tech giants.
| Question | Answer | Statistics |
|---|---|---|
| How long have you been involved in software development? | Less than one year One to two years Two to three years More than three years |
3/15 5/15 1/15 6/15 |
| How important do you think it is to do topical sentiment analysis of user reviews? | Very important important Not so important |
9/15 5/15 1/15 |
| How do you think about the comprehensibility of the summary generated by TOUR? | Very easy to understand Easy to understand Not easy to understand for some parts Difficult to understand |
5/15 8/15 2/15 0 |
| How do you think about the comprehensibility of the summary generated by TOUR? | Very easy to understand Easy to understand Not easy to understand for some parts Difficult to understand |
4/15 9/15 2/15 0 |
| Without TOUR, how do you think about the difficulty of analyzing user reviews? | Highly difficult Difficult Not very difficult Easy |
6/15 8/15 1/15 0 |
| How much time do you think TOUR can save for user review analysis? | Over 50% 30%~50% 10%~30% 0 |
8/15 3/15 4/15 0 |
| How do you think about the information given by TOUR? |
Not containing any unnecessary information Containing some unnecessary information Containing many unnecessary information |
7/15 7/15 1/15 |
| How do you think about the usefulness of the entire summary provided by TOUR? | Highly useful Useful Possibly useless Very useless |
7/15 8/15 0 0 |
| How do you think about the usefulness of the topic aggregation part? | Highly useful Useful Possibly useless Very useless |
6/15 7/15 1/15 1/15 |
| How do you think about the usefulness of the sentiment analysis part? | Highly useful Useful Possibly useless Very useless |
7/15 8/15 0 0 |
| How do you think about the usefulness of the prioritized reviews? | Highly useful Useful Possibly useless Very useless |
8/15 7/15 0 0 |