Question

I'm doing sentiment analysis for financial articles. To enhance the accuracy of my naive Bayes classifier, I'd like to implement negation handling.

Specifically, I want to add the prefix "not_" to the word following a "not" or "n't"

So if there's something like this in my corpus:

 x <- "They didn't sell the company." 

I want to get the following:

"they didn't not_sell the company."

(the stopword "didn't" will be removed later)

I could find only the gsub() function, but it doesn't seem to work for this task.

Any help would be appreciated!! Thank you!

No correct solution

OTHER TIPS

Specifically, I want to add the prefix "not_" to the word following a "not" or "n't"

str_negate <- function(x) {
  gsub("not ","not not_",gsub("n't ","n't not_",x))
}

Or I suppose you could use strsplit:

str_negate <- function(x) {
  str_split <- unlist(strsplit(x=x, split=" "))
  is_negative <- grepl("not|n't",str_split,ignore.case=T)
  negate_me <- append(FALSE,is_negative)[1:length(str_split)]
  str_split[negate_me==T]<- paste0("not_",str_split[negate_me==T])
  paste(str_split,collapse=" ")
}

either way gives you:

> str_negate("They didn't sell the company")
[1] "They didn't not_sell the company"
> str_negate("They did not sell the company")
[1] "They did not not_sell the company"
Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top