Re: Some TA_TOKENS are not recognized even for simple English sentences

If am understanding you correctly, you were using Voice of Customer to check the sentiment of the tokens,Most likely in the SAP given dictionaries they have not defined these texts:debate, super bowl, enjoy, beer

You can create with LINGANALAYSIS_BASIC

create fulltext index MYIDX2 on "MYTABLE2"("REMARK")
configuration 'LINGANALYSIS_BASIC'
text analysis on;

You should be seeing those terms being identified in below, but you won't be seeing the sentiment associated as we are using the basic configuration

Then you will have to define your own custom dictionary to analyse the sentiments. Hope this helps

Regards,

Krishna Tangudu