Description
1- Create an additional comma-separated file named frequency.csv. Use UTF-8 encoding and include a header row identifying each column. Record each lemmatized token and the number of times it occurred across the entire set of tweets. Sort the results by number of occurrences in descending order.
2- (choose one)
Do one of the following: i. Perform sentiment analysis on each cleaned tweet to determine its polarity and subjectivity. Create a comma-separated file named sentiments.csv. Use UTF-8 encoding and include a header row identifying each column. Record each tweets ID, its cleaned text, sentiment polarity, and sentiment subjectivity. Format the sentiment polarity and sentiment subjectivity as numbers with 3 decimal places.