Monday, April 06, 2009

Download Sentiment140 dataset with 1.6 million tweets


 

.

Sentiment140 dataset with 1.6 million tweets - Sentiment analysis with tweets

What is Sentiment140?

Sentiment140 allows you to discover the sentiment of a brand, product, or topic on Twitter.

How does this work?

You can read about our approach in our technical report: Twitter Sentiment Classification using Distant Supervision. There are also additional features that are not described in this paper.

How is this different?

Our approach is different from other sentiment analysis sites because:
  • We use classifiers built from machine learning algorithms. Other products use a simpler keyword-based approach which may have higher precision but lower recall.
  • We provide transparency for the classification results of individual tweets. Other sites only surface aggregated metrics, which makes it difficult to assess the accuracy of their classifiers.


Who created this?

Sentiment140 was created by Alec Go, Richa Bhayani, and Lei Huang, who were Computer Science graduate students at Stanford University.
What are the use cases?
Brand management (e.g. windows 10)
Polling (e.g. obama)
Planning a purchase (e.g. kindle)


Kaggle Site

This is the sentiment140 dataset. It contains 1,600,000 tweets extracted using the twitter api . The tweets have been annotated (0 = negative, 4 = positive) and they can be used to detect sentiment .

Content

It contains the following 6 fields:

  1. target: the polarity of the tweet (0 = negative, 2 = neutral, 4 = positive)

  2. ids: The id of the tweet ( 2087)

  3. date: the date of the tweet (Sat May 16 23:58:44 UTC 2009)

  4. flag: The query (lyx). If there is no query, then this value is NO_QUERY.

  5. user: the user that tweeted (robotickilldozr)

  6. text: the text of the tweet (Lyx is cool)

Acknowledgements

The official link regarding the dataset with resources about how it was generated is here
The official paper detailing the approach is here

Citation: Go, A., Bhayani, R. and Huang, L., 2009. Twitter sentiment classification using distant supervision. CS224N Project Report, Stanford, 1(2009), p.12.

Inspiration

To detect severity from tweets. You may have a look at this.

.

DOCLINK:

https://www-cs.stanford.edu/people/alecmgo/papers/TwitterDistantSupervision09.pdf

.

WEBLINK:

https://www.kaggle.com/kazanova/sentiment140

.

WEBLINK:

http://help.sentiment140.com/home

Read More

Saturday, January 01, 2000

What is programming


 

.

Programming is a way to “instruct the computer to perform various tasks”.

.

“Instruct the computer”: this basically means that you provide the computer a set of instructions that are written in a language that the computer can understand. The instructions could be of various types. For example:

  • Adding 2 numbers,
  • Rounding off a number, etc.

Just like we humans can understand a few languages (English, Spanish, Mandarin, French, etc.), so is the case with computers. Computers understand instructions that are written in a specific syntactical form called a programming language.

.

“Perform various tasks”: the tasks could be simple ones like we discussed above (adding 2 numbers, rounding off a number) or complex ones which may involve a sequence of multiple instructions. For example:

  • Calculating simple interest, given principal, rate and time.
  • Calculating the average return on a stock over the last 5 years.

The above 2 tasks require complex calculations. They cannot usually be expressed in simple instructions like adding 2 numbers, etc.

In summary, Programming is a way to tell computers to do a specific task.

.

Why should you bother about coding?

You must be wondering - why does one need a computer for adding or rounding off numbers? Or even for simple interest calculation? After all, even an 8th standard kid can easily do such things even over large numbers. What is programming used for? What benefits do computers offer?

Well, computers offer so many benefits:

Computers are fast: 

computers are amazingly fast. If you know how to properly utilize the power of Computer programming, you can do wonders with it. For a typical computer of today’s time, an addition of 2 numbers which could be as big as a billion each takes hardly a nanosecond. Read again - nanosecond! That means that in 1 second, a computer can perform about a billion additions. Can any human ever do that? Forget a billion additions a second, typical human can’t even do 10 additions per second. So, computers offer great speed.

Computers are cheap: 

if you were a stock market analyst and you had to monitor the data of say 1000 stocks so that you can quickly trade them. Imagine the hassle that would create if you were to do it manually! It is just impractical. While you are performing your calculation on the stock’s performance, the price may change. The other alternative is to hire people so that you can monitor more stocks in parallel. That means your cost goes up significantly. Not to mention the trouble you will face if some of your employees commit a calculation error in the process. You may end up losing money! Contrast that with the case where you use a computer. Computers can process a huge amount of information quickly and reliably. 1000 stocks are nothing for computers in the 21st century.

Computers can work 24x7: 

Computers can work 24x7 without getting exhausted. So, if you have a task that is big enough, you can without worries allocate it to a computer by programming it and sleep peacefully.

.

Extracted from: 

https://hackr.io/blog/what-is-programming



Read More