1、Zaidan et. al Annotator Rationales This is a 20-25 minute talk (without interruption) best viewed on a PC running Windows (it does not look right on a Mac). If you use the slides to present our ideas, please credit us for our hard work If you use the slides for an unrelated topic (e.g. the slides on
2、 SVM) please credit the first author, who prepared the slides. This is the slideshow used by the first author for his NAACL HTL 2007 talk on 4/24/2007. It is a slightly updated version from that given to CLSP on 12/8/2006 (which is also available). Of course, we would love to hear your ideas! Omar,
3、Jason, and ChristineZaidan et. al Annotator RationalesFYI: BibTeX EntryInProceedingszaidan-eisner-piatko:2007:MainConf,author = Zaidan, Omar and Eisner, Jason and Piatko, Christine,title = Using Annotator Rationales to Improve Machine Learning for Text Categorization,booktitle = Human Language Techn
4、ologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference,month = April,year = 2007,address = Rochester, New York,publisher = Association for Computational Linguistics,pages = 260-267,url = http:/www.aclweb.org/ant
5、hology/N/N07/N07-0133Zaidan et. al Annotator RationalesUsing “Annotator Rationales” to ImproveMachine Learning for Text CategorizationOmar F. ZaidanJason EisnerChristine D. PiatkoJohns Hopkins UniversityNAACL HLT 2007 Rochester, NYTuesday April 24th, 2007cs.jhu.edu |ozaidan cpiatkojason | Zaidan et.
6、 al Annotator RationalesTraining DocsPerformancexxxxx. . .Supervised LearningAnnotatedSupervised LearningZaidan et. al Annotator RationalesTraining DocsPerformancexxxxx. . .Supervised LearningZaidan et. al Annotator RationalesRicher AnnotationTraining DocsPerformancexxxxx. . .xxxxx. . .Zaidan et. al
7、 Annotator RationalesRicher Annotation? Usually, an annotator indicates what the correct answer is. We propose the annotator also indicate why. Each training example provides data about itsclass and why. Richer annotation provides more data. Idea #1: richer annotation can aid ML. Idea #2: richer bet
8、ter use of our time than more.Zaidan et. al Annotator RationalesRationales in Text CategorizationThe following segments were taken from movie reviews. Did the reviewer have a positive or negative opinion of the movie? Trust me, you will enjoy the hell out of American Pie. He continues to be one of t
9、he most exciting artists on the big screen, performing his own stunts and dazzling audiences. and the romance was enchanting. The movie is so badly put together that even the most casual viewer may notice the miserable pacing and stray plot threads. and it even makes watching Eddie Murphy a tedious
10、experience. A woman in peril. A confrontation. An explosion. The end. Yawn. Yawn. Yawn. Zaidan et. al Annotator Rationales. . . . .Non-annotated documentsZaidan et. al Annotator Rationales. . . . .Saving Private RyanWar became a reality to me after seeing Saving Private Ryan. Steve Spielberg goes be
11、yond reality with his latest production. Keep the kids home as the R rating is for Reality. Tom Hanks is stunning as Capt John Miller, set out in France during WW II to rescue and return home a soldier, Private Ryan (Matt Damon) who lost three brothers in the war. Spielberg takes us inside the heads
12、 of these individuals as they face death during the horrific battle scenes. Private Ryan is not for everyone, but I felt the time was right for a movie like this to be made. The movie reminds us of the sacrifices made by our fighting men and women. For this I thank them and for Steve Spielberg for m
13、aking a movie that I will never forget. And Im sure the Academy will not forget Tom Hanks come April, as another well deserved Oscar with be in Toms possession.Zaidan et. al Annotator Rationales. . . . .Saving Private RyanWar became a reality to me after seeing Saving Private Ryan. Steve Spielberg g
14、oes beyond reality with his latest production. Keep the kids home as the R rating is for Reality. Tom Hanks is stunning as Capt John Miller, set out in France during WW II to rescue and return home a soldier, Private Ryan (Matt Damon) who lost three brothers in the war. Spielberg takes us inside the
15、 heads of these individuals as they face death during the horrific battle scenes. Private Ryan is not for everyone, but I felt the time was right for a movie like this to be made. The movie reminds us of the sacrifices made by our fighting men and women. For this I thank them and for Steve Spielberg
16、 for making a movie that I will never forget. And Im sure the Academy will not forget Tom Hanks come April, as another well deserved Oscar with be in Toms possession.Zaidan et. al Annotator Rationales. . . . .Annotated documentsClass and also “rationales”Training DocsPerformancexxxxx. . .xxxxx. . .O
17、nly class; no “rationales”Zaidan et. al Annotator RationalesKundunMartin Scorseses Kundun has been criticized for its lack of narrative structure. Personally, I dont think it needs one: it works perfectly well as a study of Tibetan Buddhist culture and communist China. Scorsese views the Dalai Lama
18、the way many Tibetans probably do, as a larger-than-life symbol of Buddhist spirituality and political leadership: the only glimpses into his head come from several dream sequences, but his portrayal is appropriate for a film that concentrates on the political and spiritual. The set design and cinem
19、atography were absolutely outstanding. Scorsese gets carried away with the spectacle, and it helps to augment the cultural contrast when the Dalai Lama travels to China to meet Chairman Mao. Kundun does not succumb to the temptation to start shouting slogans, delivering its message in an artisticall
20、y interesting way without being overly manipulative. . . . .Zaidan et. al Annotator RationalesKundunMartin Scorseses Kundun has been criticized for its lack of narrative structure. Personally, I dont think it needs one: it works perfectly well as a study of Tibetan Buddhist culture and communist Chi
21、na. Scorsese views the Dalai Lama the way many Tibetans probably do, as a larger-than-life symbol of Buddhist spirituality and political leadership: the only glimpses into his head come from several dream sequences, but his portrayal is appropriate for a film that concentrates on the political and s
22、piritual. The set design and cinematography were absolutely outstanding. Scorsese gets carried away with the spectacle, and it helps to augment the cultural contrast when the Dalai Lama travels to China to meet Chairman Mao. Kundun does not succumb to the temptation to start shouting slogans, delive
23、ring its message in an artistically interesting way without being overly manipulative. . . . .Zaidan et. al Annotator RationalesVolcanoVolcano starts with Tommy Lee Jones worrying about a small earthquake enough to leave his daughter at home with a baby sitter. There is one small quake then another
24、quake. Then a geologist points out to Tommy that its takes a geologic event to heat millions of gallons of water in 12 hours. A few hours later large amount of ash start to fall. Then.it starts: the volcanic eruption!I liked this movie.but it was not as great as I hoped. It was still good none the l
25、ess. It had excellent special effects. The best view was that of the helecopters flying over the streets of volcanos. Also, there were interesting side stories that made the plot more interesting. So.it was good!. . . . .Zaidan et. al Annotator RationalesVolcanoVolcano starts with Tommy Lee Jones wo
26、rrying about a small earthquake enough to leave his daughter at home with a baby sitter. There is one small quake then another quake. Then a geologist points out to Tommy that its takes a geologic event to heat millions of gallons of water in 12 hours. A few hours later large amount of ash start to
27、fall. Then.it starts: the volcanic eruption!I liked this movie.but it was not as great as I hoped. It was still good none the less. It had excellent special effects. The best view was that of the helecopters flying over the streets of volcanos. Also, there were interesting side stories that made the
28、 plot more interesting. So.it was good!. . . . . . .Zaidan et. al Annotator RationalesThe PostmanQuestion: after the disaster that was Waterworld, what the fuck were the execs who gave Costner the money to make another movie thinking?In this 3 hour advertisement for his new hair weave, Costner plays
29、 a nameless drifter who dons a long dead postal employees uniform (I shit you not) and gradually turns a nuked-out USA into an idealized hippy-dippy society. (The main accomplishment of this brave new world is in re-inventing polyester.) When hes not pointing the camera directly at himself, director
30、 Costner does have a nice visual sense, but by the time the second hour rolled around, I was reduced to sitting on my hands to keep from clawing out my own eyes. Mark this one “return to sender“. . . . . .Zaidan et. al Annotator RationalesThe PostmanQuestion: after the disaster that was Waterworld,
31、what the fuck were the execs who gave Costner the money to make another movie thinking?In this 3 hour advertisement for his new hair weave, Costner plays a nameless drifter who dons a long dead postal employees uniform (I shit you not) and gradually turns a nuked-out USA into an idealized hippy-dipp
32、y society. (The main accomplishment of this brave new world is in re-inventing polyester.) When hes not pointing the camera directly at himself, director Costner does have a nice visual sense, but by the time the second hour rolled around, I was reduced to sitting on my hands to keep from clawing ou
33、t my own eyes. Mark this one “return to sender“. . . . . .Zaidan et. al Annotator RationalesThe PostmanQuestion: after the disaster that was Waterworld, what the fuck were the execs who gave Costner the money to make another movie thinking?In this 3 hour advertisement for his new hair weave, Costner
34、 plays a nameless drifter who dons a long dead postal employees uniform (I shit you not) and gradually turns a nuked-out USA into an idealized hippy-dippy society. (The main accomplishment of this brave new world is in re-inventing polyester.) When hes not pointing the camera directly at himself, di
35、rector Costner does have a nice visual sense, but by the time the second hour rolled around, I was reduced to sitting on my hands to keep from clawing out my own eyes. Mark this one “return to sender“. . . . . .Zaidan et. al Annotator RationalesBatman he underplays nicely and pretends like hes in a
36、real movie . . . . .Zaidan et. al Annotator RationalesBatman he underplays nicely and pretends like hes in a real movie . . . . .Zaidan et. al Annotator RationalesArmageddonThis disaster flick is a disaster alright. Directed by Tony Scott (Top Gun), its the story of an asteroid the size of Texas cau
37、ght on a collision course with Earth. After a great opening, in which an American spaceship, plus NYC, are completely destroyed by a comet shower, NASA detects said asteroid and go into a frenzy. They hire the worlds best oil driller (Bruce Willis), and send him and his crew up into space to fix our
38、 global problem.The action scenes are over the top and too ludicrous for words. So much so, I had to sigh and hit my head with my notebook a couple of times. Also, to see a wonderful actor like Billy Bob Thornton in a film like this is a waste of his talents. The only real reason for making this fil
39、m was to somehow out-perform Deep Impact. Bottom line is, Armageddon is a failure. . . . .Zaidan et. al Annotator RationalesArmageddonThis disaster flick is a disaster alright. Directed by Tony Scott (Top Gun), its the story of an asteroid the size of Texas caught on a collision course with Earth. A
40、fter a great opening, in which an American spaceship, plus NYC, are completely destroyed by a comet shower, NASA detects said asteroid and go into a frenzy. They hire the worlds best oil driller (Bruce Willis), and send him and his crew up into space to fix our global problem.The action scenes are o
41、ver the top and too ludicrous for words. So much so, I had to sigh and hit my head with my notebook a couple of times. Also, to see a wonderful actor like Billy Bob Thornton in a film like this is a waste of his talents. The only real reason for making this film was to somehow out-perform Deep Impac
42、t. Bottom line is, Armageddon is a failure. . . . . . .Zaidan et. al Annotator Rationales. . . . .Annotated documentsClass and also “rationales”OK now what?Zaidan et. al Annotator RationalesSaving Private RyanWar became a reality to me after seeing Saving Private Ryan. Steve Spielberg goes beyond re
43、ality with his latest production. Keep the kids home as the R rating is for Reality. Tom Hanks is stunning as Capt John Miller, set out in France during WW II to rescue and return home a soldier, Private Ryan (Matt Damon) who lost three brothers in the war. Spielberg takes us inside the heads of the
44、se individuals as they face death during the horrific battle scenes. Private Ryan is not for everyone, but I felt the time was right for a movie like this to be made. The movie reminds us of the sacrifices made by our fighting men and women. For this I thank them and for Steve Spielberg for making a
45、 movie that I will never forget. And Im sure the Academy will not forget Tom Hanks come April, as another well deserved Oscar with be in Toms possession.How sure was the annotator that this is a positive review?Zaidan et. al Annotator RationalesSaving Private RyanWar became a reality to me after see
46、ing Saving Private Ryan. Steve Spielberg goes beyond reality with his latest production. Keep the kids home as the R rating is for Reality. Tom Hanks is stunning as Capt John Miller, set out in France during WW II to rescue and return home a soldier, Private Ryan (Matt Damon) who lost three brothers
47、 in the war. Spielberg takes us inside the heads of these individuals as they face death during the horrific battle scenes. Private Ryan is not for everyone, but I felt the time was right for a movie like this to be made. The movie reminds us of the sacrifices made by our fighting men and women. For
48、 this I thank them and for Steve Spielberg for making a movie that I will never forget. And Im sure the Academy will not forget Tom Hanks come April, as another well deserved Oscar with be in Toms possession.How sure was the annotator that this is a positive review?Zaidan et. al Annotator Rationales
49、Saving Private RyanWar became a reality to me after seeing Saving Private Ryan. Steve Spielberg goes beyond reality with his latest production. Keep the kids home as the R rating is for Reality. Tom Hanks is stunning as Capt John Miller, set out in France during WW II to rescue and return home a soldier, Private Ryan (Matt Damon) who lost three brothers in the war. Spielberg takes us inside the heads of these individu
