Skip to content

WeSearch_StarSem

JonathonRead edited this page Feb 13, 2012 · 27 revisions

Some notes on the StarSEM 2012 shared task.

Training data

3,640 sentences with 989 instances of negation.

99 instances have no scope; 101 instances have a discontinuous scope that is not bridged by the cue.

371 instances have no event; 14 instances have discontinuous events. In 6 instances the event lies outside of the scope---these seem to be annotation errors:

  • ... only an unambitious one who abandons a London career for the country ...

  • ... an unjustifiable intrusion, ...

  • It never recovered from the blow, ...

  • "But I cant forget them, Miss Stapleton," said I.

  • ... and means to spare no pains or expense to restore the grandeur of his family.

  • Coming down with an unsigned warrant.

Collins' coverage of the training data is 99.4%.

Collins can't lemmatise contractions, e.g. can't = <unknown>

Some examples

Following Morante et al's (2011) conventions of bold for cues, underline for scope and italic for events.

HoundOfTheBaskervilles_ch1, s1. prefixal cue, weirdness

  1. Mr. Sherlock Holmes, who was usually very late in the mornings, save upon those not

in**frequent occasions when he was up all night, was seated at the breakfast table.**

Mr. Sherlock Holmes, who was usually very late in the mornings, save upon those

not infrequent occasions when he was up all night, was seated at the breakfast table.

Mr. Sherlock Holmes, who was usually very late in the mornings,

save upon those not infrequent occasions when he was up all night, was seated at the breakfast table.

HoundOfTheBaskervilles_ch1, s12, prefixal cue

Since we have been so

un**fortunate as to miss him and have no notion of his errand, this accidental souvenir becomes of importance.**

HoundOfTheBaskervilles_ch1, s67: discontinuous scope

If he was in the hospital and yet

not on the staff he could only have been a house-surpeon or a house-physician: little more than a senior student.

HoundOfTheBaskervilles_ch1, s8: weirdness

It is my experience that it is only an amiable man in this world who receives testimonials, only an

unambitious one who abandons a London career for the country, and only an absent-minded one who leaves his stick and not his visiting-card after waiting an hour in your room.

HoundOfTheBaskervilles_ch1, s89: discontinuous scope

The dog's jaw, as shown in the space between these marks, is too broad in my opinion for a terrier and

not broad enough for a mastiff.

HoundOfTheBaskervilles_ch3, s235: Multi-word cue, discontinuous scope

Then, again, whom was he waiting for that night, and why was he

waiting for him in the yew alley rather than in his own house?"

HoundOfTheBaskervilles_ch4, s154: contracted cue

But as to my uncle's death: well, it all seems boiling up in my head, and I can

't get it clear yet.

HoundOfTheBaskervilles_ch4, S194: weirdness

Not for the world**, my dear Watson.**

Instances of cues

Frq.

Cue

POS

346

not

RB

137

no

DT

71

un

JJ

64

no

UH

58

never

RB

55

nothing

NN

36

n't

RB

24

without

IN

22

less

JJ

18

no

RB

17

in

JJ

16

im

JJ

12

none

NN

8

n't

JJ

6

't

RB

6

n't

VB

5

n't

NN

5

no

NNP

5

ir

JJ

4

nor

CC

4

un

RB

4

less

RB

4

in

RB

3

dis

NN

3

not

VB

3

less

NN

2

'<NULL>'

'<NULL>'

2

not

JJ

2

un

NN

2

not

NN

2

un

IN

2

nowhere

RB

2

by_no_means

IN_DT_NN

2

prevent

VB

2

n't

NNP

2

't

NN

2

im

RB

2

on_the_contrary

IN_DT_NN

1

rather_than

RB_IN

1

nobody

NN

1

been

VBN

1

fail

VBP

1

neither_*_nor

CC_*_CC

1

absence

NN

1

other

JJ

1

nothing_at_all

NN_IN_DT

1

can

MD

1

neglected

VBN

1

ir

RB

1

un

VBG

1

refused

VBD

1

the

DT

1

yet

RB

1

never

NNP

1

save

VBP

1

not_for_the_world

RB_IN_DT_NN

1

un

VBN

1

signs

NNS

1

in

NNS

1

no

JJ

1

unusual

JJ

1

dis

VBN

1

neither_*_nor

DT_*_CC

1

by_no_means

IN_RB_VBZ

1

not_*_not

RB_*_RB

1

except

IN

1

dis

JJ

Clone this wiki locally