ErgReleases

Background

This page (a work in progress, like so many others on this wiki) collects some practical and historic information around official snapshots of the ERG, e.g. officially released versions of the grammar.

Release Procedure

1. re-generate core.smi

2. update erg.hds

3. update redwoods.xls

Re-Generate the Core SEM-I

Validate and Update the Head Table

  (tsdb::read-heads "~/src/logon/lingo/terg/erg.hds" :test t)

Generate Maximum Entropy and PCFG Models

By default, the Maximum Entropy training scripts (re-)generate a fresh feature cache, hence the following two jobs must not run in parallel

  sbatch ${LOGONROOT}/uio/titan/redwoods --redwoods --run train.wescience.lisp

  sbatch ${LOGONROOT}/uio/titan/redwoods --redwoods --run train.redwoods.lisp

For the time being, there is only one PCFG model, trained off the full (non-testing) Redwoods collection:

  sbatch ${LOGONROOT}/uio/titan/redwoods --redwoods --run pcfg.lisp