Migration to production

[chrmongeau]

Checklist of elements required for migrating the module to the production environment:

Packages

• data.table
• stringr
• magrittr
• scales
• tidyr
• futile.logger
• dplyr
• faosws
• faoswsUtil
• faoswsTrade
• faoswsFlag
• bit64
• knitr
• igraph
• lazyeval
• scales
• plyr
• zoo
• parallel
• doParallel
• faoswsModules

Datatables

• ce_combinednomenclature_unlogged_YEAR (domain: trade-input-data) {see NOTE1}
• ct_tariffline_unlogged_YEAR (domain: trade-input-data) {see NOTE1}
• unsdpartnersblocks (domain: trade-reference-files) {see NOTE2}
• unsdpartners (domain: trade-reference-files) {see NOTE2}
• fcl_2_cpc (domain: agriculture)
• hsfclmap3 (domain: trade-reference-files)
• hsfclmap4 (domain: trade-reference-files)
• hsfclmap5 (domain: trade-reference-files)
• standard_hs12_6digit (domain: trade-reference-files)
• adjustments (domain: trade-reference-files) {see NOTE2} {see NOTE3}
• fclunits (domain: trade-reference-files) {see NOTE2}
• comtradeunits (domain: trade-reference-files) {see NOTE2}
• eur_conversion_usd (domain: trade-reference-files) {see NOTE2}
• hs6faointerest (domain: trade-reference-files)
• reporters_years (domain: trade-reports)
• non_reporting_countries (domain: trade-reports)
• numb_records_reporter (domain: trade-reports)
• imp_exp_content_check (domain: trade-reports)
• qty_values_country_flow_year (domain: trade-reports)
• report_missing_data (domain: trade-reports)

Datasets

• completed_tf_cpc_m49 (domain: trade)
• total_trade_cpc_m49 (domain: trade)

Misc

• Add the 896 M49 code for "Other nei"
• The datatables with label country supported lang and seedgroupcpc exist, but the module does not require them: remove (or copy them somewhere)

Notes

• NOTE1: The ce_combinednomenclature_unlogged_YEAR and ct_tariffline_unlogged_YEAR tables with YEAR = 2000, ..., 2014 exist: check whether they are updated.
• NOTE2: the table exists, but should be moved to the trade-input-files domain.
• NOTE3: this is currently not used by the module, but a copy of it in production could be useful.
• NOTE4: the module also uses the geographicAreaFS dimension of the FS1_SUA_UPD dataset in the faostat_one domain.

[chrmongeau]

The migration is basically done. Datasets/datatables/packages available on QA are on production. There are two datatables that are not synchronised between QA and production: hsfclmap4 and hsfclmap5. This was expected, however. Indeed these are datatables used by Team BC to insert or correct the HS>FCL mapping, so since the moment said datatables were copied from QA to production they have almost certainly made some modifications to the datatables. This is why they are different. I left unticked the two so that when the move to production will be final, the two can be synchronised.