Unidata - To provide the data services, tools, and cyberinfrastructure leadership that advance Earth system science, enhance educational opportunities, and broaden participation. Unidata
         
  advanced  
 

Unidata McIDAS-X v2008 Release Notes


This document describes significant changes between Unidata McIDAS-X/-XCD Versions 2007 and 2008.

Before Installing McIDAS-X

Please take the time to read this entire document; its important to understand the whole procedure before you begin. If you connect to ADDE remote servers at other sites, contact the site coordinators at those sites. The site coordinators can tell you if any server problems that might affect your system were noted since this upgrade was distributed.

This upgrade procedure is divided into four sections.

Section I. Supported Software Configurations

Unidata McIDAS-X 2008 is supported on systems running Apple MacOS-X, HP-UX (by virtue of SSEC's support of this platform only), FreeBSD, IBM AIX, Linux (most varieties), SGI IRIX, Sun Solaris, and Microsoft Windows XP with Services for Unix. The software configurations compatible with McIDAS-X 2001 are listed in Chapter 1 of the Unidata McIDAS-X User’s Guide

Section II. Before Installing McIDAS-X

Complete all Required Actions below.

Core Software Changes

Review the changes to core software before installing McIDAS-X 2008. Section IV lists some of the significant changes since the last upgrade. Two ASCII text files, MAY08PRG.TXT and MAY08INQ.TXT, list all software changes made to McIDAS-X since the previous upgrade. A third file, MAY08OPN.TXT, lists all software bugs known at the time this upgrade was distributed. All these three files are provided with the distribution.

Required Action:

Operating System and Compiler Changes

Beginning with this upgrade, the following changes were made to operating system and compiler versions that McIDAS-X is supported on.

Required Action:

Compatibility with -X Remote Servers and -XCD

McIDAS-X 2008 can run in a stand-alone mode. However, many commands can access data on other workstations (remote servers). Therefore, your McIDAS-X client workstations and the remote servers they access must be running compatible versions in order for all features to work as expected.

For example, the items below are dependent upon the McIDAS-X version that the client and/or server is running.

Required Action:

Disk Space

McIDAS-X disk space requirements increased, mainly due to the addition of new servers.

The overall disk space requirements for obtaining, building and installing McIDAS-X 2008 listed in the table below have not changed substantially from v2007. The compiler type (vendor or gcc/g77) used for each build are also listed.


Operating system

Compilers

McIDAS-X 2008


AIX 5L version 5.1

vendor

445 MB

HP-UX 11.11

vendor

465 MB

IRIX64 6.5.21

vendor

470 MB

Fedora Linux

gcc/gfortran

420 MB

FreeBSD 4.11

gcc/f77

425 MB

MacOS_X 10.5

gcc/g77

460 MB

Solaris SPARC

vendor

745 MB

Solaris 10 x86

vendor

450 MB

Windows XP Pro

gcc/g77

355 MB


Required Action:

Section III. Installing McIDAS-X

If you need assistance with the upgrade please send email to Unidata McIDAS Support <support-mcidas@unidata.ucar.edu>.

Required Action:

Section IV. McIDAS-X Significant Changes

Complete all Required Actions below. Optional Actions are only for your consideration.

METAR Cloud Coverage Values

In the past, the METAR cloud coverage report FEW shared the same value as SCT in the ISFC-schema MD files (both were assigned a value of "1" in the CC1 and CC2 parameters). Beginning with the McIDAS-XCD 2008 upgrade, the surface decoder now assigns FEW the value "5" in those MD file parameters. The value "5" was chosen because it was previously unused and thus retains backward compatibility for the other cloud coverage values (CLR, SCT, BKN and OVC are still 0, 1, 2 and 3, respectively) with archived ISFC-schema MD files.

The table below shows the previous and current definitions.


Reported Value Old (pre-2008)
CC1 and CC2 Values
New (2008 and later)
CC1 and CC2 Values

CLR00
FEW15
SCT11
BKN22
OVC33

The splitting out of FEW into its own value in the ISFC-schema MD files means that you can now display or list its values separately from SCT. For SFCPLOT and SFCCON, you will simply see plot or contour values of 5. For SFCLIST with OPT=CLOUD or OPT=ALL, the cloud coverage values are listed in 8ths so they follow definitions of 0/8ths=CLR, 1/8th=FEW, 3/8ths=SCT, 5/8ths=BKN and 8/8ths=OVC. For SFCMG, the cloud coverage symbols will be open (unfilled) for CLR, 1/4 filled for FEW, 1/2 filled for SCT, 3/4 filled for BKN and completely filled for OVC.

Required Action:

Future McIDAS-X Software Upgrades

In 2009 and beyond, official McIDAS-X software updates will be made via software addenda (including online documentation updates) rather than via formal annual upgrades each summer. This step is being taken so that the McIDAS programming, testing and documentation efforts can focus on the next generation McIDAS, McIDAS-V.

McIDAS-X for XP Remote Servers and PAE

Due to a change in the Windows XP service installation, the ADDE remote server installation script (e.g., mcinet2005.sh) no longer works on XP workstations with Service Pack 2 (SP2) or later. Therefore, we are NOT including a remote server installation script for McIDAS-X for XP with this 2008 upgrade. (We also did not include it in the 2006 and 2007 upgrades.)

If your McIDAS-X for XP workstation is already running the remote server (e.g., from version 2004 or 2005), you can continue to run it even after installing McIDAS-X for XP version 2007. Please note, however, that if you uninstall it (with a command similar to sh ./mcinet2005.sh uninstall mcadde) you will NOT be able to reinstall it because the failure occurs during the install portion of any version of the mcinet script. Therefore, we strongly recommend that you do NOT uninstall the remote server on your McIDAS-X for XP workstations at any time unless you're sure you will not need to run it again in the future.

Required Action:

Other Modifications

The modifications below require no special action.


Command/Topic

Modification


ADT

added many corrections to ADT and associated software so it works much better on more platforms than the beta version in McIDAS-X 2007; also now sets the value for the environment variable LDR_CNTRL based on the amount of memory available when running McIDAS-X on an AIX system

IMGCOPY

modified BAND keyword to allow copying of selected bands (not just one band or ALL bands) if the source image is MTSAT raw data on an SDI server; copying of selected bands is also available with GVAR raw data on an SDI server, MODIS Level 1b data in HDF format, or real-time segmented MSG Level 1.5 files transmitted by EUMETSAT

MCLISTEN

new undocumented command that is used to send McIDAS-X information to McIDAS-V through use of the McIDAS-V bridge

MOSRPT

fixed bugs in MOS decoders and in station database so MOSRPT now correctly finds and lists Alaskan MOS forecasts

NAVCALC

updated to work correctly with MTSAT HRIT imagery

BUFR Server

several new modules were added and existing ones were modified in preparation for an upcoming McIDAS-X BUFR server and McIDAS-XCD BUFR filer; the server and filer are *not* complete in version 2008; a separate, alpha version, McIDAS BUFR package that requires Java is planned for summer 2008

GeoTIFF Servers

updated GeoTIFF servers so that GeoTIFF files created with IMGCOPY, IMGFILT, IMGOPER or IMGREMAP are compatible with the ArcGIS software pacakge

GOES-14 and -15

updated calibration module and server so applications will correctly handle increased resolution (from 8km to 4km) of band 6 GOES-O/14 and GOES-P/15 data

GVAR Servers

updated GVAR servers to output correct radiance values when using IMGCOPY with UNIT=RAD to write to a netCDF dataset

Level 1b Servers

updated Level 1b servers to work with MetOp-A AVHRR FRAC data; see the DSSERVE command's online help or its documentation in the McIDAS User's Guide for information about creating the datasets

Meteosat-8, -9

updated Meteosat Second Generation servers and calibration module to accommodate the 05 May 2008 change from spectral to effective radiance, and the inclusion of a flag in the signal to indicate the radiance type; the calibration block for MSG data was increased in size to 400 bytes; the calibration module (kbxmsg.dlm) is backward compatible to correctly read both old and new data

Meteosat Servers

updated Meteosat PDUS servers to work with archive directory structures that have a different directory for each day; also added new Meteosat OMTP servers to work with Open MTP format data

New MODIS Product Server

added MODIS product server in McIDAS-X to allow creation of datasets of MODIS Corrected Reflectance data in HDF format on local and remote servers, and display or manipulation of the data using the IMG* commands; see the DSSERVE command's online help or its documentation in the Unidata McIDAS User's Guide for information about creating the datasets

MTSAT HRIT Server

changed latitude and longitude of MTSAT's subsatellite point from a hardcoded value to one that finds the value from the satellite signal


Data Files

The following changes were made to files in the ~mcidas/data directory.


File name

Change


bufrVersion2TableA.txt
bufrVersion3TableA.txt
bufrVersion4TableA.txt

new text files used by the upcoming -X BUFR server and existing-XCD BUFR filer to label the BUFR files in a consistent manner using the category/subcategory

DCISFC

added new 5=FEW cloud cover in parameter description section

gbtbpds110.av1
gbtbpds001.2v131

added new file gbtbpds001.2v131 so McIDAS works with Table 131 grids (e.g., NARR GRIB files); updated gbtbpds001.av1 so GRDLIST gives correct values for SRC and PAR when using NARR grids

gbtbpds001.bv1

updated to support geographic GRIB domain 225, and added entries to correctly identify GRIB1 AWR, NAH, RCM and WNA grids

GEODATA.CORE

updated MTSAT entries to match SSEC Data Center real-time MTSAT datasets

grib2NavLookup.txt

added new nav information for 2008 upgrade, including lookup for RUC 13-km model and wave model files on NWS ftp

grib2Parameters.txt

added new parameters for 2008 upgrade, changed unit name for MSLM from HPA to PA, and updated parameters in physical atmospheric properties and GOES-12 forecast satellite imagery product

LEODATA.CORE

removed FLYOVER from the list of default datasets used by the LEO command because it's no longer available on the SSEC Data Center real-time servers

OUTLARST

new map file containing Argentinian states; in addition to OUTARGENTST, that is included in Unidata McIDAS-X

SATANNOT

added sensor source numbers 129, 139 and 216 for TERRA-LST, AQUA-LST and AMSU-A LWP, respectively

SATBAND

added band information for Terra LST, Aqua LST, and AMSU-A LWP

STNDB.CORE

corrected spelling from Culepra to Culebra for station CPX; corrected entry for Eldred Rock, AK (was ERI/Ekdred Rock, now ERO/Eldred Rock) and corrected Alaskan NGMMOS stations to begin with "P" so they can now be used with the MOSRPT command

USCOUNTY.MAP

corrected FIPS codes for Monroe County, Florida entries ("Mainland Monroe", "Lower Keys in Monroe", "Middle Keys in Monroe" and "Upper Keys in Monroe") so they each draw the appropriate region

XRD2008.TXT

updated with list of commands, servers and data files in McIDAS-XRD version 2008 sidecar package; run McIDAS-X command SEE XRD2008.TXT to view the list


Required Action:

Local Code

Compile and link all local code after installing the upgrade. Listed below are some of the software and structural changes most likely to affect your local code.



McIDAS-XCD v2008 Release Notes

The McIDAS-XCD upgrade procedure is divided into four sections.


Section I. Before Installing McIDAS-XCD

Complete all Required Actions below.

Compatibility with McIDAS-X

The McIDAS-XCD software is dependent on the McIDAS-X library and data files. McIDAS-X 2008 must be installed on the workstation prior to the installation of McIDAS-XCD 2008.

The McIDAS-XCD 2008 software package was tested and supported by SSEC on Enterprise Linux 4.0. As with McIDAS-X 2008, SSEC recommends that you run your Enterprise Linux workstation in 32-bit mode. Unidata tests McIDAS-XCD on Sun Solaris SPARC 5.9 and Fedora 64-bit Linux.

Required Action:

Coordinate upgrading your site's McIDAS-X and McIDAS-XCD systems according to your needs.

Section II. Installing McIDAS-XCD

If you need assistance with the installation, please contact Unidata McIDAS Support <support-mcidas@unidata.ucar.edu>.

The GRIB Server is available in -X 2008 and -XCD 2008 with the use of a MySQL database. GRIB1 and GRIB2 files from the NOAAPORT data stream have been tested and are fully supported.

Required Action:

  1. Obtain and install McIDAS-X 2008. Upgrade with additional modifications for the installation of McIDAS with the MySQL database.
    If you are planning on using the new GRIB server with -XCD, you must install MySQL on the -XCD machine, and then build and install McIDAS-X v2008 with MySQL support.

Section III. Configuring McIDAS-XCD

This section lists the actions to be performed immediately after upgrading to McIDAS-XCD 2008 from a previous version. If you are installing McIDAS-XCD for the first time on a workstation, then everything in this section will have been done during the installation procedure.

New GRIB2 Configuration File

The GRIB filer has been modified to allow the -XCD Administrator to specify which GRIB2 messages should be discarded and not decoded by -XCD. GRBFILER.CFG was modified to read the configuration file (NOGRIB2.CFG) that specifies which GRIB2 messages should be discarded. The functionality of NOGRIB2.CFG is similar to NOGRIB.CFG, which specifies which GRIB1 messages to discard.

Required Actions:

  1. As user oper, create a backup copy of your current GRBFILER.CFG file, and copy the new version of the file into ~oper/mcidas/data.

    Type: cp ~oper/mcidas/data/GRBFILER.CFG ~oper/mcidas/data/GRBFILER.CFG.BAK
    Type: cp ~oper/mcidas/xcd2008/data/GRBFILER.CFG ~oper/mcidas/data

  2. Edit GRBFILER.CFG and make any appropriate changes to reflect your McIDAS-XCD configuration.
  3. Stop and restart -XCD for the changes to take effect.

Changes to the Synoptic and METAR Decoders

The synoptic and METAR decoders were updated for NIL= data lines coming across the NOAAPORT data stream that were filling up rapid access files and overwriting real observations in MD files. The NIL= data lines are now ignored when creating the synoptic and METAR MD files.

In order to make the rapid access files larger to accommodate the NIL= data lines in the synoptic and METAR data, you must create new SAO METAR and synoptic rapid access files.

Required Actions:

  1. Shut down -XCD and wait for all associated processes to exit.
  2. Start a McIDAS-X session under the oper account.
  3. Run the following BILDTEXT commands to delete the SAOMETAR.RAP, SAOMETAR.RAT, SYNOPTIC.RAP, and SYNOPTIC.RAT files and create new SAOMETAR.RAP and SYNOPTIC.RAP files. The new SAOMETAR.RAT and SYNOPTIC.RAT files will be created as soon as the next associated SAO/METAR or SYNOPTIC message is received.

    (Note: Running the BILDTEXT command deletes the rapid access files, making the previous text data unavailable with the OBSRPT, SFCRPT, and SYNRPT commands. Current MD files are unaffected by the BILDTEXT command.)

    Type: BILDTEXT INIT SAOMETAR.RAP SAOMETAR.RAT 7000 6 C4 36 1 80 SAOMETAR X 48
    Type: BILDTEXT INIT SYNOPTIC.RAP SYNOPTIC.RAT 6500 2 IDN 16 3 80 SYNOPTIC X 48

  4. Restart -XCD for the changes to take effect.

Changes to the NGM MOS Decoder

The NGM MOS decoder and configuration file were updated to include the FOAK WMO header for Alaskan NGM MOS stations. These stations were also added to the STNDB.CORE file released in McIDAS-X Version 2008. The addition of these Alaskan stations put the total number of stations over the existing limit of 600 stations allowed in the NGM MOS rapid access text file and MD files.

In order to decode MOS forecasts from these Alaskan stations and you must update the NGM MOS configuration file. To account for the larger number of NGM MOS stations, you must create a new NGM MOS rapid access text file.

Required Actions:

  1. As user oper, create a backup copy of your current NGMMOS.CFG file and copy the new version of the file into ~oper/mcidas/data.

    Type: cp ~oper/mcidas/data/NGMMOS.CFG ~oper/mcidas/data/NGMMOS.CFG.BAK
    Type: cp ~oper/mcidas/xcd2008/data/NGMMOS.CFG ~oper/mcidas/data

  2. Shut down -XCD and wait for all associated processes to exit.
  3. Start a McIDAS-X session under the oper account.
  4. Run the following BILDTEXT command to delete the NGMMOS.RAP and NGMMOS.RAT files and create a new NGMMOS.RAP file. The new NGMMOS.RAT file will be created as soon as the next NGM MOS message is received. New NGM MOS MD files will be generated with 2000 columns the next time a new NGM MOS MD file is created, usually the next day after 0 UTC.

    (Note: Running the BILDTEXT command deletes the rapid access files, making the previous text data unavailable with the OBSRPT and MOSRPT commands. Current MD files are unaffected by the BILDTEXT command.)

    Type: BILDTEXT INIT NGMMOS.RAP NGMMOS.RAT 2000 4 C4 4 12 80 NGMMOS X 48

  5. Restart -XCD for the changes to take effect.

Changes to the Surface Observation Schema

The filing of METAR cloud coverage value FEW as a separate value (rather than combined with SCT) in ISFC-schema MD files was added for this upgrade, and changes to the surface decoder and schema have been made. No changes were made to the surface configuration file (ISFCDEC.CFG). See METAR Cloud Coverage Values in Section IV for more information.

Required Actions:

  1. From a McIDAS-X window in the oper account, register the new ISFC schema.

Type: SCHE DCISFC

Local Copies of GRIB Table Files

In version 2005, the gbtbpds001.* GRIB table files were moved from McIDAS-XCD to McIDAS-X for use with the GRIB decoder. These files now reside in ~mcidas/data and several files have been updated in 2008.

If your -XCD workstations have any local copies in ~oper/mcidas/data or in ~mcadde/mcidas/data, they should be removed so that the updated files in McIDAS-X 2008 (located in ~mcidas/data) are used.

Required Actions:

  1. Search for local copies of the gbtbpds001.* files and remove them.
  2. If any files were removed, stop and restart -XCD for the changes to take effect.


Section IV. McIDAS-X and -XCD Changes

This section lists the changes made to McIDAS-X and -XCD source, data, script, and batch files since the last upgrade (version 2007).

Source Modules Changes in -XCD

The table below lists changes to McIDAS-XCD source modules since the previous upgrade (version 2007).
File Description of Modifications
bufr.h Added and updated the prototypes for BUFR filing and decoding.
dmbin.pgm
Mcgrb2dec.c
Updated with changes related to the new NOGRIB2.CFG data file.
m0dcdsfc.for If observations indicate a NIL= reading, then do not file into the MD file, but do file into the rapid text file.
Implemented FEW=5 for cloud coverage in the ISFC schema.
m0ngmmos.for Updated to allow for up to 2000 NGM MOS stations.
m0saodec.for
m0syndec.for
If observations indicate a NIL= reading, then do not file into the MD file, but do file into the rapid text file.
m0shpdec.for Updated to put the actual (not nominal) time into the HMS key for SHIP/BUOY readings.
Mcbufrdecoder.c Moved all BUFR decoding functions into this module.
Added a branch to account for differences between BUFR Edition 4 and previous editions.
The filer now names BUFR files according to edition number (*.bufr2, *.bufr3, and *.bufr4) and according to http://www.emc.ncep.noaa.gov/mmb/data_processing/data_dumping.doc/table_1.htm
Mcgrbbfrdec.c Put in a hard-coded value of Center 7, Subcenter 14 to properly identify MOS GRIB1 files, because XCD GRIB tables are currently not designed to handle subcenters.
Moved BUFR decoding functions to Mcbufrdecoder.c.
Adjusted call to Mcbufrtofilename to include edition number of the BUFR file.
obtgserv.cp
wtxgserv.cp
Changed the type of time_t variables to int as needed for 64-bit machines.

 

Source Module Changes in -X

The table below lists changes to McIDAS-X source modules since the previous upgrade (version 2007) that are used by -XCD.

File Description of Modifications
mcgrib.h Added prototypes and structures for NOGRIB2.CFG functionality.
xcdgrib.c Updated with changes related to the new NOGRIB2.CFG data file.
Added case statement for GRIB1 236 that was improperly being assigned as Mercator when it should be Lambert Conformal.

Data File Changes in -XCD

The table below lists changes to McIDAS-XCD data files since the previous upgrade (version 2007).
File Description of Modifications
GRBFILER.CFG Added an entry for the default name of the NOGRIB2.CFG file.
NGMMOS.CFG Added WMO entries for FOAK (Alaskan NGM MOS messages).
Increased the number of columns in the MD file from 600 to 2000 to account for the additional Alaskan entries.
NOGRIB2.CFG New file - similar to NOGRIB.CFG, this allows for entries of GRIB2 data to be discarded.
XCDDEC.VER Updated -XCD version number to 2008.

 

Data File Changes in -X

The table below lists changes to McIDAS-X data files since the previous upgrade (version 2007) that are used by -XCD.
File Description of Modifications
bufrVersion2TableA.txt New file - entries for BUFR Edition 2 Table A to allow for better naming of BUFR files by -XCD.
Based on http://www.emc.ncep.noaa.gov/mmb/data_processing/data_dumping.doc/table_1.htm
bufrVersion3TableA.txt New file - same as Edition 2, but needed as a placeholder in the code.
bufrVersion4TableA.txt New file - entries for BUFR Edition 4 Table A. Different from previous editions as standard types are divided into international subtypes as defined by the WMO.
Source: BufrCommon-11-2007.pdf from http://www.wmo.ch
DCISFC Implemented FEW=5 for cloud coverage in the ISFC schema.
gbtbpds001.2v131 New file - needed for North American Regional Reanalysis (NARR) GRIB1 files.
gbtbpds001.av1
Added description to index 140 for NARR GRIB1 files.
gbtbpds001.bv1 Added default navigation entries for GRIB1 geographic ID numbers 225, 236, 238, 239, and 24..
grib2NavLookup.txt Added navigation lines for RUC-USLC13KM, NCE-USLCAWI4, NDF-AKPS, RTM-AKPS, SREF-AKPS45KM, and SREF-USME datasets.
grib2Parameters.txt Corrected MSLM unit name.
Added physical atmospheric property entries and GOES-12 forecast satellite imagery products.
Added several heating rate parameters.
STNDB.CORE Updates to the core station database file.

Script and Batch File Changes in -XCD

The table below lists changes to McIDAS-XCD scripts and batch files since the previous upgrade (version 2007).
File Description of Modifications
_mcidasxcd.mk
buildrelease
Added entries for NOGRIB2.CFG, REBILDRAP.BAT, REGROUP.BAT, and XCDBUFR.BAT.
REBILDRAP.BAT New file - rebuild the Rapid Access Pointer files.
REGROUP.BAT New file - recreates GROUPS.DAT and COUNTRY.DAT files.
RMXCDDEC.BAT Added entries for removing NAMMOS, NGMMOS, and GFSMOS .RAP and .RAT files.
Added entries for removing GRIB and BUFR files.
Removed entry for FASTXT.DAT file.
xcd_init Updated version number.
XCDADDE.BAT Added entry to run XCDBUFR.BAT file.
XCDBUFR.BAT New file - creates the new BUFR datasets.
XCDDEC.BAT Updated BILDTEXT command for NGMMOS to use 2000 stations.
Changed the default installation to add all countries by running the SIGCO ADD ALL command.
Changed number of reporting entries to 6 for SAOMETAR.RAP and 2 for SYNOPTIC.RAP, so that users can see all of the text data (including NIL=).
XCDGRB2.BAT Added RTM-AKPS, NDF-AKPS, and MGWM (MultiGrid Wave Model) GRIB2 datasets.
XCDGRIB.BAT Added new MOS-ALL dataset.
xcdscour Updated to properly delete newly named files by the BUFR filer.

 
 
  Contact Us     Site Map     Search     Terms and Conditions     Privacy Policy     Participation Policy
 
National Science Foundation (NSF) UCAR Office of Programs University Corporation for Atmospheric Research (UCAR)   Unidata is a member of the UCAR Office of Programs, is managed by the University Corporation for Atmospheric Research, and is sponsored by the National Science Foundation.
P.O. Box 3000     Boulder, CO 80307-3000 USA     Tel: 303-497-8643     Fax: 303-497-8690