ifference between revisions of "EMO:Data Initialisation"
| Line 12: | Line 12: | ||
#The files available each business day from the Energy Link web site (for grids from 16-Jul-09 onward) | #The files available each business day from the Energy Link web site (for grids from 16-Jul-09 onward) | ||
| − | '''Of the sources above, 1 - 3 are legacy data sources and we have stopped supporting them as the data available from EM6 is incomplete for the purposes required in ''EMarketOffer''. Only the daily updated grid files from 16-Jul-09 are now supported (though the other types of existing grid data can still be used in the meantime). The daily updated files also include full reserves data.''' | + | '''Of the sources above, 1 - 3 are legacy data sources and we have stopped supporting them as the data available from EM6 is incomplete for the purposes required in ''EMarketOffer'', and because we have gone to great effort to provide daily grid and reserves files that include all data reuired to solve the market by half hour. Only the daily updated grid files from 16-Jul-09 are now supported (though the other types of existing grid data can still be used in the meantime). The daily updated files also include full reserves data.''' |
On startup ''EMarketOffer'' checks the Energy Link web site for the new grid and reserves data and automatically downloads files if you are not up to date. | On startup ''EMarketOffer'' checks the Energy Link web site for the new grid and reserves data and automatically downloads files if you are not up to date. | ||
Revision as of 15:24, 3 May 2013
EMarketOffer requires three types of externally sourced input data:
- Transmission System (Grid) data
- Reserves data
- Market data
Grid and Reserves Data
EMarketOffer can create a set of grid data (circuit details, line re-ratings and constraints) at run time from one of four sources:
- Historical transmission system data files provided by Energy Link
- Transmission system files sourced through the EM6 web site operated by Transpower division EMS
- In-house databases
- The files available each business day from the Energy Link web site (for grids from 16-Jul-09 onward)
Of the sources above, 1 - 3 are legacy data sources and we have stopped supporting them as the data available from EM6 is incomplete for the purposes required in EMarketOffer, and because we have gone to great effort to provide daily grid and reserves files that include all data reuired to solve the market by half hour. Only the daily updated grid files from 16-Jul-09 are now supported (though the other types of existing grid data can still be used in the meantime). The daily updated files also include full reserves data.
On startup EMarketOffer checks the Energy Link web site for the new grid and reserves data and automatically downloads files if you are not up to date.
The Connect Grid Data Tables check box in the Database Connection Settings window can be checked if you wish to use grid data from your own database.
WARNING! EMarketOffer will ignore any database links for grid data if grid data can be obtained from files. To use grid data from your own database you must delete any grid data files that are downloaded by EMarketOffer on startup.
Market Data
Dynamic market data can be loaded into EMarketOffer directly from in-house databases. Care should be taken when constructing database queries to ensure the data that best suits your needs is returned. In particular, think through the following issues before finalising your queries:
- Demand and Generation figures can be obtained from SCADA, COMIT Daily Demand, and reconciled and arcflow data. Which of these best suits your needs?
- Offers files contain offers from Embedded Generators. How do you wish to deal with embedded generators?
Generation and price data must be loaded from database in Market View. Offer and Demand data can be loaded from database or file in Forecasts. Offers files are published on the COMIT website the business day after the day the Offers relate to. If your database does not contain Offers data you can update the Offers folder with the latest files from COMIT on a regular basis.
If your database does not store Demand data you will need to create Demand files manually using a third party program such as Excel. All files should be formatted in accordance with the templates provided in Data File Formats.
IMPORTANT: When you first install EMO you should consult with Energy Link to ensure that your database connections are set up correctly. We will also ensure that you are able to access and download the daily updated grid and reserves files which include data back to 16-Jul-09. Earlier grid data may be be available on a limited basis only, and will not be supported in future.