ifference between revisions of "EMO:Data Initialisation"
| Line 37: | Line 37: | ||
Only Offer and Demand data can be loaded directly from file (i.e. generation and price data must be loaded from database). Offers files are published on the COMIT website two weeks after the day the Offers were made. If your database does not contain Offers data you can update the Offers folder with the latest files from COMIT on a regular basis. | Only Offer and Demand data can be loaded directly from file (i.e. generation and price data must be loaded from database). Offers files are published on the COMIT website two weeks after the day the Offers were made. If your database does not contain Offers data you can update the Offers folder with the latest files from COMIT on a regular basis. | ||
| − | If your database does not store Demand data you will need to create Demand files manually using a third party program such as Excel. All files should be formatted in accordance with the templates provided in | + | If your database does not store Demand data you will need to create Demand files manually using a third party program such as Excel. All files should be formatted in accordance with the templates provided in '''''[[EMO:Data File Formats|Data File Formats]]'''''. |
---- | ---- | ||
Revision as of 14:21, 30 January 2013
EMarketOffer requires two types of externally sourced input data:
- Transmission System data
- Market data
Transmission System Data
EMarketOffer creates a set of Transmission System data (circuit details, line re-ratings and group constraints) at run time from one of three sources:
- Historical transmission system data files provided by Energy Link
- Transmission system files sourced through the online EM6 or COMIT data services
- In-house Transmission System databases
On startup EMarketOffer uses Transmission System data from EM6/COMIT files in the Grid sub-folder by preference unless the Use Grid File Inputs box in the Source Data Administration Window is checked. External database connections are used as a secondary data source where these files are absent or invalidly formatted.
WARNING! EMarketOffer will ignore any database links defined through the Data Connection Window for Transmission System data if the data can be obtained from file and the Use Grid File Inputs box in the Source Data Administration Window is unchecked.
Configuration of the connection between EMarketOffer and your online databases of Transmission System data will be unique to your site. You should not attempt to create Connections without first consulting technical support both in your company and at Energy Link.
The typical EMarketOffer installation is configured to use file or database exclusively. However, if you want to switch between file and database sources for Transmission System data you will need to obtain the latest EM6/COMIT files and save them in the appropriate folders. You will also need to define the correct links to your online database sources.
To force the system to use the online database where EM6/COMIT files exist in the Grid folder:
- Shut down EMarketOffer
- Rename the EM6 and COMIT sub-folders to easy-to-remember names
- Re-start EMarketOffer
To force the system to use the transmission system data files again:
- Shut down EMarketOffer
- Return the renamed EMS and COMIT sub-folders back to their original names
- Re-start EMarketOffer
Market Data
Dynamic market data can be loaded into EMarketOffer directly from online databases. Care should be taken when constructing database queries to ensure the data that best suits your needs is returned. In particular think through the following issues before finalising your queries:
- Demand and Generation figures can be obtained from SCADA, COMIT Daily Demand, and reconciled and arcflow data. Which of these best suits your needs?
- Offers files contain offers from Embedded Generators. How do you wish to deal with embedded generators?
Only Offer and Demand data can be loaded directly from file (i.e. generation and price data must be loaded from database). Offers files are published on the COMIT website two weeks after the day the Offers were made. If your database does not contain Offers data you can update the Offers folder with the latest files from COMIT on a regular basis.
If your database does not store Demand data you will need to create Demand files manually using a third party program such as Excel. All files should be formatted in accordance with the templates provided in Data File Formats.
NOTE: The installation package may contain EM6/COMIT data files defining the Transmission System and various types of Constraint that have been or are expected to be applied. When provided these files will be the latest available to Energy Link at the time the package was constructed and will allow you to begin using EMarketOffer right away. However, the full content of these files changes daily and you should update them regularly (particularly if you are using the program to make detailed short term forecasts of the immediate future). Unless otherwise informed, you are also advised to replace these files with current downloads before using EMarketOffer for anything other than product familiarisation and training purposes.