New York Sub-Regional ITS Architecture

Element Expanded Functional Requirements: NYMTC Member Agencies Data Collection Systems

Functional Area: ITS Data Repository
  1. The center shall collect data to be archived from one or more data sources.
  2. The center shall collect data catalogs from one or more data sources. A catalog describes the data contained in the collection of archived data and may include descriptions of the schema or structure of the data, a description of the contents of the data; e.g., time range of entries, number of entries; or a sample of the data (e. g. a thumbnail).
  3. The center shall store the archived data in a focused repository that is suited to a particular set of ITS data users.
  4. The center shall include capabilities for performing quality checks on the incoming archived data.
  5. The center shall include capabilities for error notification on the incoming archived data.
  6. The center shall include capabilities for archive to archive coordination.
  7. The center shall support a broad range of archived data management implementations, ranging from simple data marts that collect a focused set of data and serve a particular user community to large-scale data warehouses that collect, integrate, and summarize transportation data from multiple sources and serve a broad array of users within a region.
  8. The center shall perform quality checks on received data.
  9. The center shall provide the capability to execute methods on the incoming data such as cleansing, summarizations, aggregations, or transformations applied to the data before it is stored in the archive.
  10. The center shall respond to requests from the administrator interface function to maintain the archive data.
  11. When data or a catalog of data is received from the archive, the center shall generate the requested data product for the users systems.
  12. For archive data requiring financial payment, the center shall process the financial requests and manage an interface to a Financial Institution.
Functional Area: Virtual Data Warehouse Services
  1. The center shall provide capabilities to access "in-place" data from geographically dispersed archives. These capabilities may include analysis, data fusion, or data mining.
  2. The center shall coordinate information exchange with a local data warehouse.
  3. The center shall provide the specialized publishing, directory services, and transaction management functions associated with coordinating remote archives.
  4. The center shall support the collection of archived data from other archives on an as-needed basis. (This minimizes the need to duplicate the comprehensive set of data from the remote archives in the local data warehouse.)
  5. The center shall use data collected from different archives to build a set of global schema including the data archive definitions for the local archive plus any archives known to the local archive.
  6. The center shall provide the local archived data schema to other archive systems.