DATA PLATFORM
Introduction
The Data Platform Component is designed to handle the persistence of data from the IIoT Platform component. This includes data from simulated entities, mapped IoT and Robot devices. The Platform is responsible for making the persisted data available in a batch or streaming manner.
Usage Manual
Key aspects of the Data Platform Component include:
-
Persistence Layer: This layer provides persistence services to all other components. It utilizes relational databases, object and file storage, and time-series databases to support the appropriate data model for different applications.
-
Data Access Layer: This layer provides external access to the persisted data through REST APIs, Server-Side events, and Message Queues, enabling the streaming of data.
The IIoT Platform Component and Data Platform Component, together, offer a comprehensive solution for IIoT data communication, processing, and storage. They interact with each other seamlessly to ensure efficient operation, providing real-time interaction with IoT devices and Robots, and secure data persistence and retrieval.
Use Case 1.
Use Case Diagram
The System Administrator oversees the entire operation, managing and maintaining the platform, and ensuring efficient data storage and access. The IIoT devices and simulation modules interact with the platform by sending real-time data. The platform then stores this data in appropriate databases, making it accessible to external systems either in batch or streaming manner.
Use Case Mock-ups
Mock-ups not available (back-end component).
Functional Specifications
Functional Block Diagram
The activity begins with IIoT devices and simulation modules sending real-time data to the platform. This data is then stored in appropriate databases. External systems can access the stored data either in a batch or streaming manner.
Main interfaces
List of main interfaces between functional components shown in the figure.
| ID | Component | Name | Description | Sense |
|---|---|---|---|---|
| 1 | DS Platform | Data ingestion | Handles data ingestion from the IIoT Platform. | In |
| 2 | DS Platform | Data Storage | Stores the ingested data in appropriate databases. | In and Out |
| 3 | DS Platform | Data Access | Facilitates data access by external systems. | Out |
Technical Specifications
The Data Ingestion APIs facilitate data ingestion from the IIoT Platform. The ingested data is then stored in the appropriate Database Systems, which could be a mix of relational databases, object storage, and time-series databases. The Data Access APIs facilitate data access by external systems, providing the ability to access data either in batch or streaming manner.
Software and hardware Requirements
Required software
- custom software for ingestion, access and management
- relational database (PostgreSQL), file/object storage, and time-series database (TimescaleDB)
Required hardware
- 1 VM with 4 vCPUs, 16GB Ram for dev/testing.
- Production resources depend on volume and velocity of data.