Based on a REST API, T-Systems develops an API for the customer as an ingest layer to store, process and analyze machine data.

1. Data ingestion: The solution includes authenticating the messages or senders to the API. Allowed messages are processed or prioritized (real-time queue) in the message queue and further checked in the process. Validation can check both data consistency and status consistency.

Rejected messages are automatically replied to or stored in a separate location for manual review.

2. Data Transformation: The messages can be saved in raw or transformed format. This depends on the subsequent analysis requirements of the data or customer needs. T-Systems Data Scientists analyze and investigate data sets and summarize their main characteristics.

3. Data Storage: The storage takes place on an S3 memory (Datalake), which is characterized by its cost efficiency and its features (Intelligent Tiering). The messages can be harmonized in near real-time via AWS native tools and stored for long term analysis in an AWS Redshift (data warehouse).

4. Data visualizations: Our architects and data analysts handle the implementation and create customer-specific dashboards to visualize data. These visualizations display complex data relationships and data-driven insights in a way that is easy to understand. Tools such as AWS Quicksight or Grafana are available for visualization.

At the customer's request, the solution can also built on tools such as Matillion (ETL), Snowflake (Datalake) and Tableau (visualization) within AWS.

5. Machine learning: Through the use of statistical methods, algorithms are trained to make classifications or predictions, uncovering key insights within data mining projects. T-Systems provides expertise to create the value for your case and improve the prediction in its accuracy.

Customer benefits:

• The goal is to continue working with the obtained data. This is where the following use cases come in handy.
• The whole process from ingest to visualization is carefully monitored. Through measuring and visualization, bottlenecks can be identified, and process times will be reduced. Our 24/7 support, ensures a high availability of the solution.
• As T-Systems attaches great importance to security, data security considerations are incoporated right from the start: The API is protected by a firewall and access rights are set up in compliance with the least-privilege principles as evinced in AWS best practices and guidelines.
• Visualize complex data relationships and data-driven insights in a way that is easy to understand
• Serverless architecture ensures automatic adaptation to the number of senders and is characterized by rigorous cost efficiency.