Page tree

 


1. Project Information

* indicates that this field is required

Project Name*Modern Data Architecture
IPR Mode*

RAND

Explanations of each mode is available at http://www.tmforum.org/IPRPolicy/11525/home.html

Type of Project*Strategic
Strategic ProgramData & AI
Previous Project CharterInitial release
Project Workspace Link

Modern Data Architecture Home

Project JIRA Link See Section 4 below
Project SponsorN/A
 Project Team Chair*

Anthony Behan - Cloudera

Cathal Kennedy - Telenor

Ahmed Saady Yaamin - Axiata

 TM Forum Staff Support

Stuart Dunn



2. Project Overview / Executive Summary


Mission

Historically, the data architecture, that became the big data architecture, was focused around getting ‘a single version of the truth’ - get the data from the enterprise, store it in a central location, and use it for some key use cases like customer profiling and network root cause analysis. Today, however, the requirements for Operators are different in three important ways:

Everyone wants data: No just some key stakeholders. On top of that, third parties are now demanding access to data to support new business opportunities; so….

…. The modern Data Architecture project will upgrade legacy architectures to ensure that:

collaboration on data can be effectively supported by Operators, and

models can be shared, adapted and reused.

There is more data: With higher data volumes, more data sourced, and more data consumers today than ever before….

….The Modern Data Architecture Project will provide the robust governance and policy enforcement mechanisms to ensure that data consumers only see the data for which they have permission to process.

Data applications are more complicated: AI workloads, in particular, are demanding real-time access to high volumes of data for production workloads such as operations automation, and for AI model training. Upstream applications dependencies rely on consistent access to high quality data. Therefore….

….The Modern Data Architecture Project will define the measures to be taken to enable data access whilst underpinning this with the appropriate data governance to minimize the risk of upstream application issues.

Evolution: The Autonomous Operations goal of Telcos: The data capability should be largely autonomous as well which means Zero-Touch Data Management, Self-Service Data Access and Governance and Right-Data Quality, for instance, therefore….

….The MDA Project will enable Data management to be taken care of by the 'machine' itself, to realize the Zero-X, Self-X and Right-X efficiencies of an AI-enabled Data Architecture. The Data Architecture must therefore be set up to scale for AI, with humans defining the principles, guardrails and objective functions, but with little to no

human interaction to maintain and evolve the architecture further.

When data architecture evolution and data management are being taken care of in the AI 'black box', the fundamental question therefore is how do we

trust what is being done? How do we trust that the actual output is actually what was intended or needed by stakeholders across the ODA functional

blocks?

The MDA Project should also outline the data producer architecture as well as the data consumer architecture as distinct considerations:

The data producer architecture refers to the data engineering and processes that harvest and generate the data assets, and make them available.

The data consumer architecture in turn refers to the demand side, where data applications and data requirements from the business gain access to the data, in order to derive a business outcome. In general, the governance of the MDA is similarly both extensive and complex, introducing new elements such as data observability and AI explainability, each of which requires a comprehensive view of the architecture.

Value

TM Forum’s collaboration to "Modernise" Data Architecture will enable the simplification, modernisation and automation of Data Architecture to equip Operators with the flexibility, agility, security and governance they need to effectively couple and decouple internal and external data as well as democratise data to support new business models, whilst managing the scale and volume of Data which AI-Native Operators have to handle today.  Expected outcomes of the modernised Data Architecture for the industry include:

  • Data as a first order system
  • Data will be highly distributed to:
    • Ensure scalability
    • Remove silos
    • Avoid moving data
  • Open Architecture – Ease of coupling and decoupling: Open APIs, Easily Extensible for new data sources and new architecture components, Open Source…
  • Data deduplication and avoidance of duplication
  • Data as a Product enabled by Data democratisation, through open standards:
    • Findable
    • Accessible
    • Interoperable and no lock-in
    • Reusable
    • Highly observable / auditable / explainable
    • Well-governed: secure and compliant by design whilst also easy to add new assets to the architecture
    • Application-ready: IAM, Integration Framework, Volume / Time, AI
    • Secured / IAM Assured / Roles & Responsibility / Privacy Assured
    • Fully virtualised
  • Hybrid Management of Data “Assets”:
    • Cloud- and Distributed-“Assets” (data stores, data services such as streaming, model training, development environments etc.)
    • On different cloud infrastructures (public/private)
    • Alternate assets for different performance requirements, aligned with infrastructure – e.g.:
      • high volume streaming for network ingestion;
      • GPU-driven compute for AI Model Training;
      • low cost infrastructure for archive data retention / mandated regulatory data retention.
Strategy

The project will look at establishing a methodology for differentiating the value of AI-enabled ODA experience by:

  • identifying the impact of AI and other new technologies on ODA consumers / stakeholders
  • Determining what openness means to each of them.


As part of this project, we will design and develop an ODE framework for the identification and valuation consumers and producers Running on ODA. This will then enable us to identify the functional building blocks in Operations embedding a Cognitive Core in ODA to open up flexible journeys and experiences in ever evolving domains and ecosystems. A key part of the cognitive core in ODA will be the ODE KPI's for each function block.


3.  Participants

This section identifies the project team members.

Note - Please review the Team Roles & Responsibilities RACI here which also indicates which roles are mandatory or optional 

Project Team RoleName*Company* Confluence “@” mention
Project Team Chair

Anthony Behan

Cloudera


Project Team Co-Chair

Cathal Kennedy

Ahmed Saady Yaamin

Telenor

Axiata

TM Forum Subject Matter ExpertDave MilhamTM ForumDave Milham 
TM Forum Project Management Support

Stuart Dunn

Yvonne Kuimba

TM Forum

TM Forum

4. Project Workstreams and Deliverables

The project workstreams and deliverables for this project are introduced in the pages below

Sprint 2024-1

Key T Summary Value Statement Assignee Status
Loading...
Refresh


Sprint 2024-2

Key T Summary Value Statement Assignee Status
Loading...
Refresh


Sprint 2024-3



Sprint 2024-4



Sprint 2024-5



Sprint 2024-6


5.Project Backlog



6. Legal Notice

Copyright © TM Forum 2024. All Rights Reserved.

This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published, and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this section are included on all such copies and derivative works. However, this document itself may not be modified in any way, including by removing the copyright notice or references to TM FORUM, except as needed for the purpose of developing any document or deliverable produced by a TM FORUM Collaboration Project Team (in which case the rules applicable to copyrights, as set forth in the TM FORUM IPR Policy, must be followed) or as required to translate it into languages other than English.

The limited permissions granted above are perpetual and will not be revoked by TM FORUM or its successors or assigns.

This document and the information contained herein is provided on an "AS IS" basis and TM FORUM DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY OWNERSHIP RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.

Direct inquiries to the TM Forum office: 

181 New Road, Suite 304
Parsippany, NJ 07054 USA
Tel No. +1 862 227 1648
TM Forum Web Page: www.tmforum.org

  • No labels