Author: Nicholas Webb

Quick Read

• IAG has been a year into the implementation of a data mesh architecture.
• The organization is utilizing Google Cloud and Confluent solutions.
• The utilization of real-time data streaming is expanding within IAG.
• Google Cloud Platform (GCP) serves as the cornerstone of IAG’s strategic data platform.
• Confluent Cloud enables internal use cases for real-time streaming.

IAG’s Path to Implementing a Data Mesh

IAG is one year into adopting a data mesh architecture to further enhance the importance of data in its group operations and transformation initiatives. Burak Hoban, the executive manager of data platforms – data and risk, provided insights during the Confluent Data in Motion Tour 2024 event in Melbourne, expressing that IAG seeks to strike a balance in its data mesh journey.

Burak Hoban from IAG (left) with Rhett Pearson from Confluent (right) on-stage in Melbourne.

“We’ve already put that into practice, and we’re a year into the process,” Hoban mentioned. “My responsibility is to help expedite it.” Two key components of IAG’s data mesh include its strategic data and analytics platform, which utilizes Google Cloud services like BigQuery, alongside Confluent Cloud and connectors.”

Fundamental Tenets of Data Mesh

Data meshes are constructed based on several fundamental principles. These encompass treating data as a product, integrating data into a central repository while maintaining ownership and curation by “the domain team most acquainted” with the dataset, enabling self-service data access, and implementing universal standards for all data in use. Hoban noted that IAG had invested several years in establishing the essential components for a data mesh.

The use of real-time data is increasing.

IAG is beginning to identify more use cases for real-time streaming data throughout the organization. Hoban mentioned that the potential of real-time streaming and business eventing was acknowledged as early as 2017-18. Although some use cases did eventually surface, Hoban admitted that they were “slightly ahead of their time” overall.

Initial streaming implementations were internally constructed and overseen using Apache Kafka. However, as usage escalated, the insurer transitioned to a managed Kafka service via Confluent Cloud. This shift enabled Hoban and his team to collaborate more effectively with internal development and engineering teams, thereby boosting Kafka adoption.

“Kafka is beginning to take on a crucial role in our strategic platforms for the future,” Hoban remarked. He also hinted at a greater utilization of pre-built connectors provided by Confluent to access and stream data from different source systems.

Fully Committed to Google Cloud Platform (GCP)

At a Google Cloud Summit in Sydney in May, IAG’s Executive General Manager of Data, Risk, and Resilience, David Abrahams, shared additional insights about the insurer’s data platform built on GCP. Previously, the insurer had only mentioned its use of GCP in passing and had not discussed its architecture or decision-making process in detail.

“We possess a substantial amount of data that is crucial to our operations; however, due to our legacy systems, this data has become fairly fragmented and isolated,” Abrahams stated. IAG established Google Cloud as the cornerstone of its “strategic data and analytics platform.” This platform now utilizes Google Data Platform for advanced analytics, employing Vertex AI and machine learning on BigQuery.

The outcomes from this platform encompass the capability to craft more personalized experiences for customers and enable business teams to independently launch new models into production without requiring extra technical assistance.

Summary

IAG’s adoption of a data mesh architecture demonstrates its dedication to updating its data operations. Utilizing technology from Google Cloud and Confluent, IAG has established a framework that enables real-time streaming applications and self-service data access. This method improves customer experiences and grants internal teams increased independence in their data processes.

Q&A

A: Could you explain what a data mesh is?

A:

A data mesh is a design strategy that decentralizes data governance by considering data as a product. This allows domain-specific teams to manage and refine their datasets while following common guidelines.

Why did IAG opt for Google Cloud Platform?

A:

IAG selected Google Cloud Platform for its ability to provide a scalable and high-performance solution that could effectively handle its extensive, fragmented, and isolated data. This choice facilitates enhanced analytics and machine learning functionalities.

What function does Confluent Kafka serve in IAG’s strategic plan?

A:

Confluent Kafka enables IAG’s real-time streaming applications. It assists in synchronizing data across business tools, supports customer and policy migration processes, manages payment notifications, and helps develop real-time data products.

How has utilizing a managed Kafka model proven advantageous for IAG?

A:

By utilizing the managed Kafka model via Confluent Cloud, IAG has been able to free up its internal resources. This shift has enabled the team to concentrate on development and engineering activities, thereby increasing Kafka adoption throughout the organization.

Q: What are the advantages of IAG’s strategic data platform?

A:

IAG’s strategic data platform enhances customer experiences through greater personalization, allows business teams to independently deploy new models, and facilitates advanced analytics using Vertex AI and machine learning on BigQuery.

Q: What effect does real-time streaming have on IAG’s operations?

A:

Real-time streaming enables IAG to manage essential functions like generating pricing quotes or issuing policies effectively. Any downtime or problems with Kafka can severely affect these activities, underscoring its crucial importance.

The Importance of the TS Cloud

The Australian government is making a significant investment in the ‘TS Cloud’ to enhance its cyber capabilities. This cloud infrastructure, which will cost a minimum of $2 billion over the next ten years, is vital for the defence and intelligence agencies of the country. Prime Minister Anthony Albanese and Deputy Prime Minister and Defence Minister Richard Marles have emphasized that this project will enable the swift and scalable hosting, sharing, and analysis of Australia’s highly classified data.

Advanced Technologies Integration

The TS Cloud will utilize top-tier technologies such as artificial intelligence (AI) and machine learning (ML) to improve the analytical capabilities of Australia’s defence and intelligence sectors. By integrating these advanced technologies, the government seeks to maintain a competitive edge in cybersecurity and intelligence operations.

Enhancing Defence Communications

One of the primary advantages of the TS Cloud is its capacity to bolster the resilience of Defence’s communication networks. This improvement will guarantee more robust and secure communication channels within Australia’s defence system, ultimately enhancing national security.

Strengthening International Collaborations

The TS Cloud is anticipated to enhance interoperability and foster deeper collaboration with international allies, particularly the United States. This supports Australia’s strategic goals of fortifying alliances and improving collective security measures in an ever more intricate global landscape.

The Function of AWS in Developing the TS Cloud

AWS was selected for this project because of its substantial expertise in classified cloud services and its well-established presence in Australia. The company plans to partner with Australian businesses to design and construct the TS Cloud; however, specific details regarding this collaboration have not yet been revealed.

Assistance from the Australian Signals Directorate and ONI

Rachel Noble, the Director-General of the Australian Signals Directorate, has highlighted the importance of the TS Cloud as a critical element of the REDSPICE program. This program is a $10 billion effort designed to bolster Australia’s cyber security in the coming decade. Andrew Shearer, the Director-General of the Office of National Intelligence (ONI), also endorses the TS Cloud, acknowledging its ability to enhance integration and cooperation among intelligence agencies.

AWS’s Commitment

Dave Levy, the Vice President of AWS’s Worldwide Public Sector, conveyed his excitement regarding the collaboration with the Australian government. He emphasized AWS’s objective to deliver innovative, efficient, and impactful cloud services to strengthen Australia’s national defense capabilities.

Comparison with Initiatives in the US

In the United States, several providers, such as AWS, are developing a comparable top-secret cloud infrastructure. This initiative came after an initial project, which was exclusively granted to Microsoft, was reconsidered. This scenario highlights the worldwide shift towards utilizing cloud technology to bolster national security.

Quick Read

• The defense department seeks expert guidance for upgrading its ERP financial management system.
• Concentrate on data transformations, trial runs, and preparation standards.
• The ERP project was initiated in 2019 and involves transitioning to SAP S/4HANA in multiple stages.
• The existing financial system manages a budget of $56 billion and has not been updated in two decades.
• Expert guidance on accounting and ERP implementation is required to reduce financial risks.
• An audit criticized the high number of contractors, and key decisions now depend on internal staff.

ERP Upgrade: A Prolonged Initiative

The Department of Defence has entered the concluding phase of its extended ERP upgrade initiative, enlisting contractors to conduct business readiness testing. The emphasis is on the financial management system segment of the ERP implementation. This effort is a component of a broader shift to SAP S/4HANA, which started in 2019.

Revamping the Financial Management System

This year, the department is focusing on tranche “1B,” which involves upgrading the financial management information system. This tranche also encompasses supply chain management, enterprise asset management, purchasing, finance, and human resources. The existing financial system, which hasn’t been updated in twenty years, supports operations for a complex $56 billion budget.

Call for Contractors

A Defense spokesperson disclosed that they are seeking contractors for “business readiness” tasks. These tasks comprise data conversions, practice operations, and establishing readiness criteria for go-live decisions. The aim is to ensure that all financial risks are mitigated to a high standard.

Specialist Advice Needed

According to Defense, implementing the ERP system requires considerable technical skills. Therefore, they seek consultants to collaborate with Defense CFO Steven Groves to enhance business preparedness and mitigate financial risks to acceptable levels.

Addressing Audit Criticism

The choice to seek external assistance comes three years after an audit criticized the extensive reliance on contractors at all levels of the ERP program. The department has promised that crucial decisions regarding the project will stay with internal employees to reduce any risks linked to contractor dependency.

Summary

The Department of Defence’s ERP upgrade project is designed to bring its financial management system up to date, after two decades without updates. To facilitate a smooth transition, the Defence Department is hiring contractors to conduct business readiness testing, with an emphasis on data conversions and other essential tasks. Although there have been past criticisms about the use of contractors, the department maintains that core decisions are controlled by its internal team.

FAQs

What is the primary objective of the ongoing ERP enhancement?

A:

The primary objective is to enhance the financial management information system under tranche “1B.” This encompasses supply chain management, enterprise asset management, procurement, finance, and core human resources.

Why is expert consultation being pursued for this project?

A:

Expert guidance is essential for thoroughly addressing all financial risks and for preparing for business readiness activities such as data conversions and dress rehearsals.

How long has the present financial system been operational?

A:

The existing financial system has been operational for two decades and manages activities for a budget of $56 billion.

Q: What are some of the critiques associated with using contractors?

A:

An audit found fault with the widespread reliance on contractors at all levels of the ERP program. The department now guarantees that primary decisions are handled by internal staff.

Q: Can you explain what SAP S/4HANA is?

A:

SAP S/4HANA is a unified enterprise resource planning (ERP) solution that utilizes in-memory computing to handle vast quantities of data rapidly and effectively.

What does tranche “1B” refer to?

A:

The term “Tranche 1B” pertains to the emphasis for this year’s Defence ERP upgrade, which encompasses financial management information systems, supply chain management, enterprise asset management, purchasing, finance, and foundational human resources.

Quick Read

• Telstra and Optus have ended their agreements with Google.
• These agreements involved pre-installing Google’s search services on Android devices.
• The investigation that resulted in this change was started by the ACCC.
• The objective of the decision is to improve consumer options and boost market competition.
• Google Search holds a leading 98% market share in Australia.
• The ACCC’s inquiry into digital platforms is set to publish its ninth report in March 2025.

Termination Background

Telstra and Optus have chosen not to renew or form new contracts with Google for pre-installing its search services on Android devices. This choice follows an inquiry by the Australian Competition and Consumer Commission (ACCC). The previous agreements expired at the end of last month.

The ACCC’s Role

The ACCC began the investigation as a part of its continuous digital platform services inquiry. The ACCC stated that Telstra and Optus had been engaging in these agreements with Google since at least 2017. The commission contended that these arrangements restricted the capacity for competing search engines to be pre-installed and promoted on Android devices, ultimately impacting consumer choice and innovation.

Implications for Consumers

The ACCC has agreed to enforceable commitments from both Telstra and Optus. These commitments are anticipated to give Australian consumers a wider range of options concerning digital platforms and services they utilize. Furthermore, it seeks to promote increased competition within these markets.

“Engaging in practices like forming agreements to guarantee exclusivity can restrict consumer options or hinder innovation,” stated ACCC commissioner Liza Carver.

Market Dynamics

Even after this change, Google Search continues to dominate the Australian market, maintaining a steady 98% market share from September 2021 to February 2024. Alternative search engines, such as Microsoft’s Bing, have only a minimal presence. This dominance has led to concerns among regulators about the suppression of competition and innovation.

The Broad Digital Platforms Investigation

The ACCC’s investigation into digital platforms has explored different facets of the technology behind social media platforms and their possible negative effects. To date, multiple reports have been generated on these topics. The ninth report from this investigation is anticipated to be published in March 2025 and may offer additional recommendations to promote fair competition in digital markets.

For additional information on similar reports from the ACCC, check out TechBest’s piece on data transparency for major platforms: Data Transparency for Major Platforms.

Summary

Telstra and Optus have decided to end their long-term agreements with Google to pre-install its search services on Android devices. This change comes after an ACCC investigation aimed at promoting more consumer choices and competition within the market. While Google still leads the Australian search engine market, this shift could offer opportunities for competing search engines to establish themselves. The ACCC will carry on with its digital platforms inquiry, with the next significant report scheduled for March 2025.

Q&A Session

Why did Telstra and Optus end their agreements with Google?

A:

The discontinuation came after an ACCC investigation revealed that these agreements restricted consumer choice and hindered competition by stopping competing search engines from being pre-installed on Android devices.

Q: How will this affect consumers in Australia?

A:

This decision aims to give consumers more options for the search engines they can use on their devices, which could lead to increased competition and innovation in the market.

How prevalent is Google Search in Australia?

A:

As of February 2024, Google Search commands a remarkable 98% market share in Australia, showcasing its substantial dominance over other search engines such as Bing.

Q: What is the digital platforms inquiry conducted by the ACCC?

A:

The ACCC’s inquiry into digital platforms explores different facets of technology utilized by social media channels and other online services, zeroing in on topics such as market competition and consumer protection. The inquiry is set to publish its ninth report in March 2025.

What might be the potential long-term consequences of this action?

A:

If successful, this initiative could create a more competitive market, allowing alternative search engines to flourish and provide enhanced services and innovations to consumers.

Quick Read

• Russian hackers breached Microsoft’s systems and gained access to customer emails.
• Microsoft revealed that the breach took place approximately six months ago.
• The breach has resulted in heightened regulatory examination of Microsoft’s security measures.
• A purported Chinese hacking group had earlier broken into Microsoft, aiming at emails from the US government.
• Microsoft is actively informing impacted customers and distributing compromised emails.
• The company is revamping its security procedures in response to the breaches.

Summary of the Security Violation

Earlier this year, Russian hackers who breached Microsoft’s systems not only monitored employee inboxes but also exfiltrated emails from customers. This incident, revealed roughly six months after it first took place, has subjected Microsoft to heightened regulatory inspection.

Regulatory Scrutiny

The extensive nature of the breach has led regulators to worry about the safety of Microsoft’s software and systems in relation to foreign threats. This event comes after a different breach attributed to a purported Chinese hacking group last year, which resulted in the compromise of thousands of US government emails.

Information About the Breach

The Russian authorities have yet to address the hacking accusations, but Microsoft has reported that the hackers aimed at cybersecurity researchers examining the group’s actions. Microsoft has been alerting clients whose emails were breached by the Midnight Blizzard threat actor.

Customer Notifications

Microsoft is still providing updates on compromised emails to the affected customers. While it hasn’t revealed the total number of impacted customers or the amount of stolen emails, the company remains dedicated to maintaining transparency as the investigation goes on.

Ongoing Security Concerns

In January, Microsoft disclosed that Midnight Blizzard had infiltrated a minor portion of its corporate email accounts. Despite ongoing efforts to fortify its systems, the hackers persisted in their intrusion attempts, raising concerns among security experts and customers.

Microsoft’s Response

Due to the ongoing security violations, including the Chinese cyberattack from the previous year, there was a Congressional hearing in which Microsoft President Brad Smith announced that the company is revamping its security protocols to avert future breaches.

Summary

The latest breaches at Microsoft by hackers from Russia and China have revealed major weaknesses in the company’s security framework. As Microsoft undergoes regulatory investigation and strives to improve its security measures, impacted customers are being informed and provided with access to their affected emails. This incident highlights the escalating necessity for strong cybersecurity practices as the world becomes more digital.

Can you explain the details of the incident involving the Microsoft security breach?

Russian hackers breached Microsoft’s systems, gaining access to employee and customer emails. The incident was revealed approximately six months after it took place.

How many customers were impacted by the breach?

Microsoft has yet to reveal the specific number of customers affected or the amount of emails stolen, but they are in the process of informing those affected.

Q: Can you explain what Midnight Blizzard is?

The Russian hacking group known as Midnight Blizzard is behind the breach of Microsoft’s systems, leading to the compromise of customer emails.

Q: Has Microsoft responded to the breach in any way?

A: Yes, Microsoft is in the process of revamping its security procedures and has been informing impacted customers about the breached emails.

Q: What additional data breaches has Microsoft encountered lately?

Furthermore, an alleged Chinese hacking group infiltrated Microsoft last year, compromising thousands of US government emails, in addition to the Russian cyberattack.

Q: What effect has this breach had on Microsoft’s reputation?

The breach has subjected Microsoft to heightened regulatory examination and sparked concerns among its security peers and customers regarding the susceptibility of its systems.