5 Data Leaders Share AI Automation Tips to End Integration Issues
▼ Summary
– Most business leaders claim their organizations are data-driven, but only half are confident in delivering timely insights.
– AI tools are being used to drive internal consistency in processes like software engineering, accessibility compliance, and M&A due diligence.
– Data orchestration platforms, such as Astronomer’s Airflow, help manage complex data pipelines from multiple sources to support operational decisions.
– Existing data platforms like Snowflake are expanding with AI capabilities to lower barriers for non-technical users and scale data access.
– AI automates labor-intensive data integration tasks, such as mapping and normalization, significantly reducing effort and improving accuracy.
While a majority of business leaders now describe their organizations as data-driven, a significant confidence gap remains in delivering timely insights. To truly unlock value, companies must make their data both available and accessible. Emerging technologies, particularly AI and automation, are proving to be the critical keys for overcoming complex data integration challenges across platforms, mergers, and geographies. Here is how five data leaders are leveraging these tools to streamline processes and drive consistency.
Driving internal consistency is a primary benefit. Joel Hron, CTO at Thomson Reuters, explains that his organization uses AI extensively during modernization and migration activities. The company is currently developing an internal AI system for due diligence to ensure greater uniformity in deal evaluation and risk assessment. This tool integrates with their existing legal operations product, HighQ. For an acquisitive firm like Thomson Reuters, such technology brings speed, efficiency, and, most importantly, consistency to complex M&A activities, with potential future applications for external clients.
Effective data orchestration transforms raw information into actionable insights. Miko Chen, lead data engineer at Create Music Group, utilizes orchestration capabilities within Astronomer’s Airflow platform to manage over 600 data pipelines. This system integrates various cloud technologies and music service APIs into a cohesive layer that supports analytics and financial forecasting. The goal is to provide artists and labels with proactive decision-making tools, such as identifying optimal cities for concerts. The platform also simplifies data consolidation during acquisitions, enabling seamless movement of information across organizations and borders.
Professionals are advised to fully explore the AI capabilities already embedded in their existing technology stacks. Huy Dao, director of data and machine learning platform at Booking.com, highlights how his team expanded its use of Snowflake beyond traditional warehousing. By leveraging features like Cortex AI and Cortex Analyst, they have broadened data access and reduced technical barriers. The platform now enables thousands of users, including those without deep data skills, to query information and solve business challenges without writing complex SQL, democratizing data access across the company.
Focusing on marginal gains in specific, labor-intensive areas can yield substantial returns. Richard Corbridge, CIO at property firm Segro, points to the challenge of aggregating disparate European sustainability data from PDFs, digital feeds, and photos. Previously a manual task handled in spreadsheets, AI now automates the collection, validation, and highlighting of illogical data points, such as unchanged meter readings. This targeted application frees human resources for higher-value work and delivers precise, auditable reports on carbon footprint and energy usage with exciting efficiency.
A major impact of AI in data management is the significant reduction of the manual integration effort. Ankur Anand, CIO at Nash Squared, reports that AI-powered mapping and normalization can cut integration work by 30 to 40 percent while improving accuracy. Using the BlueGecko platform, his team automates tedious data-mapping processes, especially after mergers and acquisitions. The technology understands data relationships and accelerates ETL development by explaining how systems interconnect. Anand emphasizes that technological success depends equally on change management and user adoption, ensuring teams transition smoothly from older tools to new, AI-enhanced workflows.
(Source: ZDNet)
