{"id":5260,"date":"2025-08-12T12:53:53","date_gmt":"2025-08-12T10:53:53","guid":{"rendered":"https:\/\/etlia.fi\/?p=5260"},"modified":"2025-10-28T14:26:13","modified_gmt":"2025-10-28T12:26:13","slug":"matillion-dpc-ai-data-pipelines","status":"publish","type":"post","link":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/","title":{"rendered":"Leveraging AI in data stream loading: Matillion Data Productivity Cloud\u00a0"},"content":{"rendered":"\n<p>AI has been on everyone\u2019s lips in the IT industry for the past few years, and its development has been rapid. Application providers have also developed and incorporated more and more AI-enabled capabilities into their software. Matillion is no exception.&nbsp;<\/p>\n\n\n\n<p>Matillion\u2019s Data Productivity Cloud (DPC) includes several AI-based objects for use in developing loading pipelines. These include, among others, Copilot for natural language generation, AI Notes for automated documentation, and components for interacting with large language models (LLMs) such as OpenAI, Azure OpenAI, and Amazon Bedrock. In addition, Matillion DPC offers components for vector database operations (Pinecone, Snowflake) and for interacting with AI services such as Amazon Textract, Amazon Transcribe, and Azure Document Intelligence.&nbsp;<\/p>\n\n\n\n<p>In this blog, we will look at some of the opportunities offered by the Matillion Data Productivity Cloud (DPC) from three perspectives:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Using AI in loading pipeline development with Matillion\u2019s Maia AI assistant,&nbsp;<\/li>\n\n\n\n<li>Using AI in loading pipeline documentation, and&nbsp;<\/li>\n\n\n\n<li>Using Snowflake\u2019s Cortex AI functions in a business use case.&nbsp;<\/li>\n<\/ul>\n\n\n\n\n\n\n<div id=\"vert-space-block_d0b9c94fc30cc1466f0e7fffccba3a54\" class=\"vert-space\">\n\t<div class=\"spacer-desktop\" style=\"height: 20px\"><\/div>\n\t<div class=\"spacer-tablet\" style=\"height: 16px\"><\/div>\n\t<div class=\"spacer-mobile\" style=\"height: 12px\"><\/div>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\"><strong>Using AI in Loading Pipeline Development<\/strong>&nbsp;<\/h2>\n\n\n\n<p>In Matillion, loading pipelines have traditionally been built by dragging loading components onto a canvas, then connecting them and defining the desired processing rules. This has been a clear, intuitive, and easy way to build loading pipelines. Matillion\u2019s AI assistant, Maia, takes this one step further.&nbsp;<\/p>\n\n\n\n<p>Maia is especially useful in cases where:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>You have only recently started using Matillion DPC or are otherwise inexperienced with ETL\/ELT tools,&nbsp;<\/li>\n\n\n\n<li>The development environment is unfamiliar, or&nbsp;<\/li>\n\n\n\n<li>You want suggestions on how to solve a specific loading-related technical problem.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>In the example below, Maia was instructed to create a loading pipeline that:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Loads customer and order data from the SNOWFLAKE_SAMPLE_DATA database,&nbsp;<\/li>\n\n\n\n<li>Joins the table data, and&nbsp;<\/li>\n\n\n\n<li>Creates a table and loads the data into the newly created table.&nbsp;<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"807\" height=\"387\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3.png\" alt=\"\" class=\"wp-image-5267\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3.png 807w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3-300x144.png 300w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3-768x368.png 768w\" sizes=\"auto, (max-width: 807px) 100vw, 807px\" \/><figcaption class=\"wp-element-caption\"><em>Matillion can retrieve the correct source database and the desired tables from the metadata as separate table-read components, join the tables in a join component using keys, and use a rewrite component to create and load the table.&nbsp;<\/em><\/figcaption><\/figure>\n\n\n\n<p>Maia can be used for further development of the loading process or in individual loading components. In the example below, Maia is used to add metadata fields to the load and to perform calculations.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"567\" height=\"216\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image.png\" alt=\"\" class=\"wp-image-5261\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image.png 567w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-300x114.png 300w\" sizes=\"auto, (max-width: 567px) 100vw, 567px\" \/><figcaption class=\"wp-element-caption\"><em>Maia adds an Add Metadata calculation component to the loading pipeline, in which it includes the metadata fields and their functions.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"933\" height=\"189\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-6.png\" alt=\"\" class=\"wp-image-5271\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-6.png 933w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-6-300x61.png 300w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-6-768x156.png 768w\" sizes=\"auto, (max-width: 933px) 100vw, 933px\" \/><figcaption class=\"wp-element-caption\"><em>In the calculation component, the desired calculation is defined, and Maia creates the complete calculation formula. This is a useful feature, especially in cases where less commonly used functions are applied<\/em><\/figcaption><\/figure>\n\n\n\n\n\n\n<div id=\"vert-space-block_d0b9c94fc30cc1466f0e7fffccba3a54\" class=\"vert-space\">\n\t<div class=\"spacer-desktop\" style=\"height: 20px\"><\/div>\n\t<div class=\"spacer-tablet\" style=\"height: 16px\"><\/div>\n\t<div class=\"spacer-mobile\" style=\"height: 12px\"><\/div>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\"><strong>Using AI in Loading Pipeline Documentation<\/strong>&nbsp;<\/h2>\n\n\n\n<p>Documentation of loading pipelines often receives little attention or is not done at all. This frequently slows down further development of the loads, the fixing of errors, or, more generally, the understanding of the pipeline\u2019s logic. Matillion DPC enables the automatic creation of descriptions for loading pipelines and individual components using AI, quickly and with just a few mouse clicks.&nbsp;<\/p>\n\n\n\n<p>In the example below, the Add Metadata calculation component contains added fields and calculations that we want to highlight. With Matillion, automatic description generation provides a clear picture of the operations performed within the object.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"552\" height=\"303\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-1.png\" alt=\"\" class=\"wp-image-5263\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-1.png 552w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-1-300x165.png 300w\" sizes=\"auto, (max-width: 552px) 100vw, 552px\" \/><figcaption class=\"wp-element-caption\"><em>AI-generated description of the Add Metadata component.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n<p>By using Maia, it is possible to automatically create a complete description of the entire loading pipeline, including the loading steps and logic in detail. This feature enables effortless documentation of the entire pipeline and is highly beneficial when there is a need to understand the operation of a previously unfamiliar loading pipeline.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"729\" height=\"456\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-5.png\" alt=\"\" class=\"wp-image-5270\" style=\"width:677px;height:auto\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-5.png 729w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-5-300x188.png 300w\" sizes=\"auto, (max-width: 729px) 100vw, 729px\" \/><figcaption class=\"wp-element-caption\"><em>Maia-generated summary of the loading pipeline.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n\n\n\n<div id=\"vert-space-block_d0b9c94fc30cc1466f0e7fffccba3a54\" class=\"vert-space\">\n\t<div class=\"spacer-desktop\" style=\"height: 20px\"><\/div>\n\t<div class=\"spacer-tablet\" style=\"height: 16px\"><\/div>\n\t<div class=\"spacer-mobile\" style=\"height: 12px\"><\/div>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\"><strong>Snowflake Cortex AI Use Case<\/strong>&nbsp;<\/h2>\n\n\n\n<p>Matillion DPC also enables the use of Snowflake\u2019s AI capabilities with ready-made objects that can be added as part of regular loading pipelines. This low-code \/ no-code approach makes AI accessible to a wider group of users and lowers the threshold for adopting AI capabilities, as no special skills are required.&nbsp;<\/p>\n\n\n\n<p>Below is a simplified example where AI is used to create responses to customer feedback. The feedback has been received in three different languages (Finnish, Swedish, and English). The Matillion orchestration pipeline contains three different stages (transformation jobs), each using different Snowflake Cortex functions. The stages are:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>REVIEWS_1_TRANSLATE \u2013 Translates all feedback into English using the CORTEX.TRANSLATE function.&nbsp;<\/li>\n\n\n\n<li>REVIEWS_2_SENTIMENT \u2013 Determines the sentiment of the feedback (positive \/ negative) using the CORTEX.SENTIMENT function.&nbsp;<\/li>\n\n\n\n<li>REVIEWS_3_REPLY \u2013 Generates responses to the feedback using the CORTEX.COMPLETE function.&nbsp;<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"768\" height=\"414\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-4.png\" alt=\"\" class=\"wp-image-5269\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-4.png 768w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-4-300x162.png 300w\" sizes=\"auto, (max-width: 768px) 100vw, 768px\" \/><figcaption class=\"wp-element-caption\"><em>Loading pipeline for automating customer feedback responses.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n<p>In the first stage, the Cortex Translate object is used to translate customer feedback, that is loaded into Snowflake and written in multiple languages, into English. In the Cortex Translate object, the column to be translated is specified, along with the source language (in this case, automatic detection) and the target language, which is English. After the translation, the columns are renamed, and the data is loaded into the database for the next stage.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"915\" height=\"498\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-8.png\" alt=\"\" class=\"wp-image-5277\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-8.png 915w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-8-300x163.png 300w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-8-768x418.png 768w\" sizes=\"auto, (max-width: 915px) 100vw, 915px\" \/><figcaption class=\"wp-element-caption\"><em>Loading pipeline for translating customer feedback into English.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n<p>In the second stage, the Cortex Sentiment object is used to identify the sentiment of the customer feedback. In the object\u2019s settings, the column to which the sentiment analysis is applied is selected. Matillion creates a new column for the value, with a scale ranging from -1 (negative) to +1 (positive). Finally, in the loading pipeline, the necessary columns are renamed, and the data is loaded into the database for the final stage.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"840\" height=\"558\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-2.png\" alt=\"\" class=\"wp-image-5264\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-2.png 840w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-2-300x199.png 300w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-2-768x510.png 768w\" sizes=\"auto, (max-width: 840px) 100vw, 840px\" \/><figcaption class=\"wp-element-caption\"><em>Loading pipeline for determining the sentiment of customer feedback.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n<p>In the final loading pipeline, the processing performed in the previous stages is used to generate a response to the customer feedback. At the start of the pipeline, a Filter object is used to split positive and negative feedback into separate data streams, based on the sentiment analysis carried out in the previous stage. Both data streams are then directed to their own Cortex Completions objects. The following are defined for these objects:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The model to be used for generating the response.&nbsp;<\/li>\n\n\n\n<li>A system prompt that provides context for creating the response.&nbsp;<\/li>\n\n\n\n<li>A user prompt that specifies the actual response.&nbsp;<\/li>\n\n\n\n<li>The input to be used for generating the response: in this case, the feedback.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>After generating the response, the data streams are merged, transformed into a columnar format, the columns are renamed, and the data is loaded into the database, for example, to be used by customer service systems.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"945\" height=\"597\" src=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-7.png\" alt=\"\" class=\"wp-image-5272\" srcset=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-7.png 945w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-7-300x190.png 300w, https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-7-768x485.png 768w\" sizes=\"auto, (max-width: 945px) 100vw, 945px\" \/><figcaption class=\"wp-element-caption\"><em>Loading pipeline for generating customer feedback responses.<\/em>&nbsp;<\/figcaption><\/figure>\n\n\n\n\n\n\n<div id=\"vert-space-block_d0b9c94fc30cc1466f0e7fffccba3a54\" class=\"vert-space\">\n\t<div class=\"spacer-desktop\" style=\"height: 20px\"><\/div>\n\t<div class=\"spacer-tablet\" style=\"height: 16px\"><\/div>\n\t<div class=\"spacer-mobile\" style=\"height: 12px\"><\/div>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\"><strong>Summary<\/strong>&nbsp;<\/h2>\n\n\n\n<p>Matillion\u2019s AI capabilities are not just technical accelerators, they are collaborative tools that bring data engineers, analysts, and business stakeholders onto the same page. They enable natural language interaction, automatic documentation generation, and the integration of diverse perspectives directly into data pipelines. Matillion bridges the gap between business and data systems, enabling understanding of actions without the need for technical skills such as code literacy. This opens the door to more agile development, faster iteration cycles, and, ultimately, more data products that are truly aligned with business priorities.&nbsp;<\/p>\n\n\n\n<p>The AI objects in Matillion DPC that can be used within loading flows speed up and simplify the adoption of these capabilities in organizations. The Snowflake Cortex objects are a good example of this. Matillion DPC is used to build and orchestrate the loading pipeline, while the actual data processing is performed in Snowflake. This eliminates data transfers, supports real-time execution, and ensures that security practices are followed consistently throughout.&nbsp;<\/p>\n\n\n\n<p>-Asko Ovaska<\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI has been on everyone\u2019s lips in the IT industry for the past few years, and its development has been rapid. Application providers have also developed and incorporated more and more AI-enabled capabilities into their software. Matillion is no exception.&nbsp; Matillion\u2019s Data Productivity Cloud (DPC) includes several AI-based objects for use in developing loading pipelines. [&hellip;]<\/p>\n","protected":false},"author":27,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":true,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[],"class_list":["post-5260","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Matillion DPC: AI in Data Stream Loading<\/title>\n<meta name=\"description\" content=\"Discover how the Matillion Data Productivity Cloud uses AI tools like Maia and Snowflake Cortex to streamline data loading, documentation, and analysis.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Matillion DPC: AI in Data Stream Loading\" \/>\n<meta property=\"og:description\" content=\"Discover how the Matillion Data Productivity Cloud uses AI tools like Maia and Snowflake Cortex to streamline data loading, documentation, and analysis.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/\" \/>\n<meta property=\"og:site_name\" content=\"Etlia\" \/>\n<meta property=\"article:published_time\" content=\"2025-08-12T10:53:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-28T12:26:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"567\" \/>\n\t<meta property=\"og:image:height\" content=\"216\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Dina Pynssi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Dina Pynssi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/\"},\"author\":{\"name\":\"Dina Pynssi\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#\\\/schema\\\/person\\\/6aab060d9d862c727cfff0710f4aec5e\"},\"headline\":\"Leveraging AI in data stream loading: Matillion Data Productivity Cloud\u00a0\",\"datePublished\":\"2025-08-12T10:53:53+00:00\",\"dateModified\":\"2025-10-28T12:26:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/\"},\"wordCount\":1282,\"publisher\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/etlia.fi\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/image-3.png\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/\",\"url\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/\",\"name\":\"Matillion DPC: AI in Data Stream Loading\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/etlia.fi\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/image-3.png\",\"datePublished\":\"2025-08-12T10:53:53+00:00\",\"dateModified\":\"2025-10-28T12:26:13+00:00\",\"description\":\"Discover how the Matillion Data Productivity Cloud uses AI tools like Maia and Snowflake Cortex to streamline data loading, documentation, and analysis.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#primaryimage\",\"url\":\"https:\\\/\\\/etlia.fi\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/image-3.png\",\"contentUrl\":\"https:\\\/\\\/etlia.fi\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/image-3.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/matillion-dpc-ai-data-pipelines\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/etlia.fi\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Leveraging AI in data stream loading: Matillion Data Productivity Cloud\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/etlia.fi\\\/en\\\/\",\"name\":\"Etlia\",\"description\":\"Kriittiset analytiikkaratkaisut yrityksellesi\",\"publisher\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/etlia.fi\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#organization\",\"name\":\"Etlia\",\"url\":\"https:\\\/\\\/etlia.fi\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/etlia.fi\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/etlia_logo_full_for-white-background-3.jpg\",\"contentUrl\":\"https:\\\/\\\/etlia.fi\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/etlia_logo_full_for-white-background-3.jpg\",\"width\":850,\"height\":374,\"caption\":\"Etlia\"},\"image\":{\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/etlia\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/etlia.fi\\\/en\\\/#\\\/schema\\\/person\\\/6aab060d9d862c727cfff0710f4aec5e\",\"name\":\"Dina Pynssi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ea9fcaeb51aa624138ff4e6b726eb65a77913297039ddb23faa37f34980b5509?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ea9fcaeb51aa624138ff4e6b726eb65a77913297039ddb23faa37f34980b5509?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ea9fcaeb51aa624138ff4e6b726eb65a77913297039ddb23faa37f34980b5509?s=96&d=mm&r=g\",\"caption\":\"Dina Pynssi\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Matillion DPC: AI in Data Stream Loading","description":"Discover how the Matillion Data Productivity Cloud uses AI tools like Maia and Snowflake Cortex to streamline data loading, documentation, and analysis.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/","og_locale":"en_US","og_type":"article","og_title":"Matillion DPC: AI in Data Stream Loading","og_description":"Discover how the Matillion Data Productivity Cloud uses AI tools like Maia and Snowflake Cortex to streamline data loading, documentation, and analysis.","og_url":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/","og_site_name":"Etlia","article_published_time":"2025-08-12T10:53:53+00:00","article_modified_time":"2025-10-28T12:26:13+00:00","og_image":[{"width":567,"height":216,"url":"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image.png","type":"image\/png"}],"author":"Dina Pynssi","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Dina Pynssi","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#article","isPartOf":{"@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/"},"author":{"name":"Dina Pynssi","@id":"https:\/\/etlia.fi\/en\/#\/schema\/person\/6aab060d9d862c727cfff0710f4aec5e"},"headline":"Leveraging AI in data stream loading: Matillion Data Productivity Cloud\u00a0","datePublished":"2025-08-12T10:53:53+00:00","dateModified":"2025-10-28T12:26:13+00:00","mainEntityOfPage":{"@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/"},"wordCount":1282,"publisher":{"@id":"https:\/\/etlia.fi\/en\/#organization"},"image":{"@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#primaryimage"},"thumbnailUrl":"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3.png","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/","url":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/","name":"Matillion DPC: AI in Data Stream Loading","isPartOf":{"@id":"https:\/\/etlia.fi\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#primaryimage"},"image":{"@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#primaryimage"},"thumbnailUrl":"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3.png","datePublished":"2025-08-12T10:53:53+00:00","dateModified":"2025-10-28T12:26:13+00:00","description":"Discover how the Matillion Data Productivity Cloud uses AI tools like Maia and Snowflake Cortex to streamline data loading, documentation, and analysis.","breadcrumb":{"@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#primaryimage","url":"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3.png","contentUrl":"https:\/\/etlia.fi\/wp-content\/uploads\/2025\/08\/image-3.png"},{"@type":"BreadcrumbList","@id":"https:\/\/etlia.fi\/en\/matillion-dpc-ai-data-pipelines\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/etlia.fi\/en\/"},{"@type":"ListItem","position":2,"name":"Leveraging AI in data stream loading: Matillion Data Productivity Cloud\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/etlia.fi\/en\/#website","url":"https:\/\/etlia.fi\/en\/","name":"Etlia","description":"Kriittiset analytiikkaratkaisut yrityksellesi","publisher":{"@id":"https:\/\/etlia.fi\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/etlia.fi\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/etlia.fi\/en\/#organization","name":"Etlia","url":"https:\/\/etlia.fi\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/etlia.fi\/en\/#\/schema\/logo\/image\/","url":"https:\/\/etlia.fi\/wp-content\/uploads\/2021\/03\/etlia_logo_full_for-white-background-3.jpg","contentUrl":"https:\/\/etlia.fi\/wp-content\/uploads\/2021\/03\/etlia_logo_full_for-white-background-3.jpg","width":850,"height":374,"caption":"Etlia"},"image":{"@id":"https:\/\/etlia.fi\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/etlia\/"]},{"@type":"Person","@id":"https:\/\/etlia.fi\/en\/#\/schema\/person\/6aab060d9d862c727cfff0710f4aec5e","name":"Dina Pynssi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/ea9fcaeb51aa624138ff4e6b726eb65a77913297039ddb23faa37f34980b5509?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/ea9fcaeb51aa624138ff4e6b726eb65a77913297039ddb23faa37f34980b5509?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ea9fcaeb51aa624138ff4e6b726eb65a77913297039ddb23faa37f34980b5509?s=96&d=mm&r=g","caption":"Dina Pynssi"}}]}},"_links":{"self":[{"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/posts\/5260","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/users\/27"}],"replies":[{"embeddable":true,"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/comments?post=5260"}],"version-history":[{"count":8,"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/posts\/5260\/revisions"}],"predecessor-version":[{"id":5309,"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/posts\/5260\/revisions\/5309"}],"wp:attachment":[{"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/media?parent=5260"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/categories?post=5260"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/etlia.fi\/en\/wp-json\/wp\/v2\/tags?post=5260"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}