{"id":94,"date":"2016-12-15T22:24:12","date_gmt":"2016-12-15T21:24:12","guid":{"rendered":"http:\/\/dev.thediar.com\/?page_id=94"},"modified":"2019-07-09T19:55:29","modified_gmt":"2019-07-09T17:55:29","slug":"data-integration-processing","status":"publish","type":"page","link":"https:\/\/www.thediar.com\/en\/what-we-do\/data-integration-processing\/","title":{"rendered":"Data Integration and Processing"},"content":{"rendered":"<p><\/p>\n<div class=\"paragraph\">\n<p>Your company or agency has\u00a0<strong>data<\/strong>\u00a0coming from very different sources: transactional databases, CRM, ERP, Digital Analytics tools, Spreadsheets, APIs, Web Services, Social Networks, etc. Moreover, the data sources will\u00a0<strong>keep growing<\/strong>\u00a0(in number and volume) as the business evolves.\u00a0<strong>Data<\/strong><strong>integration<\/strong>\u00a0consists of gathering, crossing and joining, enrich, consolidate, and make this information systematically\u00a0<strong>available<\/strong>\u00a0in an agile, fast, and efficient way. If Data is one of the most valuable assets in a company, the correct\u00a0<strong>consolidation process<\/strong>\u00a0is for sure the second most valuable asset.<\/p>\n<div class=\"paragraph\">\n<div class=\"paragraph\"><\/div>\n<div class=\"wsite-spacer\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-95 size-full\" src=\"https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl.jpg?resize=517%2C182\" width=\"517\" height=\"182\" srcset=\"https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl.jpg?w=517&amp;ssl=1 517w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl.jpg?resize=300%2C106&amp;ssl=1 300w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl.jpg?resize=360%2C127&amp;ssl=1 360w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl.jpg?resize=250%2C88&amp;ssl=1 250w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl.jpg?resize=100%2C35&amp;ssl=1 100w\" sizes=\"auto, (max-width: 517px) 100vw, 517px\" \/><\/div>\n<p>The very last goal of Data Integration and Processing is to transform your company\u2019s data into\u00a0<strong>useful<\/strong><strong>information<\/strong><strong>for<\/strong><strong>decision-making<\/strong> and <a href=\"https:\/\/www.thediar.com\/en\/what-we-do\/business-and-data-analytics\/\">business analysis<\/a>. To move and transform data from different business units and processes in an efficient way is one of the hardest challenges to maximize the effectiveness of data usage.<\/p>\n<p>Many times information is organized in\u00a0<strong>silos<\/strong>: different isolated areas, departments, and business units can\u2019t cross data from different systems, giving an incomplete vision. This results in a huge investment of time crossing and consolidating data and not on analyzing it. Another common problem is that companies lack a\u00a0<strong>source of truth<\/strong>\u00a0for their reports: depending on the queries used or the sourced used the output might be different.<\/p>\n<p><strong>ETL<\/strong>\u00a0processes (Extract, Transform, Load) help us in solving these problems. Having the data integrated by implementing a <strong>DWH<\/strong> (Data Warehouse) allows having a single consolidated data repository\u00a0from which you can extract data in an efficient, fast, automated, and reliable way.<\/p>\n<\/div>\n<p>As an example, we can list the following applications:<\/p>\n<ul>\n<li>Sources extraction and crossing<\/li>\n<li>Advanced calculations<\/li>\n<li>Database deduplication<\/li>\n<li>ETL conceptualization and implementation<\/li>\n<li>Data flows<\/li>\n<li>Data cleansing<\/li>\n<li>Data Warehousing<\/li>\n<li>Data inconsistencies check<\/li>\n<li>Homogenize customers and addresses<\/li>\n<\/ul>\n<\/div>\n<div class=\"wsite-spacer\">\n<p>\u200bTo fulfill these services we rely on the best-of-class tools, such as:<\/p>\n<ul>\n<li>Talend<\/li>\n<li>Kettle<\/li>\n<li>Data Virtuality<\/li>\n<li>Domo<\/li>\n<li>Oracle Data Integrator<\/li>\n<\/ul>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-96 size-full\" src=\"https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?resize=640%2C87\" width=\"640\" height=\"87\" srcset=\"https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?w=667&amp;ssl=1 667w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?resize=300%2C41&amp;ssl=1 300w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?resize=520%2C71&amp;ssl=1 520w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?resize=360%2C49&amp;ssl=1 360w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?resize=250%2C34&amp;ssl=1 250w, https:\/\/i0.wp.com\/www.thediar.com\/wp-content\/uploads\/2016\/12\/etl_tech.jpg?resize=100%2C14&amp;ssl=1 100w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<\/div>\n<h2><\/h2>\n<p><aside id=\"text-4\" class=\"widget widget_text amr_widget\"><h4 class=\"widget-title\">Find out what success we can bring to your company<\/h4>\t\t\t<div class=\"textwidget\"><a class=\"button\" href=\"\/en\/meet-the-team\/success-stories\/\">Success Stories<\/a><\/div>\n\t\t<\/aside><\/p>","protected":false},"excerpt":{"rendered":"<p>Your company or agency has\u00a0data\u00a0coming from very different sources: transactional databases, CRM, ERP, Digital Analytics tools, Spreadsheets, APIs, Web Services, Social Networks, etc. Moreover, the data sources will\u00a0keep growing\u00a0(in number and volume) as the business evolves.\u00a0Dataintegration\u00a0consists of gathering, crossing and [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":37,"menu_order":8,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page_fullwidth.php","meta":{"footnotes":""},"class_list":["post-94","page","type-page","status-publish","hentry","clearfix"],"aioseo_notices":[],"jetpack_shortlink":"https:\/\/wp.me\/P8d1gX-1w","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/pages\/94","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/comments?post=94"}],"version-history":[{"count":20,"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/pages\/94\/revisions"}],"predecessor-version":[{"id":1909,"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/pages\/94\/revisions\/1909"}],"up":[{"embeddable":true,"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/pages\/37"}],"wp:attachment":[{"href":"https:\/\/www.thediar.com\/en\/wp-json\/wp\/v2\/media?parent=94"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}