{"id":9056,"date":"2025-07-30T10:28:13","date_gmt":"2025-07-30T10:28:13","guid":{"rendered":"https:\/\/elementtechnologies.com\/2025\/?p=9056"},"modified":"2025-07-31T04:44:13","modified_gmt":"2025-07-31T04:44:13","slug":"eu-pds-dashboard-performance-optimization","status":"publish","type":"post","link":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/eu-pds-dashboard-performance-optimization\/","title":{"rendered":"EU PDS Dashboard Performance Optimization"},"content":{"rendered":"\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Element \/ Retail - EU PDS Dashboard Performance Optimization<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t

EU PDS Dashboard Performance Optimization<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t
\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Problem : <\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

<\/strong><\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

The EU PDS dashboard consumed 1.28 billion records daily from <\/span>eFundamentals<\/span>, leading to long pipeline run times (6 hours) and high Azure compute costs. This slowed reporting and escalated operational costs.<\/span><\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

Solution : <\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

<\/p>

Pipeline optimization was performed using Spark-native techniques. Data was written in compressed delta tables with partitioning. Only recent data was replaced, and the entire process was streamlined using efficient cluster configurations.<\/span><\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

Outcome : <\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

<\/p>

Pipeline run time dropped from 6 hours to 2.5 hours. Azure costs were reduced by 50%. The dashboard\u2019s refresh cycle improved drastically, delivering timely insights at lower overhead.<\/span><\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>

<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Element \/ Retail – EU PDS Dashboard Performance Optimization EU PDS Dashboard Performance Optimization Problem : The EU PDS dashboard consumed 1.28 billion records daily from eFundamentals, leading to long pipeline run times (6 hours) and high Azure compute costs. This slowed reporting and escalated operational costs. Solution : Pipeline optimization was performed using Spark-native […]<\/p>\n","protected":false},"author":1,"featured_media":9247,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32,50,42],"tags":[],"class_list":["post-9056","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-case-studies","category-cloud-optimization-fractal","category-retail"],"blog_post_layout_featured_media_urls":{"thumbnail":["https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-content\/uploads\/2025\/07\/eu-150x150.jpg",150,150,true],"full":["https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-content\/uploads\/2025\/07\/eu.jpg",600,400,false]},"categories_names":{"32":{"name":"Case Studies","link":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/category\/case-studies\/"},"50":{"name":"Cloud Optimization (Fractal)","link":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/category\/cloud-optimization-fractal\/"},"42":{"name":"Retail","link":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/category\/retail\/"}},"tags_names":[],"comments_number":"0","_links":{"self":[{"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/posts\/9056","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/comments?post=9056"}],"version-history":[{"count":10,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/posts\/9056\/revisions"}],"predecessor-version":[{"id":9254,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/posts\/9056\/revisions\/9254"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/media\/9247"}],"wp:attachment":[{"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/media?parent=9056"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/categories?post=9056"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/staging-l.elementtechnologies.com\/2025v1.0\/wp-json\/wp\/v2\/tags?post=9056"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}