{"id":12461,"date":"2026-09-01T08:51:47","date_gmt":"2026-09-01T07:51:47","guid":{"rendered":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/"},"modified":"2026-09-05T08:53:07","modified_gmt":"2026-09-05T07:53:07","slug":"spark-data-lakehouse-developer","status":"publish","type":"oferty-pracy","link":"https:\/\/hiberus.pl\/en\/oferty-pracy\/spark-data-lakehouse-developer\/","title":{"rendered":"Spark \/ Data Lakehouse Developer"},"parent":0,"template":"","lokalizacja":[5835],"specjalizacje":[],"class_list":["post-12461","oferty-pracy","type-oferty-pracy","status-publish","hentry","lokalizacja-wroclaw"],"acf":{"stanowisko":"Spark \/ Data Lakehouse Developer","stanowisko_en":"Spark \/ Data Lakehouse Developer","lokalizacja":"Wroc\u0142aw","lokalizacja_en":"Wroc\u0142aw","forma_zatrudnienia":["B2B"],"forma_zatrudnienia_en":["B2B"],"tryb_pracy":"Zdalny","tryb_pracy_en":"Fully Remote","wymiar_pracy1":"Pe\u0142ny wymiar","wymiar_pracy_en":"Full-time","miasto_tryb_pracy":"Wroc\u0142aw, Zdalny","miasto_tryb_pracy_en":"Wroc\u0142aw, Fully Remote","wynagrodzenie":20160,"wynagrodzenie_max":26880,"wynagrodzenie_kopia":"20160 - 26880","wymagania":"<ul><li>4+ lata do\u015bwiadczenia\u00a0w pracy z Apache Spark w \u015brodowisku produkcyjnym.<\/li><li>Bardzo dobra znajomo\u015b\u0107\u00a0PySpark, Spark SQL, DataFrames i Structured Streaming.<\/li><li>Do\u015bwiadczenie z\u00a0MongoDB\u00a0i Spark Connector oraz znajomo\u015b\u0107 modelowania i indeksowania danych.<\/li><li>Praktyczna znajomo\u015b\u0107\u00a0Apache Iceberg\u00a0i architektury\u00a0Data Lakehouse\u00a0(upsert\/merge, optymalizacja zapis\u00f3w).<\/li><li>Do\u015bwiadczenie w\u00a0CI\/CD z Jenkins, w tym automatyzacji test\u00f3w i deployment\u00f3w aplikacji Spark.<\/li><li>Bardzo dobra znajomo\u015b\u0107\u00a0Python\u00a0oraz\u00a0Spark SQL.<\/li><li>Znajomo\u015b\u0107\u00a0Prometheus i Grafana\u00a0w obszarze monitoringu i observability.<\/li><li>Do\u015bwiadczenie w pracy w\u00a0Scrum\/Kanban\u00a0oraz znajomo\u015b\u0107\u00a0Jira i Confluence.<\/li><\/ul>","wymagania_en":"<ul><li>4+ years of experience working with Apache Spark in production environments.<\/li><li>Very good knowledge of PySpark, Spark SQL, DataFrames, and Structured Streaming.<\/li><li>Experience with MongoDB and the Spark Connector, with a good understanding of data modeling and indexing.<\/li><li>Hands-on experience with Apache Iceberg and Data Lakehouse architecture, including upsert\/merge operations and write optimization.<\/li><li>Experience with CI\/CD using Jenkins, including automation of testing and deployment of Spark applications.<\/li><li>Very good knowledge of Python and Spark SQL.<\/li><li>Knowledge of Prometheus and Grafana for monitoring and observability.<\/li><li>Experience working in Scrum\/Kanban environments, with practical knowledge of Jira and Confluence.<\/li><\/ul>","obowiazki":"<p>Dla naszego\u00a0Klienta z sektora finansowego\u00a0poszukujemy do\u015bwiadczonego\u00a0<strong>Spark \/ Data Lakehouse Developera,<\/strong> kt\u00f3ry do\u0142\u0105czy do zespo\u0142u\u00a0Data Platform.<\/p><p>Osoba na tym stanowisku b\u0119dzie odpowiedzialna za projektowanie i rozw\u00f3j rozwi\u0105za\u0144 do\u00a0rekoncyliacji i synchronizacji danych\u00a0w warstwie ODS (Operational Data Store), opartych na\u00a0MongoDB, a tak\u017ce za budow\u0119 i utrzymanie warstw danych w architekturze\u00a0Data Lakehouse\u00a0\u2013 od surowych danych po warstwy\u00a0Curated, Silver i Gold.<\/p><p>\u00a0<\/p><p><strong>G\u0142\u00f3wne obowi\u0105zki :\u00a0<\/strong><\/p><ul><li>Projektowanie i implementacja proces\u00f3w Spark SQL\/PySpark do walidacji i por\u00f3wnywania danych (MongoDB\/ODS).<\/li><li>Implementacja regu\u0142 jako\u015bci danych, detekcji duplikat\u00f3w, anomalii i brak\u00f3w oraz raportowania\/alertowania.<\/li><li>Integracja i optymalizacja Spark\u2013MongoDB (MongoDB Spark Connector, partitioning, push-down, schema-aware reads).<\/li><li>Projektowanie warstwy danych Raw \u2192 Bronze \u2192 Silver \u2192 Gold z wykorzystaniem Delta Lake\/Iceberg\/Hudi oraz CI\/CD dla schemat\u00f3w i migracji.<\/li><li>Monitoring i observability proces\u00f3w Spark\/batch\/stream (Prometheus, Grafana, OpenTelemetry, Dynatrace) oraz definiowanie SLA\/SLO.<\/li><li>Automatyzacja deployment\u00f3w Spark na Docker\/Kubernetes (Spark Operator).<\/li><li>Diagnozowanie problem\u00f3w z danymi, wydajno\u015bci\u0105 i op\u00f3\u017anieniami proces\u00f3w.<\/li><li>Tworzenie dokumentacji technicznej, runbook\u00f3w i diagram\u00f3w przep\u0142ywu danych.<\/li><li>Wsp\u00f3\u0142praca w Scrum\/Kanban z Data Engineerami, BA, testerami i DevOps; prowadzenie warsztat\u00f3w i code review.<\/li><\/ul>","obowiazki_en":"<p>For our client in the financial sector, we are looking for an experienced Spark \/ Data Lakehouse Developer to join the Data Platform team.<\/p><p>The person in this role will be responsible for designing and developing data reconciliation and synchronization solutions within the ODS (Operational Data Store) layer, based on MongoDB, as well as building and maintaining data layers within the Data Lakehouse architecture \u2014 from raw data through Curated, Silver, and Gold layers.<\/p><h3><span style=\"font-size: 14px;\">Key Responsibilities<\/span><\/h3><ul><li>Design and implementation of Spark SQL\/PySpark processes for data validation and comparison (MongoDB\/ODS).<\/li><li>Implementation of data quality rules, duplicate, anomaly, and missing data detection, as well as reporting and alerting.<\/li><li>Integration and optimization of Spark\u2013MongoDB workflows (MongoDB Spark Connector, partitioning, push-down, schema-aware reads).<\/li><li>Design of Raw \u2192 Bronze \u2192 Silver \u2192 Gold data layers using Delta Lake\/Iceberg\/Hudi, including CI\/CD for schemas and migrations.<\/li><li>Monitoring and observability of Spark\/batch\/streaming processes (Prometheus, Grafana, OpenTelemetry, Dynatrace) and definition of SLAs\/SLOs.<\/li><li>Automation of Spark application deployments using Docker\/Kubernetes (Spark Operator).<\/li><li>Troubleshooting data quality, performance, and processing latency issues.<\/li><li>Creation and maintenance of technical documentation, runbooks, and data flow diagrams.<\/li><li>Collaboration in Scrum\/Kanban teams with Data Engineers, Business Analysts, QA, and DevOps; conducting workshops and code reviews.<\/li><\/ul>","benefit_1":"Karta Multisport","benefit_1_en":"Multisport card","benefit_2":"Prywatna opieka medyczna","benefit_2_en":"Private medical care","benefit_3":"","benefit_3_en":"","benefit_4":"","benefit_4_en":"","benefit_1_ikona":5270,"benefit_1_ikona_en":5270,"benefit_2_ikona":4905,"benefit_2_ikona_en":4923,"benefit_3_ikona":null,"benefit_3_ikona_en":null,"benefit_4_ikona":null,"benefit_4_ikona_en":null,"benefit_5":"","benefit_5_en":"","benefit_6":"","benefit_6_en":"","benefit_7":"","benefit_7_en":"","benefit_8":"","benefit_8_en":"","benefit_5_ikona":null,"benefit_5_ikona_en":null,"benefit_6_ikona":null,"benefit_6_ikona_en":null,"benefit_7_ikona":null,"benefit_7_ikona_en":null,"benefit_8_ikona":null,"benefit_8_ikona_en":null,"od":"https:\/\/hiberuspoland.traffit.com\/public\/form\/a\/e935a54f090a5ac128ef90567b9c61fe715a564b?source=career_page","traffit_id":426,"ogloszenie":"<strong>Wi\u0119cej ni\u017c jeden projekt. Wi\u0119cej ni\u017c jeden rynek.<\/strong>\nJeste\u015bmy cz\u0119\u015bci\u0105\u00a0<strong>Hiberus<\/strong>, firmy technologicznej wywodz\u0105cej si\u0119 z Hiszpanii z siln\u0105 pozycj\u0105 na rynku polskim:\u00a0<strong>4700+ specjalist\u00f3w, obecnej w 14+ krajach i realizuj\u0105cej projekty dla klient\u00f3w na ca\u0142ym \u015bwiecie.<\/strong>\nPracujemy z technologiami\u00a0<strong>AI, Data, Cloud, Software Development, BI i Cybersecurity<\/strong>. Ale przede wszystkim stawiamy na ludzi \u2013\u00a0<strong>gdy jeden projekt si\u0119 ko\u0144czy, szukamy kolejnych mo\u017cliwo\u015bci w ramach Hiberus, r\u00f3wnie\u017c w innych krajach.<\/strong>\nNasz\u0105 warto\u015b\u0107 dodatkow\u0105 stanowi\u00a0<strong>Hiberus University<\/strong> - mi\u0119dzynarodowe \u015brodowisko i realna mo\u017cliwo\u015b\u0107 rozwijania swoich kompetencji. Ponad tysi\u0105c os\u00f3b przeszkolonych w zesz\u0142ym roku z wybranych technologii.\n<strong>Pierwszy projekt to pocz\u0105tek. Z Hiberus mo\u017cesz budowa\u0107 swoj\u0105 karier\u0119 d\u0142ugoterminowo.<\/strong>\u00a0","ogloszenie_en":"<strong>More Than One Project. More Than One Market.<\/strong>\nWe are part of <strong>Hiberus<\/strong>, a technology company founded in Spain with a strong presence in the Polish market: <strong>4,700+ specialists, operating in 14+ countries and delivering projects for clients worldwide.<\/strong>\nWe work with technologies including <strong>AI, Data, Cloud, Software Development, BI, and Cybersecurity<\/strong>. But above all, we put people first. <strong>When one project comes to an end, we look for new opportunities within Hiberus \u2014 including projects in other countries.<\/strong>\nOne of our key advantages is <strong>Hiberus University<\/strong> \u2014 an international learning environment offering real opportunities to develop and expand your skills. <strong>More than 1,000 people were trained last year<\/strong> in selected technologies.\n<strong>Your first project is just the beginning. With Hiberus, you can build a long-term career.<\/strong>","miejsce_pracy":[]},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Spark \/ Data Lakehouse Developer - Hiberus<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Spark \/ Data Lakehouse Developer - Hiberus\" \/>\n<meta property=\"og:url\" content=\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/\" \/>\n<meta property=\"og:site_name\" content=\"Hiberus\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Hirelypl\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-05T07:53:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/hiberus.pl\/wp-content\/uploads\/2025\/06\/SM-baner_Obszar-roboczy-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/\",\"url\":\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/\",\"name\":\"Spark \/ Data Lakehouse Developer - Hiberus\",\"isPartOf\":{\"@id\":\"https:\/\/hiberus.pl\/#website\"},\"datePublished\":\"2026-09-01T07:51:47+00:00\",\"dateModified\":\"2026-09-05T07:53:07+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/hiberus.pl\/en\/home-new\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Oferty Pracy\",\"item\":\"https:\/\/hiberus.pl\/oferty-pracy\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Spark \/ Data Lakehouse Developer\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/hiberus.pl\/#website\",\"url\":\"https:\/\/hiberus.pl\/\",\"name\":\"Hiberus\",\"description\":\"Dostarczamy do\u015bwiadczenie\",\"publisher\":{\"@id\":\"https:\/\/hiberus.pl\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/hiberus.pl\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/hiberus.pl\/#organization\",\"name\":\"Hirely sp. z o.o.\",\"url\":\"https:\/\/hiberus.pl\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/hiberus.pl\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/hiberus.pl\/wp-content\/uploads\/2021\/08\/white-logo.svg\",\"contentUrl\":\"https:\/\/hiberus.pl\/wp-content\/uploads\/2021\/08\/white-logo.svg\",\"caption\":\"Hirely sp. z o.o.\"},\"image\":{\"@id\":\"https:\/\/hiberus.pl\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/Hirelypl\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Spark \/ Data Lakehouse Developer - Hiberus","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/","og_locale":"en_US","og_type":"article","og_title":"Spark \/ Data Lakehouse Developer - Hiberus","og_url":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/","og_site_name":"Hiberus","article_publisher":"https:\/\/www.facebook.com\/Hirelypl","article_modified_time":"2026-09-05T07:53:07+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/hiberus.pl\/wp-content\/uploads\/2025\/06\/SM-baner_Obszar-roboczy-1.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/","url":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/","name":"Spark \/ Data Lakehouse Developer - Hiberus","isPartOf":{"@id":"https:\/\/hiberus.pl\/#website"},"datePublished":"2026-09-01T07:51:47+00:00","dateModified":"2026-09-05T07:53:07+00:00","breadcrumb":{"@id":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/hiberus.pl\/oferty-pracy\/spark-data-lakehouse-developer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/hiberus.pl\/en\/home-new\/"},{"@type":"ListItem","position":2,"name":"Oferty Pracy","item":"https:\/\/hiberus.pl\/oferty-pracy\/"},{"@type":"ListItem","position":3,"name":"Spark \/ Data Lakehouse Developer"}]},{"@type":"WebSite","@id":"https:\/\/hiberus.pl\/#website","url":"https:\/\/hiberus.pl\/","name":"Hiberus","description":"Dostarczamy do\u015bwiadczenie","publisher":{"@id":"https:\/\/hiberus.pl\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/hiberus.pl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/hiberus.pl\/#organization","name":"Hirely sp. z o.o.","url":"https:\/\/hiberus.pl\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/hiberus.pl\/#\/schema\/logo\/image\/","url":"https:\/\/hiberus.pl\/wp-content\/uploads\/2021\/08\/white-logo.svg","contentUrl":"https:\/\/hiberus.pl\/wp-content\/uploads\/2021\/08\/white-logo.svg","caption":"Hirely sp. z o.o."},"image":{"@id":"https:\/\/hiberus.pl\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Hirelypl"]}]}},"_links":{"self":[{"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/oferty-pracy\/12461","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/oferty-pracy"}],"about":[{"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/types\/oferty-pracy"}],"version-history":[{"count":1,"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/oferty-pracy\/12461\/revisions"}],"predecessor-version":[{"id":12462,"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/oferty-pracy\/12461\/revisions\/12462"}],"wp:attachment":[{"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/media?parent=12461"}],"wp:term":[{"taxonomy":"lokalizacja","embeddable":true,"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/lokalizacja?post=12461"},{"taxonomy":"specjalizacje","embeddable":true,"href":"https:\/\/hiberus.pl\/en\/wp-json\/wp\/v2\/specjalizacje?post=12461"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}