Data Engineering/Data Governance/App Integration/Data Integration/Big Data/Data Quality
Almere
Summary
Detail-oriented Data Engineer designs, develops and maintains highly scalable, secure and reliable data structures.
16 Years of Experience with Data Engineering, Data Integration, Cloud Data and application Integration, Data Quality, BigData Management and Data Governance.
Experience with Agile and DevOps methodologies.
Good understanding on the modern IT infrastructure and computation technologies like AWS, Azure, BigData, Hadoop, NoSQL, Docker, Kubernetes, distributed computing and micro services.
Experience in latest security protocols like Kerberos, SSL/TLS, SSO and OAuth.
Expertise in handling data streaming and near real-time change data capture.
Excellent communication, presentation, project management skills and a very good team player and self-starter with ability to work independently and as part of a team.
Overview
16
16
years of professional experience
7
7
years of post-secondary education
6
6
Certifications
1
1
Language
Work History
Sr Data Engineer - W&R Data Engineering
Rabobank
11.2023 - Current
Facilitate Data Producer for GDP intake, introduction to GDP and Data Management Teams. Guide them on Governed Data Marketplace process.
Perform Data Producer Assessment, discuss and draft support proposal.
Facilitate Data Producer onboarding to GDP on activities such as IT and service management registration in ITSM, Data producer registration in Collibra, request GDP managed subscription , request shared Azure DevOps project.
Coordinate with Data Producer and Data Management teams on Data Governance activities such as Create Data Definitions, data set registrations, Defining governance roles, set-up Lineage, monitoring CDE's.
Define and document development standards and guidelines in alignment with GDP standards.
Build Data pipelines for Data Ingestion into GDP, implement data validations, error handling and failure notifications, deployment to pre-prod and Prod environment.
Ensure compliance with GDP Governed Data Marketplace by integrating Metadata API for metadata ingestion into Collibra and implementing DTC framework to enforce data transfer controls.
Complete GDP validation checklist and get GDP go-live sign-off.
Evaluated emerging technologies and tools to identify opportunities for enhancing existing systems or creating new ones
Data Governance Engineer - Global Data Platform
Rabobank
06.2021 - 11.2023
Build Data Governance solution using Informatica EDC, Collibra DGC, Informatica Data Quality.
Administer and manage Data governance platform application (Informatica EDC, Collibra and IDQ)
Design and develop Collibra business process workflows to implement governance initiatives.
Automate process to harvest metadata and lineage from various source systems and applications.
Implement process for Business glossary and associate them to technical assets.
Process to implement GDPR PIA and DPIA initiatives.
Build Data Integration pipelines to publish/subscribe to datasets in Azure Data lake using Azure Data Factory and Azure App Service.
Principal Data Engineer
Informatica Software Nederland B.V
11.2013 - 05.2021
Worked with several customers on various projects for Data and application Integration, Data Quality, BigData Management and Data Governance.
Worked on various phases of projects; Planning & Design, Development and Operations.
Highly experienced in application administration.
Good understanding ofIT infrastructure.
Hands-on experience with Shell/batch scripting.
Hands-on development experience with Informatica PowerCenter, BDM/DEI, IDQ and IICS.
Proficient in developing BDM dynamic mappings using combination of Port Groups, Dynamic ports and static ports.
Build dynamic mapping rules and Run-time link configuration using Input rules, port selectors and Selection rules.
Generate runtime mappings to trouble shoot dynamic mappings.
Experience working with Kafka streaming data.
Experience using Informatica Mass Ingestion and Metadata Access services.
Experience with multiple BDM runtime engines Map Reduce /Tez, Blaze and Spark.
Experience with BDM on various Hadoop and spark distributions; Hortonworks, Cloudera, Azure HDInsight and DataBricks.
Generate mapping reusable report for PowerCenter to BDM migration.
Experience with migrating from PowerCenter to BDM.
Senior Technical Support Engineer
Informatica Business Solutions Private Limited
04.2009 - 10.2013
Understanding business requirements of various customers and provide best feasible solution.
Help customers in troubleshooting their issues and provide them detail analysis on possible root cause and solution.
Document customer issues and solution with exhaustive analysis to Informatica Knowledge base.
Prioritize various customer issues based on their SLA and provide them timely assistance and ensure customer success and satisfaction.
Set-up and in-house environments on various platforms to re-produce customer’s issues for further analysis.
Work closely with Product development team on product bugs/enhancements reported by customers.
Project Engineer
Wipro Technologies Limited
03.2008 - 03.2009
Gathering SR requirements from clients.
Involved in Analysis, Development and Coding.
Involved in Code Review and Peer Review.
Defect logging, tracking and analysis.
Involved in developing test cases, test procedures, unit test strategy and QA support.