Sarthak Dwivedi

• As a Data-DevOps Engineer, Sarthak is part of Data Governance team in Rabo bank Enterprise Data Lake area.
• In this assignment, Sarthak has built several APIs that can be called from Azure datafactory to apply the retention rules on Enterprise data lake data.
• Sarthak has also built several pipelines for structural removal of data from Datalake and move it to Data Science team's storage.
• Sarthak has develop the storage scanner to scan the data in EDL and compare it with the meta data repository.

In this assignment, Sarthak is using Azure DevOps, YAML, Python FastAPI, SQL Alchemy, Azure Datafactory, Azure Data Studio etc to develop such features.

• As a Jr.Data Engineer, Sarthak helped ABN AMRO, Non-financial Risk department by creating the Data Marts to fulfill the needs of the reporting team.
• In this assignment, Sarthak built several data factory pipelines to move data from one place to another, optimize existing pipelines and develop solution to process batch data.

During this assignment, Sarthak mainly used, Azure Data factory, Azure Data Studio, SQL database, power BI, synapse analytics.

• As a Systems Engineer, Sarthak was responsible for maintaining the COTS application.
• In this role, Sarthak helped ABN AMRO bank by adding features to the application, creating CI/CD pipelines, building interactive dashboards and improving the performances of the batch jobs to improve the regulatory reporting.

In this assignment, Sarthak used SSMS, Power BI, Pentaho, Powershell and Bash scripts for day to day work.