Edwin Weber (hired)

Availability: I am currently available for a new assignment, preferably in the (far) north of the Netherlands. Profile: Experienced Data Engineer. Being 'SQL-minded' I'm often working on the 'back end' of Data Warehouses and one of my key interests is ETL/ELT-automation. I consider the 'back end' to be the process from investigating source systems up to and including the design and loading of dimensional models. The last couple of years I also worked with Power BI a lot and I quite like it, together with the interaction with the people that actually use the data I prepare to support their work. To broaden my horizon, I took some time off lately to study Python, Synapse and Delta Lake and I recently became certified as an "Azure Data Engineer Associate" (DP-203) and "Microsoft Power BI Data Analyst" (PL-300). I'm interested in Open Source and have done projects with Pentaho Data Integration in combination with MySQL and PostgreSQL. I would now use Apache Hop as the Open Source data integration tool in such a project. It is a natural successor and was developed by the original creator of PDI (and has PDI -> Hop conversion capabilities). I have been working as a data engineer on a few projects where Data Vault was used and as a result I gained experience with the data modelling technique and developed Data Vault load automation frameworks using Pentaho Data Integration and SSIS (with BIML). In large organizations with many source systems to integrate and strict specifications on preserving all history I have seen it work well. In other cases I would use a less complex data architecture, which can still benefit from ETL/ELT-automation. Software I worked with: Databases (relational): Microsoft SQL Server, MySQL, PostgreSQL, Oracle Databases (multidimensional): Microsoft Analysis Services/Power BI datasets, Mondrian ETL software: Azure Data Factory/Synapse Pipelines, Pentaho Data Integration (PDI)/Apache Hop, SQL Server Integration Services Programming languages: Microsoft Transact-SQL, DAX, Python, PySpark, Oracle PL/SQL, MySQL stored procedures, PostgreSQL PL/pgSQL