Daniel G Schultz
I am an AWS Certified Developer who has primarily been focused on data. I have used a variety of languages, and have interacted with multiple AWS Services. I also have experience helping to build enterprise data warehouses, working with custom client datasets, creating standardized and custom ETL solutions, and BI reporting using multiple database and visualization technologies. Additionally I have done extensive work with various versions of Microsoft SQL Server. This has included working with SSIS, SSRS, and writing stored procedures.
Technologies
- AWS Certified Developer - Asssociate
- Amazon S3
- Amazon Lambda
- Amazon Glue
- Snowflake
- Matillion
- Java
- ElasticSearch
- Databricks
- Microsoft SQL Server
- SQL Server Integration Services (SSIS)
- SQL Server Reporting Services (SSRS)
- Python
- Amazon DynamoDB
- Amazon Athena
- Apache Airflow
- Spark
- MySQL
- PostgreSQL
- Greenplum
- Scala
- C#
- Metabase
- Tableau
Professional Experience
-
New Innovations (Apr 2020 - Present)
Senior Data Engineer 2020 to Present
Designed and built new Datalake for analysis and reporting on Amazon S3 using Apache Airflow.
Accomplishments
- Created new company standard template Python and Airflow projects.
- Built the company datalake on Amazon S3 using Airflow pipelines.
- Helped design production Airflow environment.
- Designed and built Airflow datalake project from ground up.
- Wrote custom Airflow hooks and operators for bringing in various datasources to the datalake.
- Mentored and trained new Data Engineers with various levels of prior experience.
-
Zeta Global (Nov 2019 - Mar 2020)
Zeta Global acquired assets from IgnitionOne in 2019
Senior Software Engineer 2019 to 2020
Helped to migrate IgnitionOne application to Zeta Global framework. This included custom email marketing data integrations as well as rewriting ETL supporting platform reporting efforts in Tableau.
Accomplishments
- Wrote custom Airflow operators for migrating ETL from IgnitionOne to Zeta Global ETL framework.
- Learned Zeta in house email marketing platform and migrated legacy IgnitionOne clients to the new platform.
-
IgnitionOne (Apr 2014 to Nov 2019) / KNOTICE, INC. (Feb 2012 to Apr 2014)
IgnitionOne acquired Knotice in 2014
Senior Software Engineer 2018 to 2019
Database Engineer III 2016 to 2018
Database Engineer II 2014 to 2016
Database Developer 2012 to 2014
Advanced through several promotions, culminating in Senior Software Engineer role. Have handled both enterprise and client specific development projects.
Accomplishments
- As a senior member of the team, mentored newer members and helped develop standard processes used for many ETL/ELT processes, and reports.
- Used Python and Airflow to design and implement data pipelines for aggregating data from multiple datasources into a single Snowflake destination.
- Used Matillion to design and build an ELT solution for quickly migrating data from disparate databases into a single Snowflake database. This system allowed for additional standard and custom datasets to be added simply by creating destinations, and setting up minor configurations.
- Used Spring Cloud Data Flow to design and build a solution for pulling aggregate data from ElasticSearch profile store into Snowflake. This was to allow for Tableau dashboards to be built on the dataset allowing for customer insights into their data.
- Designed dozens of ETL solutions driving continuous improvement to processes, systems, workflow and customer responsiveness.
- Created improvements to enterprise system allowing for extra data monitoring and higher success rate on data imports.
- Created standard email marketing activity data ETL and formats for sending data to clients. ETL was created to allow for each client to specify needs regarding SFTP, encryption, and compaction.
- Used Java and C# to gather data from, and send data to internal and external APIs.
- Used Apache Spark/Scala to generate application for helping Data Science team with scoring enterprise data based on external third party data stored in AWS S3.
- Worked with clients to develop a custom schema within the IgnitionOne platforms and bring in custom data.
- Designed Tableau dashboard for showing campaign services team and clients what data points were available for building targeted audiences, along with values and counts stored in each data point.
-
Kenan Advantage Group (Apr 2011 to Feb 2012)
Application Developer 2011 to 2012
Worked with multiple groups in the organization to gather requirements and generate necessary reports using Oracle and SQL Server.
Accomplishments
- Generated and maintained monthly financial reports used by CFO.
- Generated ETL to bring in gas pricing data and reporting allowing the organization to determine where it was best to purchase to take advantage of bulk purchase discounts.
-
Infocision Management Corporation (May 2005 to Apr 2011)
Application Developer 2009 to 2011
Quality Analyst 2007 to 2009
Quality Data Analyst 2005 to 2007
Worked with Account Teams and clients to ensure timeliness and quality of data offloads and reporting created by the Volunteer Recruitment team. Later as Application Developer was responsible for intaking client data and setting up calling files, along with all reporting and file extracts.
Accomplishments
- Was first Quality Data Analyst in Volunteer Recruitment division and as such created all processes and procedures for ensuring quality output from the team.
- Developed generic SQL procedures, which with a few variables could verify that expected results were included for most exports, along with ensuring that most major data fields were properly populated.
- Generated universal fulfillment report that allowed for reporting on campaign results broken out by any data field available for any clients.
- Ensured seamless transition when a member of the team was transferred and I became the Application Developer on his accounts.