Company:
Trident Consulting
Location: Chicago
Closing Date: 30/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Trident Consulting is seeking a " Data Engineering Tech Lead " for one of our clients in " Chicago, IL " A global leader in business and technology services
Title: Data Engineering Tech Lead
Location: Chicago, IL
Role : Contract
Job Description
Data Engineering Tech Lead – Preferred On-shore however if a strong resource can be off-shore.
The key here is that we would like this resource to be a lead and manage the off-shore Data Engineering resources.
Thus if on-shore / near shore would be expected to cover and work with the off-shore resources (meaning really be working their hours).
a. Types of skills would be the very strong general Data Engineering skills similar to the skills that client has communicated earlier. In addition, the resource would be a leader, thus Problem solving, quick learner, strong communicator (Written and oral) and ability to assess resources and train / coach / guide. There is also a need for a level of independence and ability to work in various grey areas toward our architecture.
b.The volume, frequency and breadth of work that comes to the team is large. Being able to delegate and guide and react / plan are crucial.
Responsibilities:
Bachelors with 12+ or Masters with 7+ experience in Computer Science, Engineering, Math or other quantitative field.
12+ Experience with developing Batch ETL/ELT processes using SQL Server and SSIS ensuring all related data pipelines meets best-in-class standards offering high performance.
12+ experience writing and optimizing SQL queries and stored Procedures for Data Processing and Data Analysis.
12+ years of Experience in designing and building complete data pipelines, moving and transforming data for ODS, Staging, Data Warehousing and Data Marts using SQL Server Integration Services (ETL) or other related technologies.
12+ years' experience Implementing Data Warehouse solutions (Star Schema, Snowflake schema) for reporting and analytical applications using SQL Server and SSIS ,or other related technologies.
5+ years' Experience with large-scale data processing and query optimization techniques using TSQL.
5+ years' Experience with implementing audit, balance and control mechanism in data solutions
3+ year experience with any source control repos like GIT, TFVC or Azure DevOps , including branching and merging and implement CICD pipelines for database and ETL workloads.
2+ experience working with Python Pandas libraries to process semi structured data sets, and load them to SQL Server DB.
Strong understanding of DW concepts including 3NF and Dimensional data models.
5+ years' experience with Data Modeling techniques in Data Warehousing projects using any tool like Erwin, Visio, ER studio.
Has in-depth knowledge of ETL Design Patterns, Optimal Data Flow mechanisms and SQL development best practices.
Perform peer reviews and take ownership of the data processes to ensure quality of data in data warehouse, downstream data marts.
Experience working on Banking and Financial domain is preferred.
Experience with mentoring team members, guide them to follow best practices.
Must be self-directed and have excellent initiative and organization skills.
About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology
Some of our recent awards include:
2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area.
Title: Data Engineering Tech Lead
Location: Chicago, IL
Role : Contract
Job Description
Data Engineering Tech Lead – Preferred On-shore however if a strong resource can be off-shore.
The key here is that we would like this resource to be a lead and manage the off-shore Data Engineering resources.
Thus if on-shore / near shore would be expected to cover and work with the off-shore resources (meaning really be working their hours).
a. Types of skills would be the very strong general Data Engineering skills similar to the skills that client has communicated earlier. In addition, the resource would be a leader, thus Problem solving, quick learner, strong communicator (Written and oral) and ability to assess resources and train / coach / guide. There is also a need for a level of independence and ability to work in various grey areas toward our architecture.
b.The volume, frequency and breadth of work that comes to the team is large. Being able to delegate and guide and react / plan are crucial.
Responsibilities:
Bachelors with 12+ or Masters with 7+ experience in Computer Science, Engineering, Math or other quantitative field.
12+ Experience with developing Batch ETL/ELT processes using SQL Server and SSIS ensuring all related data pipelines meets best-in-class standards offering high performance.
12+ experience writing and optimizing SQL queries and stored Procedures for Data Processing and Data Analysis.
12+ years of Experience in designing and building complete data pipelines, moving and transforming data for ODS, Staging, Data Warehousing and Data Marts using SQL Server Integration Services (ETL) or other related technologies.
12+ years' experience Implementing Data Warehouse solutions (Star Schema, Snowflake schema) for reporting and analytical applications using SQL Server and SSIS ,or other related technologies.
5+ years' Experience with large-scale data processing and query optimization techniques using TSQL.
5+ years' Experience with implementing audit, balance and control mechanism in data solutions
3+ year experience with any source control repos like GIT, TFVC or Azure DevOps , including branching and merging and implement CICD pipelines for database and ETL workloads.
2+ experience working with Python Pandas libraries to process semi structured data sets, and load them to SQL Server DB.
Strong understanding of DW concepts including 3NF and Dimensional data models.
5+ years' experience with Data Modeling techniques in Data Warehousing projects using any tool like Erwin, Visio, ER studio.
Has in-depth knowledge of ETL Design Patterns, Optimal Data Flow mechanisms and SQL development best practices.
Perform peer reviews and take ownership of the data processes to ensure quality of data in data warehouse, downstream data marts.
Experience working on Banking and Financial domain is preferred.
Experience with mentoring team members, guide them to follow best practices.
Must be self-directed and have excellent initiative and organization skills.
About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology
Some of our recent awards include:
2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area.
Share this job
Useful Links