Data Engineer

Our Customer is a leading global, diversified information, services and media company with more than 360 businesses. Its major interests include various financial services, medical information and services businesses, and lastly, ownership in cable television networks such as A&E, HISTORY, Lifetime and ESPN; 33 television stations; 24 daily and 52 weekly newspapers; digital services businesses; and nearly 250 magazines around the world.

Our Customer is seeking a Data Engineer on a contract basis to help support their business needs. This role is hybrid in Troy, MI.

As a Data Engineer, you will focus on creating a Unified Data Platform. You will design, develop, and maintain data pipelines, data lakes, and data platforms that support the analytics and business intelligence needs of the clients. You will work with cutting-edge technologies and tools, such as Spark, Kafka, AWS, Azure, and Kubernetes, to handle large-scale and complex data challenges. You will also collaborate with full stack developers, data scientists, analysts, and stakeholders to ensure data quality, reliability, and usability. You must be comfortable working with huge datasets.


Responsibilities:

• Build automated pipelines to extract and process data from a variety of legacy platforms (predominantly SQL Server), e.g., in stored procedures, Glue processing, etc.
• Implement data-related business logic on modern data platforms, such as AWS Glue, Databricks, and Azure using best practices and industry standards.
• Create vector databases, data marts and the data models to support them
• Optimize and monitor the performance, reliability, and security of data systems and processes.
• Integrate and transform data from (or to) various sources and formats, such as structured, unstructured, streaming, and batch.
• Develop and maintain data quality checks, tests, and documentation.
• Support data analysis, reporting, and visualization using tools such as SQL, Python, Tableau and Quicksight
• Research and evaluate new data technologies and trends to improve data solutions and existing capabilities.

Qualifications:

• Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field
• At least 5 years of experience in data engineering or a similar role (previous DBA experience is a plus)
• Experience with big data frameworks and tools, such as Spark, Hadoop, Kafka and Hive
• Expert in SQL, including a knowledge of efficient query and schema design, DDL, data modeling and use of stored procedures
• Proficient in at least one programming language, such as Python, Go or Java
• Experience with CI/CD, containerization (ex: docker, K8s) and orchestration (ex: Airflow)
• Experience building production systems with more modern ETL, ELT and data systems, such as AWS Glue, Databricks, Snowflake, Elastic, and Azure Cognitive Search • Experience deploying data infrastructure on cloud platforms (AWS, Azure, or GCP)
• Strong knowledge of data quality, data governance, and data security principles and practices
• Excellent communication, collaboration, and problem-solving

We offer a competitive salary range for this position. Most candidates who join our team are hired at the median of this range, ensuring fair and equitable compensation based on experience and qualifications.

Perks are available through our 3rd Party Employer of Record (Available upon completion of waiting period for eligible engagements)

Benefits: Medical, Dental, and 401k (no match)

Please note: In order to to create a safe, productive work environment, our client is requiring all contractors who plan to be onsite to be fully vaccinated according to the CDC guidelines. Prior to coming into our offices, contractors will be required to attest that they are fully vaccinated.

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.