AWS DATALAKE ENGINEER

Title: AWS Data engineer

Location: 100% Remote

Long term role

*Open to fully remote but will be required to work 9 AM-5PM EST with the team.

*Absolute must haves are Terraform AND experience building AWS data lakes using Glue, EMR, HUDI, Flink if we can find it.

Seeking a Subject Matter Expert to help accelerate our deployment of Raw and Derived data products to AWS data lakes. They should also be capable of helping us accelerate our rate of production through optimization and automation using Terraform Enterprise scripts and optimized AWS, Apache, and other tool configurations and architectural design.
Experience with below tech must have:
* AWS Tech Stack :
o AWS Lakeformation
o AWS EMR
o Apache Hudi
o Flink
o AWS Glue (Glue Catalog, Glue ETL and Crawler)
o AWS Athena
o Redshift,
o Sagemaker/ML
o AWS Lambda
o DynamoDB
o RDS (Relational Database Services).
* AWS S3: Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc.
* Implementation and tuning experience in Streaming use cased and Big Data Ecosystem (such as EMR, Hadoop, Spark, Hudi, Kafka/Kinesis etc.)
* Should be able to build scalable data infrastructure and understand distributed systems concepts from a data storage and compute perspective.
* Have a good understanding of Data Lake concepts and Data Warehouse concepts. Should be familiar with concepts on Modern Data Architecture.
* Ability to define Standards and guidelines with understanding of various Compliance and Auditing needs.
* Be proficient in Python or Java to handle large volume data processing.
* Terraform Enterprise.
* Kafka
* Qlik Replicate

Core Responsibilities
* Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery
* Lead the Design, Build, Test and Deployment of components in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead)
* Understand requirements / use case to outline technical scope and lead delivery of technical solution
* Works closely with the Product Owner to align on delivery goals and timing
* Collaborates with Data and Solution architects on key technical decisions
* Lead design and implementation of data quality check methods
* Ensures Test Driven development
* Strong skills with business stakeholder interactions
* Ensure data security and permissions solutions, including data encryption, user access controls and logging

Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.

Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.

Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.