G-TECH Jobs

Job Information

G-TECH Services, Inc. Application Developer III in Detroit, Michigan

The Big Data Developer / Data Engineer must have prior hands-on experience delivering/leading successful data warehousing projects in a big data environment. This individual is responsible for working with other teams with minimal or no supervision and should have strong professional consulting skills and the ability to communicate well at all levels within the division. Experience in delivering projects using agile methodology is desired.

REQUIRED EXPERTISE IN TOOLS & TECHNOLOGIES:

• MUST HAVE

o Cloudera Hadoop HDFS or Databricks, Spark, Scala, Hive, Postgres, RedShift, SQL

o Python / Unix Scripting

o Any one of the scheduling Tools (like Oozie / Stonebranch)

o Amazon Web Services or Microsoft Azure

• PREFERRED

o Certification Hadoop / Cloudera / Databricks

OTHER SKILLS/EXPERIENCE REQUIRED:

• More than 3 years of experience working in big data / Hadoop environment using Spark/Scala, Hive and SQL.

• Excellent understanding of data warehousing concepts.

• Candidate should be able to clearly communicate fundamental concepts during the interview and demonstrate previous experience in all aspects.

• Experience in tuning queries/processes and performance management tools

• Experience in scheduling tools like Oozie, Stonebranch

• Strong data modeling skills (normalized and multidimensional)

• Strong business and communication skills

• Knowledge of Health Care Insurance Payer Data Warehousing Preferred

RESPOSIBILITIES:

• The Big Data Developer / Data Engineer should be able to perform the following with minimal supervision:

o Understand Business Requirements and Conceptual Solution

o Convert Business Requirements into Technical Requirements and Design

o Create High Level Design

o Create Detailed Technical Design

o Build Spark/Scala code

o Create Shell Scripts for automation

o Understand the source systems and conduct the data profiling

o Co-ordinate Data Modeling of Sources and Targets

o Create Source to Target Mapping Specifications

o Conduct Unit Testing and create Unit Testing Results Documents

o Provide Support for QA/UA Testing

o Migrate the code to Production

o Provide warranty support

o Assist and resolve production issues

• The Big Data Developer / Data Engineer should have the following leadership skills:

o Provide hands on technical leadership

o Lead technical requirements, technical and data architectures for the data warehouse projects

o Investigative data analysis

o Direct/participate in the discovery process

o Provide subject matter expertise and knowledge guidance to a team of analysts and ETL Developers

o Lead the design and development of the ETL process

o Lead the effort to fix the data quality issues

• Follow the standards and processes defined

• Contribute for process and performance improvements

Category Development

Function Information Technology

Req ID JN -032022-117540

Have any questions? We can help. Contact Us

facebooklinkedinConnect with us on social media.

DirectEmployers