✨ Fill and validate PDF forms with InstaFill AI. Save an average of 34 minutes on each form, reducing mistakes by 90% and ensuring accuracy. Learn more

Lead Engineer - Evanston, IL

Michael Page International Inc. Chicago, Illinois
lead engineer data pipelines team aws growth software architecting java monitoring management operational
October 3, 2022
Michael Page International Inc.
Chicago, Illinois
FULL_TIME
$115000-175000/YEAR
  • We value strong relationships, embrace diverse clients- all while having fun
  • Prevalent room for growth opportunity and excellent leadership in place

About Our Client

We believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the world." drives us to do the best for our employees, customers, and everyone we serve, and we can only do that with a truly diverse and inclusive workforce. Our team spans the globe and is made up of diverse individuals all working together with cutting-edge technology.

Come join our team and help us make a positive impact on the world.


Job Description
  • Partner with Development team to deploy multiple projects and maintaining software using public clouds such as AWS
  • Architecting, developing, deploying, and maintaining software at scale using Java and Spark
  • Provide expertise to build frameworks using PySpark which can be used for orchestration, monitoring pipelines and Integrate solutions with other applications and platforms outside the framework
  • Responsible for supporting Pre-Prod and Prod environments which includes deployments of application, monitoring of pipelines and resolution, disaster recovery, incident/problem management
  • Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives that create sustainable revenue and share growth
  • Design, Develop and implement streaming and near-real time data pipelines that feed systems that are the operational backbone of our business
  • Develop and implement innovative solutions leading to automation
  • Use of Agile methodologies to manage projects

MPI does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, marital status, or based on an individual's status in any group or class protected by applicable federal, state or local law. MPI encourages applications from minorities, women, the disabled, protected veterans and all other qualified applicants.


The Successful Applicant
  • Bachelor's degree in computer science or related STEM field
  • 4-8+ years of IT experience supporting critical enterprise infrastructure environments
  • 5+ years of professional experience managing data pipelines and infra using Spark, Flink, Airflow
  • 3+ years experience of engineering, architecting, or supporting AWS solutions
  • 3+ years of development experience using Java, Python, Scala
  • 2+ years of experience with Big Data technologies like Spark, EMR and streaming technologies like Kafka, Kinesis
  • Computer skills
  • Experience with infrastructure designs, implementation, and support
  • Experience with relational database systems like MS SQL Server, Oracle, Teradata
  • Experience of implementing and supporting AWS based instances and services (eg
  • Experience of building and maintaining scalable and auto-scaled environments using automation and configuration management tools (eg CloudFormation/Terraform and Ansible) beneficial or can be gained
  • Scripting ability in one or more of Python, Bash, Perl
  • Experience of using Git for version control useful
  • Experience of working with or supporting containerized environments (ECS/EKS/Kubernetes/Docker)
  • Must be legally authorized to work in the United States for any employer without sponsorship
  • Successful completion of interview required to meet job qualification
  • Reliable, punctual attendance is an essential function of the position
  • MCSE/RHCE or equivalent level of knowledge

What's on Offer

We offer a range of market-competitive total rewards that include merit increases, paid holidays, Paid Time Off, and incentive bonus programs (unless covered by a collective bargaining agreement), medical, dental, vision, short and long term disability benefits, 401(k) +match, stock purchase plan, life insurance, wellness programs and financial education resources, to name a few


Report this job

Similar jobs near me

Related articles