Big Data Engineer (Hadoop/Athena) Job at Software Guidance & Assistance, Rockville, MD

akMzMWlvdDk2VHhjMVpaRzVtS3RxUFZ6TGc9PQ==
  • Software Guidance & Assistance
  • Rockville, MD

Job Description

Salary: $92,000 - 118,000 per year Requirements:

  • 8+ years of experience in Big Data or Data Engineering.
  • Extensive hands-on experience with AWS services including S3, Glue Data Catalog, Lake Formation, Athena, EMR, and EKS.
  • Proven expertise in Trino (or Presto) with a focus on optimizing query performance.
  • Familiarity with Kubernetes/EKS for managing data workloads.
  • Proficient in SQL, Python, and shell scripting.
  • Experience with CI/CD pipeline development and tools such as Jenkins.
  • Background in building and configuring MCP servers for AI/ML integration.
  • A proactive problem solver with an ownership mindset rather than just a task executor.
  • Preferred exposure to AI/ML data pipelines.
  • Experience in cloud-native data modernization.
Responsibilities:
  • Design and construct scalable data lakes and pipelines on AWS utilizing cloud-native and automated solutions.
  • Enable rapid, federated analytics through Amazon Athena and Trino, including performance tuning for extensive queries.
  • Manage metadata and schemas, facilitating discovery through AWS Glue Data Catalog.
  • Implement fine-grained data access and governance using AWS Lake Formation alongside KMS encryption and SSL.
  • Build and maintain data services on EKS (Kubernetes).
  • Work within the Hadoop ecosystem, leveraging tools such as Spark, Hive, and HDFS with partitioning, bucketing, and columnar formats (Parquet, ORC).
  • Troubleshoot and resolve complex issues related to big data pipelines, clusters, and queries.
  • Design, implement, and sustain CI/CD pipelines using Jenkins or similar platforms.
  • Monitor pipelines and clusters using CloudWatch and Grafana.
  • Prepare high-quality datasets for AI/ML applications.
  • Build, set up, and manage an MCP server for AI/ML integration.
  • Collaborate within Scrum teams to proactively identify challenges and propose innovative, scalable solutions.
Technologies:
  • AI
  • AWS
  • AWS Glue
  • Big Data
  • CI/CD
  • Cloud
  • CloudWatch
  • Grafana
  • Hadoop
  • Hive
  • Jenkins
  • Kubernetes
  • Python
  • SQL
  • Spark

More:

We are SGA, a technology and resource solutions provider dedicated to excellence. As a women-owned business, our mission is to address significant IT challenges with a personal, tailored approach. Each year, we connect talented consultants like you with over 1,000 engagements. When we say lets work better together, we truly mean it. You will join a diverse team founded on core values of customer service, employee development, and high-quality integrity. We encourage authenticity and passion in the workplace. Our location is hybrid, offering flexibility across multiple sites including Tysons, VA, Rockville, MD, Jersey City, NJ, and Woodbridge, NJ. Join us in a fulfilling career while embracing your individuality.

last updated 13 week of 2026

Job Tags

Full time

Similar Jobs

h/care

Home Health Registered Nurse Job at h/care

 ...Health RN (Part-Time) Job Description h/care is excited to announce an opening for a...  ...is an onsite, non-remote role, requiring travel within the local community to provide direct...  ...physicians. Requirements Registered Nurse (RN) license in good standing. Minimum... 

Medicus Healthcare Solutions

Billing Coordinator Job at Medicus Healthcare Solutions

 ...We are always seeking high-energy, hardworking employees.TheBilling Coordinatorposition requires exceptional organizational skills...  ...for career progression~Unlimited Paid Time Off~Full medical, dental, and vision benefits--starting DAY 1!~401K matching program,... 

Pillsbury Winthrop Shaw Pittman LLP

Conflict Analyst Job at Pillsbury Winthrop Shaw Pittman LLP

 ...Nashville, Tennessee Job Description The Conflict Analyst is responsible for research and analysis of incoming business and ensuring ethical compliance of the Rules of Professional Responsibility. KEY RESPONSIBILITIES Ensure compliance with ethical guidelines... 

BJC Healthcare

Research Scientist PRN Job at BJC Healthcare

Additional Information About the Role Unit - Center for Practice Excellence PRN Eight hours per week Typical hours 8:00-4:30 p.m.; with flex depending on needs of the role PhD / Doctorate Illinois RN License Five+ years RN work experience ...

Fairmount Behavioral Health System

PSYCHIATRIST Job at Fairmount Behavioral Health System

Responsibilities Works closely with hospital staff, department directors, and physicians to ensure that the highest standards of quality and service are maintained. Oversees the implementation of quality improvement efforts designed to improve clinical performance...