GenAI Data Automation Engineer

Job Summary
The GenAI Data Automation Engineer designs and implements AI-driven automation solutions across AWS and Azure hybrid cloud environments. This role is responsible for building scalable data pipelines, integrating enterprise systems, and leveraging Generative AI frameworks to support mission-critical analytics, reporting, and customer engagement platforms. The position requires strong expertise in data engineering, cloud services, and LLM-based automation, with a focus on performance, security, and compliance in regulated environments.

Job Responsibilities

• 
  

  Design, develop, and maintain data pipelines using AWS services including S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB, and Step Functions.

  
  
• 
  

  Build ETL/ELT processes to move data across systems, including DynamoDB to SQL Server and AWS to Azure SQL integrations.

  
  
• 
  

  Integrate contact center and CRM data into enterprise data platforms for analytics and operational reporting.

  
  
• 
  

  Engineer and enhance real-time and batch ingestion pipelines using Apache Spark, Flume, and Kafka, delivering data to Solr and OpenSearch platforms.

  
  
• 
  

  Leverage Generative AI frameworks such as AWS Bedrock, Amazon Q, Azure OpenAI, Hugging Face, and LangChain to:

  
  
  
  
  • 
    

    Automate vector generation and embedding from unstructured data.

    
    
  • 
    

    Implement automated data quality checks, metadata tagging, and lineage tracking.

    
    
  • 
    

    Enhance ETL processes with LLM-assisted transformations and anomaly detection.

    
    
  • 
    

    Build conversational business intelligence interfaces for natural language querying of structured and indexed data.

    
    
  • 
    

    Develop AI-enabled copilots for pipeline monitoring and automated troubleshooting.

    
    
  
  
  
  
• 
  

  Optimize SQL Server performance through stored procedures, indexing strategies, query tuning, and execution plan analysis.

  
  
• 
  

  Implement CI/CD pipelines using GitHub, Jenkins, or Azure DevOps to support data and AI solution deployment.

  
  
• 
  

  Ensure security and compliance using IAM, encryption, VPC configurations, role-based access controls, and firewall policies.

  
  
• 
  

  Participate in Agile DevOps processes and deliver sprint-based enhancements to data and AI solutions.

  
  

Job Requirements

• 
  

  Bachelor degree in Computer Science or related field.

  
  
• 
  

  Minimum of 2 years of experience in data engineering and automation.

  
  
• 
  

  Hands-on experience with LLM and Generative AI frameworks, including AWS Bedrock, Azure OpenAI, or open-source platforms.

  
  
• 
  

  Proficiency in SQL, SSIS, Python, Spark, Bash, PowerShell, and AWS/Azure CLI tools.

  
  
• 
  

  Experience with AWS services such as S3, RDS/SQL Server, Glue, Lambda, EMR, and DynamoDB.

  
  
• 
  

  Familiarity with Apache Flume, Kafka, and Solr for large-scale ingestion and search.

  
  
• 
  

  Experience integrating REST APIs into data pipelines and workflows.

  
  
• 
  

  Knowledge of SDLC and CI/CD tools such as JIRA, GitHub, Azure DevOps, and Jenkins.

  
  
• 
  

  Strong troubleshooting and performance optimization skills in SQL, Spark, or related technologies.

  
  
• 
  

  Experience operationalizing Generative AI pipelines, including deployment, monitoring, retraining, and lifecycle management.

  
  
• 
  

  Strong written and verbal communication skills.

  
  
• 
  

  US Citizenship and ability to obtain Public Trust clearance.

  
  

About Equiliem

Equiliem believes in empowering success. It's our job to cultivate relationships that connect people and employers in a way that is inclusive, intelligent, and allows both to thrive.

Across the U.S., leading companies in healthcare, government, engineering, manufacturing, professional services, and energy rely on us for their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent Contractor Compliance, and Managed Services.

For almost 30 years, we've helped shape our industry. Today, we continue to research, ask questions, and continuously enhance the candidate journey and client experience.

Benefits

We offer a comprehensive benefits package to our employees, which includes:

• Medical Insurance
• Vision & Dental Insurance
• Life Insurance
• Matching 401(k)
• Commuter Benefits
• Employee Discounts & Rewards
• Payroll Payment Options

By applying, you are providing consent for Equiliem to engage with you via phone calls, AI-generated calls, AI-generated text messages, standard text messages, and/or emails to share job opportunities. Consistent with our Privacy Policy, information obtained will not be shared with third parties for marketing or promotional purposes. Message frequency may vary for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You may reply STOP to cancel or HELP for assistance.

Equiliem is an equal opportunity employer. We do not discriminate or allow discrimination based on race, color, religion, creed, sex, age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Equiliem will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [emailprotected] or (732) 238-6050.