Databricks Engineer

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them.

With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks

We are seeking an expert data engineers with support experience with 8 to 10 years of experience to join our team. The ideal candidate will have expertise in Spark in Scala Databricks CLI Amazon S3 Python Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Life and Annuities Insurance is a plus. This is a hybrid role.

• Lead the design and implementation of scalable data architectures using Spark in Scala and Databricks CLI.
• Experience in supporting applications and handling Support engagement.
• Ensuring supporting of applications under Databricks + Pyspark Python AWS as per schedule.
• Providing on call support over weekend and holidays. Ensuring handshake with offshore support team
• Be responsible for the integration of Amazon S3 for efficient data storage and retrieval.
• Guide in Python programming to develop and optimize data processing workflows.
• Use Databricks SQL to build and manage sophisticated queries for data analysis.
• Implement and lead Databricks Delta Lake for reliable and efficient data storage solutions.
• Develop and maintain Databricks Workflows to automate data processing tasks.
• Apply PySpark to build and optimize large-scale data processing applications.
• Collaborate with multi-functional teams to ensure data architecture aligns with business requirements.
• Ensure data security and compliance with industry standards and regulations.
• Supervise and solve data pipelines to ensure smooth operation and minimal downtime.
• Provide technical guidance and mentorship to junior team members.
• Stay updated with the latest industry trends and technologies to continuously improve data architecture.
• Contribute to the overall success of the company by delivering high-quality data solutions that drive business growth.

• Possess strong expertise in Spark in Scala and Databricks CLI.
• Have extensive experience with Amazon S3 for data storage and retrieval.
• Show strength in Python programming for data processing workflows.
• Be skilled in Databricks SQL for sophisticated data analysis.
• Have hands-on experience with Databricks Delta Lake for data storage solutions.
• Be proficient in designing and maintaining Databricks Workflows.
• Have expertise in PySpark for large-scale data processing applications.
• Experience in Life and Annuities Insurance is a plus.
• Possess excellent problem-solving and troubleshooting skills.
• Have strong communication and teamwork abilities.
• Be able to work optimally in a hybrid model with rotational shifts.
• Be committed to continuous learning and improvement.
• Have a passion for delivering high-quality data solutions.

Databricks Certified Data Engineer Associate AWS Certified Solutions Architect Python Certification

The annual salary for this position is between (115,000 - 133,000) depending on the experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.

Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.