Software Engineer

Job Highlights

Using AI ⚡ to summarize the original job post

Responsibilities

• Provide production support for the Data Engineering team.
• Coordinate with Infrastructure, Network Security, and Support teams across Market Surveillance technology.
• Deploy code, automate processes, monitor batch jobs, and ensure application availability.
• Support, deploy, automate, and migrate to strategic platforms like cloud.
• Adhere to ITIL standards including Incident, Change, and Problem Management.
• Ensure compliance with company policies regarding third-party solutions, Information Security, and the Software Development Lifecycle.

Qualifications

Required

• 5+ years of experience in Software Development Life Cycle, data ingestion, storage, querying, processing, and analysis.
• Advanced expertise in SQL, Autosys, Big Data technologies (Spark, Hadoop, Hive, Python, Scala).
• Strong Unix/Linux skills and experience in writing shell scripts.
• Expertise in Oracle & SQL DB, writing complex queries, and data load management.
• Experience with ETL and Cloud Platforms.
• Experience in strategy, planning, and execution of new infrastructure setup and Data Center/Cloud Migration.
• Experience in configuring CI/CD pipelines and managing Kubernetes.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs/Data frames, Scala.
• Experience developing, installing, and configuring Hadoop ecosystem components.
• Good knowledge of ETL procedures to transform data according to business rules and functionality requirements.

Preferred

• Strong interpersonal communication skills.
• Experience with Jira and Agile/Scrum methodologies.
• Knowledge/experience with Azure and Google Cloud Platform.
• ITIL Certification and understanding of RTB & Support Functions.