Data Engineer

  • Post author:
  • Post category:IT

Role: Data Engineer
Location: Coimbatore
Experience: 5+ years
Notice Period: Immediate to 90 days

Job Description:

We are seeking a skilled Application Developer with expertise in Python programming to design, build, and configure applications that meet business process and application requirements. The role involves implementing robust data integration and ETL solutions while leveraging cloud technologies.

Responsibilities:

  • Implement data integration solutions using Python, SQL, and ETL tools.
  • Design, develop, and maintain scalable ETL (Extract, Transform, Load) processes to handle large volumes of data from diverse sources.
  • Develop and optimize SQL queries, stored procedures, and functions for efficient data retrieval and manipulation.
  • Build and maintain data warehouses and data lakes on AWS, ensuring accuracy, availability, and security.
  • Automate data workflows and monitor data pipeline performance for reliability and efficiency.
  • Implement data quality checks and validation processes to ensure data integrity.

Requirements:

  • Proven experience as a Data Engineer or similar role.
  • Strong proficiency in Python for data manipulation, ETL processes, and automation.
  • Advanced knowledge of SQL for data querying, transformation, and optimization.
  • Expertise in AWS cloud services (e.g., S3, RDS, Redshift, Glue, Lambda, EMR).
  • Familiarity with data warehousing concepts and design patterns
  • Experience with big data technologies like Snowflake, Redshift, or Synapse.
  • Exposure to ETL tools and frameworks (e.g., Apache Airflow, Apache NiFi, Talend, or equivalent).
Apply Now