Senior Data Engineer is a key member of the Data Engineering team and is part of Enterprise Data & Analytics organization that brings engineering excellence at design, deliver, and operate the capabilities that transforms our business.
The Data engineering teams create data products and consumption capabilities that meet the needs of our enterprise, analyst communities, and downstream systems that utilize data to drive the business.
Responsibilities : - Design, build and maintain batch or real-time data pipelines.
- Partners closely with data architects to deliver in alignment with the Long term architecture of data engineering solutions.
- Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.
- Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources.
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
- Adhere to SOX compliance.
- Monitor data systems performance and implement optimization strategies.
- Improves operational practices and metrics.
- Adhere to data engineering standards and best practices and contribute towards its maturity.
- Guide and Mentor junior engineers.
Experience And Minimum Qualifications : - Bachelor's degree in Computer Science, Information Systems, or a related field.
- Minimum of 5 years of relevant working experience in data engineering.
- Experience working with cloud Data Warehouse solutions (Snowflake) and Cloud-based solutions (e.g.
AWS, Azure, GCP).
- Exposure to salesforce or any CRM.
- Experience working with data ingestion tools such as Fivetran, Talend.x Advanced SQL skills and experience with relational databases and database design.
- Experience with working on large data sets and distributed computing(Spark/Hive/Hadoop) - Strong proficiency in object-oriented languages : Python, Java.
- Strong proficiency in scripting languages.
- Strong proficiency in data pipeline and workflow management tools (Airflow).
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Is a self-starter and action biased.
- Strong in communications that handles stake holder communications.
- Follows agile methodology to work , collaborate and deliver in a global team set up.
- Ability to learn and adapt quickly.
(ref:hirist.tech)
Advertisement:
Dotcod - Senior Data Engineer - Etl, Coimbatore
Free
Dotcod - Senior Data Engineer - Etl, Coimbatore
India, Tamil Nadu, Coimbatore,
Modified November 15, 2024
Description
Job details:
⇐ Previous job |
Next job ⇒ |