Role : Data Engineer Job Description : - Candidate should have 7 to 10 year of IT experience - Ideally you will have a background in software engineering along with experience in working in a complex cloud environment (Google Cloud Platform) - Ideally you will have experience working with Python and SQL.
- You have experience building data pipelines and ETL frameworks both batch and real time using Python and any of the GCP capabilities such Apache Beam, Data Flow, Data Fusion - You have Experience with using Terraform to build Experience working with Big Data Technologies (Spark, Cloud SQL, Big Query) preferably in an Enterprise environment.
- Experience in orchestrating end-end data pipelines with tools like cloud composer, Dataform is highly desired.
- Experience in managing complex and reusable dataflow pipelines is highly desired.
- Experience with Airflow is must.
- Experienced working with operations and architecture groups developing scalable and supportable solutions (desired but not mandatory) - Understand customer needs to make sound judgments - Pays attention to the detail and demonstrates problem solving capability to develop and deliver quality solutions.
- Understanding of current state landscape and relevant technologies.
(ref:hirist.tech)
Advertisement:
Data Engineer - Google Cloud Platform, Pune
Free
Data Engineer - Google Cloud Platform, Pune
India, Maharashtra, Pune,
Modified November 14, 2024
Description
Job details:
⇐ Previous job |
Next job ⇒ |