Advertisement:
Staff Data Engineer - Bengaluru/bangalore
Free
Staff Data Engineer - Bengaluru/bangalore
India, Karnataka, Bangalore,
Modified September 19, 2023
Description
Job Description Design, code, test and deploy production grade data engineering solutions including pipeline development, data quality frameworks, data validation and metadata management. Design and develop services/backend solutions including REST web services, spring boot and Java/Python/Scala. Design and deploy solutions onto cloud ecosystems like Azure/GCP. Collaborate with product and engineering teams across multiple zones, translate business requirements and roadmap into technical solutions. Design cost wise and compute wise efficient data engineering solutions. Architect and design automation and innovation ideas/solutions at Walmart scale that can be leveraged across multiple platforms. Possess exceptional attitude and zeal to learn new skills, optimise sys Possess strong leadership skills and have the capability to mentor team technically. Qualifications Min 11-18 years of Big data development experience using Spark, Hive, Hadoop technologies along with strong enterprise applications development background using Java/Python/Scala, REST API and Analytics. Demonstrates up-to-date expertise in designing Data Engineering solutions , including pipeline development, data quality frameworks, data validation and metadata management. Design, develop, implement and tune distributed data processing pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built. Demonstrates expertise in writing complex, optimised queries across large data sets Proven, working expertise with Big Data Technologies Hadoop, HDFS, Hive, Spark Scala/PySpark, and SQL Knowledge and experience in Kafka, Airflow, Druid, Presto, SPARK RAPIDS GPU, MLOps, Looker/Tableau are added advantages.
Job details:
⇐ Previous job |
Next job ⇒ |
Contact employer
Employer's info

Each day, it’s our mission to help people save money so they can live better. And as the world’s largest retailer, it takes a lot of really talented people to make this happen. You can join the millions of associates – 2.2 million, to be exact – who are already making a difference in our customers’ lives each day.
More than 50 years ago, Sam Walton started the tradition of hiring the best and brightest when he opened our first store. And our strong values still hold true today. Each day, you’ll grow and build new skills as we shape the future of the retail industry around the globe. It’s a big responsibility, with career rewards that match. And no matter how big we grow, you’ll always find a culture of support built by people passionate about innovation. Join our family.