Job Title: Junior Data Engineer Introduction: We are seeking a motivated Junior Data Engineer to join our dynamic team.
This role is pivotal in supporting our data operations, particularly in executing and auditing tasks within Databricks and assisting with the migration of SAS code to Python/Py Spark.
The successful candidate will work closely under the guidance of a senior engineer, contributing to critical data projects that drive the organization's success.
Roles and Responsibilities:- Monitor and manage Databricks jobs to ensure seamless operation and timely execution.- Conduct audits of job outputs to maintain data integrity and accuracy.- Assist in the conversion of SAS code to Python/Py Spark, ensuring the robustness and efficiency of the new codebase.- Collaborate with team members to identify and resolve issues, leveraging strong debugging and scripting skills.- Follow detailed instructions and project guidelines provided by senior engineers to achieve project goals.- Continuously learn and adapt to new technologies and methodologies as required by the team.
Qualifications:- Bachelor's degree in IT, Computer Science, or a related field.- 1–3 years of experience in a data engineering or related role.- Proficiency in Python and/or Py Spark is mandatory.- Familiarity with Databricks is essential.- Strong debugging and scripting fundamentals.- Experience with SAS is a plus but not required.- Basic understanding of Git Hub and version control practices.- Knowledge of SQL/Teradata is desired.
Tools and Technologies:- Essential: Python, Py Spark, Databricks.- Desirable: SAS, Git Hub, SQL/Teradata, Airflow (optional).
Critical Soft Skills:- Demonstrated willingness to learn and adapt to new challenges.- Keen attention to detail to ensure high-quality data outputs.- Strong ability to follow instructions and work collaboratively within a team.- Effective communication skills to facilitate collaboration and knowledge sharing.
