Endowus
Junior Data Engineer - SQL/ETL
Job Location
hyderabad, India
Job Description
Job Description : As a Junior Data Engineer, you will support the development and maintenance of our core data platform. You will work closely with senior data engineers, the Product team, and stakeholders in Data Analytics, Growth, and Operations to assist in achieving our business goals. Your focus will be on learning and applying best practices in data engineering, reliability, and : - Assist in designing, developing, and optimizing SQL queries to transform and extract insights from large datasets. - Support the building and maintenance of scalable ETL pipelines using Python to ingest, process, and load data from various sources into our data lake and data warehouse. - Help implement best practices for data governance, data quality, and data security. - Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide effective data solutions. - Assist in setting up and building data sources for dashboards to minimize repetitive ad-hoc data requests. - Monitor and troubleshoot data pipelines to ensure reliability and performance, escalating issues as needed. - Document data workflows, ETL processes, and system architectures to ensure clarity and knowledge sharing. - Stay current with the latest data engineering technologies and methodologies to enhance your skills and contribute to our data infrastructure. - Work within AWS or GCP environments; exposure to multi-cloud environments is a plus. - Support the development and maintenance of data models using dbt (data build tool) to ensure consistency and quality in data : - Bachelors degree in Computer Science, a related field, or equivalent professional experience. - Some experience (internships or projects) in building data pipelines or working with distributed data systems is a plus. - Familiarity with cloud platforms like AWS, GCP, or Azure is preferred. - Basic knowledge of SQL and experience working with relational or non-relational databases. - Understanding of data integration concepts and experience with tools like Apache Kafka or similar is a plus. - Exposure to data processing frameworks such as Apache Spark or Apache Flink is a plus. - Comfortable with at least one programming language, preferably in the JVM ecosystem (Java, Scala). - A keen interest in data quality, data privacy, and the importance of data governance. - Self-driven with a willingness to learn and adapt in a fast-paced environment. Preferred Skills & Experience : - Exposure to BI tools such as Tableau, Mode, or Looker is a plus. - Interest in B2C domains or knowledge of finance, wealth, or trading is advantageous. - Familiarity with agile processes and version control systems like Git is a plus. (ref:hirist.tech)
Location: hyderabad, IN
Posted Date: 10/20/2024
Location: hyderabad, IN
Posted Date: 10/20/2024
Contact Information
Contact | Human Resources Endowus |
---|