Associate Data Engineer
Seeking Associate Data Engineer
As an Associate Data Engineer, you will be responsible for supporting the design, development, and maintenance of data pipelines and data processing systems using various technologies such as Azure, Spark SQL, SQL Server, Azure Data Factory, Azure Databricks, Azure DevOps, Git, Power BI, Azure Synapse Analytics, and Azure Databricks. You will work under the guidance of more senior data engineers and play a vital role in ensuring the availability, reliability, and scalability of data infrastructure and supporting data-driven initiatives within the organization.
Essential Duties and Responsibilities
• Data pipeline development: Collaborate with the data engineering team to develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory, Azure Synapse Analytics, Spark SQL, and other relevant technologies. Ensure the timely and accurate movement of data between systems.
• Data processing and transformation: Assist in implementing data processing and transformation logic using Azure Synapse Analytics, Spark SQL or Databricks. Extract insights from raw data and transform it into meaningful and structured formats in our data products.
• Azure service utilization: Work with Azure services such as SQL Server, Azure Data Factory, Azure Synapse and Azure Databricks to build and manage data infrastructure components. Leverage the capabilities of these services to ensure efficient and scalable data processing.
• Version control and collaboration: Utilize Azure DevOps and Git for version control and collaborate effectively with the team to manage code repositories and ensure proper documentation and knowledge sharing.
• Azure DevOps integration: Assist in integrating data engineering workflows with Azure DevOps for continuous integration, continuous deployment, and automated testing. Contribute to the implementation of CI/CD pipelines for data engineering projects.
• Data visualization and reporting: Gain exposure to Power BI and support the team in developing insightful and visually appealing reports and dashboards to communicate data insights effectively to stakeholders.
• Troubleshooting and support: Assist in identifying and resolving data pipeline issues, bottlenecks, and data quality problems. Provide support in investigating and troubleshooting data-related incidents.
• Continuous learning and growth: Stay updated with the latest advancements in data engineering technologies and tools. Continuously enhance your knowledge of Azure services and data engineering best practices.
Qualifications and Skills
• 2 years of experience in data engineering, data integration, or related roles.
• Bachelor's Degree in Computer Science, Information Technology, or a related field preferred.
• Hands-on experience with Azure services, including Azure Data Factory, Azure Synapse, and Azure Databricks.
• Proficiency in SQL programming and experience working with SQL Server.
• Familiarity with Spark SQL or Databricks for data processing and transformation.
• Exposure to Git for version control and collaborative development.
• Knowledge of Azure DevOps practices for CI/CD and automated testing.
• Experience with data visualization tools, such as Power BI, for developing reports and dashboards.
• Understanding of Azure Analysis Services and Azure Synapse Analytics is a plus.
• Strong problem-solving skills and attention to detail.
• Good communication and teamwork skills, with the ability to work effectively in a collaborative environment.
• Self-motivated and eager to learn and grow in the field of data engineering.
Job Order ID#: 5408
Location: Houston, TX
Job Type: Direct Hire
Apply For This Position
