Other Specification:

• Bachelor's/Master's degree in Computer Engineering or a related field.

• Proven experience as a data engineer, software developer, or similar.
• Expert proficiency in Python, C++, Java, R, and SQL.
• Familiarity with Hadoop or suitable equivalent.
• Excellent analytical and problem-solving skills.
• A knack for independence and group work.
• Scrupulous approach to duties.
• Capacity to successfully manage a pipeline of duties with minimal supervision.

Job Description:

• Design and implement data collection, storage, and processing systems to ensure efficient and reliable data availability.
• Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from various sources into the data warehouse.
• Collaborate with cross-functional teams to define data requirements and implement tracking mechanisms to capture relevant data.
• Optimize and tune data pipelines to ensure scalability, performance, and data quality.
• Monitor and troubleshoot data pipeline issues and implement necessary fixes.
• Ensure data security, privacy, and compliance with relevant regulations (e.g., GDPR, CCPA).
• Stay informed about the latest technologies and tools in data engineering and implement best practices.
• Developing and maintaining data governance policies, standards, and best practices to ensure compliance and data integrity.
• Documenting data engineering processes, system architectures, and data flows for reference and knowledge sharing.
• Implementing data transformation processes to cleanse, filter, aggregate, and enrich the data as needed. 

Source: Merojob 

Job Detail Expired

Contact Detail