Sr Data Engineer

✨ You are the person they are looking for if you have...

• Provide technical support and training in Big Data frameworks and practices.
• Design and build robust, high-performance applications for processing batch and streaming data on a multi-tenant cloud platform.
• Collaborate with the architecture team to define the long-term strategy for the Big Data platform.
• Evaluate and recommend emerging technologies to enhance the platform’s scalability, efficiency, and security.
• Create and implement platform standards, tools, and reusable components to support data integration and accelerate delivery.
• Conduct analytics projects including reporting and predictive modeling; develop dashboards and other self-service tools.
• Interview stakeholders to understand business needs and translate them into data-driven insights and solutions.
• Ensure quality through testing, version control, and continuous improvement practices.
• Support data governance through cataloging, documentation, stakeholder education, and access standardization.
• Comply with Harvard University’s IT technical standards, policies, and Code of Conduct.
• Perform other related duties as assigned.

🤓 As Backend Engineer, the company expects you to perform the following tasks

• Education: Bachelor’s degree in Mathematics, Physics, Computer Science, Engineering, Statistics, or a related technical field.
• Technical Experience:
• 5+ years in hands-on technical roles (engineering or data engineering) working at scale in collaborative and cloud-based environments.
• 5+ years of experience with AWS (e.g., S3, RDS, Redshift, Glue, EMR, Kinesis, Lambda, etc.).
• 5+ years of experience with Python and SQL, handling complex data structures (e.g., deeply nested JSON/XML, Python lists/dictionaries).
• Experience with agile methodologies, continuous delivery, and test automation (unit, integration, performance).
• Solid understanding of Object-Oriented Design Patterns (2+ years).
• Expert-level experience designing and managing large-scale data processing applications in cloud or big data environments (5+ years).

Nice to Have:

• Experience with Gen AI prompt engineering and RAG architecture.
• Familiarity with scientific computing tools such as pandas and Spark.
• Public demos or projects are a plus.